Repository Index

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

• batch-processing
• kafka
• pathway
• python

A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/网页爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。

• code-free
• crawler
• gui
• layman

Workflow Engine for Kubernetes

• workflow
• kubernetes
• argo
• dag

Simple API, Complex Emails (Jakarta Mail smtp wrapper)

• java
• java-mail
• outlook
• batch-processing

The simple, stupid batch framework for Java

• java
• batch-processing
• batch

A powerful background job processing library for Clojure

• clojure
• redis
• asynchronous
• background-processing

The Frank!Framework is an easy-to-use, stateless integration framework which allows (transactional) messages to be modified and exchanged between different systems.

• java
• system-integration
• open-source
• community-driven

This is a small, opinionated Go library and CLI for Markdown to PDF. It handles cover pages, tables of contents, watermarks, signatures, and more. You can use CSS themes and custom assets. It works with parallel batch processing. The engine behind it is Chrome. It does not rely on LaTeX.

• chrome-headless
• cli
• go
• goldmark

A blazing fast job processing system backed by GenStage & Redis.

• elixir-lang
• genstage
• background-jobs
• concurrent

Distributed batch data processing framework

• cassandra
• rabbitmq
• go
• batch-processing

Lightweight Java library for reading and writing fixed-width / fixed-length flat files using annotations on POJOs — for banking, payroll, EDI, mainframe, and batch integrations.

• annotations
• banking
• batch-processing
• edi

A light-weight package for in-app micro batch processing

• batch
• batch-processing
• event-processing
• go