LlamaIndex is the document processing platform for AI
- agents
- application
- data
- fine-tuning
Repository Index
47,133 repositories indexed
1–24 of 62 · Most stars
Apache Spark - A unified analytics engine for large-scale data processing
- python
- scala
- r
- java
A lightweight, pure-Swift library for downloading and caching images from the web.
Agent for collecting, processing, aggregating, and writing metrics, logs, and other arbitrary data.
- telegraf
- monitoring
- time-series
- metrics
QuestDB is a high performance, open-source, time-series database
- time-series
- low-latency
- database
- sql
Memory layer for AI Agents. Replace complex RAG pipelines with a serverless, single-file memory layer. Give your agents instant retrieval and long-term memory.
A lightweight, lightning-fast, in-process vector database
flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》
A curated list of awesome big data frameworks, ressources and other awesomeness.
- awesome
- bigdata
- data-warehouse
- data-analytics
A curated list of awesome System Design (A.K.A. Distributed Systems) resources.
- relational-database
- message-broker
- hadoop-ecosystem
- nosql
Lightweight job scheduling for Node.js
- cron
- scheduler
- job-scheduler
- crontab
BullMQ - Message Queue and Batch processing for NodeJS, Python, .NET, Elixir, Rust and PHP based on Redis or PostgreSQL
Resque is a Redis-backed Ruby library for creating background jobs, placing them on multiple queues, and processing them later.
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
Apache Beam is a unified programming model for Batch and Streaming data processing.
- python
- java
- big-data
- beam
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
- java
- hazelcast
- in-memory
- big-data
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL
Asynchronous Python framework for event-driven services. A thin client for Kafka, RabbitMQ, NATS, Redis and MQTT with full access to native broker features, plus AsyncAPI docs, in-memory tests and observability out of the box.
A fast and reliable background task processing library for Python 3.
- python
- task-manager
- task-scheduler
- task-runner
Distributed stream processing engine in Rust
Graph database optimized for fast analysis and real-time data processing. It is provided as an extension to PostgreSQL.
Reliable PostgreSQL Backup & Restore
- postgresql
- parallel
- backup
- restore
Computing with Python functions.
- python
- parallel-computing
- caching
- multiprocessing
💎 Robust job processing in Elixir, backed by modern PostgreSQL, SQLite3, and MySQL