Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.
- data
- data-cleaning
- data-pipelines
- data-processing
Build platforms that flexibly mix SQL, batch, and stream processing paradigms
The ultimate distributed MQTT broker. Handles 100M+ connections and 10M msg/sec with ease. Built on Kafka to provide industrial-grade persistence and eliminate data loss.
🏎️ Streams & Reactive Programming paradigm for Go: declarative and composable API for event-driven applications
Messaging patterns for Backbone applications.
⏪️ Go package providing multiple queue implementations. Developed in a thread-safe generic way.
- generic
- golang
- queue
- thread-safe
Distributed Temporal Graph Analytics with Apache Flink
Time-series database and pub/sub messaging server for IoT and real-time devices, in Go: an embeddable storage engine with TTLs, wildcard topics and encryption, and a clustered server over gRPC, TCP and WebSocket with replication and rolling upgrades.
A production-grade messaging abstraction for Go. It provides a unified API to decouple business logic from various brokers including Kafka, RabbitMQ, RocketMQ, NATS, Redis, and AWS SQS. Featuring built-in OpenTelemetry integration and engineered for high reliability.
Wisp CLI — Interactive trading platform for backtesting and live trading across spot, perpetual futures, options, and prediction markets
A general-purpose data analysis engine radically changing the way batch and stream data is processed
Open, audit-grade agentic data quality framework with portable industry packs
Production-grade Server-Sent Events (SSE) for Fiber v3. Event coalescing, priority lanes, topic wildcards, adaptive throttling, built-in auth, Prometheus metrics, graceful drain.