Apache InLong - a one-stop, full-scenario integration framework for massive data
- inlong
- one-stop-service
- data-streaming
- event-streaming
89,572 visible repositories in the index
49–72 of 83 · Most stars
Apache InLong - a one-stop, full-scenario integration framework for massive data
High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis.
omniparser: a native Golang ETL streaming parser and transform library for CSV, JSON, XML, EDI, text, etc.
Polo travels through your database and creates sample snapshots so you can work with real world data in development.
The MongoDB Spark Connector
Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
:lipstick: Durable and asynchronous data imports for consuming data at scale and publishing testable SDKs.
🌱 The ultimate solution for populating your MongoDB database.
Distributed Data Transfer Service for MySQL
The Apache Spark - Apache HBase Connector is a library to support Spark accessing HBase table as external data source or sink.
The data platform for manufacturing
Graph-based security analysis for everyone
Neo4j Connector for Apache Spark, which provides bi-directional read/write access to Neo4j from Spark, using the Spark DataSource APIs
Download, unpack from a ZIP/TAR/GZ/BZ2 archive, parse, correct, convert units and import Google Spreadsheets, XLS, ODS, XML, CSV, HTML, etc. into your ActiveRecord models. Uses RemoteTable gem internally.
Powerful CSV & Excel Import experience for SaaS 🚀 Save months building data import experience from scratch 💰
A decision-model-based ontology & knowledge-graph builder — builds governed knowledge graphs from your documents, every fact gated and traceable to its evidence.
Apache HBase Connectors
A fast to develop, fast to run, Go based toolkit for ETL and feature extraction on Hadoop.
📜 A CLI toolkit for extracting and working with your digital history
go-etl is a toolset for data extraction, transformation and loading.
A plugin to push to Algolia based on graphQl queries
An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.
Event-driven OneLake pipeline with automated Upsert merge and Python reporting
This is a library that provides generic functionalities for the implementation of imports. In addition to maximum performance and optimized memory consumption, Pacemaker can also be used to implement imports in distributed scenarios that place the highest demands on speed and stability.