Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
- arrow
- parquet
132,241 visible repositories in the index
1–19 of 19 · Most stars
Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
One Postgres for your application data, full-text search, vector retrieval, and aggregations. Home of the pg_search extension.
The open-source observability database. One columnar engine for metrics, logs, and traces, on object storage.
Create full-fledged APIs for slowly moving datasets without writing a single line of code.
An extensible, state-of-the-art framework for columnar compression, and the fastest FOSS columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation.
Postgres-native columnar storage extension
Parseable is an open source, unified infrastructure observability platform built in Rust on a data lake architecture. It tracks logs, metrics, traces, and events across apps, agents, and systems, reducing storage costs by up to 90% through columnar telemetry compression.
Columnar storage extension for Postgres built as a foreign data wrapper. Check out https://github.com/citusdata/citus for a modernized columnar storage implementation built as a table access method.
❄️ Coolest database around 🧊 Embeddable column database written in Go.
High-performance, columnar, in-memory store with bitmap indexing in Go
Distributed "massively parallel" SQL query engine
Manipulate JSON-like data with NumPy-like idioms.
python implementation of the parquet columnar file format.
High-performance Go package to read and write Parquet files
Apache ORC - the smallest, fastest columnar storage for Hadoop workloads
Open, SQL-native time-series database for telemetry you need to keep. 38M+ records/sec ingestion, 25M+ rows/sec queries. InfluxDB Line Protocol and Telegraf compatible. Open Parquet on your storage. Single binary. S3/Azure native. Air-gap ready. AGPL-3.0.
Copy to/from Parquet in S3, Azure Blob Storage, Google Cloud Storage, http(s) stores, local files or standard inout stream from within PostgreSQL
An open-source columnar data format designed for fast & realtime analytic with big data.
An experimental embedded SQL engine in C++20. Query Parquet, CSV, JSON, Arrow, Avro, SQLite, and Excel files directly with SQL, in-process. Early-stage.