High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale
Repository Index
55,140 visible repositories in the index
25–48 of 154 · Most stars
🤖 Dependabot's core logic for creating update PRs.
- elixir
- ruby
- php
- python
The framework for building with WebAssembly (wasm). Easily & securely load wasm modules, move data, call functions, and build extensible apps.
- plugin-system
- c
- cpp
- go
High-Performance Serverless event and data processing platform
cloud-native distributed storage
- distributed-storage
- cncf
- kubernetes
- cloud-storage
lakeFS - Data version control for your data lake | Git for data
- data-engineering
- data-versioning
- go
- object-storage
Postgres operator creates and manages PostgreSQL clusters running in Kubernetes
- kubernetes
- postgresql
- operator
- golang
Simple data persistence for your Electron app or module - Save and load user preferences, app state, cache, etc
- storage
- user-preferences
- config
- preferences
PostgreSQL cloud native High Availability and more.
- postgresql
- high-availability
- golang
- kubernetes
A simple, battle-tested and generic set type for the Go language. Trusted by GoogleCloudPlatform, Docker, 1Password, Ethereum and Hashicorp.
- go
- set
- threadsafe
- datastructures
Generate files from docker container meta-data
- docker
- go
Google Cloud Client Libraries for Go.
- google-cloud
- golang
- go
- cloud-datastore
Production PostgreSQL for Kubernetes, from high availability Postgres clusters to full-scale database-as-a-service.
Automated database platform for PostgreSQL® - Your own DBaaS.
- postgresql
- patroni
- postgres
- dbaas
tbls is a CI-Friendly tool to document a database, written in Go.
- database-schema
- mysql
- database-document
- documentation-tool
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
Python Sorted Container Types: Sorted List, Sorted Dict, and Sorted Set
- python
- sorted
- list
- dict
Utils for streaming large files (S3, HDFS, gzip, bz2...)
- python
- s3
- hdfs
- webhdfs
Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.
Container data volume manager for your Dockerized application
File Attachment toolkit for Ruby applications
- file-upload
- ruby
- rack
- storage
KubeBlocks is a Kubernetes Operator designed to manage a variety of databases and streaming systems, including MySQL, PostgreSQL, MongoDB, Redis, RabbitMQ, RocketMQ, and more, within Kubernetes environments.
- mysql-operator
- mongodb-operator
- postgresql-operator
- rabbitmq-operator
Simple script to analyse your PostgreSQL database configuration, and give tuning advice
- postgresql
- perl
- docker
- tuning
Testcontainers is a NodeJS library that supports tests, providing lightweight, throwaway instances of common databases, Selenium web browsers, or anything else that can run in a Docker container.