Utils for streaming large files (S3, HDFS, gzip, bz2...)
- python
- s3
- hdfs
- webhdfs
Repository Index
47,133 repositories indexed
25–48 of 225 · Most stars
Cross-platform and self hosted, easy to use, intuitive mongodb management tool - Formerly Mongoclient
- mongodb
- cross-platform
- management
- database-management
Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.
Container data volume manager for your Dockerized application
Delivers efficient, stable, and secure data distribution and acceleration powered by P2P technology, with an optional content‑addressable filesystem that accelerates OCI container launch.
Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
- etl
- sql
- bigquery
- cloud-native
File Attachment toolkit for Ruby applications
- file-upload
- ruby
- rack
- storage
Determined is an open-source machine learning platform that simplifies distributed training, hyperparameter tuning, experiment tracking, and resource management. Works with PyTorch and TensorFlow.
- deep-learning
- machine-learning
- ml-platform
- ml-infrastructure
One governed graph for AI agents — GraphQL + MCP over your databases, files, APIs, and code
KubeBlocks is a Kubernetes Operator designed to manage a variety of databases and streaming systems, including MySQL, PostgreSQL, MongoDB, Redis, RabbitMQ, RocketMQ, and more, within Kubernetes environments.
- mysql-operator
- mongodb-operator
- postgresql-operator
- rabbitmq-operator
🔎 Find origin servers of websites behind CloudFlare by using Internet-wide scan data from Censys.
Lightweight selfhosted Firefox Send alternative without public upload. AWS S3 supported.
- selfhosted
- self-hosted
- download
- uploader
App to easily query, script, and visualize data from every database, file, and API.
StreamAlert is a serverless, realtime data analysis framework which empowers you to ingest, analyze, and alert on data from any environment, using datasources and alerting logic you define.
- security
- kinesis
- serverless
- terraform
Kubernetes-native platform to run massively parallel data/streaming jobs
- kubernetes
- stream-processing
- data-processing
- k8s
A distributed SQLite server with MySQL wire compatible interface
- database
- distributed
- replication
- sqlite3
A C++ library of Concurrent Data Structures
- lock-free
- containers
- hazard-pointer
- rcu
Simple script to analyse your PostgreSQL database configuration, and give tuning advice
- postgresql
- perl
- docker
- tuning
🐘 Effortless PostgreSQL backups with a user-friendly web interface! 🌐💾
Testcontainers is a NodeJS library that supports tests, providing lightweight, throwaway instances of common databases, Selenium web browsers, or anything else that can run in a Docker container.
CodeChecker is an analyzer tooling, defect database and viewer extension for static and dynamic analyzer tools.
- clang
- cpp
- c
- clang-tidy
Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
- data-science
- python
- dag
- data-engineering
Fast SQL-only data application builder. Automatically build a UI on top of SQL queries.
- database
- framework
- mysql
- postgresql
sq data wrangler