Build and deploy a serverless data pipeline on AWS with no effort.
- aws-cdk
- data-pipeline
- stepfunctions
- glue
Repository Index
47,133 repositories indexed
73–96 of 101 · Most stars
🤝 Enforce referential and data integrity in Cloud Firestore using triggers
- firebase
- firestore
- firebase-trigger
- firebase-functions
:hammer_and_wrench: T-SQL scripts for the long haul: optimizing storage, on-the-fly documentation, and general administrative needs.
- tsql
- sql-server
- dba
- sql
The Amazon DynamoDB Streams Adapter implements the Amazon Kinesis interface so that your application can use KCL to consume and process data from a DynamoDB stream.
Ansible Collection of roles, playbooks & plugins for Linux-based cloud infrastructure. Covers OS hardening, MariaDB, Icinga2, Nextcloud, FreeIPA, KVM & more. Bitwarden & Cloud integration.
- ansible
- ansible-roles
- ansible-playbooks
- ansible-plugins
A Consistent Data Visualizer for Agents and Humans
The legacy distributed object storage server developed by PitchPoint Solutions can store billions of large and small files using minimal resources. Object data is stored in replicated volumes implemented like Facebooks Haystack Object Store. Object metadata which essentially maps an object name to a volume position is stored in an elasticsearch index. (Development by PitchPoint Solutions has been discontinued)
- distributed-storage
- distributed-systems
- vertx
- rxjava
A Decky Loader plugin for tidying up your Steam Deck's storage. Quickly visualize, select and clear shader cache and compatibility data.
A C++ data container replicating std::stack functionality but with better performance than standard library containers in a stack context.
- stack
- cpp
- container
🚀 Production-ready AI-friendly Go REST API boilerplate with Clean Architecture, JWT auth, RBAC, PostgreSQL migrations, and highly tested. AI-optimized with built-in guidelines for most used IDEs. Docker hot-reload, Swagger docs, one-command setup. Build production APIs in minutes, not weeks.
Scramjet Platform is a distributed runtime supervisor that can run data processing programs called Sequences and manage local resources on any Linux server, Docker on small edge servers, and even large-scale Kubernetes clusters in the cloud or datacenters without exposing network ports to the public internet.
- nodejs
- stream-processing
- transform-as-a-service
- real-time
A cookbook for InfluxDB, a time-series database (influxdb.org)
- cookbooks
- infrastructure-management
- monitoring
- database
SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, xDC replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding. Enterprise version is at seaweedfs.com.
Store history data in InfluxDB (not for Windows)
- influxdb
- time-series
- iobroker
- storage
Self-hosted manga collection manager with automatic metadata, MyAnimeList import, Docker support, and detailed collection statistics.
- database
- isbn
- manga
- myanimelist
The Coherence Go Client allows native Go applications to act as cache clients to a Coherence cluster using gRPC for the network transport.
- coherence
- coherence-ce
- golang
- grpc
Docker microservice for saving/restoring volume data to S3
Translated🗺️ Research Data Map — AI-driven global research visualization platform | Research Data Map with 250M+ papers
- academic
- ai
- china
- cloudflare-workers
PostgreSQL migration linter. Blocks unsafe migrations before merge: 112 rules, the real Postgres parser, lock analysis, auto-fix. CLI, GitHub Action, MCP.
Installs and configures the InfluxDB timeseries database
extensible, high-performance configuration management library, optimized for hierarchical data
- configuration
- configuration-management
- config
- config-loader
A simple CDK seeder for SQL Server RDS databases
- aws-cdk
- cdk
- rds-mssql
- cdk-seeder
A serverless backup solution for PostgreSQL databases using AWS Lambda, with automatic daily, monthly, and yearly backup rotation to S3.
- aws
- backup
- backup-utility
- database-backup
Cold storage that queries like hot storage. High-ratio JSONL compressor with block-level random access. Query cold storage in seconds — no restore, no full decompression. 5–13% ratio on JSONL logs, 25–57% smaller than gzip. 1-hour window via DuckDB in under 6s. Free for personal and open-source use.