Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
Repository Index
47,133 repositories indexed
1–24 of 45 · Most stars
🚀 自托管的抖音、TikTok、B 站数据采集与无水印视频下载 API，支持 AI agent 通过 MCP 调用与离线语音转文字，Docker 一键部署。| Self-hosted TikTok, Douyin & Bilibili scraper and no-watermark video downloader — async REST API, MCP server for AI agents, CLI and web console, plus offline speech-to-text for downloaded videos. Self-healing identity pool, PostgreSQL archive, one docker compose up.
GenBI (Generative BI) for AI agents, an open-source, governed text-to-SQL through an open context layer that turns natural-language questions into trusted dashboards, charts, and SQL across 20+ data sources, such as BigQuery, Snowflake, PostgreSQL, ClickHouse, Amazon Redshift, Databricks and more.
- bigquery
- duckdb
- llm
- postgresql
Postgres CLI with autocompletion and syntax highlighting
- python
- postgresql
- postgres
- psql
a small, expressive orm -- supports postgresql, mysql, sqlite, now with asyncio
- dank
- gametight
- peewee
- sqlite
A template for PostgreSQL High Availability with Etcd, Consul, ZooKeeper, or Kubernetes
- postgresql
- high-availability
- etcd
- zookeeper
A fast PostgreSQL Database Client Library for Python/asyncio.
- postgresql
- python
- python-3
- asyncio
the portable Python dataframe library
Familiar asyncio ORM for python, built with relations in mind
- orm
- asyncio
- async
- python3
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
Pony Object Relational Mapper
- python
- python3
- orm
- postgresql
A self hosted media tracker.
Continuous Archiving for Postgres
- python
- backup
- backups
- postgresql
Barman - Backup and Recovery Manager for PostgreSQL
pg_activity is a top like application for PostgreSQL server activity monitoring.
- postgresql
- activity
- monitoring
- cli
DEPRECATED: Like diff but for PostgreSQL schemas
- developer-tools
- developer-experience
- postgresql
- schema-changes
New generation PostgreSQL database adapter for the Python programming language
- database
- development
- python
- postgresql
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
- etl
- data-integration
- python
- postgresql
A fast, user friendly ORM and query builder which supports asyncio.
- piccolo
- asyncio
- python
- python3
Highly available elephant herd: HA PostgreSQL cluster using Docker
Fake Protocol Server
Entity Relation Diagrams generation tool
aiopg is a library for accessing a PostgreSQL database from the asyncio
- asyncio
- postgresql
- sqlalchemy
PostgreSQL® backup and restore service
- postgresql
- backup
- restore
- cloud-object-storage