Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
Repository Index
47,133 repositories indexed
1–24 of 46 · Most stars
🚀 自托管的抖音、TikTok、B 站数据采集与无水印视频下载 API，支持 AI agent 通过 MCP 调用与离线语音转文字，Docker 一键部署。| Self-hosted TikTok, Douyin & Bilibili scraper and no-watermark video downloader — async REST API, MCP server for AI agents, CLI and web console, plus offline speech-to-text for downloaded videos. Self-healing identity pool, PostgreSQL archive, one docker compose up.
GenBI (Generative BI) for AI agents, an open-source, governed text-to-SQL through an open context layer that turns natural-language questions into trusted dashboards, charts, and SQL across 20+ data sources, such as BigQuery, Snowflake, PostgreSQL, ClickHouse, Amazon Redshift, Databricks and more.
Postgres CLI with autocompletion and syntax highlighting
a small, expressive orm -- supports postgresql, mysql, sqlite, now with asyncio
A template for PostgreSQL High Availability with Etcd, Consul, ZooKeeper, or Kubernetes
A fast PostgreSQL Database Client Library for Python/asyncio.
the portable Python dataframe library
macOS development environment setup: Easy-to-understand instructions with automated setup scripts for developer tools like Vim, Sublime Text, Bash, iTerm, Python data analysis, Spark, Hadoop MapReduce, AWS, Heroku, JavaScript web development, Android development, common data stores, and dev-based OS X defaults.
Familiar asyncio ORM for python, built with relations in mind
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
Pony Object Relational Mapper
A self hosted media tracker.
Continuous Archiving for Postgres
Barman - Backup and Recovery Manager for PostgreSQL
pg_activity is a top like application for PostgreSQL server activity monitoring.
DEPRECATED: Like diff but for PostgreSQL schemas
New generation PostgreSQL database adapter for the Python programming language
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
A fast, user friendly ORM and query builder which supports asyncio.
Highly available elephant herd: HA PostgreSQL cluster using Docker
Fake Protocol Server
Entity Relation Diagrams generation tool
aiopg is a library for accessing a PostgreSQL database from the asyncio