Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
Repository Index
47,133 repositories indexed
1–24 of 57 · Most stars
🚀 自托管的抖音、TikTok、B 站数据采集与无水印视频下载 API，支持 AI agent 通过 MCP 调用与离线语音转文字，Docker 一键部署。| Self-hosted TikTok, Douyin & Bilibili scraper and no-watermark video downloader — async REST API, MCP server for AI agents, CLI and web console, plus offline speech-to-text for downloaded videos. Self-healing identity pool, PostgreSQL archive, one docker compose up.
GenBI (Generative BI) for AI agents, an open-source, governed text-to-SQL through an open context layer that turns natural-language questions into trusted dashboards, charts, and SQL across 20+ data sources, such as BigQuery, Snowflake, PostgreSQL, ClickHouse, Amazon Redshift, Databricks and more.
Gel supercharges Postgres with a modern data model, graph queries, Auth & AI solutions, and much more.
Postgres CLI with autocompletion and syntax highlighting
a small, expressive orm -- supports postgresql, mysql, sqlite, now with asyncio
Low code web framework for real world applications, in Python and Javascript
Python SQL Parser and Transpiler
A template for PostgreSQL High Availability with Etcd, Consul, ZooKeeper, or Kubernetes
A fast PostgreSQL Database Client Library for Python/asyncio.
the portable Python dataframe library
macOS development environment setup: Easy-to-understand instructions with automated setup scripts for developer tools like Vim, Sublime Text, Bash, iTerm, Python data analysis, Spark, Hadoop MapReduce, AWS, Heroku, JavaScript web development, Android development, common data stores, and dev-based OS X defaults.
Familiar asyncio ORM for python, built with relations in mind
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
Pony Object Relational Mapper
A self hosted media tracker.
Continuous Archiving for Postgres
Barman - Backup and Recovery Manager for PostgreSQL
pg_activity is a top like application for PostgreSQL server activity monitoring.
DEPRECATED: Like diff but for PostgreSQL schemas
New generation PostgreSQL database adapter for the Python programming language
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
A fast, user friendly ORM and query builder which supports asyncio.
Highly available elephant herd: HA PostgreSQL cluster using Docker