🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Repository Index
47,133 repositories indexed
1–24 of 26 · Most stars
The 30 Days of Python programming challenge is a step-by-step guide to learn the Python programming language in 30 days. This challenge may take more than 100 days. Follow your own pace. These videos may help too: https://www.youtube.com/channel/UC7PNRuno1rzYPb1xLa4yktw
LlamaIndex is the document processing platform for AI
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Chat with your database or your datalake (SQL, CSV, parquet). PandasAI makes data analysis conversational using LLMs and RAG.
AKShare is an elegant and simple financial data interface library for Python, built for human beings! 开源财经数据接口库
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
:orange_book: 中华新华字典数据库。包括歇后语，成语，词语，汉字。
[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
Superduper: End-to-end framework for building custom AI applications and agents.
CKAN is an open-source DMS (data management system) for powering data hubs and data portals. CKAN makes it easy to publish, share and use data. It powers catalog.data.gov, open.canada.ca/data, data.humdata.org among many other sites.
Mimesis is a Python library for generating fake but realistic data in multiple languages and locales.
Colour Science for Python
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
Clean APIs for data cleaning. Python implementation of R package Janitor
Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!
Main yt repository
A Python toolkit for processing tabular data
No description provided by the repository host.
The power of Chart.js with Python
Build, test, deploy, iterate - Dev and prod tool for data science pipelines
:chart_with_upwards_trend: A live cryptocurrency historical trade data blotter. Download live historical trade data from any cryptoexchange, be it for machine learning, backtesting/visualizing trading strategies or for Quantopian/Zipline.