Ranked by Attention Score: stars gained over the last 180 complete days
64 repositories by Attention Score · May 7, 2026 – Nov 2, 2026 (UTC)
🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
The 30 Days of Python programming challenge is a step-by-step guide to learn the Python programming language in 30 days. This challenge may take more than 100 days. Follow your own pace. These videos may help too: https://www.youtube.com/channel/UC7PNRuno1rzYPb1xLa4yktw
[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.
AKShare is an elegant and simple financial data interface library for Python, built for human beings! 开源财经数据接口库
This is a repo with links to everything you'd ever want to learn about data engineering
LlamaIndex is the document processing platform for AI
The easy-to-use open source Business Intelligence and Embedded Analytics tool that lets everyone work with data :bar_chart:
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
🤖 Powerful asynchronous state management, server-state utilities and data fetching for the web. TS/JS, React Query, Solid Query, Svelte Query and Vue Query.
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
Chat with your database or your datalake (SQL, CSV, parquet). PandasAI makes data analysis conversational using LLMs and RAG.
Generate massive amounts of fake data in the browser and node.js
A curated list of awesome big data frameworks, ressources and other awesomeness.
Based on my own experience, I believe this roadmap provides clear answers to all the key questions about becoming a data analyst from scratch, including which technologies and programming languages to learn, what soft skills are essential, and how to start a professional career in this field.
The agent platform built on sync.
A configuration as code language with rich validation and tooling.
React Hooks for Data Fetching
📗 SheetJS Spreadsheet Data Toolkit -- New home https://git.sheetjs.com/SheetJS/sheetjs
:orange_book: 中华新华字典数据库。包括歇后语，成语，词语，汉字。
Data and code behind the articles and graphics at FiveThirtyEight
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
Distributed stream processing engine in Rust
Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.
Deepnote is a drop-in replacement for Jupyter with an AI-first design, sleek UI, new blocks, and native data integrations. Use Python, R, and SQL locally in your favorite IDE, then scale to Deepnote cloud for real-time collaboration, Deepnote agent, and deployable data apps. https://deepnote.com/
Browser compatibility data for Web technologies as displayed on MDN
Visualize and share your data. All in SQL. Powered by DuckDB.
PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement
The official home of the Presto distributed SQL query engine for big data
CKAN is an open-source DMS (data management system) for powering data hubs and data portals. CKAN makes it easy to publish, share and use data. It powers catalog.data.gov, open.canada.ca/data, data.humdata.org among many other sites.
:card_index: A simple fake data generator for C#, F#, and VB.NET. Based on and ported from the famed faker.js.
An extensible framework for linking databases and interactive views.
Colour Science for Python
Random fake data generator written in go
Mimesis is a Python library for generating fake but realistic data in multiple languages and locales.
Nessie: Transactional Catalog for Data Lakes with Git-like semantics
Superduper: End-to-end framework for building custom AI applications and agents.
🌊 Continuously synchronize the systems where your data lives, to the systems where you _want_ it to live, by managing your data flows with Estuary. 🌊
visual data prep powered by python
The leader in Customer Data Infrastructure
Powerful Analytics Solution. Setup in 30 seconds. Display all your data on a Simple, AI-powered dashboard. Fully self-hostable and GDPR compliant. Alternative to Google Analytics, MixPanel, Plausible, Umami & Matomo.
OpenDota: Open source Dota 2 data platform with automated replay parsing
Community list of data & technology resources concerning the built environment and communities. 🏙️🌳🚌🚦🗺️
Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!
A well tested and comprehensive Golang statistics library package with no dependencies.
Clean APIs for data cleaning. Python implementation of R package Janitor
Compare tables within or across databases
Faker is a pure Elixir library for generating fake data.
A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
F# Data: Library for Data Access
Main yt repository
Data processing & ETL framework for Ruby
Easy pipelines for pandas DataFrames.
:chart_with_upwards_trend: A live cryptocurrency historical trade data blotter. Download live historical trade data from any cryptoexchange, be it for machine learning, backtesting/visualizing trading strategies or for Quantopian/Zipline.
Data format converters for GameMaker LTS 2022
Generate realistic IoT test data and send it via MQTT, HTTP, or TCP.
Distributed, masterless, high performance, fault tolerant data processing
Port of a popular ruby faker gem written in kotlin. Generate realistically looking fake data such as names, addresses, banking details, and many more, that can be used for testing and data anonymization purposes.
No description provided by the repository host.
Data ingestion engine — Singer taps to Parquet in cloud buckets
🐟 A Swiss-Army Knife for Data I/O
Stock price prediction using a deterministic algorithm inspired by LSTM, focusing on pattern recognition in historical data.