Streamlit — A faster way to build and share data apps.
Repository Index
47,133 repositories indexed
73–96 of 3,724 · Most stars
This is a repo with links to everything you'd ever want to learn about data engineering
TranslatedA visual no-code/code-free web crawler/spider. 易采集 (EasySpider, "easy collection"): a visual browser automation testing/data collection/web crawler software that lets you design and execute crawler tasks graphically without code. Alias: ServiceWrapper, an intelligent service wrapping system for Web applications.
A unified trading API with more than 100 crypto exchanges and prediction markets in JavaScript / TypeScript / Python / C# / PHP / Go / Java / Rust
✨ Innovative and open-source visualization application that transforms various data formats, such as JSON, YAML, XML and CSV into interactive graphs.
- json
- tool
- react
- visualization
Apache Spark - A unified analytics engine for large-scale data processing
- python
- scala
- r
- java
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!
- machine-learning
- models
- ui
- ui-components
A command line tool and library for transferring data with URL syntax, supporting DICT, FILE, FTP, FTPS, GOPHER, GOPHERS, HTTP, HTTPS, IMAP, IMAPS, LDAP, LDAPS, MQTT, MQTTS, POP3, POP3S, RTSP, SCP, SFTP, SMTP, SMTPS, TELNET, TFTP, WS and WSS. libcurl offers a myriad of powerful features
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
DuckDB is a high-performance analytical database system
Translated微舆 (Weiyu, "micro public opinion"): a multi-Agent public opinion analysis assistant that anyone can use. It breaks information cocoons, restores the original picture of public opinion, predicts future trends, and assists decision-making! Implemented from scratch, without relying on any framework.
- agent-framework
- data-analysis
- multi-agent-system
- nlp
Self-evolving Context Database for AI Agents. Unify Agent Memory, Knowledge RAG and Skills.
- context-database
- agentic-rag
- agent-memory
- self-evolving
Making large AI models cheaper, faster and more accessible
- deep-learning
- hpc
- large-scale
- data-parallelism
Platform to build admin panels, internal tools, and dashboards. Integrates with 25+ databases and any API.
- low-code
- admin-dashboard
- app-builder
- internal-tools
Easily and securely send things from one computer to another :crocodile: :package:
Convert PDF to markdown + JSON quickly with high accuracy
TiDB is built for agentic workloads that grow unpredictably, with ACID guarantees and native support for transactions, analytics, and vector search. No data silos. No noisy neighbors. No infrastructure ceiling.
- distributed-database
- distributed-transactions
- tidb
- database
:hedgehog: PostHog is the leading platform for building self-driving products. Our developer tools – AI observability, analytics, session replay, flags, experiments, error tracking, logs, and more – capture all the context agents need to diagnose problems, uncover opportunities, and ship fixes. Steer it all from Slack, web, desktop, or the MCP.
Extremely fast Query Engine for DataFrames, written in Rust
- dataframe-library
- dataframe
- dataframes
- rust
Free, simple, and intuitive online database diagram editor and SQL generator.
- database-schema
- editor
- mariadb
- postgresql
📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG
An open-source engine that turns continuous content streams into search and monitoring. Durable ingestion, hybrid search, alerts, and plugins for formats, models and business rules.
A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.