unclecode /crawl4ai

Open on GitHub

Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Join our Discord https://discord.gg/VuxzM8mtf

Stars: 86,793 stars
Forks: 9,043 forks
Language: Python
License: APACHE-2.0
Created: May 9, 2024
Last push: Nov 2, 2026
Updated: Nov 3, 2026

In the Repository Index from the Seed Dataset since Oct 22, 2026.

Star History

192 days recorded, Apr 26, 2026 – Nov 3, 2026 (UTC). Net change +23,067 stars.

Net stars each dayhighest +598

Apr 26, 2026Nov 3, 2026

Cumulative net stars since Apr 26, 2026+23,067

Apr 26, 2026Nov 3, 2026

Observations

What the Repository Host reported each day.

Day (UTC)	Stars	Forks	Last push	Archived
Nov 3, 2026	86,793	9,043	Nov 2, 2026	No
Nov 2, 2026	86,722	9,035	Nov 1, 2026	No
Nov 1, 2026	86,663	9,020	Oct 30, 2026	No
Oct 31, 2026	86,615	9,013	Oct 30, 2026	No
Oct 30, 2026	86,545	9,010	Oct 29, 2026	No
Oct 29, 2026	86,468	9,002	Oct 28, 2026	No
Oct 28, 2026	86,411	8,991	Oct 26, 2026	No
Oct 27, 2026	86,326	8,979	Oct 26, 2026	No
Oct 26, 2026	86,261	8,972	Oct 22, 2026	No
Oct 25, 2026	86,186	8,963	Oct 22, 2026	No
Oct 24, 2026	86,115	8,952	Oct 22, 2026	No
Oct 23, 2026	86,053	8,942	Oct 22, 2026	No
Oct 22, 2026	86,041	8,943	Oct 22, 2026	No

Attention Score

7 daysOct 27, 2026 – Nov 2, 2026
+461 stars · score 6.14
Eligible to rank on the trending page.
Trending in 7 days
30 daysOct 4, 2026 – Nov 2, 2026
+2,180 stars · score 7.69
Eligible to rank on the trending page.
Trending in 30 days
90 daysAug 5, 2026 – Nov 2, 2026
+11,111 stars · score 9.32
Eligible to rank on the trending page.
Trending in 90 days
180 daysMay 7, 2026 – Nov 2, 2026
+22,440 stars · score 10.02
Eligible to rank on the trending page.
Trending in 180 days

A repository is ranked only when its Star History covers every day of the window and its latest Observation is not missing.

Repositories with shared topics

Repositories in the index that have one or more topics in common with this repository and the same primary language (Python). Sorted by the number of shared topics, then by stars.

D4Vinci/Scrapling93K
🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Shared topics:aicrawlerdata-extractionmcpplaywrightpythonweb-scraping
ScrapeGraphAI/Scrapegraph-ai32K
Python scraper based on AI
Shared topics:crawlerdata-extractionllmmarkdownragweb-crawlerweb-scraping
langchain-ai/langchain149K
The agent engineering platform.
Shared topics:aiai-agentsllmopen-sourcepythonrag
browser-use/browser-use120K
Open-source Python library for AI browser agents, plus Browser Use Cloud: stealth browsers and a hosted agent API.
Shared topics:ai-agentsllmmcpplaywrightpythonweb-scraping
langchain-ai/langgraph44K
Build resilient agents.
Shared topics:aiai-agentsllmopen-sourcepythonrag
deepset-ai/haystack27K
Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.
Shared topics:aiai-agentsllmmcppythonrag
fim-ai/fim-one1.6K
Source-available agent platform for Global × China enterprises — wire every system through one agent core. Self-hosted, any LLM.
Shared topics:aiai-agentsllmmcppythonrag
headroomlabs-ai/headroom79K
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
Shared topics:aillmmcppythonrag

Report a problem with this page