Compare repositories
This page shows the Star History and the facts of 2 to 5 repositories in the Repository Index, side by side. You choose the repositories. The page does not rank them.
Facts
| Fact | xianhu/PSpider 简单易用的Python爬虫框架，QQ交流群：597510560 | unclecode/crawl4ai Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it. | s0md3v/Photon Incredibly fast crawler designed for OSINT. | apify/crawlee-python Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract structured data with LLMs via Pydantic AI, or control the browser in natural language with Stagehand. Works with BeautifulSoup, Parsel, Playwright, and raw HTTP. Download HTML, PDF, images, and other files. Proxy rotation included. | DedSecInside/TorBot Dark Web OSINT Tool |
|---|---|---|---|---|---|
| Stars | 1,828 | 87,324 | 13,344 | 9,670 | 5,198 |
| Net stars, last 30 days | +1 | +1,827 | +74 | +90 | +140 |
| Largest star day | +1 on May 17, 2026 | +598 on Sep 12, 2026 | +11 on Sep 11, 2026 | +67 on May 9, 2026 | +69 on Jul 3, 2026 |
| Milestone reached in the record | None | None | None | None | 5,000 on Oct 7, 2026 |
| Forks | 491 | 9,108 | 1,693 | 832 | 780 |
| Language | Python | Python | Python | Python | Python |
| License | BSD-2-CLAUSE | APACHE-2.0 | GPL-3.0 | APACHE-2.0 | Other license |
| Created | Oct 15, 2016 | May 9, 2024 | Mar 30, 2018 | Jan 10, 2024 | May 17, 2017 |
| Last push | Jun 10, 2022 | Nov 13, 2026 | Oct 17, 2026 | Nov 13, 2026 | Nov 12, 2026 |
| Archived | No | No | No | No | No |
| Health facts: Maintenance | 1 of 4 checks (2 without data) | 4 of 4 checks | 3 of 4 checks | 2 of 4 checks (2 without data) | 2 of 4 checks (2 without data) |
| Health facts: Releases | 0 of 3 checks (2 without data) | 3 of 3 checks | 2 of 3 checks | 2 of 3 checks (1 without data) | 2 of 3 checks (1 without data) |
| Health facts: Security practice | 0 of 1 check (1 without data) | 1 of 1 check | 0 of 1 check | 0 of 1 check (1 without data) | 0 of 1 check (1 without data) |
| Health facts: Community files | 1 of 3 checks (2 without data) | 3 of 3 checks | 1 of 3 checks | 1 of 3 checks (2 without data) | 1 of 3 checks (2 without data) |
| Commits, last 13 weeks | No data | 188 | 2 | No data | No data |
| Weeks with commits, last 52 | No data | 51 of 52 | 5 of 52 | No data | No data |
| In the Repository Index since | Nov 12, 2026 | Oct 22, 2026 | Oct 22, 2026 | Nov 10, 2026 | Oct 22, 2026 |
Topics that all of them have on the Repository Host: crawler, python. The facts come from the Repository Host and from the Star History that AwesomeRepos records. A shared topic does not mean that one repository can replace another. Each Health Facts row is one dimension alone. AwesomeRepos does not add them into one score. How each check is defined