Compare repositories
This page shows the Star History and the facts of 2 to 5 repositories in the Repository Index, side by side. You choose the repositories. The page does not rank them.
Facts
| Fact | dixudx/tumblr-crawler Easily download all the photos/videos from tumblr blogs. 下载指定的 Tumblr 博客中的图片,视频 | D4Vinci/Scrapling 🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev | unclecode/crawl4ai Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it. | scrapy/scrapy Scrapy, a fast high-level web crawling & scraping framework for Python. | binux/pyspider A Powerful Spider(Web Crawler) System in Python. |
|---|---|---|---|---|---|
| Stars | 1,161 | 103,940 | 87,485 | 65,455 | 16,743 |
| Net stars, last 30 days | +2 | +15,483 | +1,722 | +587 | -8 |
| Largest star day | +1 on May 20, 2026 | +1,989 on Nov 3, 2026 | +598 on Sep 12, 2026 | +92 on Jun 28, 2026 | +2 on May 14, 2026 |
| Milestone reached in the record | None | 100,000 on Nov 9, 2026 | None | None | None |
| Forks | 336 | 10,847 | 9,126 | 12,156 | 3,607 |
| Language | Python | Python | Python | Python | Python |
| License | No license | BSD-3-CLAUSE | APACHE-2.0 | BSD-3-CLAUSE | APACHE-2.0 |
| Created | Apr 15, 2016 | Oct 13, 2024 | May 9, 2024 | Feb 22, 2010 | Feb 21, 2014 |
| Last push | Dec 26, 2025 | Nov 17, 2026 | Nov 17, 2026 | Nov 16, 2026 | Apr 30, 2024 |
| Archived | No | No | No | No | Yes |
| Health facts: Maintenance | 1 of 4 checks (2 without data) | 4 of 4 checks | 4 of 4 checks | 4 of 4 checks | 0 of 4 checks |
| Health facts: Releases | 0 of 3 checks (2 without data) | 2 of 3 checks | 3 of 3 checks | 3 of 3 checks | 1 of 3 checks |
| Health facts: Security practice | 0 of 1 check (1 without data) | 0 of 1 check | 1 of 1 check | 1 of 1 check | 0 of 1 check |
| Health facts: Community files | 0 of 3 checks (2 without data) | 3 of 3 checks | 3 of 3 checks | 3 of 3 checks | 1 of 3 checks |
| Commits, last 13 weeks | No data | 243 | 172 | 409 | 0 |
| Weeks with commits, last 52 | No data | 51 of 52 | 50 of 52 | 47 of 52 | 0 of 52 |
| In the Repository Index since | Nov 14, 2026 | Oct 22, 2026 | Oct 22, 2026 | Oct 22, 2026 | Oct 22, 2026 |
Topics that all of them have on the Repository Host: crawler, python. The facts come from the Repository Host and from the Star History that AwesomeRepos records. A shared topic does not mean that one repository can replace another. Each Health Facts row is one dimension alone. AwesomeRepos does not add them into one score. How each check is defined