Compare repositories
This page shows the Star History and the facts of 2 to 5 repositories in the Repository Index, side by side. You choose the repositories. The page does not rank them.
Facts
| Fact | adbar/trafilatura Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML | ScrapeGraphAI/Scrapegraph-ai Python scraper based on AI | unclecode/crawl4ai Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it. | D4Vinci/Scrapling 🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev | scrapy/scrapy Scrapy, a fast high-level web crawling & scraping framework for Python. |
|---|---|---|---|---|---|
| Stars | 7,076 | 32,501 | 86,906 | 96,507 | 65,227 |
| Net stars, last 30 days | +167 | +1,009 | +2,244 | +10,838 | +675 |
| Largest star day | +132 on Aug 8, 2026 | +605 on May 5, 2026 | +598 on Sep 12, 2026 | +1,989 on Nov 3, 2026 | +92 on Jun 28, 2026 |
| Milestone reached in the record | None | 25,000 on May 14, 2026 | None | 50,000 on May 18, 2026 | None |
| Forks | 486 | 3,320 | 9,050 | 10,101 | 12,094 |
| Language | Python | Python | Python | Python | Python |
| License | APACHE-2.0 | MIT | APACHE-2.0 | BSD-3-CLAUSE | BSD-3-CLAUSE |
| Created | Apr 8, 2019 | Jan 27, 2024 | May 9, 2024 | Oct 13, 2024 | Feb 22, 2010 |
| Last push | Nov 4, 2026 | Oct 6, 2026 | Nov 4, 2026 | Nov 4, 2026 | Nov 4, 2026 |
| Archived | No | No | No | No | No |
| Health facts: Maintenance | 2 of 4 checks (2 without data) | 4 of 4 checks | 4 of 4 checks | 4 of 4 checks | 4 of 4 checks |
| Health facts: Releases | 2 of 3 checks (1 without data) | 3 of 3 checks | 3 of 3 checks | 1 of 3 checks | 3 of 3 checks |
| Health facts: Security practice | 0 of 1 check (1 without data) | 1 of 1 check | 1 of 1 check | 0 of 1 check | 1 of 1 check |
| Health facts: Community files | 1 of 3 checks (2 without data) | 3 of 3 checks | 3 of 3 checks | 3 of 3 checks | 3 of 3 checks |
| Commits, last 13 weeks | No data | 53 | 183 | 225 | 457 |
| Weeks with commits, last 52 | No data | 38 of 52 | 51 of 52 | 51 of 52 | 47 of 52 |
| In the Repository Index since | Oct 22, 2026 | Oct 22, 2026 | Oct 22, 2026 | Oct 22, 2026 | Oct 22, 2026 |
Topics that all of them have on the Repository Host: web-scraping, crawler. The facts come from the Repository Host and from the Star History that AwesomeRepos records. A shared topic does not mean that one repository can replace another. Each Health Facts row is one dimension alone. AwesomeRepos does not add them into one score. How each check is defined