100% free and full open-source edge Firecrawl alternative with better links extraction for agents - that you can deploy to cloudflare or vercel by yourself.
- ai-agent-tools
- ai-sdk
- better-auth
- cloudflare-workers
142,187 visible repositories in the index
25–41 of 41 · Most stars
100% free and full open-source edge Firecrawl alternative with better links extraction for agents - that you can deploy to cloudflare or vercel by yourself.
Random User-Agent middleware based on fake-useragent
OSINT tool - gets data from services like shodan, censys etc. in one app
Social media scraping / data collection library for Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs
HTTP client that can impersonate web browsers
Nextjs server to query websites with GraphQL
Advanced python library to scrap Twitter (tweets, users) from unofficial API
Google Reviews API integration and scalable Google Reviews Scraper for extracting ratings, review text, and business insights from Google Maps using a structured Google Review API.
⭐️ A proxy scraper made using Protractor | Proxy list Updates every three hour 🔥
scrape proxies from more than 5 different sources and check which ones are still alive
Open source web infrastructure for AI. Scrape, crawl, and automate the web, clean markdown, browser sessions, ready for your agents.
The REST API for Jikan
Undetected web-scraping & seamless HTML parsing in Python!
a reliable high-level web crawling & scraping framework for Node.js.
Jekyll-based static site for The Programming Historian
Self-hosted, invisible CAPTCHA that detects AI agents driving real browsers. GDPR, WCAG 2.2 AA, and EAA: no cookies, no third-party data sharing, and no visual or audio puzzle. With a false-positive budget enforced in CI. Proof of work, drop-in for Turnstile and reCAPTCHA.
Go http.Client with a byte-exact browser TLS fingerprint (uTLS) — survive JA3/JA4 blocking without a headless browser.