Scrape any website, article or RSS/Atom Feed with ease!
- scrape
- elixir
- readability
- rss
142,187 visible repositories in the index
577–600 of 627 · Most stars
Scrape any website, article or RSS/Atom Feed with ease!
TranslatedAI subscription and card-shop price comparison platform: say what you need and let AI help you choose. Aggregates top-up service or account offers for ChatGPT / Codex, Claude, Gemini and more, and compares price trends, top-up channels and warranties. AI-powered shopping and price comparison for subscriptions and accounts, with cross-shop offers, price history and purchase details.
V-Modal Visual Search SDK optimized for IOS Swift and Iphone DUO
DocSearch - Scraper
Extract knowledge from all information sources using gpt and other language models. Index and make Q&A session with information sources.
Local-first web & document ingestion engine in Rust — HTTP/browser capture, layout-aware PDF/Office/OCR parsing, persistent sync, verifiable data graphs, and evidence-grounded AI context.
A declarative struct-tag-based HTML unmarshaling or scraping package for Go built on top of the goquery library
Antch, a fast, powerful and extensible web crawling & scraping framework for Go
Self-hosted, invisible CAPTCHA that detects AI agents driving real browsers. GDPR, WCAG 2.2 AA, and EAA: no cookies, no third-party data sharing, and no visual or audio puzzle. With a false-positive budget enforced in CI. Proof of work, drop-in for Turnstile and reCAPTCHA.
Playwright PHP library for browser automation: navigation, E2E tests, assertions, screenshots, and so much more!
X (Twitter) scraper API, MCP server & Claude skill to scrape tweets & followers. Not affiliated with X Corp.
Turn any website into clean, structured data: Markdown, metadata and links from one page or a whole site, in every major language.
🔥 A daily streak system & portfolio for your projects.
Chemical Information from the Web
:mag: Data pipeline for crawling PDFs from the Web and transforming their contents into structured data using AWS textract. Built with AWS CDK + TypeScript
Generate roxygen2 skeletons populated with information scraped from the function script.
Search and read the web for AI agents at 99% fewer tokens. Free CLI + MCP.
Open field guide to 39 CAPTCHA types: identification signals, free and open-source bypass methods, and paid alternatives. Includes a searchable web version.
TikTok Scraper: Keyword Search, Creator Video Lists, and Comment Analysis Automation
REA Game Asset Scraper: Scoped Asset Extraction for Visual Workflows
Steam Community Market Scraper: Python 3 library for item prices and volumes
Bahrain Flip Finder: Community-Driven Deal Scanner for Discord and Telegram
TickTock Automation: Community-Driven Bot for Discord & Telegram Content Publishing
Community-driven Telegram bot for early diabetes and heart disease risk screening