47,133 repositories indexed
1–7 of 7 · Most stars
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
Crawl a site to generate knowledge files to create your own custom GPT from a URL
File Attachment toolkit for Ruby applications
A high performance web crawler / scraper in Elixir.
Self-hosted web scraper, crawler and document parser for AI agents: URLs, PDFs with OCR and Office files to clean Markdown/JSON. Firecrawl- and Jina-compatible API, MCP server, agent endpoint, Python/Node SDKs. Single Rust binary.
Uses parselets and rwget to generate csv files from websites
Showcase your Telegram channels, groups, and bots with beautiful, dynamic preview cards. Perfect for GitHub profiles and portfolios. ✨