47,133 repositories indexed
1–9 of 9 · Most stars
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
Crawl a site to generate knowledge files to create your own custom GPT from a URL
File Attachment toolkit for Ruby applications
A high performance web crawler / scraper in Elixir.
A discord bot that compiles your spaghetti
Self-hosted web scraper, crawler and document parser for AI agents: URLs, PDFs with OCR and Office files to clean Markdown/JSON. Firecrawl- and Jina-compatible API, MCP server, agent endpoint, Python/Node SDKs. Single Rust binary.
A simple yet highly configurable Mastodon bot that posts geotagged aerial imagery of a random location in the world.
Uses parselets and rwget to generate csv files from websites
Showcase your Telegram channels, groups, and bots with beautiful, dynamic preview cards. Perfect for GitHub profiles and portfolios. ✨