Repository Index

A Fediverse and Bluesky bot to post trending rust repositories, inspired by TrendingGithub

• trending-rust-repositories
• rust
• rust-lang
• mastodon

Self-hosted web scraper, crawler and document parser for AI agents: URLs, PDFs with OCR and Office files to clean Markdown/JSON. Firecrawl- and Jina-compatible API, MCP server, agent endpoint, Python/Node SDKs. Single Rust binary.

• ai-agents
• browser-automation
• data-extraction
• firecrawl

Turn any website into clean, structured data: Markdown, metadata and links from one page or a whole site, in every major language.

• crawling
• csharp
• elixir
• ffi

A robust web archive analytics toolkit

• python
• web
• warc
• bigdata