Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.
- agent-infrastructure
- ai-agent
- ai-search
- automation
47,133 repositories indexed
1–5 of 5 · Most stars
Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.
Turn any website into a structured API. Extract, automate, search and monitor the web.
Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.
Extract structured data from web sites. Web sites scraping.
Turn any website into clean, structured data: Markdown, metadata and links from one page or a whole site, in every major language.