Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.
- agent-infrastructure
- ai-agent
- ai-search
- automation
Repository Index
47,133 repositories indexed
1–12 of 12 · Most stars
Python scraper based on AI
- scraping
- scraping-python
- llm
- web-crawler
🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...
- wget
- browser-bookmarks
- pinboard
TranslatedSelf-hosted TikTok, Douyin & Bilibili scraper and no-watermark video downloader — async REST API, MCP server for AI agents, CLI and web console, plus offline speech-to-text for downloaded videos. Self-healing identity pool, PostgreSQL archive, one docker compose up.
TranslatedLeave the dailies to March 7th, and keep the Trailblaze for yourself. An open-source automation assistant for "Honkai: Star Rail".
- honkai-star-rail
- star-rail
- march7thassistant
WarcDB: Web crawl data as SQLite databases.
DocSearch - Scraper
- algolia
- docsearch
- documentation
- scraper
Extract knowledge from all information sources using gpt and other language models. Index and make Q&A session with information sources.
micrOS - mini asynchronous automation OS for DIY projects.
- micropython
- iot-platform
- interrupts
- socket
TranslatedMaiBot Baidu search plugin, supporting search commands and LLM Tool, integrated with the official Baidu Qianfan API.
Intelligent web page comparison tool with Wayback Machine support and visual regression testing
- visual-comparison
- wayback-machine
- web-scraping
- diff
Python toolkit for discovering, monitoring, and controlling Tasmota devices via MQTT with CLI utilities and ready-to-use multi-arch Docker images
- automation
- cli
- control
- device-management