Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
Repository Index
57,637 visible repositories in the index
1–15 of 15 · Most stars
Python scraper based on AI
- scraping
- scraping-python
- llm
- web-crawler
bridge between mattermost, IRC, gitter, xmpp, slack, discord, telegram, rocketchat, twitch, ssh-chat, zulip, whatsapp, keybase, matrix, microsoft teams, nextcloud, mumble, vk and more with REST API (mattermost not required!)
- mattermost
- xmpp
- telegram
- gitter
SuiteCRM - Open source CRM for the world
- crm
- php
- agplv3
- accounts
TranslatedHands-on 🐍 web crawlers for many kinds of websites and e-commerce data 🕷. Includes 🕸: Taobao products, WeChat official accounts, Dianping, Qichacha, job recruitment sites, Xianyu, Alibaba tasks, Cnblogs, Weibo, Baidu Tieba, Douban movies, Baotu (ibaotu.com), Quanjing (quanjing.com), Douban music, a provincial drug administration, Sohu News, machine learning text collection, FOFA asset collection, Autohome, National Bureau of Statistics, Baidu keyword indexed-page counts, spider pool directories, Toutiao (Today's Headlines), Douban movie reviews, Ctrip, Xiaomi App Store, Anjuke, Tujia homestays ❤️❤️❤️. WeChat crawler showcase project:
- python3
- crawler
- baidu-tieba
- taobao-spider
The go-to web for your AI coding agent — local-first search, fetch, crawl & research over MCP. No API keys, no cloud, $0/query. Public beta.
Jobs scraper library for LinkedIn, Indeed, Glassdoor, ZipRecruiter, Bayt, Naukri, BDJobs & HelloWork
- indeed
- ziprecruiter
- jobs-scraper
freehire — the open-source search engine for job seekers
- ats
- careers
- hiring
- job-aggregator
PufferPanel is an open source game server management panel, designed for both small networks and personal use
- game-server
- minecraft
- srcds
- panel
Xiryn — the open-source personal agent. Does everything Muse, Grok Bot and Dots do, on your own computer: each agent gets its own Linux desktop in Docker, any model with your keys, an encrypted vault, and control from Telegram.
Open source autonomous engineering harness in your cloud. One sandbox per task, no real secrets inside.
- agent-harness
- agent-sandbox
- agent-security
- agentic-coding
Self-hosted web scraper, crawler and document parser for AI agents: URLs, PDFs with OCR and Office files to clean Markdown/JSON. Firecrawl- and Jina-compatible API, MCP server, agent endpoint, Python/Node SDKs. Single Rust binary.
- ai-agents
- browser-automation
- data-extraction
- firecrawl
macOS bash script to automate iOS app decryption on jailbroken devices
- activator
- autotouch
- bash
- bfdecrypt
Private Telegram bot and API that downloads App Store IPAs with ipatool and decrypts them with UnfairPlay
Take HTML Snapshots for your Angular, Ember, Durandal or any JavaScript applications