:zap: A distributed crawler for weibo, building with celery and requests.
- weibospider
- data-analysis
- python3
- distributed-crawler
Repository Index
59,132 visible repositories in the index
73–96 of 216 · Most stars
Twitter API Scraper | Without an API key | Twitter Internal API | Free | Twitter scraper | Twitter Bot
- python
- bot
- client
- python3
Jobs scraper library for LinkedIn, Indeed, Glassdoor, ZipRecruiter, Bayt, Naukri, BDJobs & HelloWork
- indeed
- ziprecruiter
- jobs-scraper
An agentic extractor for messaging platforms. Noria receives messages & URLs via chat; scrapes web data to evaluate the content against custom scoring matrices (e.g., jobs, scholarships); and sends a structured summary with a calculated match score directly to the assigned messenger number.
- ai-agent
- automation
- data-extraction
- event-driven-architecture
TranslatedAn open-source AI agent for social media — discover trends, create content, publish everywhere, and learn what works across Xiaohongshu, Douyin, Zhihu, Bilibili, and more.🎨
- agent
- agent-skill
- content-automation
- content-creation
Open Source Web Crawler for Java
CISO Assistant is a one-stop-shop GRC platform for Risk Management, AppSec, Compliance & Audit, TPRM, BIA, Privacy, and Reporting. It supports 200+ global frameworks with automatic control mapping, including ISO 27001, NIST CSF, SOC 2, CIS, PCI DSS, NIS2, DORA, GDPR, HIPAA, CMMC, and more.
- compliance
- grc
- soc2
- gdpr
IRC application written in Rust
- irc
- rust
- iced
A scalable social community platform powered by Gin backend and modern TypeScript/Vue frontend architecture
- forum
- go
- vue3
- bbs
Open-source AI teammates in Slack, Teams, Discord, Telegram and Mattermost. Self-host it, with any agent harness and any model.
Official Repository: Telegram bot which can download direct links, torrents, nzb, google drive, telegram document, any file/folder from rclone supported clouds, all yt-dlp supported sites and jdownloader supported sites, then upload them to google drive, telegram cloud or to one of rclone supported clouds
- mirror
- leech
- clone
- mega
Datascraper that is currently adult focused - Updated regularly
- onlyfans
- datascraping
- scraper
- archive
Fully functional Twitter clone built in flutter framework using Firebase realtime database and storage
- twitter-clone
- flutter-apps
- social
Open-source MCP server for LinkedIn. Give Claude and any MCP-compatible AI agent access to profiles, companies, jobs, and messages.
- linkedin-scraper
- mcp
- mcp-server
🔍 导出并模糊搜索 Telegram 聊天记录 | Export and fuzzy search your Telegram chat history
- embedding
- telegram
- telegram-bot
- mcp
Downloads albums from the web in bulk for archive purposes
- ripme
- java
- album
- downloader
job-ops: DevOps principles applied to job hunting. A self-hosted pipeline to track, analyze, and assist your application process
- automation
- self-hosted
- job-search
- jobhunt
🔥 今日热榜 API，一个聚合热门数据的 API 接口，支持 RSS 模式 及 Vercel 部署 | 前端页面：https://github.com/imsyy/DailyHot
Web scraper for NodeJS
Snoop — инструмент разведки на основе открытых данных (OSINT world)
- osint
- termux
- username-search
- username-checker
Every Code - push frontier AI to it limits. A fork of the Codex CLI with validation, automation, browser integration, multi-agents, theming, and much more. Orchestrate agents from OpenAI, Claude, Gemini or any provider.
Open-source third-party Telegram client with not many but useful modifications.
- nekogram
- telegram
freehire — the open-source search engine for job seekers
- ats
- careers
- hiring
- job-aggregator
The open source and enterprise-ready webhooks service 🦀
- webhooks
- rust
- webhook-server
- webhook-service