X/Twitter automation toolkit: scrapers, CLI and an MCP server with approval-gated write actions, no paid API.
Repository Index
142,273 visible repositories in the index
505–528 of 627 · Most stars
Complete-Life-Cycle-of-a-Data-Science-Project
- feature-engineering
- unsupervised-learning
- data-science
- deep-learning
An automatic updated list of free SOCKS4, SOCKS5, HTTP & HTTPS proxies in JSON, TXT, CSV, XML & YAML format. Proxies are online at the time of testing & updated every hour. Geolocation & detection status is also available.
- proxy-list
- proxies
- proxy
- socks4
:card_index: Extract social media profiles and more with regular expressions
This Python application is an OSINT (Open Source Intelligence) tool called "Ominis OSINT - Web Hunter." It performs online information gathering by querying Google for search results related to a user-inputted query. The tool extracts relevant information such as titles, URLs, and potential mentions of the query in the results.
EveryInfra MCP server & agent plugin: scraper API for TikTok, Instagram, Amazon, YouTube, Xiaohongshu & Douyin. 612 data APIs across 106 platforms, from $0.56/1K calls. For Claude Code, Cursor, Codex.
- ai-agents
- claude-code
- cursor
- mcp
🌐 RESTful API Wrapper for Instagram Private API
- instagram-api
- instagram-bot
- instagram-scraper
译文:Puppeteer 与 Chrome Headless —— 从入门到爬虫
- puppeteer
- headless-chrome
- scraping-websites
📸 Screen capture made easy!
- rust
- screen
- capture
- cross-platform
Popcorn Time is a multi-platform, free software BitTorrent client that includes an integrated media player. Compatible API Anime/Movies/Show Scrapper
- popcorn-api
- trakt
- metadata
- popcorn
全自动短视频搬运工具,支持自动下载、去重、AI生成标题+标签、上传,可二开扩展至多平台,例如:TikTok->视频号/抖音/小红书、抖音->TikTok/视频号/小红书......video-processing, automation, tiktok, selenium, pyqt5, ffmpeg, bot, data-scraping, video-deduplication.
- automation
- bot
- data-scraping
- ffmpeg
A port of n0madic/twitter-scraper to Node.js.
Real-time detection of anti-bot systems, captchas & fingerprinting techniques. Identifies Cloudflare, Akamai, DataDome, reCAPTCHA, hCaptcha, Shape Security & more with confidence scoring and advanced capture tools.
Dive into web scraping and build a Next.js 13 eCommerce price tracker within a single video that teaches you data scraping, cron jobs, sending emails, deployment, and more.
- scraping
- webscraping
HTTP client that can impersonate web browsers
- fingerprint
- http
- http-client
- https
Nextjs server to query websites with GraphQL
A Playwright-based Node.js tool that bypasses search engine anti-scraping mechanisms to execute Google searches. Local alternative to SERP APIs with MCP server integration.
- ai
- google-search
- llm
- mcp-server
JARVIS: a real-time agentic intelligence-gathering platform powered by autonomous web scraping & OSINT, streamed via Meta Ray-Ban smart glasses
Instagram Data Scraper, Instagram Web Scraper, Instagram Super Scraper is a PHP script which takes @user-name or #keywords as input and returns all information related to user or hash-tags e.g. likes, comments, post count, images, likes on images etc... You can search @account information and #hash-tag simultaneously by using space separated words in search box jQuery is using to build the Awesome View, to handle each and every request separately. I hope you like this small chunk of code All code is well commented to understand the flow and functionality, if I missed something or any improvement/suggestion you have, kindly let me know..
- datascraper
- instagram-php-scraper
- instagram-scraper
A anime discovery, streaming site made with NextJs and TailwindCSS. Uses AniList API and video data from GogoAnime. No ads and no vpn required
- tailwindcss
- vercel
- nextjs
- react
Advanced python library to scrap Twitter (tweets, users) from unofficial API
Universal Reddit Scraper - Works on any Subreddit or User
- awesome
- open-source
- tool
Twitch YouTube bot. Automatically make video compilations of the most viewed Twitch clips and upload them to YouTube using Python 3.
- twitch
- twitch-bot
- twitch-api
- twitchbot
:frog: 知网(CNKI)文献下载及文献速览爬虫 (Web Scraper for Extracting Data)