Hide your scrapers IP behind the cloud. Provision proxy servers across different cloud providers to improve your scraping success.
Repository Index
86,076 visible repositories in the index
313–336 of 576 · Most stars
Sikuli's official repository on github. Ask questions or report bugs at http://launchpad.net/sikuli.
微博爬虫及配套工具箱，微博用户、话题、评论采集一网打尽。图片下载、情感分析，地理位置、关系网络、spammer 机器人识别等功能应有尽有。Docs：https://buyixiao.github.io/blog/weibo-super-spider.html 配套可视化网站：https://buyixiao.github.io/blog/one-stop-weibo-visualization.html
- weibo-spider
- weibocrawler
- weibo-comment-crawl
- emotion-analysis
Track the GPS location of the user's smartphone or PC and capture a picture of the target, along with IP and device information.
- hacking-tool
- geolocation
- iptracker
- latitude-longitude-finder
A Discord bot that functions as a shared inbox between staff and members, similar to Reddit's Modmail.
- modmail
- discord-bot
- discord-py
- discord
CLI tool for saving a faithful copy of a complete web page in a single HTML file (based on SingleFile)
This is a repository that allows you to integrate ChatGPT into Line.
Completely free and open-source human-like Instagram bot. Powered by UIAutomator2 and compatible with basically any Android device 5.0+ that can run Instagram - real or emulated.
- android
- automation
- followers
- like
Build agentic systems. Run them with confidence. Orchestrate agents, automate business processes, inspect every execution, and keep humans in control. Deploy Heym on your own infrastructure.
Twitter scraper for X: tweets, profiles, followers and following, no API key needed. Python library with multi-account pooling, proxy support and async, or a hosted version on Apify.
The URL engine behind Iframely. Self-hosted parsers that turn links into metadata, previews and embeds.
- embeds
- oembed
- twitter-cards
- open-graph
This package is designed to bypass puppeteer's bot-detecting captchas such as Cloudflare. It acts like a real browser and can be managed with puppeteer.
- cloudflare-bypass
- puppeteer
- puppeteer-cloudflare-captcha
- puppeteer-extra-plugin
LinkedIn enumeration tool to extract valid employee names from an organization through search engine scraping
- webscraping
- python3
- osint
- enumeration
JavaScript library that translates Cron expressions into human readable descriptions
- cron
- cron-expression
- cron-libraries
- quartz-scheduler
This code is used to perform web scraping and data extraction from Google Maps. It is particularly designed for obtaining information about businesses, including their name, address, website, phone number, reviews, and more.
- chromium
- data
- data-scraping
WikiChat is an improved RAG. It stops the hallucination of large language models by retrieving data from a corpus.
- natural-language-processing
- chatbot
- nlp
- factuality
The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
Open source, self-hosted AI code review. Bring your own LLM.
Undetected Python version of the Playwright testing and automation library.
- automation
- bot
- bots
- botting
Track Instagram users' activities, profile changes and capture content with beautiful dashboards and instant notifications
- instagram-monitor
- instaloader
- python
Information Gathering Instagram.
- python
- python3
- instagram-scraper
Collection of open-source libraries and tools for Robotic Process Automation (RPA), designed to be used with both Robot Framework and Python
- rpa
- rpa-robots
- robotframework
- automation
Self-hosted web search for AI agents and SEO. Google, Bing, Yandex, Baidu, DuckDuckGo & Ecosia, rendered in a real browser: ranked results and clean page Markdown. API, CLI, MCP 🎉
- baidu
- serp
- serpapi
Install sing-box/xray and configure vless / tuic / hysteria2 / shadowtls for reality or tls (letsencrypt) over different transport protocols (tcp, http, grpc and websocket) with user management capability in CLI, TUI and Telegram bot by a single command in docker compose!