Boss直聘爬虫 / BOSS直聘职位数据抓取工具，基于 Chrome CDP 协议复用真实登录态，绕过字体反爬，输出明文薪资 JSON/CSV + 薪资技能分析。A Chrome-CDP-based BOSS Zhipin job scraper/crawler.
- boss-zhipin
- chrome-cdp
- spider
- boss-zhipin-scraper
Repository Index
78,850 visible repositories in the index
241–264 of 328 · Most stars
Google Play Scraper for collecting public details about applications, games, movies & TV shows, books, and more.
- google-play
- google-play-api
- google-play-scraper
The web scraping open project repository aims to share knowledge and experiences about web scraping with Python
- playwright
- python
- scrapy
- scrapy-spider
XSS spider - 66/66 wavsep XSS detected
Async Python 3.6+ web scraping micro-framework based on asyncio
- asyncio
- aiohttp
- asyncio-spider
- crawler
Hide your scrapers IP behind the cloud. Provision proxy servers across different cloud providers to improve your scraping success.
In this tutorial, we showcase how to scrape public Google data with Python and Oxylabs API.
- python
- scrape
- scrape-google
Python binding to Modest and Lexbor engines. Fast HTML5 parser with CSS selectors for Python.
- python
- html5
- css
- web-scraping
❤️ Fredy - [F]ind [R]eal [E]state [D]amn Eas[y] - Fredy keeps searching for new apartments, houses, and flats in Europe on platforms like ImmoScout24, Immowelt, eBay Kleinanzeigen and instantly delivers the results to you via Slack, Telegram, Email, Discord or ntfy, so you can focus on the more important things in life ;)
- fredy
- immowelt
- appartment
- appartments
A batteries-included framework for easy web-scraping. Just add CSS! (Or do more.)
Simple web scraping for R
Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.
A chat bot for Slack (https://slack.com).
This is a lightweight, headless browser purpose-built for AI agents (such as Codex or Claude Code) to perform browser automation tasks; it is designed to navigate through various web protection systems, login processes, and reverse-engineering scenarios
- anti-bot
- automation
- firefox
- headless-browser
:rocket: An open source alternative to searx which provides a modern-looking :sparkles:, lightning-fast :zap:, privacy respecting :disguised_face:, secure :lock: meta search engine
- meta-search-engine
- rust
- search-engine
- fast
源码级 Chromium 指纹内核，检测站按普通 Chrome 评分。Source-level Chromium fingerprint kernel that passes bot detection tests. Not JS injection — C++ patches compiled into the binary.
- ai-agents
- anti-detect
- anti-detect-browser
- bot-detection
Tools for various online judges. Downloading sample cases, generating additional test cases, testing your code, and submitting it.
- competitive-programming
- automation
- scraping
- atcoder
Crawly, a high-level web crawling & scraping framework for Elixir.
Generate smart and powerful wordlists
- wordlist
- password
- hacking-tool
- password-cracking
Ruby gem for web scraping purposes. It scrapes a given URL, and returns you its title, meta description, meta keywords, links, images...
Clone Discord servers in real time with a powerful set of tools: export messages and DMs, scrape member lists, forward messages to other services, and much more. Controlled with slash commands or a web dashboard.
- discord
- discord-cloner-bot
- discord-exporter
- discord-message-sender
Web fetch, search, and crawl for AI agents. Built from scratch in Rust. No keys, no accounts. AGPL v3.
- agpl
- ai-agents
- anti-bot
- crawling
A high performance web crawler / scraper in Elixir.
Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.
- xquery
- xml
- html
- json