Jobs scraper library for LinkedIn, Indeed, Glassdoor, ZipRecruiter, Bayt, Naukri, BDJobs & HelloWork
- indeed
- ziprecruiter
- jobs-scraper
Repository Index
78,351 visible repositories in the index
73–96 of 277 · Most stars
Java wrapper for the popular chat & VOIP service: Discord https://discord.com
A library that scrapes Linkedin for user data
- linkedin-scraper
- scraper
- profile
An agentic extractor for messaging platforms. Noria receives messages & URLs via chat; scrapes web data to evaluate the content against custom scoring matrices (e.g., jobs, scholarships); and sends a structured summary with a calculated match score directly to the assigned messenger number.
- ai-agent
- automation
- data-extraction
- event-driven-architecture
Mechanize is a ruby library that makes automated web interaction easy.
- scraping
- web
- ruby
Datascraper that is currently adult focused - Updated regularly
- onlyfans
- datascraping
- scraper
- archive
Open-source MCP server for LinkedIn. Give Claude and any MCP-compatible AI agent access to profiles, companies, jobs, and messages.
- linkedin-scraper
- mcp
- mcp-server
Lightweight, scriptable browser as a service with an HTTP API
DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
- crawler
- dotnetcore
- cross-platform
- csharp
持续维护的新浪微博采集工具🚀🚀🚀
- scrapy
- python
- weibospider
Web scraper for NodeJS
🔮 A Node.js scraper for humans.
- scraper
- node-scraper
- web-scraping
Extract any website’s design system into tokens in seconds: logo, colors, typography, borders & more. One command.
Google Maps Scraper & Lead Generation Tool. Extract 50+ data points including business emails, phone numbers, and social profiles. Includes enrichment features, API access, and a generous free plan with 200 searches/month.
- google-maps-scraping
- google-maps
- google-maps-api
- google-maps-review
Open-source web scraping API. Turn any website into clean markdown or structured JSON. Anti-detect browser, proxy auto-selection, self-hosted. One command: make up
Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, tokens and more
- endpoints
- endpoint-discovery
- bugbounty
- crawler
Emby/Jellyfin 的一个日本电影刮削器插件，可以从某些网站抓取影片信息。
- emby
- jav-scraper
- jav
- plugin
A list of practical knowledge-building projects.
- programming
- projects
- python
- web-scraper
🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单，功能强大的Python爬虫框架。内置AirSpider、Spider、TaskSpider、BatchSpider四种爬虫解决不同场景的需求。且支持断点续爬、监控报警、浏览器渲染、海量数据去重等功能。更有功能强大的爬虫管理系统feaplat为其提供方便的部署及调度
A complete and versatile web scraper.
There was no free Dictionary API on the web when I wanted one for my friend, so I created one.
🐍Python 3 wrapper of Microsoft UIAutomation. Support UIAutomation for MFC, WindowsForm, WPF, Modern UI(Metro UI), Qt, IE, Firefox, Chrome ...
A Python module to bypass Cloudflare's anti-bot page.
- cloudflare
- anti-bot-page
- protected-page
- scrape
AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.
- aitools
- crawl
- scrape
- serp