YouTube video downloader in javascript.
- youtube
- video-downloader
- scraper
- youtube-downloader
Repository Index
78,850 visible repositories in the index
97–120 of 328 · Most stars
Code samples from the book Web Scraping with Python http://shop.oreilly.com/product/0636920034391.do
Jobs scraper library for LinkedIn, Indeed, Glassdoor, ZipRecruiter, Bayt, Naukri, BDJobs & HelloWork
- indeed
- ziprecruiter
- jobs-scraper
A library that scrapes Linkedin for user data
- linkedin-scraper
- scraper
- profile
An agentic extractor for messaging platforms. Noria receives messages & URLs via chat; scrapes web data to evaluate the content against custom scoring matrices (e.g., jobs, scholarships); and sends a structured summary with a calculated match score directly to the assigned messenger number.
- ai-agent
- automation
- data-extraction
- event-driven-architecture
TranslatedPython web crawler tutorial that takes you from zero to one, covering JS reverse engineering, Selenium, Tesseract OCR recognition, the use of MongoDB, and the Scrapy framework
Mechanize is a ruby library that makes automated web interaction easy.
- scraping
- web
- ruby
Toutatis is a tool that allows you to extract information from instagrams accounts such as e-mails, phone numbers and more
- information-gathering
- osint
- osint-tools
- open-source-intelligence
Datascraper that is currently adult focused - Updated regularly
- onlyfans
- datascraping
- scraper
- archive
Open-source MCP server for LinkedIn. Give Claude and any MCP-compatible AI agent access to profiles, companies, jobs, and messages.
- linkedin-scraper
- mcp
- mcp-server
Lightweight, scriptable browser as a service with an HTTP API
Professional-grade, local-first browser extension that transforms any webpage into high-fidelity, LLM-friendly Markdown entirely within the browser's runtime. Zero-cloud, privacy-centric, and designed specifically for AI workflows.
- ai-workflows
- browser-extension
- chrome-extension-
- clipboard-api
DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
- crawler
- dotnetcore
- cross-platform
- csharp
持续维护的新浪微博采集工具🚀🚀🚀
- scrapy
- python
- weibospider
Web scraper for NodeJS
🔮 A Node.js scraper for humans.
- scraper
- node-scraper
- web-scraping
Snoop — инструмент разведки на основе открытых данных (OSINT world)
- osint
- termux
- username-search
- username-checker
This GitHub repo is a powerhouse collection of scraping APIs for developers that you can start using immediately to build everything from simple automations to full-scale applications.
- api-library
- api-list
- scraping-api
- developer-api
Google Maps Scraper & Lead Generation Tool. Extract 50+ data points including business emails, phone numbers, and social profiles. Includes enrichment features, API access, and a generous free plan with 200 searches/month.
- google-maps-scraping
- google-maps
- google-maps-api
- google-maps-review
Open-source web scraping API. Turn any website into clean markdown or structured JSON. Anti-detect browser, proxy auto-selection, self-hosted. One command: make up
Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, tokens and more
- endpoints
- endpoint-discovery
- bugbounty
- crawler
Emby/Jellyfin 的一个日本电影刮削器插件，可以从某些网站抓取影片信息。
- emby
- jav-scraper
- jav
- plugin
A list of practical knowledge-building projects.
- programming
- projects
- python
- web-scraper
🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单，功能强大的Python爬虫框架。内置AirSpider、Spider、TaskSpider、BatchSpider四种爬虫解决不同场景的需求。且支持断点续爬、监控报警、浏览器渲染、海量数据去重等功能。更有功能强大的爬虫管理系统feaplat为其提供方便的部署及调度