Web scraper for NodeJS
Repository Index
78,850 visible repositories in the index
73–96 of 221 · Most stars
🔮 A Node.js scraper for humans.
- scraper
- node-scraper
- web-scraping
Google Maps Scraper & Lead Generation Tool. Extract 50+ data points including business emails, phone numbers, and social profiles. Includes enrichment features, API access, and a generous free plan with 200 searches/month.
- google-maps-scraping
- google-maps
- google-maps-api
- google-maps-review
Open-source web scraping API. Turn any website into clean markdown or structured JSON. Anti-detect browser, proxy auto-selection, self-hosted. One command: make up
Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, tokens and more
- endpoints
- endpoint-discovery
- bugbounty
- crawler
Emby/Jellyfin 的一个日本电影刮削器插件，可以从某些网站抓取影片信息。
- emby
- jav-scraper
- jav
- plugin
A list of practical knowledge-building projects.
- programming
- projects
- python
- web-scraper
🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单，功能强大的Python爬虫框架。内置AirSpider、Spider、TaskSpider、BatchSpider四种爬虫解决不同场景的需求。且支持断点续爬、监控报警、浏览器渲染、海量数据去重等功能。更有功能强大的爬虫管理系统feaplat为其提供方便的部署及调度
A complete and versatile web scraper.
There was no free Dictionary API on the web when I wanted one for my friend, so I created one.
A Python module to bypass Cloudflare's anti-bot page.
- cloudflare
- anti-bot-page
- protected-page
- scrape
AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.
- aitools
- crawl
- scrape
- serp
Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js
- scrapy
- distributed
- webspider
- scrapyd
freehire — the open-source search engine for job seekers
- ats
- careers
- hiring
- job-aggregator
Free Trial Amazon Scraper API for extracting search, product, offer listing, reviews, question and answers, best sellers and sellers data.
- amazon-scraper
- amazon-scraping
- e-commerce-api
- web-scraping
Use Google News Scraper API to obtain the latest global news for your project, including a wide range of sources, headlines, URLs, and publication dates from the Google News platform.
- google-news-scraper
- google-scraper
- google-scraper-api
- news-scraper
Get account information, photos, videos, stories and comments.
- instagram-api
- instagram-php-scraper
- instagram-sdk
Scrape Facebook public pages without an API key
- scraping
- facebook-scraping
- facebook-scraper
A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama
Do you want to LEARN NEW STUFF for FREE? Don't worry, with the power of web-scraping and automation, this script will find the necessary Udemy coupons & enroll you for PAID UDEMY COURSES, ABSOLUTELY FREE!
新浪微博爬虫（Scrapy、Redis）
The process of extracting product data from Amazon using Python, including titles, ratings, prices, images, and descriptions.
- amazon
- amazon-scraper
- python
- web-scraper
Multifarious Scrapy examples. Spiders for alexa / amazon / douban / douyu / github / linkedin etc.
使用scrapy,redis, mongodb,graphite实现的一个分布式网络爬虫,底层存储mongodb集群,分布式使用redis实现,爬虫状态显示使用graphite实现