A scalable web crawler framework for Java.
Repository Index
142,187 visible repositories in the index
1–12 of 12 · Most stars
jsoup: the Java HTML parser, built for HTML editing, cleaning, scraping, and XSS safety.
Scrape Google AI Mode responses without blocks on a large scale.
- ai-mode
- google-ai
- google-ai-mode
- proxy-scrape
Easily collect responses from ChatGPT scraper by providing a prompt along with valid Web Scraper API credentials.
- chatgpt-api
- chatgpt-scraper
- llm-scraper
- chatgpt
Perplexity Scraper Track brand mentions, analyze rankings, and gain competitor intelligence from Perplexity. Get started in minutes.
- ai-scraper
- llm-api
- llm-scraper
- llm-scraping
历史学习项目:Spark 电影推荐、爬虫、Web 与后台。新版持续开发见 cinematch-recommender。
- spark-mllib
- spark-streaming
- ssm-maven
- scrapy
NewPipe's core library for extracting data from streaming sites
HTTP(S)/SOCKS5 rotating residential proxies - code examples & general information.
- proxy
- proxies
- https-proxy
- proxy-server
An object-oriented reverse engineered Instagram Private API in Java. Build bots, scrap data, create Instagram apps, and a lot more in very few lines of code
- instagram-api
- instagram-client
- instagram-java-scraper
Java API For Chrome and Firefox
Scrape XBMC and Kodi movie metadeta and automatically rename files for Japanese Adult Videos (JAV), American Adult DVDs, and American Adult Webcontent
eBay Scraper for extracting product titles, descriptions, prices, specifications, customer reviews, and ratings from eBay
- ebay
- ebay-api
- ebay-scraper
- python-web-scraper