Repository Index

API Support for your favorite torrent trackers

• torrent
• torznab
• newznab
• rss

TranslatedAV movie management system, avmoo, javbus, javlibrary crawler, online AV movie library, AV magnet link database, Japanese Adult Video Library, Adult Video Magnet Links - Japanese Adult Video Database

• javbus
• avmoo
• javlibrary
• spider

Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.

• python
• machine-learning
• natural-language-processing
• web-mining

TranslatedHands-on 🐍 web crawlers for many kinds of websites and e-commerce data 🕷. Includes 🕸: Taobao products, WeChat official accounts, Dianping, Qichacha, job recruitment sites, Xianyu, Alibaba tasks, Cnblogs, Weibo, Baidu Tieba, Douban movies, Baotu (ibaotu.com), Quanjing (quanjing.com), Douban music, a provincial drug administration, Sohu News, machine learning text collection, FOFA asset collection, Autohome, National Bureau of Statistics, Baidu keyword indexed-page counts, spider pool directories, Toutiao (Today's Headlines), Douban movie reviews, Ctrip, Xiaomi App Store, Anjuke, Tujia homestays ❤️❤️❤️. WeChat crawler showcase project:

• python3
• crawler
• baidu-tieba
• taobao-spider

:sparkling_heart: High available distributed ip proxy pool, powerd by Scrapy and Redis

• high-availability
• scrapy
• ipproxy
• distributed

Datascraper that is currently adult focused - Updated regularly

• onlyfans
• datascraping
• scraper
• archive

job-ops: DevOps principles applied to job hunting. A self-hosted pipeline to track, analyze, and assist your application process

• automation
• self-hosted
• job-search
• jobhunt

Automatically crawls proxy nodes on the public internet, de-duplicates and tests for usability and then provides a list of nodes

• crawler
• proxypool

Emby/Jellyfin 的一个日本电影刮削器插件，可以从某些网站抓取影片信息。

• emby
• jav-scraper
• jav
• plugin

AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.

• aitools
• crawl
• scrape
• serp

Free Trial Amazon Scraper API for extracting search, product, offer listing, reviews, question and answers, best sellers and sellers data.

• amazon-scraper
• amazon-scraping
• e-commerce-api
• web-scraping

The process of extracting product data from Amazon using Python, including titles, ratings, prices, images, and descriptions.

• amazon
• amazon-scraper
• python
• web-scraper

A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.

• search-engine
• python
• scraping
• crawler

DecryptLogin: APIs for loginning some websites by using requests.

• requests
• login
• python3
• spider

Price tracker monitors of products and alerts you when prices drop. Supported tiki.vn, shopee, lotte.vn, ... Built with firebase https://pricetrack.web.app

• api
• redash
• tracking
• crawler

An app to search startup jobs scraped from websites written in Elixir, Phoenix, React and styled-components.

• elixir
• phoenix
• otp
• react

Take HTML Snapshots for your Angular, Ember, Durandal or any JavaScript applications

Dublin Bus API