TranslatedPython API for JMComic | Provides a Python API for accessing 禁漫天堂 (JMComic), supporting both the web and mobile clients | 禁漫天堂 (JMComic) GitHub Actions downloader🚀
- 18comic
- crawler
- github-actions
- pypi
132,241 visible repositories in the index
25–48 of 248 · Most stars
TranslatedPython API for JMComic | Provides a Python API for accessing 禁漫天堂 (JMComic), supporting both the web and mobile clients | 禁漫天堂 (JMComic) GitHub Actions downloader🚀
✨ The all-contributors bot website and documentation. Recognize all contributors, not just the ones who push code ✨
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
Pholcus is a distributed high-concurrency crawler software written in pure golang
The AI local media metadata crawler
🔥 The fastest and powerful Python library for Instagram Private API 2026 with HikerAPI SaaS
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
Web Crawler/Spider for NodeJS + server-side jQuery ;-)
TranslatedA WeChat official account crawler interface based on Sogou WeChat search
TranslatedHands-on 🐍 web crawlers for many kinds of websites and e-commerce data 🕷. Includes 🕸: Taobao products, WeChat official accounts, Dianping, Qichacha, job recruitment sites, Xianyu, Alibaba tasks, Cnblogs, Weibo, Baidu Tieba, Douban movies, Baotu (ibaotu.com), Quanjing (quanjing.com), Douban music, a provincial drug administration, Sohu News, machine learning text collection, FOFA asset collection, Autohome, National Bureau of Statistics, Baidu keyword indexed-page counts, spider pool directories, Toutiao (Today's Headlines), Douban movie reviews, Ctrip, Xiaomi App Store, Anjuke, Tujia homestays ❤️❤️❤️. WeChat crawler showcase project:
Redis-based components for Scrapy.
Distributed crawler powered by Headless Chrome
The go-to web for your AI coding agent — local-first search, fetch, crawl & research over MCP. No API keys, no cloud, $0/query. Public beta.
:sparkling_heart: High available distributed ip proxy pool, powerd by Scrapy and Redis
Dark Web OSINT Tool
Simple, fast web crawler designed for easy, quick discovery of endpoints and assets within a web application
:zap: A distributed crawler for weibo, building with celery and requests.
TranslatedSina Weibo crawler: uses Python to crawl Sina Weibo data and download Weibo images and Weibo videos
Open Source Web Crawler for Java
Download comics novels 小说漫画下载工具 小説漫画のダウンローダ 小說漫畫下載:腾讯漫画 大角虫漫画 有妖气 咪咕 SF漫画 哦漫画 看漫画 漫画柜 汗汗酷漫 動漫伊甸園 快看漫画 微博动漫 733动漫网 大古漫画网 漫画DB 無限動漫 動漫狂 卡推漫画 动漫之家 动漫屋 古风漫画网 36漫画网 亲亲漫画网 乙女漫画 webtoons 咚漫 ニコニコ静画 ComicWalker ヤングエースUP モアイ pixivコミック サイコミ;アルファポリス カクヨム ハーメルン 小説家になろう 起点中文网 八一中文网 顶点小说 落霞小说网 努努书坊 笔趣阁→epub.
A list of AI agents and robots to block.
Proxy [Finder | Checker | Server]. HTTP(S) & SOCKS :performing_arts:
DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
Automatically crawls proxy nodes on the public internet, de-duplicates and tests for usability and then provides a list of nodes