TranslatedAV movie management system, avmoo, javbus, javlibrary crawler, online AV movie library, AV magnet link database, Japanese Adult Video Library, Adult Video Magnet Links - Japanese Adult Video Database
- javbus
- avmoo
- javlibrary
- spider
Repository Index
78,351 visible repositories in the index
49–72 of 327 · Most stars
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract structured data with LLMs via Pydantic AI, or control the browser in natural language with Stagehand. Works with BeautifulSoup, Parsel, Playwright, and raw HTTP. Download HTML, PDF, images, and other files. Proxy rotation included.
- apify
- automation
- beautifulsoup
- crawler
Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.
- python
- machine-learning
- natural-language-processing
- web-mining
Python Script to download hundreds of images from 'Google Images'. It is a ready-to-run code!
- python
- python-script
- image-download
- google-images
The open-source, privacy-friendly CAPTCHA you host yourself. Bots and AI agents out, people in.
- captcha
- javascript
- proof-of-work
- antispam
This GitHub repo is a powerhouse collection of APIs you can start using immediately to build everything from simple automations to full-scale applications. One of the most valuable API lists on GitHub—period. 💪
Lighter web automation with Python
- selenium
- selenium-python
- python
- python3
List of libraries, tools and APIs for web scraping and data processing.
- web-scraping
- captcha-bypass
- captcha-recaptcha
- crawling
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
scrape data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place
- golang
- google-maps-scraping
- web-scraper
- web-scraping
Official Firecrawl MCP server, the context API for AI agents: search, scrape, and interact with the web, plus parse, crawl, map, Agent and Monitor, from any MCP client.
- batch-processing
- claude
- content-extraction
- data-collection
Tabula is a tool for liberating data tables trapped inside PDF files
TranslatedThe essence edition of getting started with web crawlers in Python
A collection of awesome web crawler,spider in different languages
A Chrome DevTools Protocol driver for web automation and scraping.
- cdp
- chrome-headless
- chrome-devtools
- chrome-devtools-protocol
🔥 The fastest and powerful Python library for Instagram Private API 2026 with HikerAPI SaaS
- instagram-api
- instagram-client
- instagram-downloader
Pydoll is a library for automating chromium-based browsers without a WebDriver, offering realistic interactions.
- cdp
- chromium
- playwright
- puppeteer
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
- web-scraping
- text-extraction
- nlp
- html2text
🚀 Free HTTP, SOCKS4, & SOCKS5 proxy list * Updated every 5 minutes * and rotating proxy API (100+ countries)
- proxies
- proxy-list
- socks5
- free-proxy
Turn any webpage into structured data using LLMs
Python binding for curl-impersonate fork via cffi. A http client that can impersonate browser tls/ja3/http2 fingerprints.
- curl
- http-client
- curl-impersonate
- http
A Python module to bypass Cloudflare's anti-bot page.
- cloudflare
- cloudflare-bypass
- cloudflare-scrape
- anti-bot-page
The Unofficial TikTok API Wrapper In Python
- tiktok-api
- python
- api
- trending
A cross-platform Electron Desktop App to stream and download any Movie, TV Series or Anime in the World. Zero Ads and Tracking
- anime
- anime-downloader
- anime-scraper
- downloader