newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
- python
- news
- crawler
- crawling
Repository Index
47,133 repositories indexed
25–48 of 132 · Most stars
Peach: Local-first video metadata scraper and media manager.
- local-first
- media-library
- python
- self-hosted
Pythonic HTML Parsing for Humans™
Download pictures (or videos) along with their captions and other metadata from Instagram.
- instagram-client
- instagram-feed
- downloader
Incredibly fast crawler designed for OSINT.
Browser automation and testing without limits. SeleniumBase's CDP Mode bypasses bot-detection with ease. Check out the examples!
- python
- selenium-python
- e2e-testing
- seleniumbase
Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)
Scapy: the Python-based interactive packet manipulation program & library.
- scapy
- python
- network
- network-analysis
Translated:orange_book: Chinese Xinhua Dictionary database. Includes xiehouyu (two-part allegorical sayings), idioms, words, and Chinese characters.
- data
- scraper
- chinese-traditional
- python3
A monospaced programming font inspired by the Minecraft typeface
Linux/OSX/FreeBSD resource monitor
TranslatedPython scripts. Simulated login to Zhihu, web crawlers, working with Excel, WeChat official accounts, remote power-on
Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.
- python
- machine-learning
- natural-language-processing
- web-mining
Lighter web automation with Python
- selenium
- selenium-python
- python
- python3
Customisable coding font with alternates, ligatures and contextual positioning. Crazy crisp at 12px/9pt. http://larsenwork.com/monoid/
Democratizing Deep-Learning for Drug Discovery, Quantum Chemistry, Materials Science and Biology
- drug-discovery
- quantum-chemistry
- deep-learning
- biology
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
- web-scraping
- text-extraction
- nlp
- html2text
Simple Minecraft-inspired program using Python and Pyglet
Dark Web OSINT Tool
- tor
- tor-network
- deepweb
- dark-web
A community-driven, open-source project to share detection logic, adversary tradecraft and resources to make detection development more efficient.
- threat-hunting
- sysmon
- hunting-campaigns
- hypothesis
A Python module to bypass Cloudflare's anti-bot page.
- cloudflare
- anti-bot-page
- protected-page
- scrape
🦀 Jumper — an crab robot.
python parser for human readable dates
- hacktoberfest
Playwright that anti-bots cannot see, so no captchas: same API, anti-detect stealth headless Firefox, undetected fingerprint, bypass bot detection, Python web scraping and browser automation.
- datadome
- perimeterx
- akamai
- antidetect-browser