newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
- python
- news
- crawler
- crawling
108,094 visible repositories in the index
25–48 of 557 · Most stars
newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
A little like that j-thing, only in Go.
Build voice agents with open-source models
A deployment automation tool built on Ruby, Rake, and SSH.
Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)
A cross-platform GUI automation Python module for human beings. Used to programmatically control the mouse & keyboard.
TranslatedDistributed web crawler admin platform for spiders management regardless of languages and frameworks.
Translated:orange_book: Chinese Xinhua Dictionary database. Includes xiehouyu (two-part allegorical sayings), idioms, words, and Chinese characters.
Moshi is a speech-text foundation model and full-duplex spoken dialogue framework. It uses Mimi, a state-of-the-art streaming neural audio codec.
TranslatedBackend service for xiaozhi-esp32, helps you quickly build an ESP32 device control server.
High-performance browser automation bridge and multi-instance orchestrator with advanced stealth injection and real-time dashboard.
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract structured data with LLMs via Pydantic AI, or control the browser in natural language with Stagehand. Works with BeautifulSoup, Parsel, Playwright, and raw HTTP. Download HTML, PDF, images, and other files. Proxy rotation included.
Enterprise-grade, commercial-friendly agentic workflow platform for building next-generation SuperAgents.
TranslatedWeChat all-platform .NET SDK, Senparc.Weixin for C#, supporting .NET Framework, .NET Core, and .NET 10.0. Already supports all platforms including WeChat Official Accounts, Mini Programs, Mini Games, WeChat Pay, WeCom (Enterprise WeChat)/Enterprise Accounts, Open Platform, JSSDK, and WeChat peripherals. WeChat SDK for C#.
Android Full-Stack Device Control Platform: WebRTC/H.264 remote desktop, UI/OCR/image-matching automation, one-click MITM, built-in Frida, proxy/VPN/frp/P2P networking, MCP/Agent, 160+ APIs, designed for multi-device clusters and engineered deployments.
This is a python API which allows you to get the transcript/subtitles for a given YouTube video. It also works for automatically generated subtitles and it does not require an API key nor a headless browser, like other selenium based solutions do!
scrape data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place
✨ The all-contributors bot website and documentation. Recognize all contributors, not just the ones who push code ✨
🔥 Open Source Browser API for AI Agents & Apps. Steel Browser is a batteries-included browser sandbox that lets you automate the web without worrying about infrastructure.
TranslatedGet the real streaming URLs (live stream sources) and danmaku (live comments) of 58 live streaming platforms, including Douyu, Huya, Bilibili, Douyin, and Kuaishou. The live stream sources can be played in players such as PotPlayer and flv.js.
bridge between mattermost, IRC, gitter, xmpp, slack, discord, telegram, rocketchat, twitch, ssh-chat, zulip, whatsapp, keybase, matrix, microsoft teams, nextcloud, mumble, vk and more with REST API (mattermost not required!)
Pholcus is a distributed high-concurrency crawler software written in pure golang
The first open-source agent skills builder. Define skills by vibe workflow, run on Claude Code, Cursor, Codex & more. Build Clawdbot 🦞· APIs for Lovable · Bots for Slack & Lark/Feishu · Skills are infrastructure, not prompts.
💯 Teach puppeteer new tricks through plugins.