newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
- python
- news
- crawler
- crawling
Repository Index
47,133 repositories indexed
1–24 of 27 · Most stars
Download pictures (or videos) along with their captions and other metadata from Instagram.
- instagram-client
- instagram-feed
- downloader
Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)
A standalone version of the readability lib
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
- web-scraping
- text-extraction
- nlp
- html2text
File Attachment toolkit for Ruby applications
- file-upload
- ruby
- rack
- storage
A .NET library that converts cron expressions into human readable descriptions.
- cron
- cron-expression
- cron-libraries
- quartz
Open-source self-improving QA agent for software teams. A test harness with memory. Write tests in natural language for web and mobile. agent-qa learns from every run, adapts to UI changes, and catches regressions before you ship.
- playwright
- end-to-end-testing
- ai-testing
- ai-agents
An Adapter-based Bot Framework for Elixir Applications
- elixir
- otp
- xmpp
- bot
Browser automation engine benchmark - Test bypass rates, performance & stealth against Cloudflare, DataDome, reCAPTCHA, Kasada, Imperva, Akamai, PerimeterX and other bot detection systems. Find the best browser for scraping.
- anti-detect
- antidetect-browser
- automation
- browser
Slack Events API adapter for Python (Flask required)
- python
- slack
- slackapi
Scrape any website, article or RSS/Atom Feed with ease!
- scrape
- elixir
- readability
- rss
The type-safe, event-driven workflow orchestration library that scales with your business. Build robust, distributed workflows in Go with compile-time safety, automatic retries, and horizontal scaling out of the box. Integrate with your existing tech stack using adapters 🚀
- eventdrivenarchitecture
- golang
- kafka
- reflex
Modern IRC Client for the web, desktop and mobile.
Turn any website into clean, structured data: Markdown, metadata and links from one page or a whole site, in every major language.
- crawling
- csharp
- elixir
- ffi
Rust language bindings for Microsoft Playwright
- browser-automation
- playwright
- playwright-tests
- rust
Human-readable schedule expressions for .NET (C#): write "every day at 9am except sunday" instead of cron. Time zones, fluent builder, custom keywords, cron converter.
- cron
- csharp
- date-time
- dotnet
Hubot adapter for Telegram
- telegram-bot
- telegram
- hubot-adapter
- hubot
Upload and manage your assets in the iTunes Store using the iTunes Store’s Transporter (iTMSTransporter).
- ruby
- itunes
- app-store
- movies
Python/FastAPI application for monitoring Brazilian public-sector IT opportunities, with automated data collection, job filters, and official-source tracking.
software package for automation
- smart-home
- go
- golang
- smarthome
GPRbuild is an advanced build system designed to help automate the construction of multi-language systems.
Webpage summary extractor using Facebook Open Graph and arc90's readability
- readability
- scraper
- opengraph
Open Source & Self-hosted Spotify release tracker. Auto-syncs new releases to playlists and includes power-user utilities like a discography generator and ghost track cleaner.
- automation
- django
- django-rest-framework
- docker