newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
- python
- news
- crawler
- crawling
Repository Index
47,133 repositories indexed
1–24 of 26 · Most stars
Download pictures (or videos) along with their captions and other metadata from Instagram.
- instagram-client
- instagram-feed
- downloader
Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)
A standalone version of the readability lib
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
- web-scraping
- text-extraction
- nlp
- html2text
File Attachment toolkit for Ruby applications
- file-upload
- ruby
- rack
- storage
A .NET library that converts cron expressions into human readable descriptions.
- cron
- cron-expression
- cron-libraries
- quartz
An Adapter-based Bot Framework for Elixir Applications
- elixir
- otp
- xmpp
- bot
Ruby gem that fetches images and metadata from a given URL. Much like popular social website with link preview.
Scrape/Crawl article from any site automatically. Make any web page readable, no matter Chinese or English.
Scrape any website, article or RSS/Atom Feed with ease!
- scrape
- elixir
- readability
- rss
Readability is Elixir library for extracting and curating articles.
- readability
- webpage
- parser
- elixir
Modern IRC Client for the web, desktop and mobile.
Turn any website into clean, structured data: Markdown, metadata and links from one page or a whole site, in every major language.
- crawling
- csharp
- elixir
- ffi
Rust language bindings for Microsoft Playwright
- browser-automation
- playwright
- playwright-tests
- rust
Human-readable schedule expressions for .NET (C#): write "every day at 9am except sunday" instead of cron. Time zones, fluent builder, custom keywords, cron converter.
- cron
- csharp
- date-time
- dotnet
Hubot adapter for Telegram
- telegram-bot
- telegram
- hubot-adapter
- hubot
Upload and manage your assets in the iTunes Store using the iTunes Store’s Transporter (iTMSTransporter).
- ruby
- itunes
- app-store
- movies
Python/FastAPI application for monitoring Brazilian public-sector IT opportunities, with automated data collection, job filters, and official-source tracking.
software package for automation
- smart-home
- go
- golang
- smarthome
GPRbuild is an advanced build system designed to help automate the construction of multi-language systems.
Webpage summary extractor using Facebook Open Graph and arc90's readability
- readability
- scraper
- opengraph
Open Source & Self-hosted Spotify release tracker. Auto-syncs new releases to playlists and includes power-user utilities like a discography generator and ghost track cleaner.
- automation
- django
- django-rest-framework
- docker
atwSCADA — Free SCADA Software in a Single HTML File | IEC 61850, OPC UA, Modbus TCP | 53 Function Blocks, 65 Graphic Elements | No Installation | Download Free Demo
- digital-substation
- hmi
- iec61850
- industrial-automation