newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
- python
- news
- crawler
- crawling
Repository Index
47,133 repositories indexed
1–14 of 14 · Most stars
Download pictures (or videos) along with their captions and other metadata from Instagram.
- instagram-client
- instagram-feed
- downloader
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
- web-scraping
- text-extraction
- nlp
- html2text
SEO Tools for Laravel
- php
- opengraph
- meta-tags
- opengraph-tags
File Attachment toolkit for Ruby applications
- file-upload
- ruby
- rack
- storage
💪 User-generated content for Git-powered websites
- static-site-generator
- jekyll
- hugo
- middleman
:rocket: An open source alternative to searx which provides a modern-looking :sparkles:, lightning-fast :zap:, privacy respecting :disguised_face:, secure :lock: meta search engine
- meta-search-engine
- rust
- search-engine
- fast
Ruby gem for web scraping purposes. It scrapes a given URL, and returns you its title, meta description, meta keywords, links, images...
C++ Reflection Parser / Runtime Skeleton
- cmake
- libclang
- c-plus-plus
- meta
Modern IRC Client for the web, desktop and mobile.
A lightweight, efficient Ruby gem for interacting with Whatsapp Cloud API.
- ruby
- ruby-gem
- whatsapp-api
Turn any website into clean, structured data: Markdown, metadata and links from one page or a whole site, in every major language.
- crawling
- csharp
- elixir
- ffi
Upload and manage your assets in the iTunes Store using the iTunes Store’s Transporter (iTMSTransporter).
- ruby
- itunes
- app-store
- movies
Setup meta for your Prember/Ember blog to support opengraph, microdata, Facebook, Twitter, Slack etc.
- prember
- meta
- opengraph