Readability is Elixir library for extracting and curating articles.
- readability
- webpage
- parser
- elixir
Repository Index
47,133 repositories indexed
121–144 of 226 · Most stars
A curated list of NLP resources for Hungarian
- nlp
- natural-language-processing
- text-mining
- information-retrieval
UnifiedArchive - an archive manager with unified interface for different formats (bundled with cli utility). Supports all formats with basic operations (reading, extracting and creation) and popular formats specific features (compression level, password-protection, comment)
- tar
- zip
- rar
- archives
Audio features extraction
Self-hosted web scraper, crawler and document parser for AI agents: URLs, PDFs with OCR and Office files to clean Markdown/JSON. Firecrawl- and Jina-compatible API, MCP server, agent endpoint, Python/Node SDKs. Single Rust binary.
- ai-agents
- browser-automation
- data-extraction
- firecrawl
LibXtract is a simple, portable, lightweight library of audio feature extraction functions.
'Packet Capture Forensic Evidence eXtractor' is a tool that finds and extracts files from packet capture files
Tool for extracting pages from pdf as images and text as strings.
- ghostscript
- imagemagick
- ruby
:wink: :cyclone: :strawberry: TextRank implementation in Golang with extendable features (summarization, phrase extraction) and multithreading (goroutine).
- go
- golang
- textrank
- summarization
Native library loader for extracting and loading native libraries from Java.
Run RSpec tests on multiple cores. Like parallel_tests but with incremental summarized output. Originally extracted from the Discourse and Rubygems source code.
- rspec
- parallel-tests
- ruby
A fast to develop, fast to run, Go based toolkit for ETL and feature extraction on Hadoop.
Open source Windows x64 PE packer and crypter. Compresses and encrypts executables with a custom virtual machine into a self extracting stub.
- compression
- packer
- pe-packer
- pe-compress
📜 A CLI toolkit for extracting and working with your digital history
- chronicle
- chronicle-etl
- personal-data
- etl
go-etl is a toolset for data extraction, transformation and loading.
Extract URLs to stylesheets, scripts, links, images or HTML imports from HTML
📦 Open, Search, Extract and Create VPKs in python
- valve
- valve-pak
- gcf
- steam
Extract structured variables from sass files
Extract web archive data using Wayback Machine and Common Crawl
- golang
- crawler
- commoncrawl
- wayback-machine
:mag: Data pipeline for crawling PDFs from the Web and transforming their contents into structured data using AWS textract. Built with AWS CDK + TypeScript
An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.
- archivespark
- spark-framework
- spark
- web-archiving
The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
Grunt task to extract & inline critical-path CSS from HTML
- critical-path
- critical-css
- above-the-fold
- grunt
A robust web archive analytics toolkit
- python
- web
- warc
- bigdata