47,133 repositories indexed
1–24 of 64 · Most stars
🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/PDFs and LLMs. Supports 100+ languages.
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Join our Discord https://discord.gg/VuxzM8mtf
Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows.
A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.
Python scraper based on AI
Replace 'hub' with 'ingest' in any GitHub URL to get a prompt-friendly extract of a codebase
newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
PyMuPDF is a high performance Python library for data extraction, analysis, conversion & manipulation of PDF (and other) documents.
Plumb a PDF for detailed information about each char, rectangle, line, et cetera — and easily extract text and tables.
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
Python Audio Analysis Library: Feature Extraction, Classification, Segmentation and Applications
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
PyInstaller Extractor
FLARE Obfuscated String Solver - Automatically extract obfuscated strings from malware.
Module for automatic summarization of text documents and HTML pages.
Malware Configuration And Payload Extraction
pySLAM is a hybrid Python/C++ Visual SLAM pipeline supporting monocular, stereo, and RGB-D cameras. It provides a broad set of modern local and global feature extractors, multiple loop-closure strategies, a volumetric reconstruction module, integrated depth-prediction models, and semantic segmentation capabilities for enhanced scene understanding.
Deep neural network to extract intelligent information from invoice documents.
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
Feature engineering and selection open-source Python library compatible with sklearn.
Semantic segmentation on aerial and satellite imagery. Extracts features such as: buildings, parking lots, roads, water, clouds
What's in your data? Extract schema, statistics and entities from datasets