🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Repository Index
47,133 repositories indexed
1–14 of 14 · Most stars
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Join our Discord https://discord.gg/VuxzM8mtf
newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
PyMuPDF is a high performance Python library for data extraction, analysis, conversion & manipulation of PDF (and other) documents.
Python Audio Analysis Library: Feature Extraction, Classification, Segmentation and Applications
Module for automatic summarization of text documents and HTML pages.
Feature engineering and selection open-source Python library compatible with sklearn.
:speech_balloon: SpeechPy - A Library for Speech Processing and Recognition: http://speechpy.readthedocs.io/en/latest/
:sound: spafe: Simplified Python Audio Features Extraction
Extract knowledge from all information sources using gpt and other language models. Index and make Q&A session with information sources.
PDF extraction that audits its own output — and certifies any other extractor's, catching pages they silently dropped. Verify signed manifests offline: free, MIT, no account. 0.903 on opendataloader-bench, #2 of 8 engines. 7-tool MCP server.
AI-powered platform for OSINT intelligence analysis. Features archive discovery with hypothesis-driven investigation, GLiNER entity extraction, Mapbox geospatial visualization, network analysis, and document processing. Built with FastAPI, Next.js, Weaviate, and DSPy.
AI-Driven Full-Text Screening and Data Extraction for Systematic Reviews and Evidence Synthesis
A lightweight Python package for teaching computational methods through art history. Extract and analyze artist-specific works from WikiArt with built-in visualizations. Designed for digital humanities and computational design courses. Features genre/style analysis, matplotlib integration, and pedagogical clarity over algorithmic complexity.