AI-powered StartUp Accelerator Engine built with Next.js, LangChain, PostgreSQL + pgvector. Upload, organize, and chat with documents. Includes predictive missing-document detection, role-based workflows, and page-level insight extraction.
Repository Index
110,088 visible repositories in the index
73–88 of 88 · Most stars
Tosint is a Telegram OSINT tool that extracts actionable intelligence from bot tokens and chat IDs for security investigations.
A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data from HTML (server & client-side rendered). It places particular emphasis on ease of use and a high level of readability by providing an intuitive DSL. It aims to be a testing lib, but can also be used to scrape websites in a convenient fashion.
- skrape
- dom
- parse
- kotlin
Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.
- xquery
- xml
- html
- json
Extracts information about web pages, like youtube videos, twitter statuses or blog articles.
- php
- embed
- oembed
- opengraph
Extract structured data from web sites. Web sites scraping.
- golang
- golang-library
- extract-data
- chrome-fetcher
An Elixir library for parsing and extracting data from HTML and XML with CSS or XPath selectors.
Readability is Elixir library for extracting and curating articles.
- readability
- webpage
- parser
- elixir
Local-first web & document ingestion engine in Rust — HTTP/browser capture, layout-aware PDF/Office/OCR parsing, persistent sync, and verifiable data graphs.
- ai-agents
- browser-automation
- data-extraction
- firecrawl
Z-Hound — a CSV-first collector that finds public threat reports and extracts structured IoCs without a database, LLM, or API key.
This project is simply a demonstration of how to obtain the Pair Extraordinaire Badge in an authentic, genuine, and up-to-date way
- automation
- github-achievements
- github-actions
- javascript
Extract URLs to stylesheets, scripts, links, images or HTML imports from HTML
Extract web archive data using Wayback Machine and Common Crawl
- golang
- crawler
- commoncrawl
- wayback-machine
A robust web archive analytics toolkit
- python
- web
- warc
- bigdata
Search the web and primary sources, read full pages, and check every citation. MCP server for Claude, Cursor, Codex and more. Runs on your machine.
Webpage summary extractor using Facebook Open Graph and arc90's readability
- readability
- scraper
- opengraph