A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.
Repository Index
77,353 visible repositories in the index
1–24 of 24 · Most stars
🦉 Data Versioning and ML Experiments
- data-science
- machine-learning
- reproducibility
- data-version-control
Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
- deep-learning
- document-parsing
- machine-learning
- nlp
Refine high-quality datasets and visual AI models
LLM-Driven Extraction of Unstructured Data — Built for API Deployments & ETL Pipeline Workflows
- ai-agents
- data-engineering
- document-ai
- generative-ai
Neo4j graph construction from unstructured data using LLMs
- data-import
- genai
- graph
- graph-rag
Extrapolating knowledge graphs from unstructured text using GPT-3 🕵️♂️
- gpt-3
- knowledge-graph
Hypergraph is more powerful. Transform unstructured text into structured knowledge with LLMs. Graphs, hypergraphs, and spatio-temporal extractions — with one command.
A system for agentic LLM-powered data processing and ETL
Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.
- machine-learning
- convolutional-networks
- embedding-vectors
- embeddings
A large collection of system log datasets for AI-driven log analytics [ISSRE'23]
- logs
- unstructured-logs
- log-analysis
- log-parsing
The Context Layer for unstructured data: typed, versioned datasets over S3, GCS, Azure
- claude-code
- codex
- data-processing
- harness-engineering
Dealing with all unstructured data, such as reverse image search, audio search, molecular search, video analysis, question and answer systems, NLP, etc.
- milvus
- unstructured-data
- image-search
- audio-search
syslog-ng is an enhanced log daemon, supporting a wide range of input and output methods: syslog, unstructured text, queueing, SQL & NoSQL.
- syslog-ng
- c
- python
- elastic
🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building versatile AI-first applications
- unstructured-data
- low-code
- developer-tools
- etl
Extract structured data and insights from documents using LLMs and decision models
- ai
- data-extraction
- document-intelligence
- generative-ai
An on-premises, OCR-free unstructured data extraction, markdown conversion and benchmarking toolkit. (https://idp-leaderboard.org/)
- document
- document-analysis
- extraction
- llms
Nomic Developer API SDK
- python
- clustering
- duplicate-detection
- embeddings
Fast and efficient unstructured data extraction. Written in Rust with bindings for many languages.
- extraction
- tika
- unstructured
A curated list of resources for Document Understanding (DU) topic
- awesome-list
- machine-learning
- information-extraction
- key-information-extraction
visual data prep powered by python
- data
- data-pipelines
- etl
- structured-data
Marshmallow provides a flexible and performant JSON unmarshalling in Go. It specializes in dealing with unstructured struct - when some fields are known and some aren't, with zero performance overhead nor extra coding needed.
- go
- golang
- json
- performance
Quick Solution with Unstructured JSON data
- golang
- go
- json
µjson - A fast and minimal JSON parser and transformer that works on unstructured JSON
- json
- parser
- minimal
- performance