LLM(😽)
- information-extraction
- llm
- natural-language
- natural-language-processing
132,241 visible repositories in the index
49–72 of 131 · Most stars
LLM(😽)
🦆 Contextually-keyed word vectors
A fast, efficient universal vector embedding utility package.
WikiChat is an improved RAG. It stops the hallucination of large language models by retrieving data from a corpus.
ExtractThinker is a Document Intelligence library for LLMs, offering ORM-style interaction for flexible and powerful document workflows.
Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration
Easily deployable and scalable backend server that efficiently converts various document formats (pdf, docx, pptx, html, images, etc) into Markdown. With support for both CPU and GPU processing, it is Ideal for large-scale workflows, it offers text/table extraction, OCR, and batch processing with sync/async endpoints.
OpenOCR: An Open-Source Toolkit for General-OCR Research and Applications, integrates a unified training and evaluation benchmark, commercial-grade OCR and Document Parsing systems, and faithful reproductions of the core implementations from a wide range of academic papers.
Colivara is a suite of services that allows you to store, search, and retrieve documents based on their visual embedding. ColiVara has state of the art retrieval performance on both text and visual documents. using vision models instead of chunking and text-processing for documents. No OCR, no text extraction, no broken tables, or missing images.
Evaluation code for various unsupervised automated metrics for Natural Language Generation.
Pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE)
Multilingual word vectors in 78 languages
Loki: Open-source solution designed to automate the process of verifying factuality
DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. 🤖💤
Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo
A Framework for Speech, Language, Audio, Music Processing with Large Language Model
This Word Does Not Exist
⚕️GenAI powered multi-agentic medical diagnostics and healthcare research assistance chatbot. 🏥 Designed for healthcare professionals, researchers and patients.
Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A
Open source project for data preparation for GenAI applications
RAG-Fusion: multi-query generation + Reciprocal Rank Fusion for better retrieval-augmented generation. Includes evaluation harness with NFCorpus/BEIR.
Transform unstructured documents into validated, rich and queryable knowledge graphs.
FacTool: Factuality Detection in Generative AI
Local-first, open-source AI assistant for your data. Unify tasks, notes, docs, photos, and bookmarks. Private, self-hosted, and extensible via APIs.