[EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.
Repository Index
132,241 visible repositories in the index
25–48 of 144 · Most stars
Your Personal Librarian Agent. Ask anything on your computer, organize files, remember important info and files.
- document-parser
- embeddings
- llm
- open-source
Solve Visual Understanding with Reinforced VLMs
- deepseek-r1
- grpo
- llm
- multimodal
Democratizing Reinforcement Learning for LLMs
- agent-framework
- agentic-workflow
- distributed-training
- llm-training
The RL Bridge for LLM-based Agent Applications. Made Simple & Flexible.
- llm
- llm-reasoning
- machine-learning-systems
- mlsys
RLinf: Reinforcement Learning Infrastructure for Embodied and Agentic AI
- reinforcement-learning
- agentic-ai
- rlinf
- vla-rl
A Next-Generation Training Engine Built for Ultra-Large MoE Models
EasyR1: An Efficient, Scalable, Multi-Modality RL Training Framework based on veRL
A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)
Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI
- transformers
- text-classification
- named-entity-recognition
- question-answering
Hypergraph is more powerful. Transform unstructured text into structured knowledge with LLMs. Graphs, hypergraphs, and spatio-temporal extractions — with one command.
AdalFlow: The library to build & auto-optimize LLM applications.
The cross-harness, self-improving memory layer for AI agents. Join our community: https://discord.com/invite/zdNChS2fBu
- security-tools
- agent-ai-cli
- agent-security
- mobile-device-management
Open-source inference server and production cluster for all the models your agent needs.
MTEB: State-of-the-art evaluation of embeddings across languages and modalities
- benchmark
- clustering
- information-retrieval
- sentence-transformers
🦞 Just talk to your agent — it learns and EVOLVES 🧬.
An Efficient and User-Friendly Scaling Library for Reinforcement Learning with Large Language Models
- agentic
- rlhf
- rlvr
Miles is an enterprise-facing reinforcement learning framework for LLM and VLM post-training, forked from and co-evolving with slime.
A native macOS app that allows users to chat with a local LLM that can respond with information from files, folders and websites on your Mac without installing any other software. Powered by llama.cpp.
[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
- agent
- artificial-intelligence
- benchmark
- multimodal
Skywork-R1V is an advanced multimodal AI model series developed by Skywork AI, specializing in vision-language reasoning.
- deepseek-r1
- llm
- r1v
- reasoning
An open-source visual programming environment for battle-testing prompts to LLMs.
- ai
- evaluation
- large-language-models
- llmops
Infrastructure for the next generation of voice agents, designed to provide universal memory. It is divided into a left brain and a right brain, storing information and emotions respectively, while a fully streaming architecture eliminates latency at the fundamental level.
The code used to train and run inference with the ColVision models, e.g. ColPali, ColQwen2, and ColSmol.
- colpali
- information-retrieval
- retrieval-augmented-generation
- vision-language-model