Supercharge Your LLM Application Evaluations 🚀
- llm
- llmops
- evaluation
47,133 repositories indexed
97–120 of 337 · Most stars
Supercharge Your LLM Application Evaluations 🚀
Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view
Replace 'hub' with 'ingest' in any GitHub URL to get a prompt-friendly extract of a codebase
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).
Structured Outputs
The Cloud Native AI Platform
stable diffusion webui colab
Train your AI self, amplify you, bridge the world
TranslatedChatGLM2-6B: An Open Bilingual Chat LLM
Convert documentation websites, GitHub repositories, and PDFs into Claude AI skills with automatic conflict detection
Experiential is the open source, zero markup gateway for BYOK, self-hosted and 1000+ marketplace models. It learns from your traffic to cut costs, recommend better models, and train a specialized model you own.
GUI for ChatGPT API and many LLMs. Supports agents, file-based QA, GPT finetuning and query with web search. All with a neat UI.
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
A theoretical reconstruction of the Claude Mythos architecture, built from first principles using the available research literature.
Unified framework for building enterprise RAG pipelines with small, specialized models
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
FauxPilot - an open-source alternative to GitHub Copilot server
Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D avatar running locally across platforms
Sub-50mb agentic, voice and vision intelligence for consumer devices.
A framework for few-shot evaluation of language models.
A very simple framework for state-of-the-art Natural Language Processing (NLP)
Question and Answer based on Anything.
structured outputs for llms
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"