Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).
Repository Index
47,133 repositories indexed
25–48 of 62 · Most stars
Structured Outputs
- generative-ai
- llms
- prompt-engineering
- symbolic-ai
GUI for ChatGPT API and many LLMs. Supports agents, file-based QA, GPT finetuning and query with web search. All with a neat UI.
- chatbot
- chatgpt-api
- chatglm
- claude
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
structured outputs for llms
- openai
- python
- pydantic-v2
- openai-functions
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
TranslatedChatGLM3 series: Open Bilingual Chat LLMs
LangChain4j is an idiomatic, open-source Java library for building LLM-powered applications on the JVM. It offers a unified API over popular LLM providers and vector stores, and makes implementing tool calling (including MCP support), agents and RAG easy. It integrates seamlessly with enterprise Java frameworks like Quarkus and Spring Boot.
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
- gateway
- generative-ai
- llmops
- llms
Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
Access large language models from the command-line
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
- llm
- llmops
- model-inference
- fine-tuning
Retrieval and Retrieval-augmented LLMs
- embeddings
- information-retrieval
- llm
- sentence-embeddings
AI Observability & Evaluation
- llmops
- ai-monitoring
- ai-observability
- llm-eval
Low-code framework for building custom LLMs, neural networks, and other AI models
QLoRA: Efficient Finetuning of Quantized LLMs
Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement learning for Qwen3.6, GPT-OSS, Llama, and more!
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
- bloom
- deep-learning
- distributed-systems
- language-models
Run LLMs with MLX
- llms
- mlx
Artificial Intelligence Infrastructure-as-Code Generator.
An open source implementation of OpenAI's ChatGPT Code interpreter
The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.
- privacy-first
- gguf
- llama-cpp
- local-ai
Experimental toolkit for auto-generating codebase documentation using LLMs
- documentation-generator
- language-model
- cli-tool
- typescript
An open-source ChatGPT app with a voice