Repository Index

Efficient Triton Kernels for LLM Training

• llm-training
• triton
• finetuning
• gemma2

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

[ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

• llava
• llm
• mlx
• vision-transformer

Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.

• ai
• chain-of-thought
• collaboration
• dataset-generation

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/

• ai
• chatbot
• chatgpt
• fine-tuning

The simplest, fastest repository for training/finetuning small-sized VLMs.

CSGHub is a brand-new open-source platform for managing LLMs, developed by the OpenCSG team. It offers both open-source and on-premise/SaaS solutions, with features comparable to Hugging Face. Gain full control over the lifecycle of LLMs, datasets, and agents, with Python SDK compatibility with Hugging Face. Join us! ⭐️

• ai
• huggingface
• llm
• management-system

Easiest and laziest way for building multi-agent LLMs applications.

• llms
• ai-agent
• deep-learning
• langchain

OpenDeepWiki is the open-source version of the DeepWiki project, aiming to provide a powerful knowledge management and collaboration platform. The project is mainly developed using C# and TypeScript, supporting modular design, and is easy to expand and customize.

• chatgpt
• deepwiki
• docs
• fine-tuning

OML 1.0 via Fingerprinting: Open, Monetizable, and Loyal AI

• oml
• fine-tuning
• fingerprint
• loyalty

🦞 Just talk to your agent — it learns and EVOLVES 🧬.

• agent
• ai-agent
• fine-tuning
• llm

LLM-as-a-Verifier is a general-purpose framework that provides fine-grained feedback for any agent without requiring additional training. It achieves SOTA performance across coding, robotics, and medical agentic benchmarks.

OneTrainer is a one-stop solution for all your Diffusion training needs.

• fine-tuning
• lora
• training
• image-model-training

A local chatbot fine-tuned by bilibili user comments.

Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo

• bert
• pre-training
• fine-tuning
• gpt

A general fine-tuning kit geared toward image/video/audio diffusion models.

• diffusers
• diffusion-models
• fine-tuning
• flux-dev

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

• chatgpt
• visual-language-learning
• multi-modality
• foundation

Turn expensive prompts into cheap fine-tuned models

• ai
• llm
• llmops
• prompt-engineering

基于ChatGLM-6B、ChatGLM2-6B、ChatGLM3-6B模型，进行下游具体任务微调，涉及Freeze、Lora、P-tuning、全参微调等

• chatglm
• chatgpt
• freeze
• lora

streamline the fine-tuning process for multimodal models: PaliGemma 2, Florence-2, and Qwen2.5-VL

• captioning
• fine-tuning
• florence-2
• multimodal

Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)

• fine-tuning-llm
• large-language-models
• long-context
• llm

Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

• deep-learning
• fine-tuning
• gpt-2
• gpt-j

Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.

• deep-learning
• flax
• jax
• language-model