A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
Repository Index
67,762 visible repositories in the index
25–48 of 339 · Most stars
Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services
The finest Windows Optimizer
- windows-10
- windows
- windows-8
- windows-8-1
Ceph is a distributed object, block, and file storage platform
GUI for ChatGPT API and many LLMs. Supports agents, file-based QA, GPT finetuning and query with web search. All with a neat UI.
- chatbot
- chatgpt-api
- chatglm
- claude
A powerful tool for creating datasets for LLM fine-tuning 、RAG and Eval
- dataset
- javascript
- llm
- fine-tuning
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
Image augmentation for machine learning experiments.
- image-augmentation
- machine-learning
- augmentation
- deep-learning
Self-evolving agent: grows skill tree from 3.3K-line seed, achieving full system control with 6x less token consumption
- ai-agent
- automation
- autonomous-agent
- browser-automation
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
Defines a common protocol for language servers.
Go ahead and axolotl questions
The ultimate training toolkit for finetuning diffusion models
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
- llm
- llmops
- model-inference
- fine-tuning
The repository provides code for running inference and finetuning with the Meta Segment Anything Model 3 (SAM 3), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.
BISHENG is an open-source enterprise Agent platform for building, deploying, and managing AI applications. It combines AI agents, workflows, RAG and knowledge management, desktop agent integration, and vibecoding app hosting with unified model management, evaluation, observability, access control, and enterprise administration.
OpenRefine is a free, open source power tool for working with messy data and improving it
- datacleansing
- data-analysis
- java
- opendata
Low-code framework for building custom LLMs, neural networks, and other AI models
The AI developer platform. Use Weights & Biases to train and fine-tune models, and manage models from experimentation to production.
- machine-learning
- experiment-track
- deep-learning
- keras
Refine high-quality datasets and visual AI models
QLoRA: Efficient Finetuning of Quantized LLMs
PHP_CodeSniffer tokenizes PHP files and detects violations of a defined set of coding standards.
- php
- coding-standards
- automation
- cli
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
- bloom
- deep-learning
- distributed-systems
- language-models
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
- python
- fine-tuning
- gguf
- huggingface