Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
- python
- fine-tuning
- gguf
- huggingface
86,576 visible repositories in the index
97–120 of 656 · Most stars
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
🚀 An awesome list of curated Nano Banana pro prompts and examples. Your go-to resource for mastering prompt engineering and exploring the creative potential of the Nano banana pro(Nano banana 2) AI image model.
An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)
Jev-like family of decision models built on top of Qwen3.5/3.8 you can train and run on your own
High-speed Large Language Model Serving for Local Deployment
LangChain for Go, the easiest way to write LLM-based programs in Go
Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.
An Application Framework for AI Engineering
~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encrypted.
Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!
An AI-powered search engine with a generative UI
Curated prompts, frameworks and papers for LLMs and agents, with an engineering bias. Prompt engineering, context engineering, agent harnesses, red teaming.
KAG is a logical form-guided reasoning and retrieval framework based on OpenSPG engine and LLMs. It is used to build logical reasoning and factual Q&A solutions for professional domain knowledge bases. It can effectively overcome the shortcomings of the traditional RAG vector similarity calculation model.
slime is an LLM training framework for RL Scaling.
The GEP-powered self-evolving engine for AI agents. Auditable evolution with Genes, Capsules, and Events. | evomap.ai
Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code
A Datacenter Scale Distributed Inference Serving Framework
Open Source Deep Research Alternative to Reason and Search on Private Data. Written in Python.
TranslatedA demo site for Microsoft New Bing built with Vue3 and Go, with a consistent UI experience, support for ChatGPT prompts, and usable in China.
An amazing UI for OpenAI's ChatGPT (Website + Windows + MacOS + Linux)
Use your locally running AI models to assist you in your web browsing
TranslatedBELLE: Be Everyone's Large Language model Engine (open-source Chinese conversational large language model)
Awesome curated collection of images and prompts generated by GPT-4o and gpt-image-1. Explore AI generated visuals created with ChatGPT and Sora, showcasing OpenAI’s advanced image generation capabilities.
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.