FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
- deepseek-v4
- edge
- glm
- inference
Repository Index
81,588 visible repositories in the index
25–48 of 240 · Most stars
Qwen3-Coder is the code version of Qwen3, the large language model series developed by Qwen team.
Supercharge Your LLM Application Evaluations 🚀
- llm
- llmops
- evaluation
TranslatedChatGLM2-6B: An Open Bilingual Chat LLM
- chatglm
- chatglm-6b
- large-language-models
- llm
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
- gpt-2
- adaptation
- language-model
- gpt-3
[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.
🍌 World's largest Nano Banana Pro prompt library — 10,000+ curated prompts with preview images, 16 languages. Google Gemini AI image generation. Free & open source.
- gemini-ai
- nano-banana-pro
- prompt-engineering
- awesome
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
TranslatedChatGLM3 series: Open Bilingual Chat LLMs
💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows
- python
- search
- nlp
- semantic-search
The all-in-one, open-source backend platform for agentic coding. InsForge gives your coding agent database, auth, storage, compute, hosting, and AI gateway to ship full-stack apps end-to-end.
Capture first. Organize later. A local-first Markdown app that turns scattered records into clear notes with AI.
PaddleFormers is an easy-to-use library of pre-trained large language model zoo based on PaddlePaddle.
- model
Access large language models from the command-line
An open-source, tool-augmented conversational language model from Fudan University
- chatgpt
- deep-learning
- dialogue-systems
- large-language-models
A command-line productivity tool powered by AI large language models like GPT-5, will help you accomplish your tasks faster and more efficiently.
Kimi K2 is the large language model series developed by Moonshot AI team
https://arxiv.org/abs/2606.28344. The end of web parsing. The beginning of scalable pixel-native search. link: https://pixelrag.ai/
Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
- bloom
- deep-learning
- distributed-systems
- language-models
🚀 World's largest GPT Image 2 prompt library, updated daily — 2000+ curated prompts with preview images, 16 languages. OpenAI's next-gen image model with pixel-perfect text rendering, cross-image consistency, and commercial-grade illustration. Free & open source.
- ai-image-generation
- ai-prompts
- awesome
- awesome-list
An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)
High-speed Large Language Model Serving for Local Deployment