A high-throughput and memory-efficient inference and serving engine for LLMs
Repository Index
132,241 visible repositories in the index
1–24 of 315 · Most stars
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
- fine-tuning
- llama
- llm
- peft
SGLang is a high-performance serving framework for large language models and multimodal models.
Python packaging and dependency management made easy
- python
- dependency-manager
- package-manager
- packaging
Turn (almost) any Python command line program into a full GUI application with one line
How Python does AI. Agents, realtime voice, image generation, embeddings. Every model, every interface, typed end to end.
- agent-framework
- pydantic
- python
- genai
Unofficial Python API and agentic skill for Google Gemini Notebook. Full programmatic access to Gemini Notebook's features—including capabilities the web UI doesn't expose—via Python, CLI, and AI agents like Claude Code, Codex, and OpenClaw.
- python
- sdk
- skills
- google-notebooklm
Translated🤖 DIY-able multimodal AI chatbot | 🚀 Quickly connects to chat platforms such as WeChat, QQ, Telegram, and more | 🦈 Supports DeepSeek, Grok, Claude, Ollama, Gemini, OpenAI | Workflow system, web search, AI image generation, persona tuning, virtual maid, voice conversation |
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
- deepseek-v4
- edge
- glm
- inference
The repository host gives no description.
Automatic headphone equalization from frequency responses
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).
Nuitka is a Python compiler written in Python. It's fully compatible with Python 2.6, 2.7, 3.4-3.14. You feed it your Python app, it does a lot of clever things, and spits out an executable or extension module.
- python-compiler
- python
- nuitka
- programming
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
[CVPR 2023] SadTalker:Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation
- audio-driven-talking-face
- cvpr2023
- talking-head
- deep-fake
Transparent proxy server that works as a poor man's VPN. Forwards over ssh. Doesn't require admin. Works with Linux and MacOS. Supports DNS tunneling.
TranslatedLeave the dailies to March 7th, and keep the Trailblaze for yourself. An open-source automation assistant for "Honkai: Star Rail".
- honkai-star-rail
- star-rail
- march7thassistant
AI Observability & Evaluation
- llmops
- ai-monitoring
- ai-observability
- llm-eval
Python bindings for FFmpeg - with complex filtering support
code for Data Science From Scratch book
This is a python API which allows you to get the transcript/subtitles for a given YouTube video. It also works for automatically generated subtitles and it does not require an API key nor a headless browser, like other selenium based solutions do!
Easy-to-use,Modular and Extendible package of deep-learning based CTR models .
- ctr
- click-through-rate
- deep-learning
- factorization-machines
🚴 Call stack profiler for Python. Shows you why your code is slow!
VITS: Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speech