A command-line productivity tool powered by AI large language models like GPT-5, will help you accomplish your tasks faster and more efficiently.
Repository Index
132,241 visible repositories in the index
1–22 of 22 · Most stars
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
- bloom
- deep-learning
- distributed-systems
- language-models
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
- cuda-kernels
- deepspeed
- fastertransformer
- llm-inference
AgentPilot: Make Your Agents Move Better and Faster
Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents. Up to 4× faster than Apple's MLX (mlx-lm) on the same weights.
- apple-silicon
- local-llm
- macos
- mlx
1M param OCR model - runs on CPU, 15x faster than tesseract, close to 1B+ param models in accuracy
Build and iterate on your UI 10x faster with AI - right from your own IDE ☕️
Your iPhone helps your Mac run a 27B model: faster prompt reading and more context over a USB-C cable
Open source guides/codes for mastering deep learning to deploying deep learning in production in PyTorch, Python, Apptainer, and more.
- pytorch
- deep-learning
- apptainer
- llamaindex
Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
- adan
- bert-model
- convnext
- deep-learning
KaliGPT: an Agentic AI (built with Gemini, ChatGPT, Ollama, OpenRouter Models) fine tuned for ethical hackers & students in offensive security making workflows smarter, faster, and more accessible.
- kali
- kali-scripts
- kali-tools
- kaligpt
Build your own X - Master machine learning by building everything from scratch. It aims to cover everything from linear regression to deep learning to large language models (LLMs).
- artificial-intelligence
- awesome-list
- build-your-own
- build-your-own-x
PatrickStar enables Larger, Faster, Greener Pretrained Models for NLP and democratizes AI for everyone.
Up to 4× faster LLM decoding on Apple Silicon, lossless. Native MLX port of DeepSeek's DSpark & z-lab's DFlash speculative decoding — Gemma-4, Qwen3.8, Muse-Glimmer, Nemotron, LFM2.5, Ornith-1.0, ternary Bonsai-27B.
- apple-silicon
- claude-code
- codex
- dflash2
Local AI talk with a custom voice based on Zephyr 7B model. Uses RealtimeSTT with faster_whisper for transcription and RealtimeTTS with Coqui XTTS for synthesis.
- chatbot
- python
- realtime
Faster than your agent alone. And better. A workflow plugin that takes a bug, idea or ticket to a verified pull request: specs, cross-model review by risk, live QA, receipts in your repo. Claude Code · Codex · Cursor · Droid · Grok Build · OpenCode · Muse Code.
- claude-code
- execution
- marketplace
- planning
Your personal AI assistant, running on your own computer. Long-running tasks, real memory, proactive help, voice, phones and smart glasses. Any model, local or cloud. No account.
Ollama for classical ML models. AOT compiler that turns XGBoost, LightGBM, scikit-learn, CatBoost & ONNX models into native C99 inference code. One command to load, one command to serve. 336x faster than Python inference.
- c99
- catboost
- compiler
- decision-trees
Transcribe and translate voice into LRC file using Whisper and LLMs (GPT, Claude, et,al). 使用whisper和LLM(GPT,Claude等)来转录、翻译你的音频为字幕文件。
- faster-whisper
- lyrics
- lyrics-generator
- openai-api
Library for faster pinned CPU <-> GPU transfer in Pytorch
- cpu-pinned-tensors
- pytorch-variables
- gpu-transfer
- cuda-variables
Human + AI music production workflow for Suno - skills, templates, and tools
- claude
- claude-code
- claude-code-plugin
- claude-code-plugin-marketplace
TranslatedAn AI avatar for real-time voice/text conversations with idols from "The iDOLM@STER Shiny Colors": original Japanese voice + Chinese subtitles, recalling the original story, memory shared across characters; supports Google/GitHub login and bring-your-own key, one-command deployment with Docker Compose (inspired by LAPLACE Eidolon)
- ai-companion
- character-ai
- fastapi
- idolmaster