learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen
- course
- large-language-model
- llm
- python
Repository Index
68,261 visible repositories in the index
793–816 of 2,676 · Most stars
Keeping track of companies that "care about your data 🥺"
- android
- bootloader
- bootloader-unlock
- honor
Robust recipes to align language models with human and AI preferences
- llm
- rlhf
- transformers
Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.
A framework for serving and evaluating LLM routers - save LLM costs without compromising quality
TranslatedA Bob plugin for LLM-based text translation, text polishing, and grammar correction. Let's welcome a new era that doesn't need the Tower of Babel together! Licensed under CC BY-NC-SA 4.0
ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.
- mlops
- machine-learning
- data-science
- production-ready
Notebooks for learning deep learning
Skill that audits and rewrites content to remove AI writing patterns. Use it with your favorite agents including Claude Code, OpenClaw, Codex, and Hermes.
- ai-writing
- claude
- claude-code
- llm
TranslatedPostman Chinese localized version
- postman
- chinese
TranslatedAwesome Pretrained Chinese NLP Models, a collection of high-quality Chinese pretrained models, large models, multimodal models, and large language models
- chinese
- nlp
- pretrained-models
- bert
PHP Secure Communications Library
Real-time webcam demo with SmolVLM and llama.cpp server
The repository host gives no description.
- elasticsearch
- admin
A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
3D Visualization of an GPT-style LLM
An AI-powered custom node for ComfyUI designed to enhance workflow automation and provide intelligent assistance
Search-R1: An Efficient, Scalable RL Training Framework for Reasoning & Search Engine Calling interleaved LLM based on veRL
A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.
134+ free LLM APIs & AI API keys from 40+ providers. Google Gemini, NVIDIA NIM, Groq, OpenRouter & more. One-click setup for Claude Code, Cursor and Codex.
- freellm
- freellmapi
- free-llm-api
- free-llm-resources
📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉
- flash-attention
- paged-attention
- tensorrt-llm
- vllm
A collection of prompts, system prompts and LLM instructions
Edit Banana: A framework for converting statistical formats into editable.
🛡️ BLA (Blind LLM Agents) — Adversarial defense shield that protects binaries, Electron apps, JS bundles, Python, and WebAssembly against AI reverse-engineering agents like REA. Poison -> Exhaust -> Hallucinate.
- adversarial-ai
- claude-code
- cursor
- electron-security