Find secrets with Gitleaks 🔑
- security
- security-tools
- git
- golang
132,241 visible repositories in the index
25–48 of 748 · Most stars
Find secrets with Gitleaks 🔑
Faster Whisper transcription with CTranslate2
Distribute and run LLMs with a single file.
DeepInfer: High-performance, large-scale inference framework for DeepSeek models
Official inference repo for FLUX.1 models
TranslatedThis project aims to share the technical principles of large models and practical experience (large model engineering, large model application deployment).
Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.
DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm
ncnn is a high-performance neural network inference framework optimized for the mobile platform
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Run agents like Hermes, LangChain Deep Agents, and OpenClaw more securely inside NVIDIA OpenShell with managed inference
Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.
Inference Llama 2 in one file of pure C
The repository provides code for running inference with the Meta Segment Anything Model 2 (SAM 2), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.
Machine Learning Engineering Open Book
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
High-performance In-browser LLM Inference Engine
Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
Nano vLLM
:fire: An extremely fast, React-like JavaScript library for building modern user interfaces
Machine learning, in numpy
A static analyzer for Java, C, C++, and Objective-C