Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
Repository Index
132,241 visible repositories in the index
1–24 of 26 · Most stars
An easy to use PyTorch to TensorRT converter
- jetson-nano
- jetson-tx2
- jetson-xavier
- pytorch
A repository for storing models that have been inter-converted between various frameworks. Supported frameworks are TensorFlow, PyTorch, ONNX, OpenVINO, TFJS, TFTRT, TensorFlowLite (Float32/16/INT8), EdgeTPU, CoreML.
- tensorflow
- tensorflow-lite
- openvino
- edgetpu
The python library for real-time communication
- artificial-intelligence
- llm
- python
- real-time
A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion.
- yolox
- onnxruntime
- robustvideomatting
- mnn
Fast and exact implementation of the C++ from_chars functions for number types: 4x to 10x faster than strtod, part of GCC 12, MySQL, DuckDB, Chromium, Redis and WebKit/Safari
- cpp11
- cpp17
- cpp-library
- high-performance
Simple samples for TensorRT programming
(2020-2022)The PyTorch version of SiamFC,SiamRPN,DaSiamRPN, UpdateNet , SiamDW, SiamRPN++, SiamMask, SiamFC++, SiamCAR, SiamBAN, Ocean, LightTrack , TrTr, NanoTrack; Visual object tracking based on deep learning
- tracking
- deep-learning
- visual-tracking
Android client for ProjectRTC - a WebRTC demo
A TUTORIAL ON POINTERS AND ARRAYS IN C
Airymax AgentRT Transcend context limits. Achieve near-infinite memory.
腾讯云TRTC音视频服务,国内下载镜像:
Local and offline-first npm mirror
Build realtime AI voice agents using FastRTC for low-latency streaming, Superlinked for vector search, Twilio for live phone calls, and Runpod for scalable GPU deployment.
Real-time pose estimation accelerated with NVIDIA TensorRT
- human-pose-estimation
- human-pose
- tensorrt
- pytorch
WebRTC Live Streaming on nodeJS (+ android client !)
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.
- libtorch
- yolov5
- inference
- torchscript
Real Time Speech Transcription with FastRTC ⚡️and Local Whisper 🤗
TensorFlow models accelerated with NVIDIA TensorRT
- tensorflow
- tensorrt
- nvidia
- jetson
DetectRTC is a tiny JavaScript library that can be used to detect WebRTC features e.g. system having speakers, microphone or webcam, screen capturing is supported, number of audio/video devices etc. https://www.webrtc-experiment.com/DetectRTC/
- webrtc
- webrtc-demos
- webrtc-experiments
Fast function to parse strings into double (binary64) floating-point values, enforces the RFC 7159 (JSON standard) grammar: 4x faster than strtod
ROS2 TensorRT Node for Monocular Metric Depth estimation and Point Cloud generation from camera images with Depth Anything V3
- depth-anything-v3
- monocular-depth
- monocular-depth-estimation
- ros2
A job system for Swift backends.