LLM inference in C/C++
- ggml
Repository Index
74,860 visible repositories in the index
1–24 of 67 · Most stars
Port of OpenAI's Whisper model in C/C++
Tensor library for machine learning
KoboldCpp - Run GGUF AI models locally with a KoboldAI UI. One File. Zero Install.
Unsupervised text tokenizer for Neural Network-based text generation.
- neural-machine-translation
- natural-language-processing
- word-segmentation
Reliable & unreliable messages over UDP. Robust message fragmentation & reassembly. P2P networking / NAT traversal. Encryption.
- reliable-messages
- networking
- game-development
- realtime-messaging
Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.
Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,Minimax H3,...) inference in pure C/C++
- ai
- cplusplus
- diffusion
- ggml
🎛 🔊 A Python library for audio.
- vst3
- vst3-host
- python
- juce
A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.
- fast-data-pipeline
- image-augmentation
- data-augmentation
- image-processing
Console-based GLSL Sandbox for 2D/3D shaders
- shaders
- fragment-shader
- c-plus-plus
- opengl-es
Cyberpunk 2077 tweaks, hacks and scripting framework
- cyberpunk
- cyberpunk2077
Caffe: a fast open framework for deep learning.
- object-detection
- semantic-segmentation
- deep-learning
- real-time
An OBS plugin for removing background in portrait images (video), making it easy to replace the background when recording or streaming.
- obs
- obs-plugin
- libobs
- mac-osx
TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts. TNN has been deployed in multiple Apps from Tencent, such as Mobile QQ, Weishi, Pitu, etc. Contributions are welcome to work in collaborative with us and make TNN a better framework.
- deep-learning
- mnn
- ncnn
- inference
Fast and beautiful note-taking app written in C++. Write down your thoughts.
An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice conversion, music generation, and more, with highly optimized performance. No Python dependency.
- ai
- amd-gpu
- apple-silicon
- asr
open Structure-fom-Motion and Multi-View Stereo reconstruction library
- multi-view-stereo
- 3d-reconstruction
- point-cloud
- stereo-reconstruction-library
百度NLP：分词，词性标注，命名实体识别，词重要性
- word-segmentation
- part-of-speech-tagger
- named-entity-recognition
- chinese-word-segmentation
Open-source data modeling tool designed for PostgreSQL. No more typing DDL commands. Let pgModeler do the work for you!
- c-plus-plus
- entity-relationship-diagram
- ddl-commands
- sql-standards
校招、秋招、春招、实习好项目！带你从零实现一个高性能的深度学习推理库，支持大模型 llama2 、Unet、Yolov5、Resnet等模型的推理。Implement a high-performance deep learning inference library step by step
- inference
- inference-engine
- deep-learning
- deep-neural-networks
A modern high-performance open source message queuing system
A tensorflow implementation of EAST text detector
- tensorflow
- text-detection
- deep-learning
- ocr
A cross-platform video structuring (video analysis) framework based on CV models & mLLM.