LLM inference in C/C++
- ggml
Repository Index
56,638 visible repositories in the index
1–24 of 287 · Most stars
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
- llm-inference
- ai-chat
Port of OpenAI's Whisper model in C/C++
Self-hosted game stream host for Moonlight.
- game-streaming-server
- game-stream
- game-streaming
- remote-desktop
Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
DuckDB is a high-performance analytical database system
Official inference framework for 1-bit LLMs
Translated📚 This repository is a summary of the basic knowledge of recruiting job seekers and beginners in the direction of C/C++ technology, including language, program library, data structure, algorithm, system, network, link loading library, interview experience, recruitment, recommendation, etc.
- interview
- interview-questions
- interview-practice
- interview-preparation
Cross-platform, customizable ML solutions for live and streaming media.
- mediapipe
- c-plus-plus
- computer-vision
- deep-learning
Collection of various algorithms in mathematics, machine learning, computer science and physics implemented in C++ for educational purposes.
- cpp
- algorithm
- algorithms-implemented
- data-structures
FinceptTerminal is a modern finance application offering advanced market analytics, investment research, and economic data tools, designed for interactive exploration and data-driven decision-making in a user-friendly environment.
- bloomberg-terminal
- finance
- financial-markets
- investment
SRS is a simple, high-performance, AI-driven real-time media server supporting RTMP, WebRTC, HLS, HTTP-FLV, HTTP-TS, SRT, MPEG-DASH, and GB28181, with codec support for H.264, H.265, AV1, VP9, AAC, Opus, and G.711.
Cloud-native high-performance edge/middle/service proxy
- cats
- rocket-ships
- cars
- more-cats
Open Source alternative to Algolia + Pinecone and an Easier-to-Use alternative to ElasticSearch ⚡ 🔍 ✨ Fast, typo tolerant, in-memory fuzzy Search Engine for building delightful search experiences
- search-engine
- search
- typo-tolerance
- site-search
[Unofficial] qBittorrent Enhanced, based on qBittorrent
- bittorrent
- bittorrent-client
Distribute and run LLMs with a single file.
- cross-platform
- gguf
- llama-cpp
- local-ai
A modern formatting library
- formatting
- printf
- output
- chrono
ncnn is a high-performance neural network inference framework optimized for the mobile platform
ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
An unidentifiable mechanism that helps you bypass GFW.
- china
- censorship-circumvention
- anticensorship
- gfw
A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.
- gbdt
- gbm
- machine-learning
- data-mining
An efficient, small mobile key-value storage framework developed by WeChat. Works on Android, iOS, macOS, Windows, POSIX, and OHOS.
Open source simulator for autonomous vehicles built on Unreal Engine / Unity, from Microsoft AI & Research
- drones
- ai
- self-driving-car
- autonomous-vehicles
Wazuh - The Open Source Security Platform. Unified XDR and SIEM protection for endpoints and cloud workloads.
- security
- compliance
- log-analysis
- vulnerability-detection