High Performance Serving Runtime For Interactive Super Intelligence System
Repository Index
111,821 visible repositories in the index
409–432 of 872 · Most stars
An Emacs web feeds client
Proof of Inference - Trustless AI verification
Vitis AI is Xilinx’s development stack for AI inference on Xilinx hardware platforms, including both edge devices and Alveo cards.
media streaming framework and teleconferencing system written in rust
- rust
- rust-lang
- zoom
- actix-web
:banana:Spring+SpringMVC+Mybatis+easyUI实现简单的后台管理系统
Let's simplify the way we write Lisp
🛠 A command-line system information utility written in PowerShell. Like Neofetch, but for Windows.
High-performance, privacy-first on-device AI inference library for React Native, powered by PyTorch's ExecuTorch runtime
- computer-vision
- executorch
- llm-inference
- object-detection
Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
This course is designed to guide beginners through the exciting world of Edge AI, covering fundamental concepts, popular models, inference techniques, device-specific applications, model optimization, and the development of intelligent Edge AI agents.
《阿里云前端技术周刊》
Infer TS types from JSON schemas 📝
- json-schema
- typescript
- json
- type
A native macOS AI chat app powered by MLX. 100% local inference on Apple Silicon, no cloud required. Built with ShipSwift.
- app
- klee
- self-hosted
- apple-silicon
High-performance data-driven data specification library for Clojure/Script.
- clojure
- clojurescript
- validation
- modelling
Learn LLM internals step by step - from tokenization to attention to inference optimization.
- attention-is-all-you-need
- attention-mechanism
- large-language-models
- learn-llm
Router that virtually distributes inference across connected devices in the home.
Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX.
- agents
- calibration
- classification
- decision-making
Inference Microsoft Florence2 VLM
Frontend for https://confs.tech
- conference
- javascript-conferences
- ruby-conferences
- python-conferences
Pure C inference of Mistral Voxtral Realtime 4B speech to text model
Official PyTorch inference for Breeze TTS 2
Python package for compiling and analyzing quantum algorithms to simulate electronic structures.
- quantum-computing
- quantum-chemistry
- quantum-algorithms
- quantum-programming-language
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.