Repository Index

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

• inference
• gpu
• machine-learning
• deep-learning

Low-latency local speech-to-speech voice assistant with Ming-3.0-audio-tiny on AMD and Nvidia GPUs. Easy setup on Windows and Linux

• amd
• local-llm
• radeon
• realtime