Sign in

Repository Index

89,572 visible repositories in the index

Tags: Model serving
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters

Filters

Clear all filters

1–14 of 14 · Most stars

Jev-like family of decision models built on top of Qwen3.5/3.8 you can train and run on your own

  • decision-model
  • jev
  • qwen3

Dockerized OpenAI-compatible wrapper for Kokoro-82M text-to-speech w/multiplatform CPU, AMD, NVIDIA GPU PyTorch; multi-speaker, clone-tuning, caption timestamps, SSML, websockets, optional readalong web UI

TranslatedOffline translation model server with low resource consumption, fast speed, and private deployment capability.

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.

Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali

  • llm
  • text-embeddings
  • bert-embeddings

MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environment and automates the delivery of production data, ML pipelines, and online applications.