⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
- llama
- llamacpp
- llm-inference
- ollama-api
132,241 visible repositories in the index
1–9 of 9 · Most stars
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines
Structured data extraction, instruction calling and agentic workflows with ML, LLM and Vision LLM
中文nlp解决方案(大模型、数据、模型、训练、推理)
Simple UI for LLM Model Finetuning
Distributed training & inference for multimodal perception: shared embeddings across text, images, video, audio, code & graphs from 64 to 1024 dimensions 🖼️
Learn Cloud Applied Generative AI Engineering (GenEng) using OpenAI, Gemini, Streamlit, Containers, Serverless, Postgres, LangChain, Pinecone, and Next.js
Serverless LLM Serving for Everyone.
Extract knowledge from all information sources using gpt and other language models. Index and make Q&A session with information sources.