This is a project that unifies the management of LLM APIs. It can call multiple backend services through a unified API interface, convert them to the OpenAI format uniformly, and support load balancing. Currently supported backend services include: OpenAI, Anthropic, DeepBricks, OpenRouter, Gemini, Vertex, etc.
Repository Index
132,241 visible repositories in the index
73–96 of 142 · Most stars
NativeMind: Your fully private, open-source, on-device AI assistant
The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on AI applications.
AI Group is a powerful mobile intelligent assistant application that integrates multiple large language models (LLMs) and AI services, providing you with a convenient intelligent interaction experience.
The repository host gives no description.
A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for various file types through textract.
- embedding-similarity
- embedding-vectors
- embeddings
- llama2
Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.
- android
- cpp
- edge-ai
- gguf
The most advanced, fully offline client-side AI suite on Android today.
- artificial-intelligence
- box
- gguf
- litert
maxxing the ability to run different LLMs on the smallest devices possible
Web UI for AutoGen (A Framework Multi-Agent LLM Applications)
- agent-based-framework
- chatgpt
- visualization
- ai
This suite of tools enables users to interact with AI services directly from their terminal.
jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.
[中文法律大模型] DISC-LawLLM: an intelligent legal system powered by large language models (LLMs) to provide a wide range of legal services.
- domain-llm
- legal-intelligence
- legal-llm
- nlp
Local-first, open-source AI assistant for your data. Unify tasks, notes, docs, photos, and bookmarks. Private, self-hosted, and extensible via APIs.
MCP Gateway is a reverse proxy and management layer for MCP servers, enabling scalable, session-aware stateful routing and lifecycle management of MCP servers in Kubernetes environments.
- gateway
- kubernetes
- mcp
- restful-api
Spark-x2.6 open model series. Pushing the Limits of Agentic Capabilities in On-Device Models
- agent
- huggingface
- llm
- modelscope
Running any GGUF SLMs/LLMs locally, on-device in Android
- android
- cpp
- ggml
- kotlin
workshop materials to build intelligent solutions on Open AI
- azure
- cognitive-services
- machine-learning
- openai
DISC-FinLLM,中文金融大语言模型(LLM),旨在为用户提供金融场景下专业、智能、全面的金融咨询服务。DISC-FinLLM, a Chinese financial large language model (LLM) designed to provide users with professional, intelligent, and comprehensive financial consulting services in financial scenarios.
- instruction-tuning
- tool-learning
- chain-of-retrieval
- financial-large-language-model
63 个 Claude Skills,为 A 股金融从业者而生 基于 Anthropic 官方 claude-for-financial-services 深度适配国内市场,现已开源。
OpenAI-compatible API server for Apple on-device models
Chat and Ask on your own data. Accelerator to quickly upload your own enterprise data and use OpenAI services to chat to that uploaded data and ask questions
Run full Kimi K3 on a single device. And an OpenAI-compatible API server for local chat and coding agents.
- kimi
- kimi-k3
- local-ai
- local-llm
A simple web application for a OpenAI-enabled document search. This repo uses Azure OpenAI Service for creating embeddings vectors from documents. For answering the question of a user, it retrieves the most relevant document and then uses GPT-3, GPT-3.5 or GPT-4 to extract the matching answer for the question.
- azureopenai