A Datacenter Scale Distributed Inference Serving Framework
- diffusion
- disaggregated-serving
- kubernetes
- llm-inference
Repository Index
85,081 visible repositories in the index
121–144 of 777 · Most stars
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
- chatgpt
- deep-learning
- instruction-following
- language-model
An amazing UI for OpenAI's ChatGPT (Website + Windows + MacOS + Linux)
Use your locally running AI models to assist you in your web browsing
- chat-application
- chrome-extension
- open-source
- localllm
The first GitHub Copilot, Codeium and ChatGPT Xcode Source Editor Extension
- copilot
- xcode
- xcode-extension
- xcode-extensions
Awesome curated collection of images and prompts generated by GPT-4o and gpt-image-1. Explore AI generated visuals created with ChatGPT and Sora, showcasing OpenAI’s advanced image generation capabilities.
- ai-art
- awesome-list
- generative-art
- gpt-4o
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
- cuda-kernels
- deepspeed
- fastertransformer
- llm-inference
Ingest, parse, and optimize any data format ➡️ from documents to multimedia ➡️ for enhanced compatibility with GenAI frameworks
- ingestion-api
- ocr
- omniparser
- parse-server
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
- artificial-intelligence
- attention-mechanisms
- deep-learning
- reinforcement-learning
Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, Intel, or just a CPU.
A simple task management system for managing AI dev agents
A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.
The official repository for ERNIE 4.5 and ERNIEKit – its industrial-grade development toolkit based on PaddlePaddle.
- ernie
- erniekit
- llm
- vlm
Sweep: AI coding assistant for JetBrains
- ai
- code-assistant
- developer-tools
- github-app
Providing a free OpenAI GPT-4 API ! This is a replication project for the typescript version of xtekky/gpt4free
AI Product Design Agent - Open Source
ClawX is a desktop app that provides a graphical interface for OpenClaw AI agents. It turns CLI-based AI orchestration into a desktop experience without using the terminal. China website is https://clawx.com.cn.
Chinese version of GPT2 training code, using BERT tokenizer.
- transformer
- gpt-2
- chinese
- nlp
A pixel office for your OpenClaw: turn invisible work states into a cozy little space with characters, daily notes, and guest agents. Code under MIT; art assets for non-commercial learning only.
- agent-collaboration
- ai-assistant
- dashboard
- flask
NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
- agents
- guardrails
- python
- safety
Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
- gemma
- gpgpu
- llm
- local-ai
PDF GPT allows you to chat with the contents of your PDF file by using GPT capabilities. The most effective open source solution to turn your pdf files in a chatbot!
- pdfgpt
- chatpdf
- chatwithpdf
An APP that integrates mainstream large language models and image generation models, built with Flutter, with fully open-source code.
Postgres with GPUs for ML/AI apps.
- ml
- machine-learning
- ai
- ann