An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)
Repository Index
107,098 visible repositories in the index
25–48 of 145 · Most stars
Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.
Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!
Transformer Explained Visually: Learn How LLM Transformer Models Work with Interactive Visualization
- generative-ai
- gpt
- deep-learning
- langauge-model
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
- chatgpt
- deep-learning
- instruction-following
- language-model
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
- cuda-kernels
- deepspeed
- fastertransformer
- llm-inference
Stylish, intuitive and user-friendly prompts. Used by eslint, webpack, yarn, pm2, pnpm, RedwoodJS, FactorJS, salesforce, Cypress, Google Lighthouse, Generate, tencent cloudbase, lint-staged, gluegun, hygen, hardhat, AWS Amplify, GitHub Actions Toolkit, @airbnb/nimbus, and more! Please follow Enquirer's author: https://github.com/jonschlinkert
- prompt
- inquirer
- cli
- readline
Ingest, parse, and optimize any data format ➡️ from documents to multimedia ➡️ for enhanced compatibility with GenAI frameworks
- ingestion-api
- ocr
- omniparser
- parse-server
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
- artificial-intelligence
- attention-mechanisms
- deep-learning
- reinforcement-learning
Chinese version of GPT2 training code, using BERT tokenizer.
- transformer
- gpt-2
- chinese
- nlp
Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"
An open, programmable decision layer for models and compute.
- mixture-of-models
- semantic-router
- vllm
- ai-gateway
Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.
- chinese
- computer-vision
- multi-modal-learning
- nlp
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
- llama
- llamacpp
- llm-inference
- ollama-api
TranslatedMedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. Training medical large models, implementing incremental pre-training (PT), supervised fine-tuning (SFT), RLHF, DPO, ORPO, and GRPO.
MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
- llava
- llm
- mlx
- vision-transformer
A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines
Robust recipes to align language models with human and AI preferences
- llm
- rlhf
- transformers
Structured data extraction, instruction calling and agentic workflows with ML, LLM and Vision LLM
- machinelearning
- huggingface-transformers
- computer-vision
- llm
The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.
Translatedcube studio is an open-source, cloud-native, one-stop machine learning / deep learning / large model AI platform. It covers the full mlops algorithm pipeline, a computing power rental platform, online notebook development, drag-and-drop task flow pipeline orchestration, multi-machine multi-GPU distributed training, hyperparameter search, inference services with VGPU virtualization, edge computing, a labeling platform with automated labeling, SFT fine-tuning / reward model / reinforcement learning training for large models such as deepseek, multi-machine large model inference with vllm/ollama/mindie, a private knowledge base, and an AI model marketplace. It supports domestic Chinese CPUs/GPUs/NPUs and the Ascend ecosystem, supports RDMA, and supports distributed frameworks such as pytorch/tf/mxnet/deepspeed/paddle/colossalai/horovod/ray/volcano.
An Open-Source Framework for Prompt-Learning.
Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research
- chatgpt
- chatgpt-api
- gpt-3
- gpt-3-prompts
CISO Assistant is a one-stop-shop GRC platform for Risk Management, AppSec, Compliance & Audit, TPRM, BIA, Privacy, and Reporting. It supports 200+ global frameworks with automatic control mapping, including ISO 27001, NIST CSF, SOC 2, CIS, PCI DSS, NIS2, DORA, GDPR, HIPAA, CMMC, and more.
- compliance
- grc
- soc2
- gdpr