Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, sglang, llama.cpp and other custom engines) and model-agnostic. Currently shipping Qwen3.8-27B Qwen3.6 35B Gemma 4 26B Gemma 4 31B configs for 1×/2×/4x/8x cards.
Repository Index
78,351 visible repositories in the index
529–552 of 890 · Most stars
🤗 Evaluate: A library for easily evaluating machine learning models and datasets.
- evaluation
- machine-learning
Docker configuration for running VLLM on dual DGX Sparks
Leaked GPTs Prompts Bypass the 25 message limit or to try out GPTs without a Plus subscription.
- ai
- awesome
- awesome-list
- gpts
Machine learning metrics for distributed, scalable PyTorch applications.
- python
- data-science
- machine-learning
- pytorch
A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.
Implementation of my RAG system that won all categories in Enterprise RAG Challenge 2
A simple, performant, and scalable Jax LLM!
Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, ChatGLM, ChatGLM2, ChatGLM3 etc. 开源大模型的统一后端接口
💬 RasaGPT is the first headless LLM chatbot platform built on top of Rasa and Langchain. Built w/ Rasa, FastAPI, Langchain, LlamaIndex, SQLModel, pgvector, ngrok, telegram
Reproduce R1 Zero on Logic Puzzle
τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.
- agent
- anthropic-api
- apple-silicon
- claude-code
the terminal client for LLMs
This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai, Zeqiu Wu, Yizhong Wang, Avirup Sil, and Hannaneh Hajishirzi.
Seamlessly integrate LLMs as Python functions
Automatic Video Generation from Scientific Papers
⭐️ NLP Algorithms with transformers lib. Supporting Text-Classification, Text-Generation, Information-Extraction, Text-Matching, RLHF, SFT etc.
- nlp
- text-classification
- text-matching
- information-extraction
The official CLI for Agentic Document Extraction (ADE) by LandingAI — parse documents and extract schema-shaped data from your terminal
AssetOpsBench - Industry 4.0: A unified benchmark and framework for building, orchestrating, and evaluating domain-specific AI agents for Industry 4.0 asset operations and maintenance, with 460+ scenarios, 5 specialist agents (IoT, FMSR, TSFM, Work Order,...), and multi-agent orchestration blueprints (MetaAgent, AgentHive) over MCP.
- llm-agents
- model-context-protocol
- time-series-forecasting
- condition-based-maintenance
Build tested agent skills and govern their lifecycle through a user-defined marketplace: evidence, discovery, updates, rollback, quarantine, and 17-platform distribution.
Olive: Simplify ML Model Finetuning, Conversion, Quantization, and Optimization for CPUs, GPUs and NPUs.
State-of-the-art Image & Video CLIP, Multimodal Large Language Models, and More!
Doing simple retrieval from LLM models at various context lengths to measure accuracy