Sign in

Repository Index

47,133 repositories indexed

Filters (1)

Filters

Clear all filters

1–24 of 28 · Most stars

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

Training-free language model modification: Remove censorship, suppress slop, reduce sycophancy, and more

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

  • nlp
  • pre-trained-model
  • unilm
  • minilm

Janus-Series: Unified Multimodal Understanding and Generation Models

  • any-to-any
  • foundation-models
  • llm
  • multimodal

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

The official GitHub page for the survey paper "A Survey of Large Language Models".

  • chain-of-thought
  • chatgpt
  • in-context-learning
  • instruction-tuning

The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.

《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验

  • accelerator
  • ai-infra
  • ai-infrastructure
  • book

MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. 训练医疗大模型,实现了包括增量预训练(PT)、有监督微调(SFT)、RLHF、DPO、ORPO、GRPO。

An open-source document parsing model with SOTA accuracy and speed, using an RSI loop during post-training.

Turn any LLM into a Jev-style decision model: typed decisions, real probabilities, no training. (continue updating, welcome any issue and PR request)

  • calibration
  • decision-model
  • jev
  • jev-model