Sign in

Repository Index

47,133 repositories indexed

Filters (1)

Filters

Clear all filters

1–24 of 76 · Most stars

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.