1.microsoft / LoRA
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
+79 stars
from 13,814 · score 4.38
Ranked by Attention Score: stars gained over the last 30 complete days
3 repositories by Attention Score · Oct 4, 2026 – Nov 2, 2026 (UTC)
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://casl-project.ai/