1.microsoft / LoRA
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
+482 stars
from 13,411 · score 6.18
Ranked by Attention Score: stars gained over the last 180 complete days
3 repositories by Attention Score · May 7, 2026 – Nov 2, 2026 (UTC)
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://casl-project.ai/