Repository Index

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

• gpt-2
• adaptation
• language-model
• gpt-3

Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）

• chinese-bert
• tensorflow
• pytorch
• bert

Plan and train German transformer models.

• transformer
• huggingface
• bert
• roberta