Repository Index

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

• gpt-2
• adaptation
• language-model
• gpt-3

TranslatedPre-Training with Whole Word Masking for Chinese BERT (Chinese BERT-wwm series models)

• chinese-bert
• tensorflow
• pytorch
• bert

Plan and train German transformer models.

• transformer
• huggingface
• bert
• roberta