Repository Index

Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ languages, with a router that picks the right checkpoint per request.

• calibration
• classification
• decision-model
• huggingface

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

• gpt-2
• adaptation
• language-model
• gpt-3

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

• nlp
• embedding
• bert
• ernie

🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP

• bert
• sentence-encoding
• deep-learning
• clip-model

TranslatedPre-Training with Whole Word Masking for Chinese BERT (Chinese BERT-wwm series models)

• chinese-bert
• tensorflow
• pytorch
• bert

Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://casl-project.ai/

• machine-learning
• natural-language-processing
• tensorflow
• deep-learning

A BERT model for scientific text.

• bert
• nlp
• scientific-papers

DNABERT: pre-trained Bidirectional Encoder Representations from Transformers model for DNA-language in genome

• kmer
• dnabert-model
• kmer-format
• gpu

BlueBERT, pre-trained on PubMed abstracts and clinical notes (MIMIC-III).

• bert
• bert-model
• natural-language-processing
• pubmed

Translated斑海豹 (Spotted Seal) — Phocinae-Largha-150M-v1: a 144.3M bilingual decision model. Tiny model. Big decisions.

• bilingual
• calibration
• cpu-inference
• decision-making

Cryptographic Dataset Generation & Modelling Framework

• cryptography
• deep-learning
• deep-neural-networks
• machine-learning

Plan and train German transformer models.

• transformer
• huggingface
• bert
• roberta

Code and data for the paper "Evaluating German Transformer Language Models with Syntactic Agreement Tests" (Zaczynska et al., 2020)

• bert
• transformers
• syntactic-agreement
• german