Repository Index

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

• nlp
• pre-trained-model
• unilm
• minilm

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

• nlp
• embedding
• bert
• ernie

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

State of the Art Natural Language Processing

• nlp
• natural-language-processing
• spark
• pyspark

Seamlessly integrate LLMs into scikit-learn.

• chatgpt
• deep-learning
• llm
• machine-learning

Pretrained model hub for Keras 3.

• deep-learning
• keras
• machine-learning
• nlp

An NLP library for Uralic languages such as Finnish, Skolt Sami, Moksha and so on. Also supporting some non-Uralic languages such as Spanish, French, Arabic, Swedish, Norwegian, Russian and English. LLMs, FSTs and More!

• nlp-library
• uralic-languages
• finnish
• sami