Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
- nlp
- pre-trained-model
- unilm
- minilm
142,187 visible repositories in the index
1–24 of 94 · Most stars
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
TranslatedChinese LLaMA & Alpaca LLMs + local CPU/GPU training and deployment
PaddleFormers is an easy-to-use library of pre-trained large language model zoo based on PaddlePaddle.
The official GitHub page for the survey paper "A Survey of Large Language Models".
[ECCV 2024] Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"
Silero VAD: pre-trained enterprise-grade Voice Activity Detector
TranslatedPre-Training with Whole Word Masking for Chinese BERT (Chinese BERT-wwm series models)
Easy-to-use image segmentation library with awesome pre-trained model zoo, supporting wide-range of practical tasks in Semantic Segmentation, Interactive Segmentation, Panoptic Segmentation, Image Matting, 3D Segmentation, etc.
GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)
Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷
Official Implementation of OCR-free Document Understanding Transformer (Donut) and Synthetic Document Generator (SynthDoG), ECCV 2022
Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
Segmentation models with pretrained backbones. Keras and TensorFlow Keras.
An Open-Source Framework for Prompt-Learning.
Pre-trained Deep Learning models and demos (high quality and extremely fast)
TranslatedChinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard
TorchGeo: datasets, samplers, transforms, and pre-trained models for geospatial data
A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型
OpenMMLab Pre-training Toolbox and Benchmark
Top2Vec learns jointly embedded topic, document and word vectors.
Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo
A TensorFlow implementation of Google's Tacotron speech synthesis with pre-trained model (unofficial)
A training framework for Stable Baselines3 reinforcement learning agents, with hyperparameter optimization and pre-trained agents included.
RoBERTa中文预训练模型: RoBERTa for Chinese