Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
- nlp
- pre-trained-model
- unilm
- minilm
47,133 repositories indexed
1–7 of 7 · Most stars
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
The official GitHub page for the survey paper "A Survey of Large Language Models".
[ECCV 2024] Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"
TranslatedPre-Training with Whole Word Masking for Chinese BERT (Chinese BERT-wwm series models)
Scaling in Games: Continued Pre-Training for Embodied Agents in Diverse Virtual Worlds. Weights on Hugging Face.
Pathology Language and Image Pre-Training (PLIP) is the first vision and language foundation model for Pathology AI (Nature Medicine). PLIP is a large-scale pre-trained model that can be used to extract visual and language features from pathology images and text description. The model is a fine-tuned version of the original CLIP model.
Official repo for CellPLM: Pre-training of Cell Language Model Beyond Single Cells.