Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"
- transformers
- pre-training
- vision-and-language
- pytorch
142,187 visible repositories in the index
73–94 of 94 · Most stars
Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"
PhoGPT: Generative Pre-training for Vietnamese (2023)
DNABERT: pre-trained Bidirectional Encoder Representations from Transformers model for DNA-language in genome
Pre-trained Transformers for Arabic Language Understanding and Generation (Arabic BERT, Arabic GPT2, Arabic ELECTRA)
72.8% MobileNetV2 1.0 model on ImageNet and a spectrum of pre-trained MobileNetV2 models
The Hailo Model Zoo includes pre-trained models and a full building and evaluation environment
The PyTorch implementation of Generative Pre-trained Transformers (GPTs) using Kolmogorov-Arnold Networks (KANs) for language modeling
[CVPR 2022] Pre-Training 3D Point Cloud Transformers with Masked Point Modeling
MEAL V2: Boosting Vanilla ResNet-50 to 80%+ Top-1 Accuracy on ImageNet without Tricks. In NeurIPS 2020 workshop.
The repository of ET-BERT, a network traffic classification model on encrypted traffic. The work has been accepted as The Web Conference (WWW) 2022 accepted paper.
Supervision Exists Everywhere: A Data Efficient Contrastive Language-Image Pre-training Paradigm
Word2vec, Fasttext, Glove, Elmo, Bert, Flair pre-train Word Embedding
[ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
[NeurIPS 2020] "Graph Contrastive Learning with Augmentations" by Yuning You, Tianlong Chen, Yongduo Sui, Ting Chen, Zhangyang Wang, Yang Shen
Efficient Training (including pre-training and fine-tuning) for Big Models
:fire: Use pre-trained models in PyTorch to extract vector embeddings for any image
🎉 PILOT: A Pre-trained Model-Based Continual Learning Toolbox
BERTweet: A pre-trained language model for English Tweets (EMNLP-2020)
Scaling in Games: Continued Pre-Training for Embodied Agents in Diverse Virtual Worlds. Weights on Hugging Face.
BlueBERT, pre-trained on PubMed abstracts and clinical notes (MIMIC-III).
An open-source codebase for exploring autonomous driving pre-training
Pathology Language and Image Pre-Training (PLIP) is the first vision and language foundation model for Pathology AI (Nature Medicine). PLIP is a large-scale pre-trained model that can be used to extract visual and language features from pathology images and text description. The model is a fine-tuned version of the original CLIP model.