A curated list of awesome papers related to pre-trained models for information retrieval (a.k.a., pretraining for IR).
- pretraining-for-ir
- dense-retrieval
- bert-for-ir
- information-retrieval
142,187 visible repositories in the index
121–142 of 142 · Most stars
A curated list of awesome papers related to pre-trained models for information retrieval (a.k.a., pretraining for IR).
The first-ever vast natural language processing benchmark for Indonesian Language. We provide multiple downstream tasks, pre-trained IndoBERT models, and a starter code! (AACL-IJCNLP 2020)
Word2vec, Fasttext, Glove, Elmo, Bert, Flair pre-train Word Embedding
[ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
[NeurIPS 2020] "Graph Contrastive Learning with Augmentations" by Yuning You, Tianlong Chen, Yongduo Sui, Ting Chen, Zhangyang Wang, Yang Shen
:sunrise:The code of post "Image retrieval using MatconvNet and pre-trained imageNet"
Efficient Training (including pre-training and fine-tuning) for Big Models
:fire: Use pre-trained models in PyTorch to extract vector embeddings for any image
🎉 PILOT: A Pre-trained Model-Based Continual Learning Toolbox
BERTweet: A pre-trained language model for English Tweets (EMNLP-2020)
Scaling in Games: Continued Pre-Training for Embodied Agents in Diverse Virtual Worlds. Weights on Hugging Face.
BlueBERT, pre-trained on PubMed abstracts and clinical notes (MIMIC-III).
Multi-label Classification with BERT; Fine Grained Sentiment Analysis from AI challenger
Collection of awesome parameter-efficient fine-tuning resources.
iPython notebook and pre-trained model that shows how to build deep Autoencoder in Keras for Anomaly Detection in credit card transactions data
An open-source codebase for exploring autonomous driving pre-training
GuwenBERT: 古文预训练语言模型(古文BERT) A Pre-trained Language Model for Classical Chinese (Literary Chinese)
Implementations, Pre-training Code and Datasets of Large Time-Series Models
Pathology Language and Image Pre-Training (PLIP) is the first vision and language foundation model for Pathology AI (Nature Medicine). PLIP is a large-scale pre-trained model that can be used to extract visual and language features from pathology images and text description. The model is a fine-tuned version of the original CLIP model.
Official repo for CellPLM: Pre-training of Cell Language Model Beyond Single Cells.
Repository for paper scMulan: a multitask generative pre-trained language model for single-cell analysis.
An example of CoreML using a pre-trained VGG16 model