Awesome list for research on CLIP (Contrastive Language-Image Pre-Training).
- clip
- contrastive-learning
- pre-training
142,273 visible repositories in the index
73–96 of 142 · Most stars
Awesome list for research on CLIP (Contrastive Language-Image Pre-Training).
Pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE)
[ACL 2024] Official PyTorch code for extracting features and training downstream models with emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representation
:smiley_cat: Pretty & simple image classifier app template. Deploy your own trained model or pre-trained model (VGG, ResNet, Densenet) to a web app using Flask in 10 minutes.
Starter code to solve real world text data problems. Includes: Gensim Word2Vec, phrase embeddings, Text Classification with Logistic Regression, word count with pyspark, simple text preprocessing, pre-trained embeddings and more.
Official Repository for the Uni-Mol Series Methods
A curated list of NLP resources focused on Transformer networks, attention mechanism, GPT, BERT, ChatGPT, LLMs, and transfer learning.
Paddle.js is a web project for Baidu PaddlePaddle, which is an open source deep learning framework running in the browser. Paddle.js can either load a pre-trained model, or transforming a model from paddle-hub with model transforming tools provided by Paddle.js. It could run in every browser with WebGL/WebGPU/WebAssembly supported. It could also run in Baidu Smartprogram and WX miniprogram.
Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo
TextBox 2.0 is a text generation library with pre-trained language models
Strategies for Pre-training Graph Neural Networks
UNet model with VGG11 encoder pre-trained on Kaggle Carvana dataset
Official code, datasets and checkpoints for "Timer: Generative Pre-trained Transformers Are Large Time Series Models" (ICML 2024) and subsequent works
Official implementation of the paper: "FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Models"
Large-scale Pre-training Corpus for Chinese 100G 中文预训练语料
Fast & Simple repository for pre-training and fine-tuning T5-style models
KakaoBrain KoGPT (Korean Generative Pre-trained Transformer)
⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)
Open Language Pre-trained Model Zoo
The official implementation of “Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training”
High level network definitions with pre-trained weights in TensorFlow
Open Chinese Language Pre-trained Model Zoo
X-modaler is a versatile and high-performance codebase for cross-modal analytics(e.g., image captioning, video captioning, vision-language pre-training, visual question answering, visual commonsense reasoning, and cross-modal retrieval).
Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN