Repository Index

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

• gpt
• large-language-models
• llm
• python

CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image

• deep-learning
• machine-learning

Janus-Series: Unified Multimodal Understanding and Generation Models

• any-to-any
• foundation-models
• llm
• multimodal

TranslatedLlama Chinese community: compiles the latest Llama learning materials in real time and builds the best open-source ecosystem of Chinese Llama large models, fully open source and commercially usable

• llama
• llm
• pretraining
• agent

Official Repository for the Uni-Mol Series Methods

• molecular-modeling
• pre-trained-model
• pretraining
• deep-learning

Recent Advances in Vision and Language PreTrained Models (VL-PTMs)

• vision-and-language
• pretraining
• multimodal-deep-learning
• bert

Speedrun for pretraining without backpropagation