Repository Index

快速上手AI理论及应用实战：基础知识、Transformer、NLP、ML、DL、竞赛。含大量注释及数据集，力求每一位能看懂并复现。

• ai
• nlp
• dataming
• bert

Official codebase used to develop Vision Transformer, SigLIP, MLP-Mixer, LiT and more.

An open-source project dedicated to tracking and segmenting any objects in videos, either automatically or interactively. The primary algorithms utilized include the Segment Anything Model (SAM) for key-frame segmentation and Associating Objects with Transformers (AOT) for efficient tracking and propagation purposes.

• interactive-segmentation
• segment-anything
• segment-anything-model
• video-object-segmentation

中文翻译的 Hands-On-Large-Language-Models (hands-on-llms)，动手学习大模型

• hands-on-llm
• llms
• hands-on-transformers
• hans-on-llms

Code for "LoFTR: Detector-Free Local Feature Matching with Transformers", CVPR 2021, T-PAMI 2022

• feature-matching
• pose-estimation
• 3d-vision

TranslatedCovers pre-training data, Tokenizer, Transformer, MoE,distributed training, Scaling Laws, inference & alignment .6 progressive code assignments for full-stack LLM learning

• gpu-programming
• llm
• nlp
• rl

A computer vision closed-loop learning platform where code can be run interactively online. 学习闭环《计算机视觉实战演练：算法与应用》中文电子书、源码、读者交流社区（持续更新中 ...） 📘 在线电子书 https://charmve.github.io/computer-vision-in-action/ 👇项目主页

• tutorial
• charmve
• machine-learning
• computer-vision

Efficient few-shot learning with Sentence Transformers

• few-shot-learning
• nlp
• sentence-transformers

ProtTrans is providing state of the art pretrained language models for proteins. ProtTrans was trained on thousands of GPUs from Summit and hundreds of Google TPUs using Transformers Models.

Neural question generation using transformers

• nlp
• nlg
• deep-learning
• transformer

Foundation Models for Genomics & Transcriptomics

• genomics
• deep-learning
• transformer
• dna

Repository for MolFormer

MolTrans: Molecular Interaction Transformer for Drug Target Interaction Prediction (Bioinformatics)

Repository for Nicheformer: a foundation model for single-cell and spatial omics

TranslatedA tiny Transformer built from scratch in PyTorch, with an English-to-Chinese translation demo | A small Transformer implemented from scratch with PyTorch, with an English-to-Chinese translation demo, to help understand how the model works

• attention-mechanism
• deep-learning
• educational
• from-scratch

BulkFormer: A large-scale foundation model for human bulk transcriptomes

Research experiments exploring uncommon quant techniques.

• analysis
• jupyter-notebook
• python
• quant