Repository Index

🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP

• bert
• sentence-encoding
• deep-learning
• clip-model

Train and evaluate embeddings for similarity search with PyTorch. Includes contrastive losses, hard example mining, samplers, and retrieval metrics.

• metric-learning
• deep-learning
• computer-vision
• machine-learning

Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.

• chinese
• computer-vision
• multi-modal-learning
• nlp

PyTorch code and models for V-JEPA self-supervised learning from video.

Karate Club: An API Oriented Open-source Python Framework for Unsupervised Learning on Graphs (CIKM 2020)

• community-detection
• graph-clustering
• deepwalk
• networkx

ProtTrans is providing state of the art pretrained language models for proteins. ProtTrans was trained on thousands of GPUs from Summit and hundreds of Google TPUs using Transformers Models.

Tasks Assessing Protein Embeddings (TAPE), a set of five biologically relevant semi-supervised learning tasks spread across different domains of protein biology.

• deep-learning
• protein-sequences
• protein-structure
• semi-supervised-learning

Pathology Language and Image Pre-Training (PLIP) is the first vision and language foundation model for Pathology AI (Nature Medicine). PLIP is a large-scale pre-trained model that can be used to extract visual and language features from pathology images and text description. The model is a fine-tuned version of the original CLIP model.

• artificial-intelligence
• clip
• pathology
• vision-and-language

This is a german ELMo deep contextualized word representation. It is trained on a special German Wikipedia Text Corpus.

• bilm
• elmo
• tensorflow
• machine-learning