Repository Index

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

• nlp
• pre-trained-model
• unilm
• minilm

TranslatedTransfer learning / domain adaptation / domain generalization / multi-task learning etc. Papers, codes, datasets, applications, tutorials.-Transfer learning

• transferlearning
• domain-adaptation
• transfer-learning
• survey

Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.

• transformer
• conformer
• speech-translation
• streaming-asr

PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Models

Train and evaluate embeddings for similarity search with PyTorch. Includes contrastive losses, hard example mining, samplers, and retrieval metrics.

• metric-learning
• deep-learning
• computer-vision
• machine-learning

A python library for self-supervised learning and latent world models on images.

• deep-learning
• self-supervised-learning
• machine-learning
• computer-vision

This is a Pytorch implementation of the paper: Self-Supervised Graph Transformer on Large-Scale Molecular Data

The PASS dataset: pretrained models and how to get the data

• computer-vision
• self-supervised-learning
• representation-learning

[DEPRECATED] Self-Supervised Extrinsic Calibration using 3D Spatial Transformer Networks