Repository Index

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

• nlp
• pre-trained-model
• unilm
• minilm

PyTorch code and models for the DINOv2 self-supervised learning method.

Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.

• transformer
• conformer
• speech-translation
• streaming-asr

PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Models

A python library for self-supervised learning and latent world models on images.

• deep-learning
• self-supervised-learning
• machine-learning
• computer-vision

An unsupervised learning framework for depth and ego-motion estimation from monocular videos

• deep-learning
• depth-prediction
• visual-odometry
• self-supervised-learning

This is a Pytorch implementation of the paper: Self-Supervised Graph Transformer on Large-Scale Molecular Data

The PASS dataset: pretrained models and how to get the data

• computer-vision
• self-supervised-learning
• representation-learning

[DEPRECATED] Self-Supervised Extrinsic Calibration using 3D Spatial Transformer Networks