【EMNLP 2024🔥】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection
- instruction-tuning
- large-vision-language-model
- multi-modal
73,862 visible repositories in the index
25–48 of 106 · Most stars
【EMNLP 2024🔥】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection
An Open-Source Python3 tool with SMALL models for recognizing layouts, tables, math formulas (LaTeX), and text in images, converting them into Markdown format. A free alternative to Mathpix, empowering seamless conversion of visual content into text-based representations. 80+ languages are supported.
Text preprocessing, representation and visualization from zero to hero.
Python tools for 3D face: 3DMM, Mesh processing(transform, camera, light, render), 3D face representations.
EVA Series: Visual Representation Fantasies from BAAI
A lightweight JIT compiler based on MIR (Medium Internal Representation) and C11 JIT compiler and interpreter based on MIR
Repository for benchmarking graph neural networks (JMLR 2023)
A curated list of resources on implicit neural representations.
A curated list of network embedding techniques.
Self-Supervised Speech Pre-training and Representation Learning Toolkit
Must-read papers on network representation learning (NRL) / network embedding (NE)
PyTorch implementation of SimCLR: A Simple Framework for Contrastive Learning of Visual Representations
[ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods
A deep matching model library for recommendations & advertising. It's easy to train models and to export representation vectors which can be used for ANN search.
Large Concept Models: Language modeling in a sentence representation space
Resources of Neural Rendering
OpenSPG is a Knowledge Graph Engine developed by Ant Group in collaboration with OpenKG, based on the SPG (Semantic-enhanced Programmable Graph) framework. Core Capabilities: 1) domain model constrained knowledge modeling, 2) facts and logic fused representation, 3) natively support KAG...
The implementation of DeBERTa
Python library for Representation Learning on Knowledge Graphs https://docs.ampligraph.org
Bioinformatics'2020: BioBERT: a pre-trained biomedical language representation model for biomedical text mining
Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.
A comprehensive list of Implicit Representations, NeRF and 3D Gaussian Splatting papers relating to SLAM/Robotics domain, including papers, videos, codes, and related websites
A Unified Framework for Surface Reconstruction
Official PyTorch Implementation of "Diffusion Transformers with Representation Autoencoders"