Repository Index

State-of-the-Art Embeddings, Retrieval, and Reranking

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

• attention-mechanism
• deep-learning
• gpt
• gpt-2

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

• python
• search
• nlp
• semantic-search

🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP

• bert
• sentence-encoding
• deep-learning
• clip-model

Retrieval and Retrieval-augmented LLMs

• embeddings
• information-retrieval
• llm
• sentence-embeddings

Leveraging BERT and c-TF-IDF to create easily interpretable topics.

• bert
• transformers
• topic-modeling
• sentence-embeddings

all kinds of text classification models and more with deep learning

• classification
• nlp
• fasttext
• textcnn

Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages

• python
• nlp
• natural-language-processing
• machine-learning

A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

• embedding
• llm
• rag
• easy

Red Ink - A one-stop Xiaohongshu image-and-text generator based on the 🍌Nano Banana Pro🍌, "One Sentence, One Image: Generate Xiaohongshu Text and Images."

• ai
• aigc
• content-generator
• social-media

Extract Keywords from sentence or Replace keywords in sentences.

• search-in-text
• keyword-extraction
• nlp
• word2vec

NeuralTalk is a Python+numpy project for learning Multimodal Recurrent Neural Networks that describe images with sentences.

Translatedtext2vec, text to vector. A text vector representation tool that converts text into vector matrices. It implements text representation and text similarity calculation models such as Word2Vec, RankBM25, Sentence-BERT, and CoSENT, and works out of the box.

• similarity
• nlp
• text-similarity
• text2vec

Speech-to-Text-WaveNet : End-to-end sentence level English speech recognition based on DeepMind's WaveNet and tensorflow

[EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821

• nlp
• sentence-embeddings

🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools

• onnx
• pytorch
• inference
• training

MTEB: State-of-the-art evaluation of embeddings across languages and modalities

• benchmark
• clustering
• information-retrieval
• sentence-transformers

Top2Vec learns jointly embedded topic, document and word vectors.

• topic-modeling
• word-embeddings
• document-embedding
• topic-vector

Large Concept Models: Language modeling in a sentence representation space

• language-models
• nlp
• pytorch
• seq2seq

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.

• nlp
• information-retrieval
• bert
• benchmark

Fast State-of-the-Art Static Embeddings

• embeddings
• machine-learning
• model2vec
• nlp

CNNs for sentence classification

中文长文本分类、短句子分类、多标签分类、两句子相似度（Chinese Text Classification of Keras NLP, multi-label classify, or sentence classify, long or short），字词句向量嵌入层（embeddings）和网络层（graph）构建基类，FastText，TextCNN，CharCNN，TextRNN, RCNN, DCNN, DPCNN, VDCNN, CRNN, Bert, Xlnet, Albert, Attention, DeepMoji, HAN, 胶囊网络-CapsuleNet, Transformer-encode, Seq2seq, SWEM, LEAM, TextGCN

• text-classification
• keras
• rcnn
• dcnn

jiant is an nlp toolkit

• nlp
• sentence-representation
• bert
• multitask-learning