Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI
- transformers
- text-classification
- named-entity-recognition
- question-answering
132,241 visible repositories in the index
1–24 of 26 · Most stars
Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI
A library for transfer learning by reusing parts of TensorFlow models.
MTEB: State-of-the-art evaluation of embeddings across languages and modalities
Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo
[ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings
Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX.
Multi-class confusion matrix library in Python
A Docker-powered service for PDF document layout analysis. This service provides a powerful and flexible PDF analysis service. The service allows for the segmentation and classification of different parts of PDF pages, identifying the elements such as texts, titles, pictures, tables and so on.
An elegent pytorch implement of transformers
Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo
sentence embedding by Smooth Inverse Frequency weighting scheme
Open multimodal decision models, 0.8B to 27B, for text, images and video. Decide with probabilities over your own candidates and locate with bounding boxes, in place of generated text. Free API, ONNX, GGUF, vLLM and SGLang; fine-tuning code included.
This repo contains a PyTorch implementation of a pretrained BERT model for multi-label text classification.
Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.
Turn any collection of documents into a knowledge graph. Extract entities and relationships via LLM, deduplicate with your approval. Map domains, find hidden connections, spot patterns across documents — knowledge that persists and compounds, for you and your AI agents. All from the CLI.
A SOTA Industrial-Grade All-in-One ASR system with ASR, VAD, LID, and Punc modules. FireRedASR2 supports Chinese (Mandarin, 20+ dialects/accents), English, code-switching, and both speech and singing ASR. FireRedVAD supports speech/singing/music in 100+ langs. FireRedLID supports 100+ langs and 20+ zh dialects. FireRedPunc supports zh and en.
NucliaDB, The AI Search database for RAG
Machine learning Guide. Learn all about Machine Learning Tools, Libraries, Frameworks, Large Language Models (LLMs), and Training Models.
AI-powered Claude skill for Spine 2D skeletal animation — auto-rig, animate, and preview characters
An open-source AI Text Detector for identifying AI-generated content in essays, articles, and documents. Supports document-level and sentence-level detection, with Human, AI, and Mixed content classification, explainable results, and multilingual model development.
Active Learning for Text Classification in Python
An AI framework for generating and modding osu! beatmaps for all gamemodes from spectrogram inputs.
Compute Sentence Embeddings Fast!
Span-level grounding verification for RAG, code, and tool-grounded AI outputs.