🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
- nlp
- natural-language-processing
- pytorch
- pytorch-transformers
Repository Index
47,133 repositories indexed
1–24 of 83 · Most stars
Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/PDFs and LLMs. Supports 100+ languages.
- ocr
- chineseocr
- pdf2markdown
- pp-ocr
A generative speech model for daily dialogue.
TranslatedChinese word segmentation, part-of-speech tagging, named entity recognition, dependency parsing, constituency parsing, semantic dependency parsing, semantic role labeling, coreference resolution, style transfer, semantic similarity, new word discovery, keyword and keyphrase extraction, automatic summarization, text classification and clustering, pinyin and Simplified/Traditional Chinese conversion, natural language processing
- nlp
- natural-language-processing
- hanlp
- pos-tagging
Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ languages, with a router that picks the right checkpoint per request.
- calibration
- classification
- decision-model
- huggingface
💫 Industrial-strength Natural Language Processing (NLP) in Python
Code and documentation to train Stanford's Alpaca models, and generate the data.
- deep-learning
- instruction-following
- language-model
Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc.
The #1 AI Harness for Building Resumes, PDFs, Cover Letters & more, locally with 100+ LLMs support.
- text-similarity
- natural-language-processing
- word-embeddings
- python
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.
- audio-generation
- gpt-4o
- text-to-speech
- tts
Universal LLM Deployment Engine with ML Compilation
- llm
- machine-learning-compilation
- language-model
- tvm
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
- nlp
- pre-trained-model
- unilm
- minilm
🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools
TranslatedThe official repo of Qwen chat & pretrained large language model proposed by Alibaba Cloud.
- chinese
- large-language-models
- natural-language-processing
- flash-attention
OCR, layout analysis, reading order, table recognition in 90+ languages
Generate audiobooks from e-books, 50+ TTS engines with voice cloning and 1696 languages!
Translate the video from one language to another and embed dubbing & subtitles.
- text-to-speech
- video-transition
- speech-to-text
- stt
A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
- machine-translation
- speaker-recognition
- asr
- tts
Ongoing research training transformer models at scale
- large-language-models
- model-para
- transformers
Janus-Series: Unified Multimodal Understanding and Generation Models
- any-to-any
- foundation-models
- llm
- multimodal
Topic Modelling for Humans
- gensim
- topic-modeling
- information-retrieval
- machine-learning
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
- attention-mechanism
- deep-learning
- gpt
- gpt-2
NLTK Source
- nltk
- python
- nlp
- natural-language-processing