🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
- nlp
- natural-language-processing
- pytorch
- pytorch-transformers
47,133 repositories indexed
1–24 of 105 · Most stars
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
TranslatedChinese word segmentation, part-of-speech tagging, named entity recognition, dependency parsing, constituency parsing, semantic dependency parsing, semantic role labeling, coreference resolution, style transfer, semantic similarity, new word discovery, keyword and keyphrase extraction, automatic summarization, text classification and clustering, pinyin and Simplified/Traditional Chinese conversion, natural language processing
Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ languages, with a router that picks the right checkpoint per request.
💫 Industrial-strength Natural Language Processing (NLP) in Python
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools
Topic Modelling for Humans
Nano vLLM
The open-source hub to build & deploy GPT/LLM Agents ⚡️
NLTK Source
A very simple framework for state-of-the-art Natural Language Processing (NLP)
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
modest natural-language processing
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
OpenVINO™ is an open source toolkit for optimizing and deploying AI inference
TranslatedPre-Training with Whole Word Masking for Chinese BERT (Chinese BERT-wwm series models)
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages
Open-source offline translation library written in Python
An NLP library for building bots, with entity extraction, sentiment analysis, automatic language identify, and so more
Statistical Machine Intelligence & Learning Engine
Natural language detection
State of the Art Natural Language Processing
Module for automatic summarization of text documents and HTML pages.