🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
- nlp
- natural-language-processing
- pytorch
- pytorch-transformers
Repository Index
87,573 visible repositories in the index
1–24 of 153 · Most stars
A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.
TranslatedChinese word segmentation, part-of-speech tagging, named entity recognition, dependency parsing, constituency parsing, semantic dependency parsing, semantic role labeling, coreference resolution, style transfer, semantic similarity, new word discovery, keyword and keyphrase extraction, automatic summarization, text classification and clustering, pinyin and Simplified/Traditional Chinese conversion, natural language processing
- nlp
- natural-language-processing
- hanlp
- pos-tagging
💫 Industrial-strength Natural Language Processing (NLP) in Python
Offline, privacy-first grammar checker. Fast, open-source, Rust-powered
- developer-tools
- english-language
- grammar-checker
- rust
Topic Modelling for Humans
- gensim
- topic-modeling
- information-retrieval
- machine-learning
State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!
- browser
- javascript
- transformers
- webml
Style and Grammar Checker for 25+ Languages
- grammar
- natural-language
- natural-language-processing
- style-checker
NLTK Source
- nltk
- python
- nlp
- natural-language-processing
A very simple framework for state-of-the-art Natural Language Processing (NLP)
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
- nlp
- embedding
- bert
- ernie
modest natural-language processing
- nlp
- part-of-speech
- named-entity-recognition
Unsupervised text tokenizer for Neural Network-based text generation.
- neural-machine-translation
- natural-language-processing
- word-segmentation
Multi-layer Recurrent Neural Networks (LSTM, GRU, RNN) for character-level language models in Torch
An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.
- python
- pii
- privacy
- data-anonymization
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
- nlp
- natural-language-processing
- natural-language-understanding
- language-model
general natural language facilities for node
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
- natural-language-processing
- nlp
- nlp-parsing
- named-entity-recognition
Simple, Pythonic, text processing--Sentiment analysis, part-of-speech tagging, noun phrase extraction, translation, and more.
- nlp
- nltk
- pattern
- python
Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.
- python
- machine-learning
- natural-language-processing
- web-mining
all kinds of text classification models and more with deep learning
- classification
- nlp
- fasttext
- textcnn
Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages
Open Source Neural Machine Translation and (Large) Language Models in PyTorch
- deep-learning
- pytorch
- machine-translation
- neural-machine-translation
An open source library for deep learning end-to-end dialog systems and chatbots.