TranslatedChinese word segmentation, part-of-speech tagging, named entity recognition, dependency parsing, constituency parsing, semantic dependency parsing, semantic role labeling, coreference resolution, style transfer, semantic similarity, new word discovery, keyword and keyphrase extraction, automatic summarization, text classification and clustering, pinyin and Simplified/Traditional Chinese conversion, natural language processing
Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ languages, with a router that picks the right checkpoint per request.
💫 Industrial-strength Natural Language Processing (NLP) in Python
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
- nlp
- pre-trained-model
- unilm
- minilm
Offline, privacy-first grammar checker. Fast, open-source, Rust-powered
Topic Modelling for Humans
Style and Grammar Checker for 25+ Languages
NLTK Source
A very simple framework for state-of-the-art Natural Language Processing (NLP)
- pytorch
- nlp
- named-entity-recognition
- sequence-labeling
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
modest natural-language processing
- nlp
- part-of-speech
- named-entity-recognition
Unsupervised text tokenizer for Neural Network-based text generation.
An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.
Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages
An NLP library for building bots, with entity extraction, sentiment analysis, automatic language identify, and so more
VADER Sentiment Analysis. VADER (Valence Aware Dictionary and sEntiment Reasoner) is a lexicon and rule-based sentiment analysis tool that is specifically attuned to sentiments expressed in social media, and works well on texts from other domains.
Natural language detection
- javascript
- natural-language
- language-detection
- nlp
State of the Art Natural Language Processing
Seamlessly integrate LLMs into scikit-learn.
TranslatedNon-autoregressive System 1 decision engine, designed for structured, typed decision-making scenarios. DeepOpen Multilingual, non-autoregressive System 1 decision engine.
natural language processor powered by plugins part of the @unifiedjs collective
- natural-language
- ast
- retext
- cst