Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ languages, with a router that picks the right checkpoint per request.
💫 Industrial-strength Natural Language Processing (NLP) in Python
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages
Naive linter for English prose
📐 Compute distance between sequences. 30+ algorithms, pure python implementation, common interface, optional external libs usage.
Seamlessly integrate LLMs into scikit-learn.
Self-contained Machine Learning and Natural Language Processing library in Go
🚀 Catalyst is a C# Natural Language Processing library built for speed. Inspired by spaCy's design, it brings pre-trained models, out-of-the box support for training word and document embeddings, and flexible entity recognition models.
Parse human names into title, given, middle, family, suffix, nickname and maiden name. Typed, zero-dependency, CJK-aware.
- python
- text-processing
- text-parser
- python-module
An NLP library for Uralic languages such as Finnish, Skolt Sami, Moksha and so on. Also supporting some non-Uralic languages such as Spanish, French, Arabic, Swedish, Norwegian, Russian and English. LLMs, FSTs and More!
A multilingual tokenizer to split a string into tokens
Beagle helps you identify keywords, phrases, regexes, and complex search queries of interest in streams of text documents.
- stream-search
- lucene
- luwak
- stored-query-engine
Break words and phrases into ngrams.