💫 Industrial-strength Natural Language Processing (NLP) in Python
Repository Index
47,133 repositories indexed
1–23 of 23 · Most stars
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
- nlp
- embedding
- bert
- ernie
Unsupervised text tokenizer for Neural Network-based text generation.
- neural-machine-translation
- natural-language-processing
- word-segmentation
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
- natural-language-processing
- nlp
- nlp-parsing
- named-entity-recognition
Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages
Open-source offline translation library written in Python
- python
- machine-translation
- transformers
- translation
Naive linter for English prose
📐 Compute distance between sequences. 30+ algorithms, pure python implementation, common interface, optional external libs usage.
- distance
- algorithm
- python
- textdistance
Seamlessly integrate LLMs into scikit-learn.
Self-contained Machine Learning and Natural Language Processing library in Go
An R package for the Quantitative Analysis of Textual Data
- r
- text-analytics
- natural-language-processing
- corpus
🚀 Catalyst is a C# Natural Language Processing library built for speed. Inspired by spaCy's design, it brings pre-trained models, out-of-the box support for training word and document embeddings, and flexible entity recognition models.
Pragmatic Segmenter is a rule-based sentence boundary detection gem that works out-of-the-box across many languages.
A multilingual command line sentence tokenizer in Golang
- sentence-tokenizer
- tokenizer
- cli
- sentences
Simple embedding based text classifier inspired by fastText, implemented in tensorflow
- fasttext
- tensorflow
- language-identification
- text-classifier
:wink: :cyclone: :strawberry: TextRank implementation in Golang with extendable features (summarization, phrase extraction) and multithreading (goroutine).
- go
- golang
- textrank
- summarization
A Ruby natural language processor.
- natural-language-processing
- nlp
- ruby
- rubynlp
Ruby port of the NLTK Punkt sentence segmentation algorithm
- rubynlp
- sentence-tokenizer
- ruby
- sentence-boundaries
Accurate Bayesian sentence tokenizer in Ruby.
- rubynlp
- ruby
- nlp
The Harmony Python library: a research tool for psychologists to harmonise data and questionnaire items. Open source.
- data-harmonization
- data-science
- depression
- harmonisation
Gibran is an Elixir natural language processor, and a port of WordsCounted.
- natural-language-processing
- nlp
- elixir-lang
Beagle helps you identify keywords, phrases, regexes, and complex search queries of interest in streams of text documents.
- stream-search
- lucene
- luwak
- stored-query-engine
A fast and accurate rule-based sentence segmentation tool for Ruby.