TranslatedChinese word segmentation, part-of-speech tagging, named entity recognition, dependency parsing, constituency parsing, semantic dependency parsing, semantic role labeling, coreference resolution, style transfer, semantic similarity, new word discovery, keyword and keyphrase extraction, automatic summarization, text classification and clustering, pinyin and Simplified/Traditional Chinese conversion, natural language processing
💫 Industrial-strength Natural Language Processing (NLP) in Python
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
- nlp
- pre-trained-model
- unilm
- minilm
An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.
Open-source offline translation library written in Python
Naive linter for English prose
The most accurate natural language detection library for Go, suitable for short text and mixed-language text
Self-contained Japanese Morphological Analyzer written in pure Go
🚀 Catalyst is a C# Natural Language Processing library built for speed. Inspired by spaCy's design, it brings pre-trained models, out-of-the box support for training word and document embeddings, and flexible entity recognition models.
A Modern C++ Data Sciences Toolkit
Pragmatic Segmenter is a rule-based sentence boundary detection gem that works out-of-the-box across many languages.
CogComp's Natural Language Processing Libraries and Demos: Modules include lemmatizer, ner, pos, prep-srl, quantifier, question type, relation-extraction, similarity, temporal normalizer, tokenizer, transliteration, verb-sense, and more.
Selected Machine Learning algorithms for natural language processing and semantic analysis in Golang
A multilingual command line sentence tokenizer in Golang
- sentence-tokenizer
- tokenizer
- cli
- sentences
:hospital: Medical Text Mining and Information Extraction with spaCy
No-Frills Functional Programming Lib Augmenting Javascript/Node.js
- functional-programming
- pure-function
- recursion
- javascript
A Library to parse natural language in pure Clojure and ClojureScript
This repository is a proof of concept toolbox for using Deep Belief Nets for Topic Modeling in Python.
A Go port of the Rapid Automatic Keyword Extraction algorithm (RAKE)
A flexible and general-purpose ngrams library written in Ruby. Raingrams supports ngram sizes greater than 1, text/non-text grams, multiple parsing styles and open/closed vocabulary models.
The Harmony Python library: a research tool for psychologists to harmonise data and questionnaire items. Open source.
Transliterate Cyrillic → Latin in every possible way
- golang
- go
- transliteration
- translit
Framework for information extraction from tables
- table-information-extraction
- information-extraction
- literature
- text-mining
A project around helping to prevent typing typos. TySug (Typo Suggestions) suggests alternative words with respect to keyboard layouts
- string-distance
- suggestions
- typo
- typing