TranslatedChinese word segmentation, part-of-speech tagging, named entity recognition, dependency parsing, constituency parsing, semantic dependency parsing, semantic role labeling, coreference resolution, style transfer, semantic similarity, new word discovery, keyword and keyphrase extraction, automatic summarization, text classification and clustering, pinyin and Simplified/Traditional Chinese conversion, natural language processing
Topic Modelling for Humans
A very simple framework for state-of-the-art Natural Language Processing (NLP)
- pytorch
- nlp
- named-entity-recognition
- sequence-labeling
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages
Date() for humans
Parse human names into title, given, middle, family, suffix, nickname and maiden name. Typed, zero-dependency, CJK-aware.
- python
- text-processing
- text-parser
- python-module
Pragmatic Segmenter is a rule-based sentence boundary detection gem that works out-of-the-box across many languages.
Selected Machine Learning algorithms for natural language processing and semantic analysis in Golang
A multilingual command line sentence tokenizer in Golang
- sentence-tokenizer
- tokenizer
- cli
- sentences
Fast and Portable Character String Processing in R (with the Unicode ICU)
An NLP library for Uralic languages such as Finnish, Skolt Sami, Moksha and so on. Also supporting some non-Uralic languages such as Spanish, French, Arabic, Swedish, Norwegian, Russian and English. LLMs, FSTs and More!
Stemmer packages for Go programming language. Includes English, German and Dutch stemmers.
High Performance Porter2 Stemmer
Golang text Transliterator (i.e München -> Muenchen)
- golang
- transliteration
- transliterator
- go
Tagify produces a set of tags from a given source. Source can be either an HTML page, a Markdown document or a plain text. Supports English, Russian, Chinese, Hindi, Spanish, Arabic, Japanese, German, Hebrew, French and Korean languages.
- tagify
- keywords
- keyword-extraction
- html
Sentiment analysis for the German language
German version of SimpleNLG 4
- natural-language
- java
- nlg
- simplenlg
Investigating multilingual language models (BERT) by using them for NER in German and English