Unsupervised text tokenizer for Neural Network-based text generation.
- neural-machine-translation
- natural-language-processing
- word-segmentation
47,133 repositories indexed
1–23 of 23 · Most stars
Unsupervised text tokenizer for Neural Network-based text generation.
general natural language facilities for node
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages
VADER Sentiment Analysis. VADER (Valence Aware Dictionary and sEntiment Reasoner) is a lexicon and rule-based sentiment analysis tool that is specifically attuned to sentiments expressed in social media, and works well on texts from other domains.
Easily train your own text-generating neural network of any size and complexity on any text dataset with a few lines of code.
Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://casl-project.ai/
Neural question generation using transformers
Java API for Natural Language Generation. Originally developed by Ehud Reiter at the University of Aberdeen’s Department of Computing Science and co-founder of Arria NLG. This git repo is the official SimpleNLG version.
RNNLG is an open source benchmark toolkit for Natural Language Generation (NLG) in spoken dialogue system application domains. It is released by Tsung-Hsien (Shawn) Wen from Cambridge Dialogue Systems Group under Apache License 2.0.
CogComp's Natural Language Processing Libraries and Demos: Modules include lemmatizer, ner, pos, prep-srl, quantifier, question type, relation-extraction, similarity, temporal normalizer, tokenizer, transliteration, verb-sense, and more.
A tool for holistic analysis of language generations systems
An Analysis Toolkit for Natural Language Generation (Translation, Captioning, Summarization, etc.)
Statistical NLG for spoken dialogue systems
Convert a number to an approximated text expression: from '0.23' to 'less than a quarter'.
Bayesian text classifier with flexible tokenizers and storage backends for Go
An NLP library for Uralic languages such as Finnish, Skolt Sami, Moksha and so on. Also supporting some non-Uralic languages such as Spanish, French, Arabic, Swedish, Norwegian, Russian and English. LLMs, FSTs and More!
A flexible and general-purpose ngrams library written in Ruby. Raingrams supports ngram sizes greater than 1, text/non-text grams, multiple parsing styles and open/closed vocabulary models.
N-Gram generator in Ruby - http://en.wikipedia.org/wiki/N-gram
Surface realiser (part of a Natural Language Generation system) using Tree Adjoining Grammar
Investigating multilingual language models (BERT) by using them for NER in German and English
A generalized rack framework for text classifications.
Spelling corrector for Spanish language