Unsupervised text tokenizer for Neural Network-based text generation.
- neural-machine-translation
- natural-language-processing
- word-segmentation
73,862 visible repositories in the index
1–24 of 34 · Most stars
Unsupervised text tokenizer for Neural Network-based text generation.
Simple, Pythonic, text processing--Sentiment analysis, part-of-speech tagging, noun phrase extraction, translation, and more.
VADER Sentiment Analysis. VADER (Valence Aware Dictionary and sEntiment Reasoner) is a lexicon and rule-based sentiment analysis tool that is specifically attuned to sentiments expressed in social media, and works well on texts from other domains.
Easily train your own text-generating neural network of any size and complexity on any text dataset with a few lines of code.
An Open-Source Framework for Prompt-Learning.
Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research
Minimal keyword extraction with BERT
Module for automatic summarization of text documents and HTML pages.
Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)
Neologism dictionary based on the language resources on the Web for mecab-ipadic
AFINN-based sentiment analysis for Node.js.
Unified Schema-Based Information Extraction
Python implementation of TextRank algorithms ("textgraphs") for phrase extraction
Pluralize or singularize any word based on a count
Explain, analyze, and visualize NLP language models. Ecco creates interactive visualizations directly in Jupyter notebooks explaining the behavior of Transformer-based language models (like GPT2, BERT, RoBERTA, T5, and T0).
What's in your data? Extract schema, statistics and entities from datasets
Pragmatic Segmenter is a rule-based sentence boundary detection gem that works out-of-the-box across many languages.
RNNLG is an open source benchmark toolkit for Natural Language Generation (NLG) in spoken dialogue system application domains. It is released by Tsung-Hsien (Shawn) Wen from Cambridge Dialogue Systems Group under Apache License 2.0.
Simple embedding based text classifier inspired by fastText, implemented in tensorflow
:wink: :cyclone: :strawberry: TextRank implementation in Golang with extendable features (summarization, phrase extraction) and multithreading (goroutine).
Modular, fast NLP framework, compatible with Pytorch and spaCy, offering tailored support for French clinical notes.
Rule based Answer Type classification system in Node.js
Lemmatizer for text in English. Inspired by Python's nltk.corpus.reader.wordnet.morphy
An elixir module to translate simplified Chinese to traditional Chinese, and vice versa, based on wikipedia data