Repository Index

Offline, privacy-first grammar checker. Fast, open-source, Rust-powered

• developer-tools
• english-language
• grammar-checker
• rust

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

• nlp
• embedding
• bert
• ernie

modest natural-language processing

• nlp
• part-of-speech
• named-entity-recognition

An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.

• python
• pii
• privacy
• data-anonymization

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

An NLP library for building bots, with entity extraction, sentiment analysis, automatic language identify, and so more

• nlp
• nlu
• nodejs
• sentiment-analysis

VADER Sentiment Analysis. VADER (Valence Aware Dictionary and sEntiment Reasoner) is a lexicon and rule-based sentiment analysis tool that is specifically attuned to sentiments expressed in social media, and works well on texts from other domains.

Easily train your own text-generating neural network of any size and complexity on any text dataset with a few lines of code.

• keras
• deep-learning
• text-generation
• tensorflow

Module for automatic summarization of text documents and HTML pages.

• python
• lsa
• textteaser
• html-page

📐 Compute distance between sequences. 30+ algorithms, pure python implementation, common interface, optional external libs usage.

• distance
• algorithm
• python
• textdistance

Chronic is a pure Ruby natural language date parser.

TranslatedNon-autoregressive System 1 decision engine, designed for structured, typed decision-making scenarios. DeepOpen Multilingual, non-autoregressive System 1 decision engine.

Bioinformatics'2020: BioBERT: a pre-trained biomedical language representation model for biomedical text mining

A full spaCy pipeline and models for scientific/biomedical documents.

• scientific-documents
• spacy
• custom-pipes
• nlp

Self-contained Machine Learning and Natural Language Processing library in Go

• deep-learning
• machine-learning
• natural-language-processing
• neural-network

What's in your data? Extract schema, statistics and entities from datasets

• python
• privacy
• pii
• npi

Self-contained Japanese Morphological Analyzer written in pure Go

• japanese
• tokenizer
• nlp-library
• japanese-language

Java API for Natural Language Generation. Originally developed by Ehud Reiter at the University of Aberdeen’s Department of Computing Science and co-founder of Arria NLG. This git repo is the official SimpleNLG version.

• simplenlg
• natural-language-generation
• nlg
• realiser

RNNLG is an open source benchmark toolkit for Natural Language Generation (NLG) in spoken dialogue system application domains. It is released by Tsung-Hsien (Shawn) Wen from Cambridge Dialogue Systems Group under Apache License 2.0.

• natural-language-processing
• natural-language-generation
• nlg-dataset
• deep-learning

CogComp's Natural Language Processing Libraries and Demos: Modules include lemmatizer, ner, pos, prep-srl, quantifier, question type, relation-extraction, similarity, temporal normalizer, tokenizer, transliteration, verb-sense, and more.

• natural-language-processing
• nlp
• big-data
• data-mining

Selected Machine Learning algorithms for natural language processing and semantic analysis in Golang

• go
• golang
• natural-language-processing
• nlp

A tool for holistic analysis of language generations systems

A multilingual command line sentence tokenizer in Golang

• sentence-tokenizer
• tokenizer
• cli
• sentences

Simple sentiment analysis with Ruby