An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.
- python
- pii
- privacy
- data-anonymization
Repository Index
47,133 repositories indexed
1–24 of 25 · Most stars
An NLP library for building bots, with entity extraction, sentiment analysis, automatic language identify, and so more
VADER Sentiment Analysis. VADER (Valence Aware Dictionary and sEntiment Reasoner) is a lexicon and rule-based sentiment analysis tool that is specifically attuned to sentiments expressed in social media, and works well on texts from other domains.
Module for automatic summarization of text documents and HTML pages.
- python
- lsa
- textteaser
- html-page
A full spaCy pipeline and models for scientific/biomedical documents.
- scientific-documents
- spacy
- custom-pipes
- nlp
What's in your data? Extract schema, statistics and entities from datasets
- python
- privacy
- pii
- npi
Ruby gem to calculate the similarity between texts using tf*idf
Onnx transformer pipelines in Golang
RNNLG is an open source benchmark toolkit for Natural Language Generation (NLG) in spoken dialogue system application domains. It is released by Tsung-Hsien (Shawn) Wen from Cambridge Dialogue Systems Group under Apache License 2.0.
- natural-language-processing
- natural-language-generation
- nlg-dataset
- deep-learning
CogComp's Natural Language Processing Libraries and Demos: Modules include lemmatizer, ner, pos, prep-srl, quantifier, question type, relation-extraction, similarity, temporal normalizer, tokenizer, transliteration, verb-sense, and more.
- natural-language-processing
- nlp
- big-data
- data-mining
A Library to parse natural language in pure Clojure and ClojureScript
- natural-language-processing
- clojure
- clojurescript
- pos-tagger
This repository is a proof of concept toolbox for using Deep Belief Nets for Topic Modeling in Python.
Nickel extracts date, time, and message information from naturally worded text.
An NLP library for Uralic languages such as Finnish, Skolt Sami, Moksha and so on. Also supporting some non-Uralic languages such as Spanish, French, Arabic, Swedish, Norwegian, Russian and English. LLMs, FSTs and More!
- nlp-library
- uralic-languages
- finnish
- sami
Sentiment analysis based on afinn-165, emojis and some enhancements.
- sentiment-analysis
- elixir
- elixir-library
- hex
Natural language parser for recurring events
A flexible and general-purpose ngrams library written in Ruby. Raingrams supports ngram sizes greater than 1, text/non-text grams, multiple parsing styles and open/closed vocabulary models.
- ruby
- ngrams
The Harmony Python library: a research tool for psychologists to harmonise data and questionnaire items. Open source.
- data-harmonization
- data-science
- depression
- harmonisation
Beagle helps you identify keywords, phrases, regexes, and complex search queries of interest in streams of text documents.
- stream-search
- lucene
- luwak
- stored-query-engine
Tagify produces a set of tags from a given source. Source can be either an HTML page, a Markdown document or a plain text. Supports English, Russian, Chinese, Hindi, Spanish, Arabic, Japanese, German, Hebrew, French and Korean languages.
- tagify
- keywords
- keyword-extraction
- html
Ruby gem to calculate statistics from text to determine readability, complexity and grade level of a particular corpus.
- textstat
- flesch-kincaid-grade
- smog
- flesch-reading-ease
Multilingual library to easily parse date strings to java.util.Date objects.
- clojure
- parsing
- date-time
- date-parser
A project around helping to prevent typing typos. TySug (Typo Suggestions) suggests alternative words with respect to keyboard layouts
- string-distance
- suggestions
- typo
- typing
The public release of the Babel2 framework, a framework for Fluid Construction Grammar, multi-agent experiments and Incremental Recruitment Language.