Sign in

Repository Index

109,091 visible repositories in the index

Tags: NLP library
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters

Filters

Clear all filters

1–24 of 67 · Most stars

An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.

  • python
  • pii
  • privacy
  • data-anonymization

Simple, Pythonic, text processing--Sentiment analysis, part-of-speech tagging, noun phrase extraction, translation, and more.

  • nlp
  • nltk
  • pattern
  • python

Translated👮‍♂️The sensitive word tool for java.(Sensitive words / prohibited words / illegal words / profanity. A high-performance Java sensitive word filtering tool framework implemented based on the DFA algorithm. Built-in support for tag classification and grading of words. Please do not post content involving politics, advertising, marketing, circumventing the Great Firewall, or violating national laws and regulations. A high-performance sensitive word detection and filtering component, with traditional/simplified Chinese conversion, full-width/half-width conversion, Chinese character to pinyin conversion, fuzzy search, and other features.)

  • sensitive
  • sensitive-word
  • sensitive-word-filter
  • dfa

TranslatedA high-performance sensitive word (illegal word / profanity) detection and filtering component, which also comes with Traditional/Simplified Chinese conversion, and supports full-width/half-width conversion, Chinese character to pinyin conversion, fuzzy search, and other features.

  • word-filter
  • stringsearch
  • wordssearch
  • pinyin

VADER Sentiment Analysis. VADER (Valence Aware Dictionary and sEntiment Reasoner) is a lexicon and rule-based sentiment analysis tool that is specifically attuned to sentiments expressed in social media, and works well on texts from other domains.

Top2Vec learns jointly embedded topic, document and word vectors.

  • topic-modeling
  • word-embeddings
  • document-embedding
  • topic-vector

Text preprocessing, representation and visualization from zero to hero.

  • text-preprocessing
  • text-representation
  • text-visualization
  • nlp

文本挖掘和预处理工具(文本清洗、新词发现、情感分析、实体识别链接、关键词抽取、知识抽取、句法分析等),无监督或弱监督方法

  • nlp
  • sentiment-analysis
  • new-word-discovery
  • unsupervised

Unsupervised Word Segmentation for Neural Machine Translation and Text Generation

  • neural-machine-translation
  • segmentation
  • machine-translation
  • nmt