TranslatedChinese word segmentation, part-of-speech tagging, named entity recognition, dependency parsing, constituency parsing, semantic dependency parsing, semantic role labeling, coreference resolution, style transfer, semantic similarity, new word discovery, keyword and keyphrase extraction, automatic summarization, text classification and clustering, pinyin and Simplified/Traditional Chinese conversion, natural language processing
Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ languages, with a router that picks the right checkpoint per request.
💫 Industrial-strength Natural Language Processing (NLP) in Python
An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.
- python
- pii
- privacy
- data-anonymization
all kinds of text classification models and more with deep learning
- classification
- nlp
- fasttext
- textcnn
An open source library for deep learning end-to-end dialog systems and chatbots.
Local-first healthcare AI: clinical NER and HIPAA PII de-identification on hardware you control. 2,200+ medical models, 35 model-backed PII languages, and Python, MLX, Android and browser runtimes. Apache-2.0 SDK.
- healthcare
- llm
- on-device
- on-premise
TranslatedChinese text classification, TextCNN, TextRNN, FastText, TextRCNN, BiLSTM_Attention, DPCNN, Transformer, based on pytorch, ready to use out of the box.
A machine learning software for extracting information from scholarly documents
VADER Sentiment Analysis. VADER (Valence Aware Dictionary and sEntiment Reasoner) is a lexicon and rule-based sentiment analysis tool that is specifically attuned to sentiments expressed in social media, and works well on texts from other domains.
A C library for parsing/normalizing street addresses around the world. Powered by statistical NLP and open geo data.
TranslatedChinese text classification using Bert and ERNIE
Natural language detection
- javascript
- natural-language
- language-detection
- nlp
Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI
- transformers
- text-classification
- named-entity-recognition
- question-answering
State of the Art Natural Language Processing
百度NLP:分词,词性标注,命名实体识别,词重要性
- word-segmentation
- part-of-speech-tagger
- named-entity-recognition
- chinese-word-segmentation
Snips Python library to extract meaning from text
Module for automatic summarization of text documents and HTML pages.
- python
- lsa
- textteaser
- html-page
fastNLP: A Modularized and Extensible NLP Framework. Currently still in incubation.
Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo
Stand-alone language identification system
⭐️ NLP Algorithms with transformers lib. Supporting Text-Classification, Text-Generation, Information-Extraction, Text-Matching, RLHF, SFT etc.
- nlp
- text-classification
- text-matching
- information-extraction
Kashgari is a production-level NLP Transfer learning framework built on top of tf.keras for text-labeling and text-classification, includes Word2Vec, BERT, and GPT2 Language Embedding.
- nlp
- sequence-labeling
- text-classification
- bert-model
Bioinformatics'2020: BioBERT: a pre-trained biomedical language representation model for biomedical text mining