TranslatedChinese word segmentation, part-of-speech tagging, named entity recognition, dependency parsing, constituency parsing, semantic dependency parsing, semantic role labeling, coreference resolution, style transfer, semantic similarity, new word discovery, keyword and keyphrase extraction, automatic summarization, text classification and clustering, pinyin and Simplified/Traditional Chinese conversion, natural language processing
Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ languages, with a router that picks the right checkpoint per request.
💫 Industrial-strength Natural Language Processing (NLP) in Python
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
- nlp
- pre-trained-model
- unilm
- minilm
An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.
- python
- pii
- privacy
- data-anonymization
all kinds of text classification models and more with deep learning
- classification
- nlp
- fasttext
- textcnn
An open source library for deep learning end-to-end dialog systems and chatbots.
Local-first healthcare AI: clinical NER and HIPAA PII de-identification on hardware you control. 2,200+ medical models, 35 model-backed PII languages, and Python, MLX, Android and browser runtimes. Apache-2.0 SDK.
- healthcare
- llm
- on-device
- on-premise
TranslatedChinese text classification, TextCNN, TextRNN, FastText, TextRCNN, BiLSTM_Attention, DPCNN, Transformer, based on pytorch, ready to use out of the box.
A machine learning software for extracting information from scholarly documents
VADER Sentiment Analysis. VADER (Valence Aware Dictionary and sEntiment Reasoner) is a lexicon and rule-based sentiment analysis tool that is specifically attuned to sentiments expressed in social media, and works well on texts from other domains.
A C library for parsing/normalizing street addresses around the world. Powered by statistical NLP and open geo data.
Tensorflow solution of NER task Using BiLSTM-CRF model with Google BERT Fine-tuning And private Server services
- bert
- ner
- named-entity-recognition
- blstm
TranslatedChinese text classification using Bert and ERNIE
Natural language detection
- javascript
- natural-language
- language-detection
- nlp
Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI
- transformers
- text-classification
- named-entity-recognition
- question-answering
State of the Art Natural Language Processing
百度NLP:分词,词性标注,命名实体识别,词重要性
- word-segmentation
- part-of-speech-tagger
- named-entity-recognition
- chinese-word-segmentation
Snips Python library to extract meaning from text
FlagAI (Fast LArge-scale General AI models) is a fast, easy-to-use and extensible toolkit for large-scale model.
Module for automatic summarization of text documents and HTML pages.
- python
- lsa
- textteaser
- html-page
📐 Compute distance between sequences. 30+ algorithms, pure python implementation, common interface, optional external libs usage.
Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://casl-project.ai/
Bioinformatics'2020: BioBERT: a pre-trained biomedical language representation model for biomedical text mining