A very simple framework for state-of-the-art Natural Language Processing (NLP)
Repository Index
78,850 visible repositories in the index
1–24 of 50 · Most stars
An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.
- python
- pii
- privacy
- data-anonymization
Leveraging BERT and c-TF-IDF to create easily interpretable topics.
- bert
- transformers
- topic-modeling
- sentence-embeddings
all kinds of text classification models and more with deep learning
- classification
- nlp
- fasttext
- textcnn
Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research
- chatgpt
- chatgpt-api
- gpt-3
- gpt-3-prompts
Language, engine, and tooling for expressing, testing, and evaluating composable language rules on input strings.
State of the Art Natural Language Processing
Superfast AI decision making and intelligent processing of multi-modal data.
Neologism dictionary based on the language resources on the Web for mecab-ipadic
- mecab-ipadic
- named-entities
- dictionary
- furigana
结巴分词(java版)
Kashgari is a production-level NLP Transfer learning framework built on top of tf.keras for text-labeling and text-classification, includes Word2Vec, BERT, and GPT2 Language Embedding.
- nlp
- sequence-labeling
- text-classification
- bert-model
Multilingual text (NLP) processing toolkit
中文命名实体识别（包括多种模型：HMM，CRF，BiLSTM，BiLSTM+CRF的具体实现）
- named-entity-recognition
- nlp
- sequence-labeling
- pytorch-nlp
NLP, before and after spaCy
- natural-language-processing
- nlp
- python
- spacy
Chinese NER(Named Entity Recognition) using BERT(Softmax, CRF, Span)
- chinese
- nlp
- ner
- bert
Bioinformatics'2020: BioBERT: a pre-trained biomedical language representation model for biomedical text mining
EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit
- transformers
- bert
- nlp
- pretrained-models
Explain, analyze, and visualize NLP language models. Ecco creates interactive visualizations directly in Jupyter notebooks explaining the behavior of Transformer-based language models (like GPT2, BERT, RoBERTA, T5, and T0).
- nlp
- visualization
- explorables
- natural-language-processing
ALIbaba's Collection of Encoder-decoders from MinD (Machine IntelligeNce of Damo) Lab
An Open-source Neural Hierarchical Multi-label Text Classification Toolkit
NCRF++, a Neural Sequence Labeling Toolkit. Easy use to any sequence labeling tasks (e.g. NER, POS, Segmentation). It includes character LSTM/CNN, word LSTM/CNN and softmax/CRF components.
- pytorch
- ner
- sequence-labeling
- crf
The most accurate natural language detection library for Python, suitable for short text and mixed-language text
- nlp
- natural-language-processing
- language-detection
- language-recognition
中文长文本分类、短句子分类、多标签分类、两句子相似度（Chinese Text Classification of Keras NLP, multi-label classify, or sentence classify, long or short），字词句向量嵌入层（embeddings）和网络层（graph）构建基类，FastText，TextCNN，CharCNN，TextRNN, RCNN, DCNN, DPCNN, VDCNN, CRNN, Bert, Xlnet, Albert, Attention, DeepMoji, HAN, 胶囊网络-CapsuleNet, Transformer-encode, Seq2seq, SWEM, LEAM, TextGCN
- text-classification
- keras
- rcnn
- dcnn
Microsoft.Recognizers.Text provides recognition and resolution of numbers, units, date/time, etc. in multiple languages (ZH, EN, FR, ES, PT, DE, IT, TR, HI, NL. Partial support for JA, KO, AR, SV). Packages available at: https://www.nuget.org/profiles/Recognizers.Text, https://www.npmjs.com/~recognizers.text
- nlp
- datetime
- timex
- parser-library