🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
- nlp
- natural-language-processing
- pytorch
- pytorch-transformers
111,820 visible repositories in the index
1–24 of 65 · Most stars
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
TranslatedChinese word segmentation, part-of-speech tagging, named entity recognition, dependency parsing, constituency parsing, semantic dependency parsing, semantic role labeling, coreference resolution, style transfer, semantic similarity, new word discovery, keyword and keyphrase extraction, automatic summarization, text classification and clustering, pinyin and Simplified/Traditional Chinese conversion, natural language processing
💫 Industrial-strength Natural Language Processing (NLP) in Python
A very simple framework for state-of-the-art Natural Language Processing (NLP)
modest natural-language processing
An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages
An open source library for deep learning end-to-end dialog systems and chatbots.
An Open-Source Framework for Prompt-Learning.
Tensorflow solution of NER task Using BiLSTM-CRF model with Google BERT Fine-tuning And private Server services
[EMNLP 2022] An Open Toolkit for Knowledge Graph Extraction and Construction
Generalist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts)
Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI
State of the Art Natural Language Processing
百度NLP:分词,词性标注,命名实体识别,词重要性
Snips Python library to extract meaning from text
📐 Compute distance between sequences. 30+ algorithms, pure python implementation, common interface, optional external libs usage.
SymSpell: 1 million times faster spelling correction & fuzzy search through Symmetric Delete spelling correction algorithm
TextAttack 🐙 is a Python framework for adversarial attacks, data augmentation, and model training in NLP https://textattack.readthedocs.io/en/master/
中文分词
fastNLP: A Modularized and Extensible NLP Framework. Currently still in incubation.
Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo
:book: A Golang library for text processing, including tokenization, part-of-speech tagging, and named-entity extraction.