🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
- nlp
- natural-language-processing
- pytorch
- pytorch-transformers
Repository Index
71,372 visible repositories in the index
1–24 of 48 · Most stars
A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.
TranslatedChinese word segmentation, part-of-speech tagging, named entity recognition, dependency parsing, constituency parsing, semantic dependency parsing, semantic role labeling, coreference resolution, style transfer, semantic similarity, new word discovery, keyword and keyphrase extraction, automatic summarization, text classification and clustering, pinyin and Simplified/Traditional Chinese conversion, natural language processing
- nlp
- natural-language-processing
- hanlp
- pos-tagging
💫 Industrial-strength Natural Language Processing (NLP) in Python
A very simple framework for state-of-the-art Natural Language Processing (NLP)
modest natural-language processing
- nlp
- part-of-speech
- named-entity-recognition
Unsupervised text tokenizer for Neural Network-based text generation.
- neural-machine-translation
- natural-language-processing
- word-segmentation
An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.
- python
- pii
- privacy
- data-anonymization
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
- natural-language-processing
- nlp
- nlp-parsing
- named-entity-recognition
Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages
An open source library for deep learning end-to-end dialog systems and chatbots.
Language Technology Platform
- nlp
- natural-language-processing
- chinese-nlp
- machine-learning
A machine learning software for extracting information from scholarly documents
- machine-learning
- scientific-articles
- metadata
Tensorflow solution of NER task Using BiLSTM-CRF model with Google BERT Fine-tuning And private Server services
- bert
- ner
- named-entity-recognition
- blstm
[EMNLP 2022] An Open Toolkit for Knowledge Graph Extraction and Construction
- knowledge-graph
- relation-extraction
- chinese
- named-entity-recognition
Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI
- transformers
- text-classification
- named-entity-recognition
- question-answering
Generalist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts)
- information-extraction
- large-language-models
- named-entity-recognition
- natural-language-processing
State of the Art Natural Language Processing
百度NLP：分词，词性标注，命名实体识别，词重要性
- word-segmentation
- part-of-speech-tagger
- named-entity-recognition
- chinese-word-segmentation
Snips Python library to extract meaning from text
- nlp
- nlu
- python
- machine-learning
中文分词
- hanlp
- natural-language-processing
- chinese-word-segmentation
- part-of-speech-tagger
🇨🇳 功能全面的汉字工具库 (拼音 笔画 偏旁 成语 语音 可视化等) (Chinese character util)
- spell-stroke
- draw
- chinese-characters
- pinyin
Neologism dictionary based on the language resources on the Web for mecab-ipadic
- mecab-ipadic
- named-entities
- dictionary
- furigana
文本挖掘和预处理工具（文本清洗、新词发现、情感分析、实体识别链接、关键词抽取、知识抽取、句法分析等），无监督或弱监督方法
- nlp
- sentiment-analysis
- new-word-discovery
- unsupervised