🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
- nlp
- natural-language-processing
- pytorch
- pytorch-transformers
Repository Index
78,351 visible repositories in the index
1–24 of 118 · Most stars
A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.
TranslatedChinese word segmentation, part-of-speech tagging, named entity recognition, dependency parsing, constituency parsing, semantic dependency parsing, semantic role labeling, coreference resolution, style transfer, semantic similarity, new word discovery, keyword and keyphrase extraction, automatic summarization, text classification and clustering, pinyin and Simplified/Traditional Chinese conversion, natural language processing
- nlp
- natural-language-processing
- hanlp
- pos-tagging
💫 Industrial-strength Natural Language Processing (NLP) in Python
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
- nlp
- pre-trained-model
- unilm
- minilm
Topic Modelling for Humans
- gensim
- topic-modeling
- information-retrieval
- machine-learning
State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!
- browser
- javascript
- transformers
- webml
A very simple framework for state-of-the-art Natural Language Processing (NLP)
modest natural-language processing
- nlp
- part-of-speech
- named-entity-recognition
Unsupervised text tokenizer for Neural Network-based text generation.
- neural-machine-translation
- natural-language-processing
- word-segmentation
An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.
- python
- pii
- privacy
- data-anonymization
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
- nlp
- natural-language-processing
- natural-language-understanding
- language-model
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
- natural-language-processing
- nlp
- nlp-parsing
- named-entity-recognition
Simple, Pythonic, text processing--Sentiment analysis, part-of-speech tagging, noun phrase extraction, translation, and more.
- nlp
- nltk
- pattern
- python
Leveraging BERT and c-TF-IDF to create easily interpretable topics.
- bert
- transformers
- topic-modeling
- sentence-embeddings
Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages
Officially maintained, supported by PaddlePaddle, including CV, NLP, Speech, Rec, TS, big models and so on.
- paddlepaddle
- deep-learning
- neural-network
- computer-vision
TranslatedThe pkuseg toolkit for multi-domain Chinese word segmentation
- chinese-word-segmentation
Extract Keywords from sentence or Replace keywords in sentences.
- search-in-text
- keyword-extraction
- nlp
- word2vec
A machine learning software for extracting information from scholarly documents
- machine-learning
- scientific-articles
- metadata
A C library for parsing/normalizing street addresses around the world. Powered by statistical NLP and open geo data.
- address-parser
- machine-learning
- nlp
- address
Easily train your own text-generating neural network of any size and complexity on any text dataset with a few lines of code.
- keras
- deep-learning
- text-generation
- tensorflow
An Open-Source Framework for Prompt-Learning.
Tensorflow solution of NER task Using BiLSTM-CRF model with Google BERT Fine-tuning And private Server services
- bert
- ner
- named-entity-recognition
- blstm