🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
- nlp
- natural-language-processing
- pytorch
- pytorch-transformers
108,094 visible repositories in the index
1–24 of 121 · Most stars
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
💫 Industrial-strength Natural Language Processing (NLP) in Python
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
Topic Modelling for Humans
Style and Grammar Checker for 25+ Languages
Pretrained models for TensorFlow.js
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
Unsupervised text tokenizer for Neural Network-based text generation.
Multi-layer Recurrent Neural Networks (LSTM, GRU, RNN) for character-level language models in Torch
An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
Library for conversion between Traditional and Simplified Chinese
Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.
Leveraging BERT and c-TF-IDF to create easily interpretable topics.
all kinds of text classification models and more with deep learning
An open source library for deep learning end-to-end dialog systems and chatbots.
Officially maintained, supported by PaddlePaddle, including CV, NLP, Speech, Rec, TS, big models and so on.
Translatedpycorrector is a toolkit for text error correction. Text error correction, implementing applications of models such as Kenlm, T5, MacBERT, ChatGLM3, and Qwen2.5 in error correction scenarios, ready to use out of the box.
Local-first healthcare AI: clinical NER and HIPAA PII de-identification on hardware you control. 2,200+ medical models, 35 model-backed PII languages, and Python, MLX, Android and browser runtimes. Apache-2.0 SDK.
A machine learning software for extracting information from scholarly documents
TranslatedA high-performance sensitive word (illegal word / profanity) detection and filtering component, which also comes with Traditional/Simplified Chinese conversion, and supports full-width/half-width conversion, Chinese character to pinyin conversion, fuzzy search, and other features.
A C library for parsing/normalizing street addresses around the world. Powered by statistical NLP and open geo data.
Easily train your own text-generating neural network of any size and complexity on any text dataset with a few lines of code.
🦛 CHONK docs with Chonkie ✨ — The lightweight ingestion library for fast, efficient and robust RAG pipelines