🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
- nlp
- natural-language-processing
- pytorch
- pytorch-transformers
Repository Index
81,588 visible repositories in the index
1–24 of 110 · Most stars
A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.
Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ languages, with a router that picks the right checkpoint per request.
- calibration
- classification
- decision-model
- huggingface
Offline, privacy-first grammar checker. Fast, open-source, Rust-powered
- developer-tools
- english-language
- grammar-checker
- rust
Topic Modelling for Humans
- gensim
- topic-modeling
- information-retrieval
- machine-learning
State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!
- browser
- javascript
- transformers
- webml
Pretrained models for TensorFlow.js
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
- nlp
- embedding
- bert
- ernie
Unsupervised text tokenizer for Neural Network-based text generation.
- neural-machine-translation
- natural-language-processing
- word-segmentation
An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.
- python
- pii
- privacy
- data-anonymization
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
- nlp
- natural-language-processing
- natural-language-understanding
- language-model
Library for conversion between Traditional and Simplified Chinese
- chinese-translation
- traditional-chinese
- simplified-chinese
- chinese
Simple, Pythonic, text processing--Sentiment analysis, part-of-speech tagging, noun phrase extraction, translation, and more.
- nlp
- nltk
- pattern
- python
Leveraging BERT and c-TF-IDF to create easily interpretable topics.
- bert
- transformers
- topic-modeling
- sentence-embeddings
all kinds of text classification models and more with deep learning
- classification
- nlp
- fasttext
- textcnn
Open Source Neural Machine Translation and (Large) Language Models in PyTorch
- deep-learning
- pytorch
- machine-translation
- neural-machine-translation
An open source library for deep learning end-to-end dialog systems and chatbots.
Open-source offline translation library written in Python
- python
- machine-translation
- transformers
- translation
Translatedansj word segmentation. A true Java implementation of ICT. Its segmentation quality and speed both exceed the open-source version of ICT. Chinese word segmentation, person name recognition, part-of-speech tagging, user-defined dictionaries
- nlp
- chinese
- ansj
- java
Transformer related optimization, including BERT, GPT
- pytorch
- transformer
- gpt
- bert
Translated👮♂️The sensitive word tool for java.(Sensitive words / prohibited words / illegal words / profanity. A high-performance Java sensitive word filtering tool framework implemented based on the DFA algorithm. Built-in support for tag classification and grading of words. Please do not post content involving politics, advertising, marketing, circumventing the Great Firewall, or violating national laws and regulations. A high-performance sensitive word detection and filtering component, with traditional/simplified Chinese conversion, full-width/half-width conversion, Chinese character to pinyin conversion, fuzzy search, and other features.)
- sensitive
- sensitive-word
- sensitive-word-filter
- dfa
TranslatedChinese text classification, TextCNN, TextRNN, FastText, TextRCNN, BiLSTM_Attention, DPCNN, Transformer, based on pytorch, ready to use out of the box.
keras implement of transformers for humans
A machine learning software for extracting information from scholarly documents
- machine-learning
- scientific-articles
- metadata