🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
- nlp
- natural-language-processing
- pytorch
- pytorch-transformers
Repository Index
88,573 visible repositories in the index
1–24 of 129 · Most stars
💫 Industrial-strength Natural Language Processing (NLP) in Python
Offline, privacy-first grammar checker. Fast, open-source, Rust-powered
- developer-tools
- english-language
- grammar-checker
- rust
Topic Modelling for Humans
- gensim
- topic-modeling
- information-retrieval
- machine-learning
State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!
- browser
- javascript
- transformers
- webml
Style and Grammar Checker for 25+ Languages
- grammar
- natural-language
- natural-language-processing
- style-checker
NLTK Source
- nltk
- python
- nlp
- natural-language-processing
A very simple framework for state-of-the-art Natural Language Processing (NLP)
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
- nlp
- embedding
- bert
- ernie
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
- nlp
- natural-language-processing
- natural-language-understanding
- language-model
Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.
- python
- machine-learning
- natural-language-processing
- web-mining
Leveraging BERT and c-TF-IDF to create easily interpretable topics.
- bert
- transformers
- topic-modeling
- sentence-embeddings
all kinds of text classification models and more with deep learning
- classification
- nlp
- fasttext
- textcnn
Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages
Open Source Neural Machine Translation and (Large) Language Models in PyTorch
- deep-learning
- pytorch
- machine-translation
- neural-machine-translation
An open source library for deep learning end-to-end dialog systems and chatbots.
Officially maintained, supported by PaddlePaddle, including CV, NLP, Speech, Rec, TS, big models and so on.
- paddlepaddle
- deep-learning
- neural-network
- computer-vision
Translated👮♂️The sensitive word tool for java.(Sensitive words / prohibited words / illegal words / profanity. A high-performance Java sensitive word filtering tool framework implemented based on the DFA algorithm. Built-in support for tag classification and grading of words. Please do not post content involving politics, advertising, marketing, circumventing the Great Firewall, or violating national laws and regulations. A high-performance sensitive word detection and filtering component, with traditional/simplified Chinese conversion, full-width/half-width conversion, Chinese character to pinyin conversion, fuzzy search, and other features.)
- sensitive
- sensitive-word
- sensitive-word-filter
- dfa
Local-first healthcare AI: clinical NER and HIPAA PII de-identification on hardware you control. 2,200+ medical models, 35 model-backed PII languages, and Python, MLX, Android and browser runtimes. Apache-2.0 SDK.
- healthcare
- llm
- on-device
- on-premise
Extract Keywords from sentence or Replace keywords in sentences.
- search-in-text
- keyword-extraction
- nlp
- word2vec
Language Technology Platform
- nlp
- natural-language-processing
- chinese-nlp
- machine-learning
A machine learning software for extracting information from scholarly documents
- machine-learning
- scientific-articles
- metadata
TranslatedA high-performance sensitive word (illegal word / profanity) detection and filtering component, which also comes with Traditional/Simplified Chinese conversion, and supports full-width/half-width conversion, Chinese character to pinyin conversion, fuzzy search, and other features.
- word-filter
- stringsearch
- wordssearch
- pinyin