1.Automattic / harper
Offline, privacy-first grammar checker. Fast, open-source, Rust-powered
- developer-tools
- english-language
- grammar-checker
- rust
- webassembly
- chrome-extension
- +3 more
+3,333 stars
from 14,058 · score 8.11
Trending repositories
Ranked by Attention Score: stars gained over the last 90 complete days
38 repositories by Attention Score · Aug 6, 2026 – Nov 3, 2026 (UTC)
2.openai / tiktoken
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
+739 stars
from 18,853 · score 6.61
3.languagetool-org / languagetool
Style and Grammar Checker for 25+ Languages
- grammar
- natural-language
- natural-language-processing
- style-checker
- proofreading
- spellcheck
+513 stars
from 14,718 · score 6.24
4.karpathy / minbpe
Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
+363 stars
from 10,642 · score 5.90
5.argosopentech / argos-translate
Open-source offline translation library written in Python
- python
- machine-translation
- transformers
- translation
- language-models
- linux
- +2 more
+313 stars
from 6,310 · score 5.75
6.huggingface / tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
- nlp
- natural-language-processing
- natural-language-understanding
- language-model
- transformers
- bert
- +1 more
+299 stars
from 10,918 · score 5.70
7.explosion / spaCy
💫 Industrial-strength Natural Language Processing (NLP) in Python
- natural-language-processing
- data-science
- machine-learning
- python
- cython
- nlp
- +11 more
+293 stars
from 33,724 · score 5.68
8.huggingface / transformers.js
State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!
- browser
- javascript
- transformers
- webml
+237 stars
from 16,163 · score 5.47
9.fxsjy / jieba
TranslatedJieba (结巴, "stutter") Chinese word segmentation
+215 stars
from 35,015 · score 5.38
10.google / sentencepiece
Unsupervised text tokenizer for Neural Network-based text generation.
- neural-machine-translation
- natural-language-processing
- word-segmentation
+181 stars
from 11,983 · score 5.20
11.hankcs / HanLP
TranslatedChinese word segmentation, part-of-speech tagging, named entity recognition, dependency parsing, constituency parsing, semantic dependency parsing, semantic role labeling, coreference resolution, style transfer, semantic similarity, new word discovery, keyword and keyphrase extraction, automatic summarization, text classification and clustering, pinyin and Simplified/Traditional Chinese conversion, natural language processing
- nlp
- natural-language-processing
- hanlp
- pos-tagging
- dependency-parser
- text-classification
- +2 more
+157 stars
from 36,379 · score 5.06
12.nltk / nltk
NLTK Source
+113 stars
from 14,653 · score 4.74
13.microsoft / unilm
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
- nlp
- pre-trained-model
- unilm
- minilm
- layoutlm
- layoutxlm
- +14 more
+96 stars
from 22,141 · score 4.57
14.PaddlePaddle / PaddleNLP
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
- nlp
- embedding
- bert
- ernie
- paddlenlp
- pretrained-models
- +13 more
+66 stars
from 12,921 · score 4.20
15.stanfordnlp / stanza
Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages
+65 stars
from 7,841 · score 4.19
16.piskvorky / gensim
Topic Modelling for Humans
- gensim
- topic-modeling
- information-retrieval
- machine-learning
- natural-language-processing
- nlp
- +9 more
+64 stars
from 16,446 · score 4.17
17.cjhutto / vaderSentiment
VADER Sentiment Analysis. VADER (Valence Aware Dictionary and sEntiment Reasoner) is a lexicon and rule-based sentiment analysis tool that is specifically attuned to sentiments expressed in social media, and works well on texts from other domains.
+60 stars
from 5,030 · score 4.11
18.karpathy / char-rnn
Multi-layer Recurrent Neural Networks (LSTM, GRU, RNN) for character-level language models in Torch
+59 stars
from 12,072 · score 4.09
19.mozillazg / python-pinyin
TranslatedChinese characters to pinyin converter (pypinyin)
- python
- pinyin
- pypinyin
- hanzi
- hanzi-pinyin
- python2
- +2 more
+49 stars
from 5,340 · score 3.91
20.tensorflow / tfjs-models
Pretrained models for TensorFlow.js
+46 stars
from 14,767 · score 3.85
21.stanfordnlp / CoreNLP
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
- natural-language-processing
- nlp
- nlp-parsing
- named-entity-recognition
- stanford-nlp
+41 stars
from 10,085 · score 3.74
22.spencermountain / compromise
modest natural-language processing
- nlp
- part-of-speech
- named-entity-recognition
+40 stars
from 12,131 · score 3.71
+34 stars
from 5,073 · score 3.56
24.facebookresearch / fairseqArchived
Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
+33 stars
from 32,177 · score 3.53
25.flairNLP / flair
A very simple framework for state-of-the-art Natural Language Processing (NLP)
+30 stars
from 14,366 · score 3.43
26.clips / pattern
Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.
- python
- machine-learning
- natural-language-processing
- web-mining
- wordnet
- sentiment-analysis
- +1 more
+20 stars
from 8,836 · score 3.04
+18 stars
from 10,865 · score 2.94
28.axa-group / nlp.js
An NLP library for building bots, with entity extraction, sentiment analysis, automatic language identify, and so more
- nlp
- nlu
- nodejs
- sentiment-analysis
- natural-language-processing
- bot
- +7 more
+16 stars
from 6,561 · score 2.83
29.life4 / textdistance
📐 Compute distance between sequences. 30+ algorithms, pure python implementation, common interface, optional external libs usage.
- distance
- algorithm
- python
- textdistance
- hamming-distance
- levenshtein-distance
- +7 more
+16 stars
from 3,530 · score 2.83
30.fnnx-ai / scikit-llm
Seamlessly integrate LLMs into scikit-learn.
+16 stars
from 3,520 · score 2.83
31.wooorm / franc
Natural language detection
+14 stars
from 4,404 · score 2.71
32.JohnSnowLabs / spark-nlp
State of the Art Natural Language Processing
- nlp
- natural-language-processing
- spark
- pyspark
- named-entity-recognition
- sentiment-analysis
- +14 more
+13 stars
from 4,146 · score 2.64
33.allenai / allennlpArchived
An open-source NLP research library, built on PyTorch.
+12 stars
from 11,871 · score 2.56
34.miso-belica / sumy
Module for automatic summarization of text documents and HTML pages.
- python
- lsa
- textteaser
- html-page
- summarizer
- pagerank-algorithm
- +8 more
+12 stars
from 3,688 · score 2.56
35.facebookresearch / fastTextArchived
Library for fast text representation and classification.
+11 stars
from 26,502 · score 2.48
36.facebookresearch / ParlAIArchived
A framework for training and evaluating AI models on a variety of openly available dialogue datasets.
+4 stars
from 10,612 · score 1.61
37.pytorch / textArchived
Models, data loaders and abstractions for language processing, powered by PyTorch
- nlp
- data-loader
- deep-learning
- pytorch
- dataset
- models
+2 stars
from 3,552 · score 1.10
38.minimaxir / textgenrnn
Easily train your own text-generating neural network of any size and complexity on any text dataset with a few lines of code.
- keras
- deep-learning
- text-generation
- tensorflow
- python
+1 stars
from 4,917 · score 0.69