1.Automattic / harper
Offline, privacy-first grammar checker. Fast, open-source, Rust-powered
- developer-tools
- english-language
- grammar-checker
- rust
- webassembly
- chrome-extension
- +3 more
+3,336 stars
from 14,077 · score 8.11
Trending repositories
Ranked by Attention Score: stars gained over the last 90 complete days
75 repositories by Attention Score · Aug 7, 2026 – Nov 4, 2026 (UTC)
2.openai / tiktoken
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
+744 stars
from 18,861 · score 6.61
3.languagetool-org / languagetool
Style and Grammar Checker for 25+ Languages
- grammar
- natural-language
- natural-language-processing
- style-checker
- proofreading
- spellcheck
+516 stars
from 14,719 · score 6.25
4.karpathy / minbpe
Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
+367 stars
from 10,642 · score 5.91
5.argosopentech / argos-translate
Open-source offline translation library written in Python
- python
- machine-translation
- transformers
- translation
- language-models
- linux
- +2 more
+311 stars
from 6,314 · score 5.74
6.huggingface / tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
- nlp
- natural-language-processing
- natural-language-understanding
- language-model
- transformers
- bert
- +1 more
+301 stars
from 10,919 · score 5.71
7.explosion / spaCy
💫 Industrial-strength Natural Language Processing (NLP) in Python
- natural-language-processing
- data-science
- machine-learning
- python
- cython
- nlp
- +11 more
+291 stars
from 33,731 · score 5.68
8.huggingface / transformers.js
State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!
- browser
- javascript
- transformers
- webml
+236 stars
from 16,164 · score 5.47
9.fxsjy / jieba
TranslatedJieba (结巴, "stutter") Chinese word segmentation
+211 stars
from 35,018 · score 5.36
10.google / sentencepiece
Unsupervised text tokenizer for Neural Network-based text generation.
- neural-machine-translation
- natural-language-processing
- word-segmentation
+182 stars
from 11,983 · score 5.21
11.hankcs / HanLP
TranslatedChinese word segmentation, part-of-speech tagging, named entity recognition, dependency parsing, constituency parsing, semantic dependency parsing, semantic role labeling, coreference resolution, style transfer, semantic similarity, new word discovery, keyword and keyphrase extraction, automatic summarization, text classification and clustering, pinyin and Simplified/Traditional Chinese conversion, natural language processing
- nlp
- natural-language-processing
- hanlp
- pos-tagging
- dependency-parser
- text-classification
- +2 more
+153 stars
from 36,382 · score 5.04
12.nltk / nltk
NLTK Source
+114 stars
from 14,653 · score 4.74
13.microsoft / unilm
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
- nlp
- pre-trained-model
- unilm
- minilm
- layoutlm
- layoutxlm
- +14 more
+97 stars
from 22,142 · score 4.58
14.PaddlePaddle / PaddleNLP
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
- nlp
- embedding
- bert
- ernie
- paddlenlp
- pretrained-models
- +13 more
+66 stars
from 12,921 · score 4.20
15.piskvorky / gensim
Topic Modelling for Humans
- gensim
- topic-modeling
- information-retrieval
- machine-learning
- natural-language-processing
- nlp
- +9 more
+63 stars
from 16,448 · score 4.16
16.stanfordnlp / stanza
Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages
+63 stars
from 7,843 · score 4.16
17.karpathy / char-rnn
Multi-layer Recurrent Neural Networks (LSTM, GRU, RNN) for character-level language models in Torch
+61 stars
from 12,072 · score 4.13
18.cjhutto / vaderSentiment
VADER Sentiment Analysis. VADER (Valence Aware Dictionary and sEntiment Reasoner) is a lexicon and rule-based sentiment analysis tool that is specifically attuned to sentiments expressed in social media, and works well on texts from other domains.
+60 stars
from 5,030 · score 4.11
19.mozillazg / python-pinyin
TranslatedChinese characters to pinyin converter (pypinyin)
- python
- pinyin
- pypinyin
- hanzi
- hanzi-pinyin
- python2
- +2 more
+49 stars
from 5,341 · score 3.91
20.tensorflow / tfjs-models
Pretrained models for TensorFlow.js
+44 stars
from 14,767 · score 3.81
21.spencermountain / compromise
modest natural-language processing
- nlp
- part-of-speech
- named-entity-recognition
+40 stars
from 12,131 · score 3.71
22.stanfordnlp / CoreNLP
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
- natural-language-processing
- nlp
- nlp-parsing
- named-entity-recognition
- stanford-nlp
+40 stars
from 10,086 · score 3.71
23.facebookresearch / fairseqArchived
Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
+34 stars
from 32,177 · score 3.56
+34 stars
from 5,073 · score 3.56
25.flairNLP / flair
A very simple framework for state-of-the-art Natural Language Processing (NLP)
+30 stars
from 14,367 · score 3.43
+28 stars
from 633 · score 3.37
27.capitalone / DataProfiler
What's in your data? Extract schema, statistics and entities from datasets
- python
- privacy
- pii
- npi
- nlp
- data-science
- +14 more
+27 stars
from 1,568 · score 3.33
28.allenai / scispacy
A full spaCy pipeline and models for scientific/biomedical documents.
- scientific-documents
- spacy
- custom-pipes
- nlp
- biomedical
- bioinformatics
+24 stars
from 1,975 · score 3.22
29.clips / pattern
Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.
- python
- machine-learning
- natural-language-processing
- web-mining
- wordnet
- sentiment-analysis
- +1 more
+20 stars
from 8,836 · score 3.04
30.fnnx-ai / scikit-llm
Seamlessly integrate LLMs into scikit-learn.
+19 stars
from 3,520 · score 3.00
31.bootphon / phonemizer
Simple text to phones converter for multiple languages
+18 stars
from 1,559 · score 2.94
+17 stars
from 10,865 · score 2.89
33.axa-group / nlp.js
An NLP library for building bots, with entity extraction, sentiment analysis, automatic language identify, and so more
- nlp
- nlu
- nodejs
- sentiment-analysis
- natural-language-processing
- bot
- +7 more
+16 stars
from 6,561 · score 2.83
34.life4 / textdistance
📐 Compute distance between sequences. 30+ algorithms, pure python implementation, common interface, optional external libs usage.
- distance
- algorithm
- python
- textdistance
- hamming-distance
- levenshtein-distance
- +7 more
+16 stars
from 3,530 · score 2.83
35.go-ego / gse
Go efficient fast multilingual NLP and text segmentation; support English, Chinese, Japanese and others.
- go
- segment
- nlp
- gse
- hmm
- jieba
- +5 more
+16 stars
from 2,831 · score 2.83
36.dmis-lab / biobert
Bioinformatics'2020: BioBERT: a pre-trained biomedical language representation model for biomedical text mining
+16 stars
from 2,199 · score 2.83
37.wooorm / franc
Natural language detection
+15 stars
from 4,404 · score 2.77
38.cltk / cltk
The Classical Language Toolkit
+15 stars
from 914 · score 2.77
39.allenai / allennlpArchived
An open-source NLP research library, built on PyTorch.
+14 stars
from 11,871 · score 2.71
40.JohnSnowLabs / spark-nlp
State of the Art Natural Language Processing
- nlp
- natural-language-processing
- spark
- pyspark
- named-entity-recognition
- sentiment-analysis
- +14 more
+14 stars
from 4,146 · score 2.71
41.keras-team / keras-hub
Pretrained model hub for Keras 3.
+14 stars
from 982 · score 2.71
42.pemistahl / lingua-go
The most accurate natural language detection library for Go, suitable for short text and mixed-language text
- natural-language-processing
- language-detection
- language-recognition
- language-classification
- language-identification
- language-processing
- +6 more
+13 stars
from 1,356 · score 2.64
43.miso-belica / sumy
Module for automatic summarization of text documents and HTML pages.
- python
- lsa
- textteaser
- html-page
- summarizer
- pagerank-algorithm
- +8 more
+12 stars
from 3,688 · score 2.56
44.ikawaha / kagome
Self-contained Japanese Morphological Analyzer written in pure Go
- japanese
- tokenizer
- nlp-library
- japanese-language
- pos-tagging
- segmentation
- +3 more
+12 stars
from 975 · score 2.56
45.quanteda / quanteda
An R package for the Quantitative Analysis of Textual Data
- r
- text-analytics
- natural-language-processing
- corpus
- quanteda
+12 stars
from 883 · score 2.56
46.facebookresearch / fastTextArchived
Library for fast text representation and classification.
+11 stars
from 26,502 · score 2.48
47.mozillazg / go-pinyin
TranslatedConvert Chinese characters to pinyin
- go
- pinyin
- golang
- hanzi
- hanzi-pinyin
- chinese
+11 stars
from 1,785 · score 2.48
48.jpmckinney / tf-idf-similarity
Ruby gem to calculate the similarity between texts using tf*idf
+11 stars
from 781 · score 2.48
49.facebookresearch / vizseq
An Analysis Toolkit for Natural Language Generation (Translation, Captioning, Summarization, etc.)
+11 stars
from 453 · score 2.48
50.derek73 / python-nameparser
Parse human names into title, given, middle, family, suffix, nickname and maiden name. Typed, zero-dependency, CJK-aware.
- python
- text-processing
- text-parser
- python-module
- cjk
- name-parsing
- +5 more
+9 stars
from 711 · score 2.30
51.meta-toolkit / meta
A Modern C++ Data Sciences Toolkit
- nlp
- nlp-parsing
- search-engine
- inverted-index
- pos-tag
- text-analysis
- +6 more
+7 stars
from 714 · score 2.08
52.olebedev / when
A natural language date/time parser with pluggable rules
- natural-language
- datetime
- date
- time
- parser
- golang
+6 stars
from 1,458 · score 1.95
53.retextjs / retext
natural language processor powered by plugins part of the @unifiedjs collective
- natural-language
- ast
- retext
- cst
- javascript
- unified
+5 stars
from 2,428 · score 1.79
54.asyml / texar
Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://casl-project.ai/
- machine-learning
- natural-language-processing
- tensorflow
- deep-learning
- text-generation
- python
- +9 more
+5 stars
from 2,388 · score 1.79
55.nlpodyssey / spago
Self-contained Machine Learning and Natural Language Processing library in Go
- deep-learning
- machine-learning
- natural-language-processing
- neural-network
- computation-graph
- automatic-differentiation
- +13 more
+5 stars
from 1,848 · score 1.79
56.curiosity-ai / catalyst
🚀 Catalyst is a C# Natural Language Processing library built for speed. Inspired by spaCy's design, it brings pre-trained models, out-of-the box support for training word and document embeddings, and flexible entity recognition models.
+5 stars
from 856 · score 1.79
57.abadojack / whatlanggo
Natural language detection library for Go
+5 stars
from 692 · score 1.79
58.kbastani / graphifyArchived
Graphify is a Neo4j unmanaged extension used for document and text classification using graph-based hierarchical pattern recognition.
+5 stars
from 446 · score 1.79
59.facebookresearch / ParlAIArchived
A framework for training and evaluating AI models on a variety of openly available dialogue datasets.
+4 stars
from 10,612 · score 1.61
+4 stars
from 3,250 · score 1.61
61.MihaiValentin / lunr-languages
A collection of languages stemmers and stopwords for Lunr Javascript library
- lunr-languages
- stemmer
- stopwords
- lunr
- localization
- language-stemmer
+4 stars
from 455 · score 1.61
62.fukuball / jieba-php
Translated"Jieba" (Chinese for "to stutter") Chinese text segmentation: built to be the best PHP Chinese word segmentation module.
- nlp
- natural-language-processing
- chinese-text-segmentation
- machine-learning
+3 stars
from 1,375 · score 1.39
63.simplenlg / simplenlg
Java API for Natural Language Generation. Originally developed by Ehud Reiter at the University of Aberdeen’s Department of Computing Science and co-founder of Arria NLG. This git repo is the official SimpleNLG version.
- simplenlg
- natural-language-generation
- nlg
- realiser
- surface-realiser
- java
- +1 more
+3 stars
from 830 · score 1.39
64.diasks2 / pragmatic_segmenter
Pragmatic Segmenter is a rule-based sentence boundary detection gem that works out-of-the-box across many languages.
+3 stars
from 594 · score 1.39
65.NLPatVCU / medaCy
:hospital: Medical Text Mining and Information Extraction with spaCy
- natural-language-processing
- medical-natural-language-processing
- machine-learning
- metamap
- clinical-text-processing
- information-extraction
- +2 more
+3 stars
from 439 · score 1.39
66.gagolews / stringi
Fast and Portable Character String Processing in R (with the Unicode ICU)
+3 stars
from 318 · score 1.39
67.pytorch / textArchived
Models, data loaders and abstractions for language processing, powered by PyTorch
- nlp
- data-loader
- deep-learning
- pytorch
- dataset
- models
+2 stars
from 3,552 · score 1.10
68.minimaxir / textgenrnn
Easily train your own text-generating neural network of any size and complexity on any text dataset with a few lines of code.
- keras
- deep-learning
- text-generation
- tensorflow
- python
+1 stars
from 4,917 · score 0.69
69.huggingface / swift-coreml-transformersArchived
Swift Core ML 3 implementations of GPT-2, DistilGPT-2, BERT, and DistilBERT for Question answering. Other Transformers coming soon!
+1 stars
from 1,681 · score 0.69
70.patil-suraj / question_generation
Neural question generation using transformers
- nlp
- nlg
- deep-learning
- transformer
- t5
- question-generation
- +2 more
+1 stars
from 1,137 · score 0.69
71.dselivanov / text2vec
Fast vectorization, topic modeling, distances and GloVe word embeddings in R.
- word2vec
- text-mining
- natural-language-processing
- glove
- vectorization
- topic-modeling
- +2 more
+1 stars
from 876 · score 0.69
72.dbpedia-spotlight / dbpedia-spotlightArchived
DBpedia Spotlight is a tool for automatically annotating mentions of DBpedia resources in text.
- dbpedia-spotlight
- nlp
- semantic-web
- entity-linking
- text-annotation
- content-tagging
- +2 more
+1 stars
from 760 · score 0.69
73.threedaymonk / textArchived
Collection of text algorithms. gem install text
+1 stars
from 598 · score 0.69
74.shawnwun / RNNLG
RNNLG is an open source benchmark toolkit for Natural Language Generation (NLG) in spoken dialogue system application domains. It is released by Tsung-Hsien (Shawn) Wen from Cambridge Dialogue Systems Group under Apache License 2.0.
- natural-language-processing
- natural-language-generation
- nlg-dataset
- deep-learning
- machine-learning
- dialogue-systems
- +3 more
+1 stars
from 490 · score 0.69
75.james-bowman / nlp
Selected Machine Learning algorithms for natural language processing and semantic analysis in Golang
- go
- golang
- natural-language-processing
- nlp
- lsa
- latent-semantic-analysis
- +14 more
+1 stars
from 476 · score 0.69