1.Automattic / harper
Offline, privacy-first grammar checker. Fast, open-source, Rust-powered
- developer-tools
- english-language
- grammar-checker
- rust
- webassembly
- chrome-extension
- +3 more
Ranked by Attention Score: stars gained over the last 180 complete days
72 repositories by Attention Score · May 9, 2026 – Nov 4, 2026 (UTC)
Offline, privacy-first grammar checker. Fast, open-source, Rust-powered
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
Style and Grammar Checker for 25+ Languages
Open-source offline translation library written in Python
💫 Industrial-strength Natural Language Processing (NLP) in Python
Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!
TranslatedJieba (结巴, "stutter") Chinese word segmentation
TranslatedChinese word segmentation, part-of-speech tagging, named entity recognition, dependency parsing, constituency parsing, semantic dependency parsing, semantic role labeling, coreference resolution, style transfer, semantic similarity, new word discovery, keyword and keyphrase extraction, automatic summarization, text classification and clustering, pinyin and Simplified/Traditional Chinese conversion, natural language processing
Unsupervised text tokenizer for Neural Network-based text generation.
NLTK Source
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
Topic Modelling for Humans
Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages
Multi-layer Recurrent Neural Networks (LSTM, GRU, RNN) for character-level language models in Torch
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
VADER Sentiment Analysis. VADER (Valence Aware Dictionary and sEntiment Reasoner) is a lexicon and rule-based sentiment analysis tool that is specifically attuned to sentiments expressed in social media, and works well on texts from other domains.
modest natural-language processing
TranslatedChinese characters to pinyin converter (pypinyin)
Library for fast text representation and classification.
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
A very simple framework for state-of-the-art Natural Language Processing (NLP)
Pretrained models for TensorFlow.js
Seamlessly integrate LLMs into scikit-learn.
A full spaCy pipeline and models for scientific/biomedical documents.
Go efficient fast multilingual NLP and text segmentation; support English, Chinese, Japanese and others.
State of the Art Natural Language Processing
What's in your data? Extract schema, statistics and entities from datasets
An NLP library for building bots, with entity extraction, sentiment analysis, automatic language identify, and so more
Natural language detection
Simple text to phones converter for multiple languages
The most accurate natural language detection library for Go, suitable for short text and mixed-language text
An open-source NLP research library, built on PyTorch.
Module for automatic summarization of text documents and HTML pages.
Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.
📐 Compute distance between sequences. 30+ algorithms, pure python implementation, common interface, optional external libs usage.
TranslatedConvert Chinese characters to pinyin
Graphify is a Neo4j unmanaged extension used for document and text classification using graph-based hierarchical pattern recognition.
Bioinformatics'2020: BioBERT: a pre-trained biomedical language representation model for biomedical text mining
Pretrained model hub for Keras 3.
The Classical Language Toolkit
Self-contained Japanese Morphological Analyzer written in pure Go
A framework for training and evaluating AI models on a variety of openly available dialogue datasets.
An R package for the Quantitative Analysis of Textual Data
🚀 Catalyst is a C# Natural Language Processing library built for speed. Inspired by spaCy's design, it brings pre-trained models, out-of-the box support for training word and document embeddings, and flexible entity recognition models.
Ruby gem to calculate the similarity between texts using tf*idf
Parse human names into title, given, middle, family, suffix, nickname and maiden name. Typed, zero-dependency, CJK-aware.
Natural language detection library for Go
natural language processor powered by plugins part of the @unifiedjs collective
Self-contained Machine Learning and Natural Language Processing library in Go
A natural language date/time parser with pluggable rules
Translated"Jieba" (Chinese for "to stutter") Chinese text segmentation: built to be the best PHP Chinese word segmentation module.
Java API for Natural Language Generation. Originally developed by Ehud Reiter at the University of Aberdeen’s Department of Computing Science and co-founder of Arria NLG. This git repo is the official SimpleNLG version.
A collection of languages stemmers and stopwords for Lunr Javascript library
Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://casl-project.ai/
A Modern C++ Data Sciences Toolkit
Models, data loaders and abstractions for language processing, powered by PyTorch
Pragmatic Segmenter is a rule-based sentence boundary detection gem that works out-of-the-box across many languages.
Selected Machine Learning algorithms for natural language processing and semantic analysis in Golang
:hospital: Medical Text Mining and Information Extraction with spaCy
A multilingual command line sentence tokenizer in Golang
Swift Core ML 3 implementations of GPT-2, DistilGPT-2, BERT, and DistilBERT for Question answering. Other Transformers coming soon!
Fast and Portable Character String Processing in R (with the Unicode ICU)
Neural question generation using transformers
DBpedia Spotlight is a tool for automatically annotating mentions of DBpedia resources in text.
CogComp's Natural Language Processing Libraries and Demos: Modules include lemmatizer, ner, pos, prep-srl, quantifier, question type, relation-extraction, similarity, temporal normalizer, tokenizer, transliteration, verb-sense, and more.