Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ languages, with a router that picks the right checkpoint per request.
💫 Industrial-strength Natural Language Processing (NLP) in Python
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
Offline, privacy-first grammar checker. Fast, open-source, Rust-powered
Topic Modelling for Humans
State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!
Style and Grammar Checker for 25+ Languages
A very simple framework for state-of-the-art Natural Language Processing (NLP)
- pytorch
- nlp
- named-entity-recognition
- sequence-labeling
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
modest natural-language processing
- nlp
- part-of-speech
- named-entity-recognition
Multi-layer Recurrent Neural Networks (LSTM, GRU, RNN) for character-level language models in Torch
An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.
- python
- pii
- privacy
- data-anonymization
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages
An NLP library for building bots, with entity extraction, sentiment analysis, automatic language identify, and so more
State of the Art Natural Language Processing
📐 Compute distance between sequences. 30+ algorithms, pure python implementation, common interface, optional external libs usage.
TranslatedNon-autoregressive System 1 decision engine, designed for structured, typed decision-making scenarios. DeepOpen Multilingual, non-autoregressive System 1 decision engine.
Go efficient fast multilingual NLP and text segmentation; support English, Chinese, Japanese and others.
natural language processor powered by plugins part of the @unifiedjs collective
- natural-language
- ast
- retext
- cst
Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://casl-project.ai/
A full spaCy pipeline and models for scientific/biomedical documents.
- scientific-documents
- spacy
- custom-pipes
- nlp
Self-contained Machine Learning and Natural Language Processing library in Go