47,133 repositories indexed
1–24 of 84 · Most stars
Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ languages, with a router that picks the right checkpoint per request.
💫 Industrial-strength Natural Language Processing (NLP) in Python
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
Offline, privacy-first grammar checker. Fast, open-source, Rust-powered
Topic Modelling for Humans
Style and Grammar Checker for 25+ Languages
A very simple framework for state-of-the-art Natural Language Processing (NLP)
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
Unsupervised text tokenizer for Neural Network-based text generation.
Multi-layer Recurrent Neural Networks (LSTM, GRU, RNN) for character-level language models in Torch
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.
Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages
An NLP library for building bots, with entity extraction, sentiment analysis, automatic language identify, and so more
VADER Sentiment Analysis. VADER (Valence Aware Dictionary and sEntiment Reasoner) is a lexicon and rule-based sentiment analysis tool that is specifically attuned to sentiments expressed in social media, and works well on texts from other domains.
Module for automatic summarization of text documents and HTML pages.
Seamlessly integrate LLMs into scikit-learn.
TranslatedNon-autoregressive System 1 decision engine, designed for structured, typed decision-making scenarios. DeepOpen Multilingual, non-autoregressive System 1 decision engine.
Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://casl-project.ai/
A full spaCy pipeline and models for scientific/biomedical documents.
Self-contained Machine Learning and Natural Language Processing library in Go
Simple text to phones converter for multiple languages