47,133 repositories indexed
1–24 of 86 · Most stars
Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ languages, with a router that picks the right checkpoint per request.
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
Offline, privacy-first grammar checker. Fast, open-source, Rust-powered
Topic Modelling for Humans
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
modest natural-language processing
Unsupervised text tokenizer for Neural Network-based text generation.
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.
An NLP library for building bots, with entity extraction, sentiment analysis, automatic language identify, and so more
Naive linter for English prose
VADER Sentiment Analysis. VADER (Valence Aware Dictionary and sEntiment Reasoner) is a lexicon and rule-based sentiment analysis tool that is specifically attuned to sentiments expressed in social media, and works well on texts from other domains.
State of the Art Natural Language Processing
Module for automatic summarization of text documents and HTML pages.
📐 Compute distance between sequences. 30+ algorithms, pure python implementation, common interface, optional external libs usage.
Chronic is a pure Ruby natural language date parser.
TranslatedNon-autoregressive System 1 decision engine, designed for structured, typed decision-making scenarios. DeepOpen Multilingual, non-autoregressive System 1 decision engine.
Go efficient fast multilingual NLP and text segmentation; support English, Chinese, Japanese and others.
Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://casl-project.ai/
Bioinformatics'2020: BioBERT: a pre-trained biomedical language representation model for biomedical text mining
A full spaCy pipeline and models for scientific/biomedical documents.
What's in your data? Extract schema, statistics and entities from datasets
The most accurate natural language detection library for Go, suitable for short text and mixed-language text