Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ languages, with a router that picks the right checkpoint per request.
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
- nlp
- pre-trained-model
- unilm
- minilm
Style and Grammar Checker for 25+ Languages
Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages
Module for automatic summarization of text documents and HTML pages.
- python
- lsa
- textteaser
- html-page
Simple text to phones converter for multiple languages
Pragmatic Segmenter is a rule-based sentence boundary detection gem that works out-of-the-box across many languages.
A collection of languages stemmers and stopwords for Lunr Javascript library
- lunr-languages
- stemmer
- stopwords
- lunr
An NLP library for Uralic languages such as Finnish, Skolt Sami, Moksha and so on. Also supporting some non-Uralic languages such as Spanish, French, Arabic, Swedish, Norwegian, Russian and English. LLMs, FSTs and More!
Stemmer packages for Go programming language. Includes English, German and Dutch stemmers.
Tagify produces a set of tags from a given source. Source can be either an HTML page, a Markdown document or a plain text. Supports English, Russian, Chinese, Hindi, Spanish, Arabic, Japanese, German, Hebrew, French and Korean languages.
- tagify
- keywords
- keyword-extraction
- html
A project around helping to prevent typing typos. TySug (Typo Suggestions) suggests alternative words with respect to keyboard layouts
- string-distance
- suggestions
- typo
- typing