Repository Index

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

• nlp
• pre-trained-model
• unilm
• minilm

Go efficient fast multilingual NLP and text segmentation; support English, Chinese, Japanese and others.

• go
• segment
• nlp
• gse

Bioinformatics'2020: BioBERT: a pre-trained biomedical language representation model for biomedical text mining

A full spaCy pipeline and models for scientific/biomedical documents.

• scientific-documents
• spacy
• custom-pipes
• nlp

Translated斑海豹 (Spotted Seal) — Phocinae-Largha-150M-v1: a 144.3M bilingual decision model. Tiny model. Big decisions.

• bilingual
• calibration
• cpu-inference
• decision-making

CogComp's Natural Language Processing Libraries and Demos: Modules include lemmatizer, ner, pos, prep-srl, quantifier, question type, relation-extraction, similarity, temporal normalizer, tokenizer, transliteration, verb-sense, and more.

• natural-language-processing
• nlp
• big-data
• data-mining

Natural Language Processing (NLP) library for Crystal

• string-distance
• stemmer
• inflector
• sentiment-analysis

A Ruby natural language processor.

• natural-language-processing
• nlp
• ruby
• rubynlp

A Library to parse natural language in pure Clojure and ClojureScript

• natural-language-processing
• clojure
• clojurescript
• pos-tagger

🔤 Natural language detection for Elixir without AI

• elixir
• language
• language-detection
• detect-language

Apache cTAKES is a Natural Language Processing (NLP) platform for clinical text.

• clinical
• nlp
• bioinformatics
• ai

An NLP library for Uralic languages such as Finnish, Skolt Sami, Moksha and so on. Also supporting some non-Uralic languages such as Spanish, French, Arabic, Swedish, Norwegian, Russian and English. LLMs, FSTs and More!

• nlp-library
• uralic-languages
• finnish
• sami

Gibran is an Elixir natural language processor, and a port of WordsCounted.

• natural-language-processing
• nlp
• elixir-lang

Framework for information extraction from tables

• table-information-extraction
• information-extraction
• literature
• text-mining

Tagify produces a set of tags from a given source. Source can be either an HTML page, a Markdown document or a plain text. Supports English, Russian, Chinese, Hindi, Spanish, Arabic, Japanese, German, Hebrew, French and Korean languages.

• tagify
• keywords
• keyword-extraction
• html

Ruby gem to calculate statistics from text to determine readability, complexity and grade level of a particular corpus.

• textstat
• flesch-kincaid-grade
• smog
• flesch-reading-ease

Elixir port of Nakatani Shuyo's natural language detector

• elixir
• language-detection
• language
• elixir-lang

Combinatory Categorial Grammar (CCG): Full set CCG, and probabilistic CCG

A JavaScript bilingual text realizer for web development

SimpleNLG-EnFr 1.1 is a bilingual English/French adaption of SimpleNLG v4.2

A tokenizer based on the dictionary and Bigram language models for Go. (Now only support chinese segmentation)

• tokenizer
• segmentation
• golang

German version of SimpleNLG 4

• natural-language
• java
• nlg
• simplenlg

A smorgasbord architecture for coreference resolution in biomedical text