Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
- nlp
- pre-trained-model
- unilm
- minilm
Repository Index
47,133 repositories indexed
1–24 of 48 · Most stars
Topic Modelling for Humans
- gensim
- topic-modeling
- information-retrieval
- machine-learning
State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!
- browser
- javascript
- transformers
- webml
Style and Grammar Checker for 25+ Languages
- grammar
- natural-language
- natural-language-processing
- style-checker
A very simple framework for state-of-the-art Natural Language Processing (NLP)
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
- nlp
- embedding
- bert
- ernie
An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.
- python
- pii
- privacy
- data-anonymization
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
- nlp
- natural-language-processing
- natural-language-understanding
- language-model
Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
An NLP library for building bots, with entity extraction, sentiment analysis, automatic language identify, and so more
VADER Sentiment Analysis. VADER (Valence Aware Dictionary and sEntiment Reasoner) is a lexicon and rule-based sentiment analysis tool that is specifically attuned to sentiments expressed in social media, and works well on texts from other domains.
📐 Compute distance between sequences. 30+ algorithms, pure python implementation, common interface, optional external libs usage.
- distance
- algorithm
- python
- textdistance
Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://casl-project.ai/
Bioinformatics'2020: BioBERT: a pre-trained biomedical language representation model for biomedical text mining
A full spaCy pipeline and models for scientific/biomedical documents.
- scientific-documents
- spacy
- custom-pipes
- nlp
Self-contained Machine Learning and Natural Language Processing library in Go
Fast vectorization, topic modeling, distances and GloVe word embeddings in R.
- word2vec
- text-mining
- natural-language-processing
- glove
🚀 Catalyst is a C# Natural Language Processing library built for speed. Inspired by spaCy's design, it brings pre-trained models, out-of-the box support for training word and document embeddings, and flexible entity recognition models.
A Modern C++ Data Sciences Toolkit
- nlp
- nlp-parsing
- search-engine
- inverted-index
Pragmatic Segmenter is a rule-based sentence boundary detection gem that works out-of-the-box across many languages.
RNNLG is an open source benchmark toolkit for Natural Language Generation (NLG) in spoken dialogue system application domains. It is released by Tsung-Hsien (Shawn) Wen from Cambridge Dialogue Systems Group under Apache License 2.0.
- natural-language-processing
- natural-language-generation
- nlg-dataset
- deep-learning
CogComp's Natural Language Processing Libraries and Demos: Modules include lemmatizer, ner, pos, prep-srl, quantifier, question type, relation-extraction, similarity, temporal normalizer, tokenizer, transliteration, verb-sense, and more.
- natural-language-processing
- nlp
- big-data
- data-mining
Selected Machine Learning algorithms for natural language processing and semantic analysis in Golang
- go
- golang
- natural-language-processing
- nlp
:hospital: Medical Text Mining and Information Extraction with spaCy
- natural-language-processing
- medical-natural-language-processing
- machine-learning
- metamap