TranslatedChinese word segmentation, part-of-speech tagging, named entity recognition, dependency parsing, constituency parsing, semantic dependency parsing, semantic role labeling, coreference resolution, style transfer, semantic similarity, new word discovery, keyword and keyphrase extraction, automatic summarization, text classification and clustering, pinyin and Simplified/Traditional Chinese conversion, natural language processing
Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ languages, with a router that picks the right checkpoint per request.
💫 Industrial-strength Natural Language Processing (NLP) in Python
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
- nlp
- pre-trained-model
- unilm
- minilm
Topic Modelling for Humans
NLTK Source
A very simple framework for state-of-the-art Natural Language Processing (NLP)
- pytorch
- nlp
- named-entity-recognition
- sequence-labeling
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
modest natural-language processing
- nlp
- part-of-speech
- named-entity-recognition
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages
Open-source offline translation library written in Python
An NLP library for building bots, with entity extraction, sentiment analysis, automatic language identify, and so more
Natural language detection
- javascript
- natural-language
- language-detection
- nlp
State of the Art Natural Language Processing
Module for automatic summarization of text documents and HTML pages.
- python
- lsa
- textteaser
- html-page
Go efficient fast multilingual NLP and text segmentation; support English, Chinese, Japanese and others.
A full spaCy pipeline and models for scientific/biomedical documents.
- scientific-documents
- spacy
- custom-pipes
- nlp
Self-contained Machine Learning and Natural Language Processing library in Go
What's in your data? Extract schema, statistics and entities from datasets
Translated"Jieba" (Chinese for "to stutter") Chinese text segmentation: built to be the best PHP Chinese word segmentation module.
The most accurate natural language detection library for Go, suitable for short text and mixed-language text
Neural question generation using transformers