🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
- nlp
- natural-language-processing
- pytorch
- pytorch-transformers
Repository Index
47,133 repositories indexed
1–24 of 44 · Most stars
TranslatedChinese word segmentation, part-of-speech tagging, named entity recognition, dependency parsing, constituency parsing, semantic dependency parsing, semantic role labeling, coreference resolution, style transfer, semantic similarity, new word discovery, keyword and keyphrase extraction, automatic summarization, text classification and clustering, pinyin and Simplified/Traditional Chinese conversion, natural language processing
- nlp
- natural-language-processing
- hanlp
- pos-tagging
Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ languages, with a router that picks the right checkpoint per request.
- calibration
- classification
- decision-model
- huggingface
💫 Industrial-strength Natural Language Processing (NLP) in Python
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
- nlp
- pre-trained-model
- unilm
- minilm
🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools
Topic Modelling for Humans
- gensim
- topic-modeling
- information-retrieval
- machine-learning
Nano vLLM
NLTK Source
- nltk
- python
- nlp
- natural-language-processing
A very simple framework for state-of-the-art Natural Language Processing (NLP)
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
- nlp
- embedding
- bert
- ernie
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
- bloom
- deep-learning
- distributed-systems
- language-models
Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）
- chinese-bert
- tensorflow
- pytorch
- bert
Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
- web-scraping
- text-extraction
- nlp
- html2text
Open-source offline translation library written in Python
- python
- machine-translation
- transformers
- translation
Module for automatic summarization of text documents and HTML pages.
- python
- lsa
- textteaser
- html-page
aeneas is a Python/C library and a set of tools to automagically synchronize audio and text (aka forced alignment)
- speech
- alignment
- tts
- python
A full spaCy pipeline and models for scientific/biomedical documents.
- scientific-documents
- spacy
- custom-pipes
- nlp
A BERT model for scientific text.
- bert
- nlp
- scientific-papers
A deep learning toolkit for healthcare AI: EHR (MIMIC, eICU, OMOP), clinical text, signals and imaging. 30+ models, reproducible pipelines.
- healthcare
- data-mining
- deep-learning
- preprocessing
What's in your data? Extract schema, statistics and entities from datasets
- python
- privacy
- pii
- npi
Evaluation code for various unsupervised automated metrics for Natural Language Generation.
- natural-language-generation
- natural-language-processing
- nlg
- nlp
Plug and Play Language Model implementation. Allows to steer topic and attributes of GPT-2 models.
- language-modeling
- natural-language-generation
- machine-learning
- deep-learning