🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
- nlp
- natural-language-processing
- pytorch
- pytorch-transformers
107,098 visible repositories in the index
1–24 of 40 · Most stars
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
Leveraging BERT and c-TF-IDF to create easily interpretable topics.
Open-source offline translation library written in Python
Transformer related optimization, including BERT, GPT
TranslatedChinese text classification, TextCNN, TextRNN, FastText, TextRCNN, BiLSTM_Attention, DPCNN, Transformer, based on pytorch, ready to use out of the box.
keras implement of transformers for humans
A machine learning software for extracting information from scholarly documents
An Open-Source Framework for Prompt-Learning.
Fast inference engine for Transformer models
Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research
Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI
State of the Art Natural Language Processing
Fengshenbang-LM(封神榜大模型)是IDEA研究院认知计算与自然语言研究中心主导的大模型开源体系,成为中文AIGC和认知智能的基础设施。
Seamlessly integrate LLMs into scikit-learn.
Top2Vec learns jointly embedded topic, document and word vectors.
Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)
Efficient few-shot learning with Sentence Transformers
⭐️ NLP Algorithms with transformers lib. Supporting Text-Classification, Text-Generation, Information-Extraction, Text-Matching, RLHF, SFT etc.
Kashgari is a production-level NLP Transfer learning framework built on top of tf.keras for text-labeling and text-classification, includes Word2Vec, BERT, and GPT2 Language Embedding.
EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit