🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
- nlp
- natural-language-processing
- pytorch
- pytorch-transformers
108,094 visible repositories in the index
1–24 of 67 · Most stars
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
Topic Modelling for Humans
State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
Unsupervised text tokenizer for Neural Network-based text generation.
An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
Library for conversion between Traditional and Simplified Chinese
Simple, Pythonic, text processing--Sentiment analysis, part-of-speech tagging, noun phrase extraction, translation, and more.
Leveraging BERT and c-TF-IDF to create easily interpretable topics.
Open Source Neural Machine Translation and (Large) Language Models in PyTorch
An open source library for deep learning end-to-end dialog systems and chatbots.
Open-source offline translation library written in Python
Translatedansj word segmentation. A true Java implementation of ICT. Its segmentation quality and speed both exceed the open-source version of ICT. Chinese word segmentation, person name recognition, part-of-speech tagging, user-defined dictionaries
Transformer related optimization, including BERT, GPT
TranslatedChinese text classification, TextCNN, TextRNN, FastText, TextRCNN, BiLSTM_Attention, DPCNN, Transformer, based on pytorch, ready to use out of the box.
keras implement of transformers for humans
A machine learning software for extracting information from scholarly documents
An Open-Source Framework for Prompt-Learning.
Fast inference engine for Transformer models
Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research
Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI
State of the Art Natural Language Processing
Fengshenbang-LM(封神榜大模型)是IDEA研究院认知计算与自然语言研究中心主导的大模型开源体系,成为中文AIGC和认知智能的基础设施。