🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
- nlp
- natural-language-processing
- pytorch
- pytorch-transformers
Repository Index
47,133 repositories indexed
1–24 of 50 · Most stars
中文分词 词性标注 命名实体识别 依存句法分析 成分句法分析 语义依存分析 语义角色标注 指代消解 风格转换 语义相似度 新词发现 关键词短语提取 自动摘要 文本分类聚类 拼音简繁转换 自然语言处理
- nlp
- natural-language-processing
- hanlp
- pos-tagging
Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ languages, with a router that picks the right checkpoint per request.
- calibration
- classification
- decision-model
- huggingface
💫 Industrial-strength Natural Language Processing (NLP) in Python
An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.
- large-language-models
- nlp
- knowledge-curation
- naacl
Repository to track the progress in Natural Language Processing (NLP), including the datasets and the current state-of-the-art for the most common NLP tasks.
- natural-language-processing
- machine-learning
- named-entity-recognition
- machine-translation
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
- nlp
- pre-trained-model
- unilm
- minilm
🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools
💬 Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants
- nlp
- machine-learning
- machine-learning-library
- bot
Tongyi Deep Research, the Leading Open-source Deep Research Agent
- agent
- llm
- artificial-intelligence
- information-seeking
中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
- llm
- plm
- pre-trained-language-models
- alpaca
Topic Modelling for Humans
- gensim
- topic-modeling
- information-retrieval
- machine-learning
Nano vLLM
NLTK Source
- nltk
- python
- nlp
- natural-language-processing
A very simple framework for state-of-the-art Natural Language Processing (NLP)
💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows
- python
- search
- nlp
- semantic-search
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
- nlp
- embedding
- bert
- ernie
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
- bloom
- deep-learning
- distributed-systems
- language-models
Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）
- chinese-bert
- tensorflow
- pytorch
- bert
Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
- web-scraping
- text-extraction
- nlp
- html2text
Open-source offline translation library written in Python
- python
- machine-translation
- transformers
- translation
Module for automatic summarization of text documents and HTML pages.
- python
- lsa
- textteaser
- html-page
aeneas is a Python/C library and a set of tools to automagically synchronize audio and text (aka forced alignment)
- speech
- alignment
- tts
- python