Easy-to-use and powerful LLM and SLM library with awesome model zoo.
- nlp
- embedding
- bert
- ernie
Repository Index
47,133 repositories indexed
25–48 of 70 · Most stars
Translated:orange_book: Chinese Xinhua Dictionary database. Includes xiehouyu (two-part allegorical sayings), idioms, words, and Chinese characters.
- data
- scraper
- chinese-traditional
- python3
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
- bloom
- deep-learning
- distributed-systems
- language-models
TranslatedPre-Training with Whole Word Masking for Chinese BERT (Chinese BERT-wwm series models)
- chinese-bert
- tensorflow
- pytorch
- bert
Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
- web-scraping
- text-extraction
- nlp
- html2text
Open-source offline translation library written in Python
- python
- machine-translation
- transformers
- translation
Module for automatic summarization of text documents and HTML pages.
- python
- lsa
- textteaser
- html-page
aeneas is a Python/C library and a set of tools to automagically synchronize audio and text (aka forced alignment)
- speech
- alignment
- tts
- python
TranslatedAgent Skill for Refining AI-Generated Japanese into Natural Japanese
- agent-skills
- ai-writing
- claude-code
- codex
A full spaCy pipeline and models for scientific/biomedical documents.
- scientific-documents
- spacy
- custom-pipes
- nlp
brat rapid annotation tool (brat) - for all your textual annotation needs
A BERT model for scientific text.
- bert
- nlp
- scientific-papers
A deep learning toolkit for healthcare AI: EHR (MIMIC, eICU, OMOP), clinical text, signals and imaging. 30+ models, reproducible pipelines.
- healthcare
- data-mining
- deep-learning
- preprocessing
What's in your data? Extract schema, statistics and entities from datasets
- python
- privacy
- pii
- npi
Evaluation code for various unsupervised automated metrics for Natural Language Generation.
- natural-language-generation
- natural-language-processing
- nlg
- nlp
Plug and Play Language Model implementation. Allows to steer topic and attributes of GPT-2 models.
- language-modeling
- natural-language-generation
- machine-learning
- deep-learning
Pretrained model hub for Keras 3.
The Classical Language Toolkit
Chatbot in 200 lines of code using TensorLayer
- tensorlayer
- tensorflow
- chatbot
- rnn
in progress
- tensorflow
- cnn
- lstm
- nlp
DNABERT: pre-trained Bidirectional Encoder Representations from Transformers model for DNA-language in genome
- kmer
- dnabert-model
- kmer-format
- gpu
Parse human names into title, given, middle, family, suffix, nickname and maiden name. Typed, zero-dependency, CJK-aware.
- python
- text-processing
- text-parser
- python-module
BlueBERT, pre-trained on PubMed abstracts and clinical notes (MIMIC-III).
- bert
- bert-model
- natural-language-processing
- pubmed