Train a 1B LLM with 1T tokens from scratch by personal
Repository Index
142,273 visible repositories in the index
1–3 of 3 · Most stars
Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conversations}. Don't let the poverty limit your imagination! Train your own 8B/14B LLaVA-training-like MLLM on RTX3090/4090 24GB.
- multimodal-large-language-models
- deepspeed
- model-parallel
- pipeline-parallelism
AI Bank Statement Document Automation By LLM model and Personal Finanical Analysis