1.bigscience-workshop / petals🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloadingbloomdeep-learningdistributed-systemslanguage-modelslarge-language-modelsmachine-learning+14 morePythonMIT11K total650 forks+240 starsfrom 10,439 · score 5.48
2.huggingface / text-generation-inferenceArchivedLarge Language Model Text Generation Inferencebloomnlppytorchinferencegptdeep-learning+3 morePythonAPACHE-2.011K total1.3K forks+23 starsfrom 10,859 · score 3.18