1.bigscience-workshop / petals🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloadingbloomdeep-learningdistributed-systemslanguage-modelslarge-language-modelsmachine-learning+14 morePythonMIT11K total650 forks+633 starsfrom 10,046 · score 6.45
2.huggingface / text-generation-inferenceArchivedLarge Language Model Text Generation Inferencebloomnlppytorchinferencegptdeep-learning+3 morePythonAPACHE-2.011K total1.3K forks+98 starsfrom 10,784 · score 4.60