1.bigscience-workshop / petals🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloadingbloomdeep-learningdistributed-systemslanguage-modelslarge-language-modelsmachine-learning+14 morePythonMIT11K total650 forks+83 starsfrom 10,596 · score 4.43
2.huggingface / text-generation-inferenceArchivedLarge Language Model Text Generation Inferencebloomnlppytorchinferencegptdeep-learning+3 morePythonAPACHE-2.011K total1.3K forks+7 starsfrom 10,875 · score 2.08