From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's makemore :)
- large-language-models
- llm
- mixture-of-experts
- deep-learning
132,241 visible repositories in the index
1–1 of 1 · Most stars
From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's makemore :)