aditya699/EduMOE: EduMoE is an educational project that implements a Mixture-of-Experts Transformer from scratch in PyTorch.

github.com

saved by: 0 people
related read on: arman-bd/guppylm: A ~9M parameter LLM that talks like a s... from the discussion