ML Wiki

Tag: sparse

2 items with this tag.

  • Apr 16, 2026

    Mixture of Experts (MoE)

    • concept
    • architecture
    • scaling
    • efficiency
    • sparse
  • Apr 16, 2026

    Switch Transformers: Scaling to Trillion Parameter Models with Sparse MoE

    • source
    • mixture-of-experts
    • moe
    • scaling
    • efficiency
    • sparse