The architecture of open-weight LLMs: MoE, hybrid layers, ternary weights www.silasdata.com 16 points by silasyl 3 days ago