Show HN: Hardware-software co-design for MoE models to bypass NCCL bottlenecks github.com 2 points by PJHkorea 7 hours ago
PJHkorea 7 hours ago Imagine virtual memory, but instead of using your local storage, you’re pooling a whole bunch of network servers into a single address space
Imagine virtual memory, but instead of using your local storage, you’re pooling a whole bunch of network servers into a single address space