by matheusmoreira 4 months ago

I wish we had some kind of distributed training capability... Like Folding@home, but for LLMs.

woctordho 4 months ago

See the recent advance of DiLoCo at Nous Research and Prime Intellect.