by matheusmoreira 3 years ago

We shouldn't need corporations for this anyway. Why can't we decentralize training? Model training à la folding@home.

nvm0n2 3 years ago

Training needs insane amounts of inter node bandwidth, to the extent that training clusters use specially built hardware for it. Decentralised training isn't physically possible anytime soon, maybe never.