Bringing PyTorch Monarch to AMD GPUs
https://pytorch.org/blog/bringing-pytorch-monarch-to-amd-gpus-single-controller-distributed-training-on-rocm/Love monarch, amazing primitives and feels so much lighter than Ray.
Another awesome add on their part
So are we at a point where we can’t train llms for fun at home on less expensive AMD cards ?
loading story #49049152
loading story #49050088