Hacker News new | past | comments | ask | show | jobs | submit
AND developer cloud has an image for K3 running it on a single MI300x. Offloading to system ram can be quite decent.

I cant say how well that image works as I'm still waiting for them to approve my gpu access