For the time being this thesis hasn’t worked out though. H100’s are only going up in price and becoming more scarce [1]. At what point would you update if now going on 3 years into H100 lifecycle this doesn’t seem close to happen.
But they are becoming more scarce while staying on Nvidia’s shelves buy-and-hold, or being leased back in some cases. They are not being installed by customers at anything like the rate the sales figures suggest. So yeah, these H100s will last a long time in the packaging.
Meanwhile, Meta is selling their spare AI data centre capacity.
loading story #50420884
loading story #50422002