Hacker News new | past | comments | ask | show | jobs | submit
If you have 2x DGX Spark it will run quite nicely. They cost only $8000 or so and use less power so you may be able to rent them cheaper than the MI300X.

I found an offer to rent two at $1.65 per hour https://spark.enverge.ai/#pricing

The MI300X will vastly outperform it for only a slightly higher price.

As other calculated, even with a Mi300 you could not saturae it enough with one stream to break even with the DS API, so I think renting sparks would make it even harder cause they are considerably slower.

(274gb/s vs 5.3tb/s)