The other day I tried to rent a spot MI-300. I couldn't find a way to do that! Whereas fairly easy to rent an H-100. I think they're just behind a bit on their tsmc allocation! Their stock seems to think so, it's priced much more aggressively than Nvidia's.
My company Hot Aisle is working on solving this problem.
It has nothing to do with availability or pricing. You can't rent single MI300x today cause ROCm doesn't support virtualization. PCIe passthrough doesn't work yet. AMD knows about the issue and is working on it.
We will have 8xMI300x for rent soon. Once AMD fixes their stuff, we will be able to rent out one at a time.
Thanks! Oh it has been a wild ride so far and we just have 8 gpus! We just closed our second SAFE and are about to order 128 more, from Dell this time. That is its own whole story that I posted about on reddit. Cluster size of 16 boxes works well for 128 port 400g switches. Exciting times.
