I rent and manage GPUs on sites like vast.ai and clore.ai. The prices are all over the place. You will see 5090s from $0.30/hr to $5/hr, plus bandwidth which is set by the gpu owner and can range from $0.4 per TB up to $12.00 per TB.
This is a concept for what an order book would look like for GPU compute instead of the current listing model. It would use standardized SKUs so users know what they are getting. Its pre product, I'm curious to know what people think.
I think the idea is a natural next step in GPU's as a service. If you can create the unifying API layer for GPU access I think that would be immensely useful.
I rent and manage GPUs on sites like vast.ai and clore.ai. The prices are all over the place. You will see 5090s from $0.30/hr to $5/hr, plus bandwidth which is set by the gpu owner and can range from $0.4 per TB up to $12.00 per TB.
This is a concept for what an order book would look like for GPU compute instead of the current listing model. It would use standardized SKUs so users know what they are getting. Its pre product, I'm curious to know what people think.
I think the idea is a natural next step in GPU's as a service. If you can create the unifying API layer for GPU access I think that would be immensely useful.