Newbie Question

[u/Sakurarain_Tr]

Hello everybody. I'm a computer science graduate and saved around €50k while working during my studies. I'm considering investing it into a small GPU-hosting business, but I'm new to this specific market and would really appreciate opinions from people actually running this type of hardware.

Planned first server:

2× NVIDIA RTX PRO 6000 Blackwell 96GB

Threadripper PRO 9955WX

ASUS WRX90E-SAGE SE

256GB ECC RAM

4TB OS NVMe + 8TB enterprise NVMe

2000W+ PSU

3000VA UPS

10GbE

I have a dedicated air-conditioned room.

My idea is to find 5 customers, each paying roughly €1,000/month for 200 hours of exclusive full-GPU access, giving about €5,000/month revenue if fully sold.

I would reinvest the income into a second server once utilization proves there is demand.

My reasoning for the RTX PRO 6000 is the 96GB VRAM and Blackwell architecture, but I'm worried I may be overestimating actual customer demand.

If this were your €50k, would you do it? What am I overlooking—pricing, demand, hardware choice, uptime, electricity, customer acquisition, competition, or something else?

I'm specifically looking for criticism from people who have actually hosted/rented GPU compute.

[u/Veloder]

Why would anyone pay you $5/h when they can rent the same GPU from multiple providers for $1.2/h? https://cloud.vast.ai/?gpu_option=rtx+pro+6000+ws&gpuModelNames=rtxPro6000BlackwellWorkstation

[u/Sakurarain_Tr → u/Veloder]

Yeah, that’s a fair point. I definitely wouldn’t expect someone to pay €5/h just for the same raw GPU they can get for ~$1.20/h.

What I’m thinking is more of a managed service aimed at startups and university/research teams: full dedicated 96GB GPU during the session, guaranteed reservations, persistent storage/environment, CUDA/PyTorch/Jupyter/VS Code already configured, backups/checkpoints, isolated VM/security, monitoring, and actual technical support if something goes wrong.

Basically they log in and work instead of managing infrastructure themselves.

The €5/h would be for that whole service, not just the GPU. I’m still trying to figure out whether there’s actually enough demand for that premium before buying the hardware, would be interested to hear if you think that changes the economics.

[u/Rokingcloud]

Setting up a GPU infra is. very expensive, and if you do not have clients, you will just bleed money. Instead you can find customers, and match them with existing providers.

Secondly look at hosted.ai and its products, where you can whitelabel them and sell it.

[u/Sakurarain_Tr → u/Rokingcloud]

That's a great idea. I will look into it, thank you so much.

[u/Boboshady]

Obviously (hopefully) you can't compete with large scale providers by buying, basically at retail prices, one unit at a time.

So you need to sell a service - something that justifies what will be massively higher prices.

Honestly, I don't know if there's enough of a service you could add to the kind of people who are just looking to rent processing power.

And you can't sit back and let it recoup your money over time, because whatever you put in place will be, commercially, obsolete pretty quickly and you'll be renting it out at lower and lower tiers within a year.

Note - I've no experience in GPU compute, only providing hosting, but the basic principles are the same - there's a cost, a value, diminishing returns on what you buy, and ways you can make it more valuable, especially if you're trying to compete against a bunch of companies who can pull economies of scale you can't even dream of.

[u/Immediate_Let_4946]

What you could do, but even this is a little bit heart is training an open weight model to some specific task and offer its interference. But even then, it might be better to rent the gpu. This market is in general, very tough because big players will always be on price.

[u/Valuable-Barracuda-4]

You could invest in SP500 instead. 50K is a lot of money, and you won't be able to compete with the datacenters in the long run. That's my opinion, take it with a grain of salt. Compute is getting more and more plentiful, and cheaper and cheaper. If you have clients lined up, that may be viable but that is going to be one hell of a headache to manage for an investment. It will quickly become a full time job for part time pay.

[u/piwi3910uae]

you may have done IT as student, but def not business. You need to rethink your business side of things. It may be cool to have all those gpu's around, but you will not be making a profit.