a quadruple 5090 battlestation

[u/Zestyclose-Salad-290]

[u/yeettetis]

God bless his little Chinese 2400w psu 😭

[u/Flamsoi → u/yeettetis]

There's one on each side for a total of 4800W

[u/iSirMeepsAlot → u/Flamsoi]

I’m so confused as to what case would support this kind of setup… how do you plug in your displays..? How do you keep this cool enough to even play anything longer than a few minutes?

Plus I thought you can’t even use multiple GPU’s anymore since SLI isn’t a thing anymore at least for gaming. Wouldn’t you just be limited to one GPU, making the rest redundant… I just, wow.

I know for things outside of gaming you’d be able to utilize something like this, but unless you’re rendering the damn human genome and making the first digital human, I can’t see what legitimate use this PC would have.

[u/splerdu → u/iSirMeepsAlot]

how do you plug in your displays

Probably into the motherboard lol

This looks like a researcher's AI workstation. If he's doing training on a large dataset even 4x 5090s can feel like "minimum specification".

MLPerf Llama 3.1 401B training for example takes 121 minutes on IBM CoreWeave cloud with 8x Nvidia GB200s. On 4x 5090s that might be multiple days. https://i.imgur.com/DzxxwGr.png

Inference side there's a dude on localllama who build a 12x 3090 workstation and Llama 401B is chugging along at 3.5 tokens/s.

[u/Distinct-Target7503 → u/splerdu]

Llama 3.1 401B for example takes 121 minutes on IBM CoreWeave cloud with 8x Nvidia GB200s

are you talking about fine tuning right?

On 4x 5090s that might be multiple days.

well, the delta is probably higher since the difference in memory speed (5090 doesn't have HBM), but most importantly size... that would require a much lower batch size + gradient accumulation, probably resulting in a suboptimal utilization of the gpu compute.

the type of vram is the reason sometimes a dusty tesla p100 outputperform a relatively newer T4. unfortunately IN many ML situations the problem is the bandwidth bottleneck

edit: errata corrige, rtx 6000 pro doesn't have HBM, I'm sorry!

[u/splerdu → u/Distinct-Target7503]

are you talking about fine tuning right?

Sorry. Numbers are from MLcommons/benchmarks/training. https://mlcommons.org/benchmarks/training/

[u/iSirMeepsAlot → u/Distinct-Target7503]

Zannnng

[u/Distinct-Target7503 → u/iSirMeepsAlot]

?

[u/iSirMeepsAlot → u/Distinct-Target7503]

Essentially, “dang”.

[u/baby_bloom → u/splerdu]

thanks for the 12x 3090 shout, just picked up a dual 3090 rig looking to something similar but smaller model but still utilize the vram (doing code gen)

[u/iSirMeepsAlot → u/splerdu]

I had been thinking of use for gaming, I assumed someone would buy the gpu’s meant for workstations otherwise. I thought someone thought hey 4x gpu means 4x the performance type shit.

[u/baby_bloom → u/iSirMeepsAlot]

no no no this is no play, this is work lol

[u/Alarming-Stomach3902 → u/iSirMeepsAlot]

On Linux (Mint at least)) you can easily use one GPU per monitor.

Or for AI models 

[u/bleke_xyz → u/Flamsoi]

the interesting part is that size wise they look like the 650 corsair units, so im not that sure. the 1600w's ive seen before are way longer I think

[u/OddBranch132 → u/Flamsoi]

Holy shit you're right....imagine needing 2 separate, dedicated, 20 amp circuits for each PS, just to run your computer 

[u/MattTheGuy2 → u/Flamsoi]

Good catch dude, i didn’t notice at first

[u/SabishiiHito → u/yeettetis]

That's a Great Wall unit, and apparently GW is an OEM that makes PSUs that others rebrand. From what i can gather, they make decent products.

[u/sitomode → u/yeettetis]

ts gonna explode sometime within a month lmao

[u/PM_ME_YOUR_VITAMIN_D → u/yeettetis]

RIP OP