best server/workstation gpu for under 1k€?

Posted by Devilz_i7@reddit | buildapc | View on Reddit | 1 comments

I wanted to make a server that can locally host multiple ai agents at the same time. Currently I'm looking at the nvidia V100 32gb, but the speeds are kind of slow and the card is overpriced in my region. What else should I consider?

[-]

BaronB@reddit

Maybe consider a budget increase?

The only other option I can think of would be the Intel Arc Pro B60. It only has 24GB of VRAM, is on paper a little faster, but since it doesn't support CUDA is probably not actually any faster. But it is a lot cheaper.

Then there's the Quadro RTX 6000 which is also only 24GB, but a little faster for about the same price.

The reality is 1k isn't a lot of money, and you either get to choose a very slow GPU with RAM, or a decently fast GPU without much RAM for that price.

And a $700 5070 12GB on a PCIe 5.0 system will probably out perform them even with the limited RAM just by virtue of being so much faster.