Best gpu for local ia for 350€?

Posted by Longjumping-Room-170@reddit | LocalLLaMA | View on Reddit | 9 comments

for llm

[-]

optimisticalish@reddit

That's 750 Euro in the UK, more than twice what this guy wants to spend. A 3060 12Gb would be more in his range.

[-]

I think if he is lucky, he can get RX6800 16GB - they are often around 300Euros on used market. Or also RX9060XT 16GB. Nvidia is usually much more bucks for less VRAM... And as we know, VRAM >>> any other parameters. Support on both of those cards is good on both Vulkan and ROCm, while I prefer Vulkan.

[-]

--Spaci--@reddit

Where the fuck are you getting that for 350$?

[-]

Technical-Earth-3254@reddit

On Alibaba

[-]

Kal-LZ@reddit

Mi50 32GB for 250$ on Alibaba

[-]

ea_man@reddit

used amd 6800xt 16GB, yet you are close to buy 2x used 6700 12GB

[-]

blastbottles@reddit

3060 12gb is the best all around especially since everything uses cuda but if you are willing to deal with amd or intel for more vram the arc pro b50 16gb is around that price and the 9060xt 16gb is also around that price.