AMD 395+ and NVIDIA GPU

Posted by EntropyNegotiator@reddit | LocalLLaMA | View on Reddit | 11 comments

Is there any reason I can’t put an NVIDIA GPU in an AMD 395+ machine? I assume one piece of software can’t use both simultaneously, but I also assume that different instances of software could use each.

[-]

isugimpy@reddit

I've got one connected via TB4 to my Framework Desktop. Running things that need lower latency (or that are only optimized for CUDA) on the Nvidia, and everything else on the AMD GPU. Works just fine.

[-]

BoeJonDaker@reddit

Is there a 395+ machine that you can fit an Nvidia GPU in? I thought most people used some kind of external GPU setup.

Anyway, they generally work together with Vulkan.

[-]

ThatOnePerson@reddit

Is there a 395+ machine that you can fit an Nvidia GPU in?

I'm looking into doing it with a Framework Desktop, which is mITX sized, and a PCI-E extension myself.

[-]

EntropyNegotiator@reddit (OP)

I have an RTX 4000 SFF; it fits in almost anything.

[-]

Mediocre-Waltz6792@reddit

Put a real GPU in one of those small PCs... get an EGPU

[-]

randomisednick@reddit

see e.g. https://www.reddit.com/r/LocalLLaMA/comments/1ofboir/strix_halo_rtx_3090_achieved_interesting_results/

https://www.reddit.com/r/LocalLLaMA/comments/1oceht9/amd_ryzen_ai_max_395_pci_slot_big_and_fast_local/

Nvidia dGPUs work better in the Strix Halo than do either Intel or AMD, apparently.

Or for bigger models, get two Strixen and connect with TB or ConnectX IB:

https://www.reddit.com/r/LocalLLaMA/comments/1ot3lxv/i_tested_strix_halo_clustering_w_50gig_ib_to_see/

[-]

LumpyWelds@reddit

Yes, but only a small NVidia GPU. If you are thinking a 5090, it will be hobbled due to lack of free PCIe lanes.

I've looked into it, but didn't follow through so take the following with a grain of salt:

The MS-S1 Max comes with a PCIe x16 slot but it's x4 electrically.

So you'll need a PCIe 4.0 x4 tolerant card with low power requirements, maybe <70W.

They are out there, and they are cheap, so it will work if you find the right one.

[-]