Need advice
Posted by Savantskie1@reddit | LocalLLaMA | View on Reddit | 1 comments
Has anyone else tried multi vendor GPU’s with Vulkan? Like say mixed amd and nvidia GPU’s? And does it work fairly well? I have a decent chance of getting a 48GB nvidia card to go with my 2MI50 32GB cards. I’ve seen discussions on it, but I’m dubious on whether people have had success with it for inference. I mean Vulkan should be vendor agnostic, so I’m assuming it would work. Am I wrong here?
TokenRingAI@reddit
You don't need to use Vulkan for the Nvidia, you can use CUDA, layer split works across different device types.