OAM waterblocks
Posted by Aphid_red@reddit | LocalLLaMA | View on Reddit | 4 comments
Are there any companies that make them separately for less than datacenter scale sales?
OAM meaning for AMD MI250, MI300, or SXM4, SXM5, etc. form factors.
I'd love to find some to get a 2-3KW device down to a somewhat tolerable noise level compared to a 2-4U server with a decent external radiator.
If not, is there a good summary of the dimensions of that socket so someone with a CNC milling machine could be tasked to make a custom waterblock out of a block of copper and plate it?
PseudonymousSnorlax@reddit
Did you find a low-cost way to use OAM modules? Or are you looking for a way to cool a retired datacenter server?
Knowing what you're trying to achieve can make a huge difference in how you approach the problem.
Aphid_red@reddit (OP)
Examples: You can get PCI-e A100s for about $9000. Not cost effective given the existence of the RTX 6000 pro.
But the SXM4 variant can be found much cheaper, around 4-5K at the time of writing. There's plenty of cost savings there for a water cooling setup so you can actually run it locally.
There's also MI250s available for \~2K each, and boards to run 4 of them (8x64GB GPUs @ 2KW, since each is 2x MI200 at 250W). Cooling 2KW is well within the range of enthusiast watercooling radiators, the only missing component that's not widely available is the block. If you can get a working setup, you can get 512GB of VRAM for \~12-15K or so on a GPU with moderate to good AI performance. I don't think you can get near that kind of performance/power/noise/cost tradeoff in any other way.
PseudonymousSnorlax@reddit
I haven't found any OAM boards for less than $10k, unfortunately.
CNWDI_Sigma_1@reddit
Yes. https://www.comino.com/en/waterblocks