Anyone running HUANANZHI H12D-8D + BMC with 4x RTX 3090 for LLM inference?
Posted by awfulalexey@reddit | LocalLLaMA | View on Reddit | 15 comments
Hi everyone,
I'm considering building a home LLM inference rig around:
- HUANANZHI H12D-8D + BMC
- AMD EPYC 7002/7003
- 4x RTX 3090 24GB
- DDR4 ECC RDIMM, 8-channel
- Linux + vLLM / SGLang / llama.cpp
- Open frame, PCIe 4.0 x16 risers
The board looks very attractive for the price: EPYC SP3, 8-channel memory, BMC/IPMI, 4x PCIe 4.0 x16 physical slots, 3x M.2, etc. But documentation and real-world reports are a bit scattered, so I’d love to hear from actual owners.
Questions:
- Do all 4 PCIe slots run electrically at x16, or is one of them limited to x8?
Could you share lspci -vv / nvidia-smi link width output if possible?
-
Does Above 4G Decoding work properly with 3-4 GPUs?
-
Does Resizable BAR work after the newer BIOS update?
I saw that HUANANZHI has a BIOS note mentioning Resizable BAR / PCIe split optimization.
- Any issues booting with RTX 3090 specifically?
I’ve seen some reports about GPU compatibility quirks on this board.
- How stable is the BMC/IPMI module?
Does remote KVM work reliably? Any fan control or sensor weirdness?
- Any RAM/channel issues with 8 DIMMs?
Did all 8 memory channels work out of the box?
-
How long is POST/boot time in your setup?
-
Any problems with PCIe 4.0 risers?
Did you have to force Gen3/Gen4 manually?
-
If you run vLLM/SGLang/llama.cpp on this board, how has stability been under long inference workloads?
-
Would you buy this board again, or would you rather go with Supermicro H12SSL-i / ASRock Rack ROMED8-2T / TYAN S8030?
My main concern is not peak CPU performance, but stable 4-GPU operation for LLM inference. Even 3x PCIe 4.0 x16 + 1x PCIe 4.0 x8 would probably be acceptable, but I’d like to understand the real limitations before buying.
Thanks!
CalligrapherFar7833@reddit
I was planning on doing the same but most forums said the bios had massive issues with multi gpu and there were some russian bios files that fixed it but didnt want to risk testing it
HopefulMaximum0@reddit
I am currently running 2 AMD MI50 GPUs and the H12D-8D BIOS does not seem to cause problems. In fact, everything worked right out of the box under CachyOS (Arch derivative).
With the BMS, the server is "headless" so I get to use the 4 PCIe slots for MI50s. I only needed to add spacers so they clear the board headers and the connectors that are plugged in it. Better than the previous Dell workstation I had that wouldn't boot without video-out card.
CalligrapherFar7833@reddit
the issue was with 4 gpus not 2
gogitossj3@reddit
Do you have link to the forum?
CalligrapherFar7833@reddit
Sorry no that was some time ago
xanduonc@reddit
2-3. did not test specifically, but no known problems here, up to 4 gpu do work fine, including 2x rtx6000
kvm did work on new board, but now it does not.
i did not touch fan control at all
HopefulMaximum0@reddit
Speaking of fan control, did the fan monitoring work in your BMS interface? Mine is displaying 8 stopped fans even if my CPU fan is working and plugged in the motherboard header.
Nepherpitu@reddit
Running 8 3090 on this board with 7702 CPU. All slots are x16 4.0 with bifurcation up to 4x4. Zero issues so far (since October 2025). Maybe when running 4x4 bifurcation with cheap $20 oculink splitter and $5 cables I see interference errors on gpu lanes, but it's still stable (disabled AER reporting in bios, LOL).
awfulalexey@reddit (OP)
Bro, could you please show a photo of your system? I'm trying to figure out what kind of case to build so that 8 cards will fit. I'm getting a bit lost with it all now.
Nepherpitu@reddit
Its in progress now. Waiting for x8 splitters instead of 4x4 oculinks. Two cards on x16, two on x8 and four on x4. I'm bought server in pc case, so just made simple rack from aluminum profiles and rivets.
awfulalexey@reddit (OP)
why 4 on x4? Is it possible to have 8 x8 cards?
Nepherpitu@reddit
Of course. Board has 4 x16 ports, all ports equal. It's just me waiting for shipping of 3 more x8 splitters. I didn't knew I will go for 8 cards, so I didn't had 4 x8 splitters in my drawer.
awfulalexey@reddit (OP)
Thank u a lot!
segmond@reddit
I have long recommended huananzhi boards on this forum since 2023. Possible the first person to do so. I have 3 of them, granted those were dual x99 platforms. Everything works. Just go buy, build and have fun.
Glittering-Call8746@reddit
Does it has dual bios. A pity if it doesn't.