$300k DGX B300 is actually a better deal than buying 24 RTX 6000s

Posted by Ok_Warning2146@reddit | LocalLLaMA | View on Reddit | 30 comments

Its FP4 performance is actually equivalent to 24 RTX 6000 Blackwells. Then with the tcgen05 support, that's further 20% speed up. Also, hardware compression engine will also speed up training.

Its 2304GB VRAM is also equivalent to 24 RTX 6000 Blackwells. It is good enough for you to run multiple sota Chinese models to work together to solve the world's pressing problems. You can also finetune them as much as you want which you can't do with 24 6000s.

It is a turnkey solution with CPU and motherboard. Overall it is a better deal than buying 24 RTX 6000 Blackwells and put them in multiple boxes.

What do you think?