Huawei 300i Pro Duo AI Inference Card with 96 GB VRAM - anyone bought it and tested it?
Posted by Darlanio@reddit | LocalLLaMA | View on Reddit | 9 comments
It has been over a year since I first heard about Huawei 300i Pro Duo Atlas (rumors before the release).
What support do we have for Huawei 300i Atlas Duo as of present in the LLM-community?
Has anyone bought the cards and the shipping went well?
What kind of tokens/second on models that require more than 24 GB memory have _you_ gotten - not just links to others reviews, but your own tests...
Please, enlighten us...
2 months:
https://www.reddit.com/r/LocalLLaMA/comments/1r04r2w/huawei_atlas_300i_duogpu/
7 months:
https://www.reddit.com/r/LocalLLM/comments/1n4f1gs/huawei_96gb_gpu_cardatlas_300i_duo/
12+ months ago:
https://www.reddit.com/r/LocalLLaMA/comments/1j78xnk/huawei_gpu/
https://www.reddit.com/r/LocalLLaMA/comments/1kgltqs/huawei_atlas_300i_32gb/
https://www.reddit.com/r/LocalLLaMA/comments/1j78xnk/huawei_gpu/
stilet69@reddit
https://youtu.be/O16C0HGbgyU?si=W90V3fRzg0S7b6vA. Here is a link to the Russian channel where qwen 3 was launched. Enable subtitle translation.
Worried_Drama151@reddit
Ya it makes sense to buy inferior Chinese hardware when I can go buy Nvidia shit, makes perfect sense
sleepingsysadmin@reddit
Basically people received it 6 months ago, it didnt work and felt scammed.
Huawei in fact came out with a successor and nobody talked about it because it's a scam. It's too good to be true.
Avoid Huawei.
beryugyo619@reddit
GamersNexus has one and they've done nothing about it in months, I think that's a good indication of its utility
Darlanio@reddit (OP)
So either buy a Huawei server and mount the atlas duo i300 inside, or use it as a paperweight...
beryugyo619@reddit
No way it is actually locked to Huawei servers, it's just GN saying so. They are sorta experts in benchmarks, and they do have some connections with Linux people too, so GN not saying anything either means that they actually can't get hold of the driver, or that the performance is really not great, or both. I think.
Darlanio@reddit (OP)
Ah, ok... so... Linux Server and write my own driver ;-) without having the documentation...
Reverse-engineering from hardware only - anyone?
Powerful_Evening5495@reddit
it lack hardware support outside of huwaei data centers OP
https://www.youtube.com/watch?v=qGe_fq68x-Q
Darlanio@reddit (OP)
So either buy a Huawei server and mount the atlas duo i300 inside, or use it as a paperweight...