MI25 vs CMP100-210, which would you pick?
Posted by onephn@reddit | LocalLLaMA | View on Reddit | 26 comments
i wanna build ideally a quad-gpu inference setup, i would like to run quants of MoEs, ones from this user come to mind
https://huggingface.co/sokann
mi25 performance should in theory be inferior but im concerned about the pcie link speed for the cmp, if anyone else has any other budget recs though im all ears, i appreciate all the help i can get on this
Toooooool@reddit
you can still find MI50 32GB's on alibaba for $150, you just have to look beyond page 2
janusr@reddit
No you don’t. You might find some outdated listing, but the sellers will either not reply, reply that they‘re out of stock, or quote a much higher price. They cost almost 3x of that now
onephn@reddit (OP)
i havent found them at 150, though many of them are at 200, lets hope the sellers reply though
janusr@reddit
Pretty sure you won’t get them for that price. Ist just ordered four of them two days ago.
onephn@reddit (OP)
how much did you get them for?
janusr@reddit
About $400
onephn@reddit (OP)
Each? Ended up ordering eight for a total of 1.3k, was only intending on buying four but I got two pretty good deals. Here's to hoping they show up at my doorstep.
janusr@reddit
Each. 8 Mi50 for 1.3k ? 32 GB variant?
onephn@reddit (OP)
Yup
janusr@reddit
Good deal if true, hope you’re not getting scammed and also they don’t send the 16 variant. Please lmk how this turns out
onephn@reddit (OP)
I got the tracking for four of the cards so far, other four I'm expecting soon
onephn@reddit (OP)
u are so unbelievably real appreciate it man
def_not_jose@reddit
Safety and reliability are on MI25 side. Mining cards have been through hell, there have been posts on CMP cards literally catching fire
onephn@reddit (OP)
Shit, glad I canceled the order, went on Alibaba and ordered the 32gb mi50s, see my other comment
desexmachina@reddit
Cmp is only PCIE 1x, you aren’t going to be sharding models across multiple GPUs
Prestigious-Chair282@reddit
Well, there are some modded cmp's with full x16
onephn@reddit (OP)
Only thing that stinks is that it's pcie gen1
desexmachina@reddit
Can you share more detail? Because as far as I know, the falcon firmware chip is pretty limiting. At least on the 16 gb CMP sample I have
Ender_PK@reddit
They can be made x16 by soldering missing capacitors. It's still PCIe 1 x16, though.
Prestigious-Chair282@reddit
I've seen some posts on local marketplace about those cards with fully available x16 that was achieved via "adding few missing components", but idk how its done correctly
desexmachina@reddit
I only have one sample and have been probing the hell out of it and it appears to be wired as 1x PCIE and the tensors are fused at the die since they aren’t used in mining
Ender_PK@reddit
MI50 16 gb. AFAIK they the same price as 2x mi25, but they are faster and more widespread. They also quite abundant due to crypto mining. The top option in junk tier is mi60 32gb, but those were never sold in bulk and now Chinese people sell them for high price (supply controls the price).
onephn@reddit (OP)
At that point though if I have the capacity would I get better results with 2 mi25s?
Independent-Fig-5006@reddit
Mining cards usually have problems with normal calculations. However, some CMP100-210 have a different BIOS. This may be better in terms of software compatibility. Non-original BIOS, but may be unstable.
xraybies@reddit
raw compute MI25, everything else is better on the CMP.
ttkciar@reddit
I can't find the peak power draw for the CMP100-210, but the MI25 is 300W. Unless the CMP draw is crazy-high, it's probably the way to go, with almost twice the memory bandwidth.