Compared AMD 7900 XTX to Nvidia ada 4000 SFF

Posted by badabimbadabum2@reddit | LocalLLaMA | View on Reddit | 8 comments

Compared with Ollama and phi4:latest model. * architecture phi3 * parameters 14.7B * context length 16384 * embedding length 5120 * quantization Q4\_K\_M AMD 7900 XTX (300w tdp) prompt eval duration: 5ms eval rate: 54.26 tokens/s 430W during inference total systempower Nvidia 4000 SFF ada (70W tdp) prompt eval duration: 21ms eval rate: 26.45 tokens/s 134W during inference total systempower

Reply to Post

8 Comments

[-]

ForsookComparison@reddit

The fact that the 7900xt and 7900xtx were allowed to get blower variants at their consumer pricing should have made them fly off the shelves for inference. These cards are so freaking good.

[-]

Specific-Local6073@reddit

Unfortunately, blower variants are still much more expensive. Haven't found any under 1,3k€ while you can get "normal" cooling versions of 7900xtx at price below 900€.

[-]

ForsookComparison@reddit

Ah darn, over in the US they're only a $50-$100 premium right now

[-]

Specific-Local6073@reddit

Everything is always cheaper in USA.

[-]

ForsookComparison@reddit

Consumer electronics** yes.

[-]

badabimbadabum2@reddit (OP)

For my use case Nvidia is still better option, its so convinient and fits into u2 server case.

[-]

tomz17@reddit

Sure... but they are completely different product lines i.e. low profile / low tdp engineering card (cad certified) vs. AMD halo gaming card... Far better to compare the equivalent radeon pro card w.r.t. price and performance.

[-]

badabimbadabum2@reddit (OP)

Just had these on hand....if you send me one I compare