Tesla P4 or Tesla P100?
Posted by Nokin345@reddit | LocalLLaMA | View on Reddit | 3 comments
I am looking for a cheap gpu to run small llm (e.g. qwen 4b q4_k_m) in a home server, and from where im at, I can get the p4 for $ 70 and the p100 for $ 80, are they even worth it as cuda support has ended for both of them. should I get either of these? if so, which one?
a_beautiful_rhind@reddit
P100 has decent FP16, as long as you're handy with software it will work fine.
senrew@reddit
I picked up 2 p100s a few months ago for $150 a piece. I say go for it.
SSOMGDSJD@reddit
I would pick up a p100 at that price tbh, hard to beat for 80 bones