Tesla P40 is too expensive. Here is the next best value. (45$ per 10GB, P102)

Posted by My_Unbiased_Opinion@reddit | LocalLLaMA | View on Reddit | 40 comments

I have been researching a replacement GPU to take the budget value crown for inference. I don't want ANYONE to buy a P40 for over 180$ (They are not worth it). This is exactly why I am making this post. Here is the GPU: Nvidia **P102-100 10GB.** This is a Pascal GPU with 10GB of GDDR5X. It will work with Llama.cpp GGUFs. You can buy 4 of these for about 200$ (Currently) for 40GB of VRAM. These will perform similar to a P40 as they both have about 11 TFLOPS of FP32. Here are a couple ebay links: [https://www.ebay.com/itm/156284589025?itmmeta=01J2WF5YX78F5RQ3FPWXK826S1&hash=item24634993e1:g:f2kAAOSwkYBmhDPk&itmprp=enc%3AAQAJAAAA4I6aZTIVA6OMHtdqIdorCfKVXfHUauPNjLKdJOmOe8YAJh4vRGWb%2BT08y6Qxe%2BM0C%2F9SATbboUTXHZnMy6OQWojPtqesB9AxdNBvanVyaoEusrcwM02WRE9oupXcN8PUzrRZoJaRHeeiTxwfa6ZdKb15VPlJlhdeOCYnL%2F%2BQZKyaNuEyNwNSMK%2F4h5Th1I9e2cpYTqF8NT5GFTwy88G1kUNc8dMGH8v3BqkZtjgIZ6Tz94I32G22ItnrAqMQ6baYD2yJF%2FyWK2CCADGQhIVX6HprrFdnQIP8DrYEfUrUG9YQ%7Ctkp%3ABk9SR9rul4-XZA](https://www.ebay.com/itm/156284589025?itmmeta=01J2WF5YX78F5RQ3FPWXK826S1&hash=item24634993e1:g:f2kAAOSwkYBmhDPk&itmprp=enc%3AAQAJAAAA4I6aZTIVA6OMHtdqIdorCfKVXfHUauPNjLKdJOmOe8YAJh4vRGWb%2BT08y6Qxe%2BM0C%2F9SATbboUTXHZnMy6OQWojPtqesB9AxdNBvanVyaoEusrcwM02WRE9oupXcN8PUzrRZoJaRHeeiTxwfa6ZdKb15VPlJlhdeOCYnL%2F%2BQZKyaNuEyNwNSMK%2F4h5Th1I9e2cpYTqF8NT5GFTwy88G1kUNc8dMGH8v3BqkZtjgIZ6Tz94I32G22ItnrAqMQ6baYD2yJF%2FyWK2CCADGQhIVX6HprrFdnQIP8DrYEfUrUG9YQ%7Ctkp%3ABk9SR9rul4-XZA) [https://www.ebay.com/itm/156284588757?itmmeta=01J2WF5YX7Q4J8BBJC235DGH3K&hash=item24634992d5:g:8poAAOSwMTRmhDPB&itmprp=enc%3AAQAJAAAAwEKlaFy13FoA3nUHmcfvCajOu4fL%2F55M1Rscx2mUI5uS8aEPrvksXKQqbWb46QkB%2Fx4n0mIGTKgeAaJUY30zBiBTHKJd2gDyWVuZnZivzquzRFaORYNxw2mru5fa5liNm7ptbB2HZ6%2Ff4jrKpMffywR6IGMceWTVCun7%2F4M0LL6JL%2BCzzGlxvjAOJd%2Fl9CBcaOA9qdfOtSswuW0ffTbXL2testDGwAg5oEGaT0cK7QYX1tTWb5K%2FFJq8OLACoHBpUw%3D%3D%7Ctkp%3ABk9SR9rul4-XZA](https://www.ebay.com/itm/156284588757?itmmeta=01J2WF5YX7Q4J8BBJC235DGH3K&hash=item24634992d5:g:8poAAOSwMTRmhDPB&itmprp=enc%3AAQAJAAAAwEKlaFy13FoA3nUHmcfvCajOu4fL%2F55M1Rscx2mUI5uS8aEPrvksXKQqbWb46QkB%2Fx4n0mIGTKgeAaJUY30zBiBTHKJd2gDyWVuZnZivzquzRFaORYNxw2mru5fa5liNm7ptbB2HZ6%2Ff4jrKpMffywR6IGMceWTVCun7%2F4M0LL6JL%2BCzzGlxvjAOJd%2Fl9CBcaOA9qdfOtSswuW0ffTbXL2testDGwAg5oEGaT0cK7QYX1tTWb5K%2FFJq8OLACoHBpUw%3D%3D%7Ctkp%3ABk9SR9rul4-XZA) One plus side is you can find these cards with a fan already installed, so you wont need to rig your own fan setup.