Tesla P40 is too expensive. Here is the next best value. (45$ per 10GB, P102)
Posted by My_Unbiased_Opinion@reddit | LocalLLaMA | View on Reddit | 40 comments
I have been researching a replacement GPU to take the budget value crown for inference. I don't want ANYONE to buy a P40 for over 180$ (They are not worth it). This is exactly why I am making this post. Here is the GPU:
Nvidia **P102-100 10GB.**
This is a Pascal GPU with 10GB of GDDR5X. It will work with Llama.cpp GGUFs. You can buy 4 of these for about 200$ (Currently) for 40GB of VRAM. These will perform similar to a P40 as they both have about 11 TFLOPS of FP32.
Here are a couple ebay links:
[https://www.ebay.com/itm/156284589025?itmmeta=01J2WF5YX78F5RQ3FPWXK826S1&hash=item24634993e1:g:f2kAAOSwkYBmhDPk&itmprp=enc%3AAQAJAAAA4I6aZTIVA6OMHtdqIdorCfKVXfHUauPNjLKdJOmOe8YAJh4vRGWb%2BT08y6Qxe%2BM0C%2F9SATbboUTXHZnMy6OQWojPtqesB9AxdNBvanVyaoEusrcwM02WRE9oupXcN8PUzrRZoJaRHeeiTxwfa6ZdKb15VPlJlhdeOCYnL%2F%2BQZKyaNuEyNwNSMK%2F4h5Th1I9e2cpYTqF8NT5GFTwy88G1kUNc8dMGH8v3BqkZtjgIZ6Tz94I32G22ItnrAqMQ6baYD2yJF%2FyWK2CCADGQhIVX6HprrFdnQIP8DrYEfUrUG9YQ%7Ctkp%3ABk9SR9rul4-XZA](https://www.ebay.com/itm/156284589025?itmmeta=01J2WF5YX78F5RQ3FPWXK826S1&hash=item24634993e1:g:f2kAAOSwkYBmhDPk&itmprp=enc%3AAQAJAAAA4I6aZTIVA6OMHtdqIdorCfKVXfHUauPNjLKdJOmOe8YAJh4vRGWb%2BT08y6Qxe%2BM0C%2F9SATbboUTXHZnMy6OQWojPtqesB9AxdNBvanVyaoEusrcwM02WRE9oupXcN8PUzrRZoJaRHeeiTxwfa6ZdKb15VPlJlhdeOCYnL%2F%2BQZKyaNuEyNwNSMK%2F4h5Th1I9e2cpYTqF8NT5GFTwy88G1kUNc8dMGH8v3BqkZtjgIZ6Tz94I32G22ItnrAqMQ6baYD2yJF%2FyWK2CCADGQhIVX6HprrFdnQIP8DrYEfUrUG9YQ%7Ctkp%3ABk9SR9rul4-XZA)
[https://www.ebay.com/itm/156284588757?itmmeta=01J2WF5YX7Q4J8BBJC235DGH3K&hash=item24634992d5:g:8poAAOSwMTRmhDPB&itmprp=enc%3AAQAJAAAAwEKlaFy13FoA3nUHmcfvCajOu4fL%2F55M1Rscx2mUI5uS8aEPrvksXKQqbWb46QkB%2Fx4n0mIGTKgeAaJUY30zBiBTHKJd2gDyWVuZnZivzquzRFaORYNxw2mru5fa5liNm7ptbB2HZ6%2Ff4jrKpMffywR6IGMceWTVCun7%2F4M0LL6JL%2BCzzGlxvjAOJd%2Fl9CBcaOA9qdfOtSswuW0ffTbXL2testDGwAg5oEGaT0cK7QYX1tTWb5K%2FFJq8OLACoHBpUw%3D%3D%7Ctkp%3ABk9SR9rul4-XZA](https://www.ebay.com/itm/156284588757?itmmeta=01J2WF5YX7Q4J8BBJC235DGH3K&hash=item24634992d5:g:8poAAOSwMTRmhDPB&itmprp=enc%3AAQAJAAAAwEKlaFy13FoA3nUHmcfvCajOu4fL%2F55M1Rscx2mUI5uS8aEPrvksXKQqbWb46QkB%2Fx4n0mIGTKgeAaJUY30zBiBTHKJd2gDyWVuZnZivzquzRFaORYNxw2mru5fa5liNm7ptbB2HZ6%2Ff4jrKpMffywR6IGMceWTVCun7%2F4M0LL6JL%2BCzzGlxvjAOJd%2Fl9CBcaOA9qdfOtSswuW0ffTbXL2testDGwAg5oEGaT0cK7QYX1tTWb5K%2FFJq8OLACoHBpUw%3D%3D%7Ctkp%3ABk9SR9rul4-XZA)
One plus side is you can find these cards with a fan already installed, so you wont need to rig your own fan setup.
40 Comments
jbaenaxd@reddit
Ok_Interview_7138@reddit
MachineZer0@reddit
DeltaSqueezer@reddit
smcnally@reddit
MachineZer0@reddit
BlipOnNobodysRadar@reddit
tmvr@reddit
DeltaSqueezer@reddit
smcnally@reddit
Thellton@reddit
sipjca@reddit
My_Unbiased_Opinion@reddit (OP)
sipjca@reddit
DeltaSqueezer@reddit
sipjca@reddit
Thellton@reddit
syrupsweety@reddit
Thellton@reddit
syrupsweety@reddit
Thellton@reddit
My_Unbiased_Opinion@reddit (OP)
Thellton@reddit
ZCEyPFOYr0MWyHDQJZO4@reddit
My_Unbiased_Opinion@reddit (OP)
kenny2812@reddit
My_Unbiased_Opinion@reddit (OP)
kenny2812@reddit
hahaeggsarecool@reddit
Thellton@reddit
Playful_Criticism425@reddit
My_Unbiased_Opinion@reddit (OP)
Playful_Criticism425@reddit
Ofacon@reddit
Playful_Criticism425@reddit
Ofacon@reddit
syrupsweety@reddit
muxxington@reddit
ambient_temp_xeno@reddit
a_beautiful_rhind@reddit