LLMs be like... reminder for the GPU poor among us :‘(

Posted by nderstand2grow@reddit | LocalLLaMA | View on Reddit | 4 comments

Reply to Post

4 Comments

[-]

rawednylme@reddit

I just want more vram, even on a mid-range GPU. Nvidia/AMD/Intel, please... Build the "peasant's special" for people like me. We'll buy them in droves.

[-]

ttkciar@reddit

On one hand, this is funny :-) On the other hand, I've been able to do a *lot* with just CPU inference.

[-]

Admirable-Star7088@reddit

As someone who prioritize quality over speed, I'm a happy CPU user (with some GPU offloading).

[-]

Low88M@reddit

…and time 😅 ?