SelfAwareMcNugget

Deepseek V3 is absolutely astonishing

Posted by klippers@reddit | LocalLLaMA | View on Reddit | 385 comments

Open models wishlist

Posted by hackerllama@reddit | LocalLLaMA | View on Reddit | 238 comments

SelfAwareMcNugget@reddit

I don't understand why 27 billion parameters is offered as a model, as the server needed to run this costs about $15k a month. A personal assistant that, like notebook LM, can summarise documents is top of my list. It can run on low end hardware, and using something Iike Anything LM, gets input from a Vector DB in under a second. An instructive model might be what I'm trying to describe.