misanthrophiccunt

• What's this sub geebral opinion on quantisizing the KV cache

  Posted by misanthrophiccunt@reddit | LocalLLaMA | View on Reddit | 91 comments

• Qwen3.6 27b fixed my erectyle disfunction and reversed my baldness 😱

  Posted by misanthrophiccunt@reddit | LocalLLaMA | View on Reddit | 21 comments

• Rule suggestion: links to "I made this website" with full disclosure, so we can avoid AI slop.

  Posted by misanthrophiccunt@reddit | LocalLLaMA | View on Reddit | 9 comments

• Is there a place where I can compare generation of tokens per second of 1 GPU VRAM+RAM vs 2 GPUs for those models that don't fit in 1 GPU?

  Posted by misanthrophiccunt@reddit | LocalLLaMA | View on Reddit | 5 comments

• What are your thoughts on decent yet still unaffordable miniPCs that call themselves "datacentres at home"?

  Posted by misanthrophiccunt@reddit | LocalLLaMA | View on Reddit | 1 comments