Gemma 4 26B A4B heretic Q2_K is broken
Posted by Academic-Map268@reddit | LocalLLaMA | View on Reddit | 6 comments
The model spits out gibberish. Maybe others in that repo are also broken idk I don't have the VRAM.
mradermacher/gemma-4-26B-A4B-it-heretic-GGUF at main
ps5cfw@reddit
What the fuck do you even expect Q2 to do it's already a small as hell MoE model and you are quantizing It to literal death
No-Pineapple-6656@reddit
Well he expected it to have a basic level of functionality. It doesn't. It literally says "asb fgc e1.2345" when I test it. So he's right. Meanwhile Unsloth at Q2_K_XL works like a charm.
DinoAmino@reddit
This post really should have the Funny tag.
OneSlash137@reddit
Hey 2bit model, make yourself as smart as opus4.7. Make no mistakes and don’t get caught in loops.
Profit
VoiceApprehensive893@reddit
make no mistakes
JuniorDeveloper73@reddit
lobotomy edition