Gemma-4 What the A is going on???
Posted by Automatic-Sound6593@reddit | LocalLLaMA | View on Reddit | 14 comments
Just downloaded this, typed in "Hi."
Posted by Automatic-Sound6593@reddit | LocalLLaMA | View on Reddit | 14 comments
Just downloaded this, typed in "Hi."
HistorianPotential48@reddit
asking reasoning models "hi" will be the reason of why future AI destroyed human civilization because we're doomed as a failing specimen
Specter_Origin@reddit
Your setup has some issues, model is much much better, I run it at Q4 and works wonders...
Automatic-Sound6593@reddit (OP)
Yeah, I don't really know enough to mess with params. llama.cpp on Fedora 43, amd 2700 (?) and amd 9060XT 16gb. I compiled llama.cpp with vulkan. llama-cli returns 8670 (af76639f7) built with GNU 15.2.1 for linux x86_64
Specter_Origin@reddit
bub there is your problem, you are on way to old of llama.cpp and most of the gemma-4 patches are pretty recent in llama.cpp upgrade that and also update your quant if its unsloth as they had to release path to support llama.cpp updates too yesterday.
Automatic-Sound6593@reddit (OP)
Updated, downloaded, rebuilt. It's working again, thanks everyone
DocMadCow@reddit
Are you running CUDA 13.2? It is producing garbage.
Automatic-Sound6593@reddit (OP)
No, I'm running vulkan
Fun_Factor_2886@reddit
what is the Local LLM Runner software op is using?
Automatic-Sound6593@reddit (OP)
llama.cpp on Fedora 43, amd 2700 (?) and amd 9060XT 16gb. I compiled llama.cpp with vulkan.
ttkciar@reddit
I ran into very similar problems before I refreshed llama.cpp (from the Github repo) last night. No problems now.
ExoticPerformer4061@reddit
ask them a question or prompt
silenceimpaired@reddit
When attempting to see in what ways Gemma 4 was censored I noticed the model would freeze up on a single word if forced to head in a direction that was not in keeping with its policy. I suspect the Heretic models cause this to trigger more. I also suspect it’s part of the model’s design to prevent models from having this safety protections removed. This is, however, all conjecture.
nerdr0ck@reddit
same, gemma. same.
vk3r@reddit
Aaaaaaaaaaaaaa