Gemma 4 & Obsidian

Posted by Errorunnamed@reddit | LocalLLaMA | View on Reddit | 3 comments

so today I tried the Obsidian LLM wiki system by Karparthy, but with Gemma 4 locally in OpenCode with instead of Claude code.

My experience is very frustrating. I tried both 26b and a4b models.

I have a lot of issues to make it follow the instructions in the agents.md file. It always takes shortcuts, skip things, and is... dumb as hell.

Anyone relates, or maybe am I doing something wrong?

[-]

Adventurous-Okra-407@reddit

Are you sure your OpenCode is using interleaved thinking correctly with your local hosted models?

[-]

Substantial_Swan_144@reddit

Check your quantization. Gemma IS prone to some shortcuts, like e.g, Opus is. But it shouldn't go as far as writing random dates in log files.

And as u/hattlessman said, it could be something in OpenCode messing with the model.

[-]

Could be instructions/harnessing. Maybe your quant? I'm using gemma-4-26B-A4B-APEX-I-Compact.gguf with Nous Research's Hermes and its been pretty great. I've only really built a facebook scraper though.