Best DM model right now?

Posted by opoot_@reddit | LocalLLaMA | View on Reddit | 2 comments

I’ve always tried to get a local ai model working well enough for it to act as a dungeon master for DnD. What’s the best for storytelling, writing, and long term consistency? I got dual MI50 32gbs.

Right now Gemma 4 31B uncensored Q4KS (of course) has worked the best but I get around 7 tokens per second and very long prompt processing. 26B A4B Q4KS is just a tad bit away from being good enough, so does anyone have any recommendations?

I’m quite interested in a Claude distill model only because I’ve heard that they’re good but I’m not familiar enough with specific models that I don’t know if they will fit my needs.

I’d really appreciate some recommendations, thanks.

[-]

EffectiveCeilingFan@reddit

Maybe check out https://huggingface.co/eousphoros/kappa-20b-131k? It's from Level1Techs, who's pretty trusted in the tech space, and was trained with D&D character alignment, so maybe it'd be good at DMing? It probably won't be as good as Gemma4 31B, though, since it's an MoE, but it'll be a helluva lot faster.

opoot_@reddit (OP)

Thanks, I’ll give it a try