Reasoning Stuck in Loops
Posted by ShaneBowen@reddit | LocalLLaMA | View on Reddit | 14 comments
Does anyone else have their models get stuck in loops like this? I was trying to bake off a 3080 Ti(CUDA13) with Qwen3.5-9B vs and a Xe iGPU with Qwen3.5-35B-A3B.
agreeduponspring@reddit
What.... what was the prompt for this?
bucolucas@reddit
Nobody wonders what conversation would have both "urine" and "roman concrete" as relevant topics?
pedronasser_@reddit
The only situation I've seen Qwen3.5 get stuck on a loop like this was during context overflow.
UniqueAttourney@reddit
This is my assessment, it's the context overflow, usually your harness should take care of this. most of the time, vLLM or llama.cpp won't handle getting close to the limit of the context.
Nyghtbynger@reddit
Okay, I'll go with the "Brine" fact.
Sixhaunt@reddit
unfortunately a common problem with that model right now
Freigus@reddit
Presence penalty 1.0-1.5 should fix infinite looping (but thinking can still take over 7k tokens).
I've actually noticed that in Agentic flows (roo code in my case) model doesn't use "extensive" thinking - it actually works fine. But in more basic instruct-chat environments - it will usually think too much in the first few messages.
I've seen "opus-reasoning" fine-tunes of HF that are supposed to solve this problem, but I haven't seen their benchmarks.
VEHICOULE@reddit
Qwopus 3.5 9b fix that and get better results anyway at lower thinking token cost
Easy_Kitchen7819@reddit
Try cuda 13.1, nvidia 590 and llama cpp ik. A lot of glitches in main project.
miniocz@reddit
Have you used recommended parameters? (Temperature, top_k....) For me it helped a lot. I can get one or two waits but nothing like this anymore.
ShaneBowen@reddit (OP)
I use the parameters recommended by Unsloth, are there other resources where I can find configs?
UnbeliebteMeinung@reddit
We just disabled thinking on Qwen3.5-35B-A3B its clearly not working properly. This looping is all over the place.
DUFRelic@reddit
A tomato is botanically a fruit because it develops from a flower and contains seeds. However, due to its savory flavor and culinary uses in salads, sauces, and cooking, it is commonly classified as a vegetable by cooks and in nutrition. So its ok to be unsure :)
UnbeliebteMeinung@reddit
Yes it was looping about "what the user wants from me?" like if its for a cook book or a scintific thing.