Qwen3.5 REAP

Posted by BothYou243@reddit | LocalLLaMA | View on Reddit | 2 comments

Will we get REAP variants of Qwen3.5 35B and 27B? will the reap variants would be better than dense 14B ones?

Reply to Post

2 Comments

[-]

Awwtifishal@reddit

REAP removes experts, and while the 35B is MoE, the 27B is not, it's dense, and it's much more difficult to prube. Better wait for smaller qwen 3.5 models to come out.

[-]

smahs9@reddit

Better quants (byteshape) for 27B.