Solidity LM surpasses Opus
Posted by swingbear@reddit | LocalLLaMA | View on Reddit | 4 comments
My weekend project overran a little but happy with the end result.
soleval pass@1 beat Opus 4.7 on the same set of tasks. Some more work to be done here but any feedback is welcome, I spent quite a lot of time (and money) on this one!
https://huggingface.co/samscrack/Qwen3.6-Solidity-27B
RIP26770@reddit
Nice do you plan to release the 35B-A3B variant?
o0genesis0o@reddit
I remember you sharing WIP of this a few days back. Good job for pulling through to the end.
I don't do ethereum work anymore so can't say whether it would be useful, but the hf page looks quite thorough. Hope you got good outcome, whatever that is, with this work.
swingbear@reddit (OP)
Appreciated! I learned a bunch from this one. I’m very confident v2 will be much better.
swingbear@reddit (OP)
Edit: still pushing the merged checkpoint to HF