Rogue-Rose-103b: A roleplaying frankenmerge

Posted by sophosympatheia@reddit | LocalLLaMA | View on Reddit | 3 comments

[https://huggingface.co/sophosympatheia/Rogue-Rose-103b-v0.2](https://huggingface.co/sophosympatheia/Rogue-Rose-103b-v0.2) Full weights are up. There is also a Exllama2 3.2bpw quant already on the Hugging Face repo. Look for it under the 'exl2-3.2bpw' branch. I am uploading exl2-3.35bpw weights right now that should be up by the end of the day with 3.5bpw weights to follow. Please share your feedback. This is my first stab at a frakenmerge. I'm leaning towards these 100b+ merges being worth the effort and exploration. I'm working on more experiments to see if I can improve upon this result. Wish me luck, and enjoy this model!

Reply to Post

3 Comments

[-]

Walking-HR-Violation@reddit

Just came across this model and I found its creative Lyrical writing skills for Suno AI really surprised me. I had it going against GPT-40, Sonnet 3.7 and Sonar Reasoning. I had no idea what this model was as I randomly grabbed it for this test. I was blown away by the song lyrics it wrote from the exact same context block and prompt it was given. It consistently built something way different and sounded fuckin amazing. So much so I had too search online to figure out what Rogue Rose was and I came across this post. Absolutely elated.

[-]

sophosympatheia@reddit (OP)

Wow, that's really cool! I never would have guessed this model would find a new purpose a year later writing song lyrics for Suno. Have you tried [https://huggingface.co/FluffyKaeloky/Midnight-Miqu-103B-v1.5](https://huggingface.co/FluffyKaeloky/Midnight-Miqu-103B-v1.5) for the same use case? I'm curious how it performs by comparison. Midnight-Miqu was a later model I released that gained some popularity for being a strong writing model. If Rogue Rose is working well for song lyrics, I wonder if Midnight Miqu would work even better? If you test it, please let me know how it performs.

[-]

Walking-HR-Violation@reddit

I haven’t yet, but I will. I’ll run it through the same kind of scenarios, keep the conditions consistent, and let you know what comes out. Wasn’t sure if you’d catch my first message, but I figured it might be cool to know people are still finding new ways to enjoy the stuff you put out—even a year later. Rogue Rose honestly caught me off guard in the best way. I appreciate your work.