What are the most unique models that are under 15b you encountered

Posted by ResponsibleTruck4717@reddit | LocalLLaMA | View on Reddit | 10 comments

I'm not talking about nsfw, I know remember people claiming some models have personality, I would like to see what models you have encountered that were unique and fun to chat with.

[-]

noctrex@reddit

Here you go :)

https://huggingface.co/noctrex/The-Philosopher-Zephyr-7B-GGUF

[-]

SlavaSobov@reddit

Apollo 4B is pretty interesting for a model so small.

https://huggingface.co/AllThingsIntel/Apollo-V0.1-4B-Thinking

[-]

MaxKruse96@reddit

Mistral Nemo 14b is pretty unique for any model below 15b. I still dont think there is anything like it (surely mistral will release new models soon... *hope*)

[-]

MaxKruse96@reddit

yes it is. and its damn good at that, despite its age. no idea why im getting bullied :(

[-]

stopcomputing@reddit

Wayfarer-2 12B. I'm not one for DnD or roleplay stuff usually, but this model makes for one difficult session of keeping your character alive.

[-]

AppearanceHeavy6724@reddit

Models by trillion labs. They have the weirdest prose style.

[-]

LeatherRub7248@reddit

any links to a cloud provider i can test Trillion models?

[-]

There's the good old Llama2 where someone recently mentioned the personality. The thing is, that this is a consequence of not using the correct prompt/chat template. It's been observed in a few models that they enter some sort of roleplay mode when used with the wrong prompt template. When used with the correct prompt/chat template Llama2 mostly gives the standard, not really engaging answers by default like other models.