In terms of Quality, how good is Bonsai 8B?

Posted by AsrielPlay52@reddit | LocalLLaMA | View on Reddit | 3 comments

As the title said, I'm looking and has anybody done a comparison with other 8B or similar parameter model yet?

Reply to Post

3 Comments

[-]

keen23331@reddit

für mich bei Praxis-Test funktioniert zum beispiel "https://huggingface.co/unsloth/NVIDIA-Nemotron-3-Nano-4B-GGUF" in der kleinsten Quant UD-IQ2\_XXS **2.18 G** B deutlich besser als Bonasai 8B 1 Bit

[-]

You got graphs with comparison at hf - [https://huggingface.co/prism-ml/Bonsai-8B-gguf](https://huggingface.co/prism-ml/Bonsai-8B-gguf) And also demo for free try this model - [https://huggingface.co/spaces/prism-ml/Bonsai-demo](https://huggingface.co/spaces/prism-ml/Bonsai-demo)

In terms of Quality, how good is Bonsai 8B?

Reply to Post

3 Comments

keen23331@reddit

rhinodevil@reddit

Skyline34rGt@reddit