New merge: sophosympatheia/New-Dawn-Llama-3.1-70B-v1.1

Posted by sophosympatheia@reddit | LocalLLaMA | View on Reddit | 30 comments

While waiting for new finetunes of Llama 3.1 70B, I have been experimenting with merging Llama 3 70B models with Llama 3.1 70B. Long story short, it's totally doable. This release was the most promising candidate out of a dozen or so that I've played around with in the past few weeks. [The fp16 weights are available on HF](https://huggingface.co/sophosympatheia/New-Dawn-Llama-3.1-70B-v1.1), and I will update the model card as people release quants. Enjoy!