Fine Tuning LLaMa-3 8B

Posted by Crazyscientist1024@reddit | LocalLLaMA | View on Reddit | 1 comments

I have been using open source models from around 6 month now by using ollama. I recently wanted to do some fine-tuning on LLaMa-3 8B as it kinda has that annoying GPT-4 tone. I wanna fix that by using a Opus dataset I found on huggingFace and fine tuning LLaMa-3 8B. I know about Axolotl and it's a easy way to fine tune. I tried to do that myself but it didn't quite work, does anyone have any good and simple tutorials to fine-tune LLaMa-3 8B?