My new Hebrew model is available on HuggingFace

Posted by Sicarius_The_First@reddit | LocalLLaMA | View on Reddit | 8 comments

Hi all, My previous model, Zion\_Alpha was a raw model, not finetuned for tasks, this one is! It's far from perfect, but from what I've checked it's one of the best open source models available. Please feel free to further fine tune it and post any feedback. Regarding how I made it, I already answered that question in previous threads. In short, wikipedia, synthetic data, parallel translation (datasets available on HF) and some voodoo magic. The training was done on prem. FP16: [https://huggingface.co/SicariusSicariiStuff/Zion\_Alpha\_Instruction\_Tuned](https://huggingface.co/SicariusSicariiStuff/Zion_Alpha_Instruction_Tuned) GGUF: [https://huggingface.co/SicariusSicariiStuff/Zion\_Alpha\_Instruction\_Tuned\_GGUF](https://huggingface.co/SicariusSicariiStuff/Zion_Alpha_Instruction_Tuned_GGUF)