My new Hebrew model is available on HuggingFace
Posted by Sicarius_The_First@reddit | LocalLLaMA | View on Reddit | 8 comments
Hi all,
My previous model, Zion\_Alpha was a raw model, not finetuned for tasks, this one is!
It's far from perfect, but from what I've checked it's one of the best open source models available. Please feel free to further fine tune it and post any feedback.
Regarding how I made it, I already answered that question in previous threads.
In short, wikipedia, synthetic data, parallel translation (datasets available on HF) and some voodoo magic. The training was done on prem.
FP16:
[https://huggingface.co/SicariusSicariiStuff/Zion\_Alpha\_Instruction\_Tuned](https://huggingface.co/SicariusSicariiStuff/Zion_Alpha_Instruction_Tuned)
GGUF:
[https://huggingface.co/SicariusSicariiStuff/Zion\_Alpha\_Instruction\_Tuned\_GGUF](https://huggingface.co/SicariusSicariiStuff/Zion_Alpha_Instruction_Tuned_GGUF)
8 Comments
Ok_Breath8274@reddit
skwyckl@reddit
Conutu@reddit
theytookmyfuckinname@reddit
Nileghi@reddit
oh_how_droll@reddit
redballooon@reddit
Sicarius_The_First@reddit (OP)