Believe it or not 🤯 but officially… the code used to train and develop the Horus-1.0-4B model is now open source ❕

Posted by assemsabryy@reddit | LocalLLaMA | View on Reddit | 4 comments

Believe it or not 🤯
but officially… the code used to train and develop the Horus-1.0-4B model is now open source ❕

This means anyone can use the code to:
• Learn and understand how models are built
• Benefit from ready-to-use code
• Train their own models
• Fine-tune Horus-1.0-4B for specific tasks

🔥 Horus, which led the AI scene during April,
is now fully available with its complete source code for any developer or researcher who wants to build on it or improve it.

And if this is your first time hearing about Horus — it is the first open-source LLM trained from scratch in Egypt, developed by TokenAI.

Here’s the model link:
tokenaii/horus · Hugging Face

You can access the code easily on GitHub:
https://github.com/tokenaii/horus-1.0

đź“ś The project is released under the MIT License,
which gives you full freedom to use and modify the code, as long as you keep the license text and credit TokenAI.

The goal of this bold step is to create stronger and better opportunities for developers to build their own projects.
And just like the Horus model was open source, today the code that contributed to its development and training is also open source đź’Ż

—

Assem Sabry