Sure, but whatever Ministral 3 is, it's a new architecture, because they are adding support for it to Transformers. If this was based on the original Ministral 8B, they wouldn't need to touch Transformers to support it, right? But here they are, removing 9 lines, adding 1403 new lines of code. This is not our old Ministral architecture, so the performance of the model is yet to be disclosed.

To be fair, when I said Bert-Nebulon Alpha could be this Ministral 3, it is just my wishful thinking and there could really be a bigger model, maybe one that is using the same new architecture as this Ministral 3, but we don't know that for sure. What I do know though, last time I tried this Bert-Nebulon Alpha, it had some serious flaws in its logic which I commented about in other threads in this sub and I made comparison to Mistral Small 3.2 at some point with conclusion that if this Bert-Nebulon Alpha is indeed a new Mistral model, its logic is weaker than that of Mistral Small 3.2, but then again maybe they fixed it in the meantime. If not, it would make more sense that it is truly that 8B model and for that size, it would be really smart one.

In the meantime, someone knowledgeable in this could take a look and figure out what kind of architecture it really is from the code, I'm sure it would be appreciated.