Unless backed by hardware/infrastructure providers, it is very hard for a AI company to survive. Mistral have almost a billion in funding, but none of the investors are the likes of microsoft, google or amazon.
Lately alibaba and google have significantly raised the bar. Facebook is also in the race, IBM has joined recently. All of them have open source or semi-open source models. So I think no one really cares about mistral at this moment, unless they pull off something comparable to o1+
> IBM has joined recently
And their 2b model us surprisingly good. I was trying out a dozen models for a sentiment analysis task and theirs came a close second for that task after qwen2.5:3b (better than qwen2.5 7b, llama 3.1 8b and many more surprisingly)
No, I gave it a number (>200k) of German sentences with rapper names in them and made it categorize how positively or negatively the sentiment in the sentences is in regards to the rapper (only giving out a number between 1 and 5).
I ran on GPU via ollama and its python integration.
Feel free to ask more questions about it, I'm currently writing the research paper :D
Did you compare with Bert models?
Is seems to me that LLMs aren't the right tool for the job of text classification. (It's not like you are actually generating text).
You make a good point. In my class, it wasn't really made that clear what Bert actually does, I thought it was just an earlier, worse version of LLMs still used as a baseline in research. But it would likely have been a more fitting tool for the task.
That said, qwen 2.5 3b did decently overall, with 65% perfect agreement and 95% off-by-one classification, zero shot.
yes they are. Nowhere said they are making state of the art models, but based on any leaderboard, LLAMA models are ahead of mistral's and this is the point of the argument.
Yup, I could have been clearer. Just because Meta doesn't have a large cloud business doesn't mean they don't have one of the 5 largest data center footprints (and GPU compute) in the world.
Mistral have provided the best all round local model in actual use (Mistral Large) and nobody cares about them? No. If nobody cared this thread wouldn’t exist.
But Mistral is literally funded by amazon? and Nvidia? might wanna do some more research on them lmao
They’ve also released some really great models (esp for the gpu poor).
**Strategic partnership** is nothing like funding. Every cloud providers are partners of every open source models, because it brings them revenue. The primary investors, according to crunchbase are Andreessen-horowitz, salesforce and bnp paribas
Well, on the flip side - EU (parts of it anyway) will also be the only place where realistically some form of UBI or monetary support for unemployment will happen.
If mass job loss starts in the future due to all the unregulated AI rapidly advancing, citizens of US or Asia are absolutely screwed compared to Europeans (at least Nordic countries will for sure do ok, some others might join in).
> the only place where realistically some form of UBI or monetary support for unemployment will happen.
With what money tho
We've sorta regulated outselves out of every major/cutting-edge industry, and a lot of our talent have left shore for the US or the Middle East to enjoy 4x the salary and 0.1x the taxes.
Coupled with that, the Euro has been in steep decline against the USD since the financial crisis, with no sign of relief.
Unfortunately I don't think there's gunna be anyone to actually pay for UBI on our shores.
JD & Elon are fans of UBI and minimum wage funded by innovation. They say "put kiosks in McDonalds, make more profit, pay better wages, build more restaurants". They're official on raising Fed min wage. The old school conservatives hate it.
We may be entering a new pro-tech, pro-worker era?
Could be in the US
The EU will likely regulate & fully outlaw anything which automates away a single job, even if it could fund thousands of UBI recipients in return.
We've sorta wrecked ourselves in that regard tbh, we have bureaucrats who outlaw technology without even understanding the bare basics about it.
Well I am not saying the chances are good I am just saying proportionally it will likely be the only place where governments \*might\* give a fuck to come up with some system.
Yeah, I'm sure they'll try to do something or other - but it's just as likely to accelerate the collapse. Can't just print euros to feed the masses when there's nothing of value backing them.
> Well, on the flip side - EU (parts of it anyway) will also be the only place where realistically some form of UBI or monetary support for unemployment will happen.
That is not flip side, that is getting fucked while getting fucked.
Why thought? Isn't it better for them especially since the act itself talks about giving insights into data used and their models are open source. I think this is an advantage for then in the EU region it's also home grown company so I don't see why The EU AI act is a speed breaker.
The thing is EU AI Act is an hindrance put on Mistral's back in the AI race. While companies like OAI and Anthropic train their models on everything they can get their hands on, Mistral is forced to only use data they own themselves. These closed-source models are very good because they are trained on a lot of copyrighted data. I mean, previous year ChatGPT was giving people working windows license keys when asked. I think OpenAI is the proof that even the professional customers don't care about transparency and explainability, they care about quality and performance
It's plain obvious even in whisper to someone non-knowledgeable like me.. At the end of each inference the model spits a note about subtitles...
Meaning it has been trained with copyrighted movies and subtitles produced by people
As someone that works in a large EU headquartered MNC, I can confirm accountability and transparency trumps model power. GDPR and other data/digital related acts in the EU are no joke when it comes to fines. We’re talking multiple percentage points of **global** turnover.
What's wild to me is the EU thinking they could enforce this without risking a global trade war. Imagine trying to fine Apple or Nvidia at 4% of global *turnover* (not even profit) - that is a very fast way to end up on the losing side of a terrible trade war.
What ever you say it's 100% valid, I agree we live in a capitalistic world.
What I am also saying is that there are certain industries like finance, healthcare, pharma where transparency and explainability plays a huge role. Mistral still has a very good chance.
That part in the EU AI act also means not breaking copyright, which is a question most companies aren't ready to answer. And the need to give insight is only a small part of the act.
Baseless Bs:
"The AI Act **introduces limited exceptions for text and data mining**, recognizing the importance of balancing copyright protection with promoting innovation and research."
[https://keanet.eu/eu-ai-act-shaping-copyright-compliance-in-the-age-of-ai-innovation/#:\~:text=The%20AI%20Act%20introduces%20limited,with%20promoting%20innovation%20and%20research](https://keanet.eu/eu-ai-act-shaping-copyright-compliance-in-the-age-of-ai-innovation/#:~:text=The%20AI%20Act%20introduces%20limited,with%20promoting%20innovation%20and%20research)
I don't think it's necessarily bad , because companies like mistral will always have customers in heavily regulated industries where transparent and explainability plays a huge role.
The customers are paying for the best models. You can't make the best models if you don't have the best quality data. 'Training data' transparency doesn't bring any benefits for most of the end users. We, Europeans, are just coping with this heavy regulation bullshit.
What's sad is that Eurocrats **do believe** law makes money. In Luxembourg they do money with copyrights and when leveraging patent. That's an horrible way of doing money that will be made irrelevant in the few next years like the European Union It seems
Exactly, having AI that complies with the rules gives you a giant market pretty much for yourself. Also the EU AI act is still not enforced yet (most stuff has a two year period, so 2026) and still Mistral is quiet now for months.
Maybe in Europe but the rest of the world including the US does not care about "the rules" as their is currently no legal risk outside of US
IMO, Europe acted too quickly and likely gutted any development from Europe. Don't worry though non European companies will gladly gobble the data and train on it.
Do you know how much an average data engineer/scientist is paid after taxes in France? 3500€ or 4000USD per month lol. Or make an effort. You can be top whatever, the state need to pay all the pensions from the old foggies and various welfare programs. That's the only country on earth where retirees earn more than working people. And no one is shocked when you tell them.
Culture is good, food is good, cities are top class but doing business and working in France is one of the shittiest thing imaginable in the country, making the upsides *unaffordable*.
People sometimes says that the US is a third-world country when it comes to catering to the people and the infrastructure. France is third-world when it comes to not being disappointed when starting an innovative project. No wonder the greatest minds are f*cking fleeing the country ~~I will too~~. Entrepreneur is a french word lmao
Why the IT salaries are so low in France? I mean you can make 3500 euro after tax as a software/ML engineer even in some developing countries like China or Russia with much lower cost of living... is there a huge brain drain from France to the US and neighbouring countries like UK or Netherlands which afaik have higher salaries for skilled engineers?
Being a software engineer in France is disregarded. Anyone touching a computer is basically an untouchable (indian Dalit). I've seen people that are geniuses in their field, not getting any job because they didn't do the right study or didn't stay long enough in their previous companies, or just don't know the right tool. People with lesser skills but some 6 months training in the tool via some training organization whose boss knows the hiring company have more chance of being hired.
That's like a cartel where the manager are some nerdy assholes with a comp sci degree and they only hire asshole. If I seem salty it's because I had to face this kind of people that are average everywhere, except for their big egos.
Now looking for options in "third world countries". In Thailand or Malaysia, I could earn 1:1 salary in euro compared to what you earn in smaller towns. That's approx 2.3 times better
Wow, that's shitty and, tbh, really stupid considering that huge chunks of economy are becoming more digital and are running on software engineers. Not to mention that France is just shooting itself in the foot in AI race...
As a French citizen, could you try to go to Netherlands or perhaps Germany? They have better salaries for software developers & AFAIK you don't need a work visa since you are a EU member? Good luck!
Thanks for your words. I have french and thainayionalities. 🤭 That's even better ! I tried in Germany (I speak German) but their GDP dropped 10% since they don't have cheap energy anymore. They don't really hire foreigners right now...
I still believe the current situation in France is a waste. The country basically have free nuclear energy and produces a lot of scientists (in data too). Having good AI should be an evidence. But I must be realistic, France is in cultural decline for one century now. They can't imagine themselves without being a global power that relies on a long gone colonial hinterland. Time for the big questioning and some practices changes..
If that doesn't work I can still changes carrier and become a plumber. Fine by me 🤷♀️
The EU AI Act is a self reported thing much like AI regulations in the USA
People don't know what it does and think it's some kind of tough regulation.
It's not.
In the worst case with enough investor support they may move their headquarters to U.S, although I'm not sure if it will help them in the long run to become an independent company without being acquired by some closed-source property giants or will just make them bankrupt.
Mistral is currently in the process of opening a Bay Area office. I wonder if they'll incorporate separately there in order to get around the EU's restrictions on AI.
Personally I lost interest in following them after they stopped releasing under open licenses.
I dont even know what you complain about. Why not asking meta and google to release more who also have more resources? Mistral released pixtral large just recently. Whereas meta and google both doesnt release too end model.
The only company that released more is alibaba with their qwen series.
Dont think llama 4 released date is confirmed yet right. For 3.3 is more incremental update, whereas their 3.2 vision part is not as good as competitor. In comparison, qwen released good vision model and reasoning model. Pixtral have good vision capabilities. To be honest, i am sure they are capable of release something better. But it feels like the bigger player is intentionally holding back
It's a bit, they do ask for them as well. The rotation is Mistral > Meta (Llama) > Google (Gemma) > Cohere.
We got 3.3 from Meta and a new updated Paligemma from Google, as well as a 7B from Cohere.
Mistral is next up.
A Mistral-not-so-small-and-not-that-large would be nice. 32B is the sweet spot for me. I really like the current Mistral Small model for its overall consistency when prompted to follow long step-by-step interactive scenarios. In comparison, other models (even Qwen 32B) mix up the steps or items or interpret the instructions in abstract manner. Mistral Small is the most solid, but +10B would benefit it, I think.
That's either a misunderstanding on your part or a blatant lie:
https://arcprize.org/blog/oai-o3-pub-breakthrough
Time per task was ~13 mins on the semi-private eval.
The fact remains that no other model has come close on the ARC-AGI or frontier math benchmarks. The reason you can't use it now is because it's absurdly expensive to run, but the costs will drop fast.
Not really. They dropped a new version of the 22b in September. October was a new 8b. A month ago we got two new versions of largestral - with and without image support. I know this space moves fast, but going one whole month without a new model is hardly "sleeping".
you know who has really been totally silent? Anthropic. I wonder what they will do Claude 3.5 was a fucking beast but they havent released the next gen models yet and are behind now
They released pix large not long ago. They don't get much press anymore because there are other good models and they have no commercial use without licensing.
Came here to say this. My interest in them died the moment they switched to a license like this… especially since their dataset is probably based off the work of others without their consent.
127 Comments
Mr_Moonsilver@reddit
Dark_Fire_12@reddit
procgen@reddit
SocialBudai@reddit
silenceimpaired@reddit
nrkishere@reddit
zitr0y@reddit
Bitter-Good-2540@reddit
zitr0y@reddit
Bitter-Good-2540@reddit
zitr0y@reddit
Willing_Landscape_61@reddit
zitr0y@reddit
FPham@reddit
Massive_Robot_Cactus@reddit
nrkishere@reddit
Bitter-Good-2540@reddit
FlerD-n-D@reddit
Massive_Robot_Cactus@reddit
thereisonlythedance@reddit
silenceimpaired@reddit
fka_nate@reddit
LevianMcBirdo@reddit
nrkishere@reddit
Only-Letterhead-3411@reddit
medialoungeguy@reddit
lleti@reddit
Feisty-Pay-5361@reddit
CNWDI_Sigma_1@reddit
lleti@reddit
Disastrous-Peak7040@reddit
lleti@reddit
Feisty-Pay-5361@reddit
lleti@reddit
procgen@reddit
AssistBorn4589@reddit
ohio_rizz_rani@reddit
Only-Letterhead-3411@reddit
goingsplit@reddit
woutertjez@reddit
InertialLaunchSystem@reddit
ohio_rizz_rani@reddit
InertialLaunchSystem@reddit
MorallyDeplorable@reddit
Many_SuchCases@reddit
GraceToSentience@reddit
ohio_rizz_rani@reddit
SpargeOase@reddit
Nyghtbynger@reddit
brotie@reddit
LevianMcBirdo@reddit
Any_Elderberry_3985@reddit
ThenExtension9196@reddit
Nyghtbynger@reddit
Original_Bend@reddit
4sater@reddit
Nyghtbynger@reddit
4sater@reddit
Nyghtbynger@reddit
4sater@reddit
Nyghtbynger@reddit
Josh_j555@reddit
MorallyDeplorable@reddit
Bitter-Good-2540@reddit
GraceToSentience@reddit
mahithefish@reddit
anonynousasdfg@reddit
lilythompsilly@reddit
Willing_Landscape_61@reddit
BetEvening@reddit
PrinceOfLeon@reddit
Nyghtbynger@reddit
MoffKalast@reddit
Ok_Wear7716@reddit
Zangwuz@reddit
ninjasaid13@reddit
FortranUA@reddit
infernys20@reddit
FortranUA@reddit
JzTheLazy@reddit
umarmnaq@reddit (OP)
TheDreamWoken@reddit
MoffKalast@reddit
Such_Advantage_6949@reddit
Healthy-Nebula-3603@reddit
Such_Advantage_6949@reddit
kif88@reddit
Such_Advantage_6949@reddit
Healthy-Nebula-3603@reddit
Dark_Fire_12@reddit
Such_Advantage_6949@reddit
Mother-Ad-2559@reddit
FantasticRewards@reddit
martinerous@reddit
johnny1064@reddit
Spammesir@reddit
EquivalentIce7442@reddit
procgen@reddit
Few_Painter_5588@reddit
procgen@reddit
EquivalentIce7442@reddit
procgen@reddit
EquivalentIce7442@reddit
procgen@reddit
squareOfTwo@reddit
procgen@reddit
fallingdowndizzyvr@reddit
candre23@reddit
kif88@reddit
ForsookComparison@reddit
pigeon57434@reddit
Any_Elderberry_3985@reddit
silenceimpaired@reddit
Aurelien-Morgan@reddit
lolwutdo@reddit
Great_Currency_3998@reddit
CheatCodesOfLife@reddit
Amgadoz@reddit
Illustrious-Lake2603@reddit
Combinatorilliance@reddit
DarKresnik@reddit
Nyghtbynger@reddit
darkplaceguy1@reddit
randomrealname@reddit
RAGcontent@reddit
mlon_eusk-_-@reddit
Many_SuchCases@reddit