Yet another reason to stick with local models
Posted by nekofneko@reddit | LocalLLaMA | View on Reddit | 33 comments

Tibor Blaho,a trusted reverse engineer, found ad system strings inside the latest ChatGPT Android beta(v1.2025.329).
Chromix_@reddit
You find some 3rd party ad SDK in almost every Android app, that's not big news. Well, except for those on f-droid probably. Here it's not 3rd party but 1st party though.
The thing is, they wouldn't even need to put anything ad-specific into their app. They control the server that it connects to, and can thus read any entered data and send any ad content back anyway.
waiting_for_zban@reddit
You can collect much more granular data with a dedicated sdk built into the app. It can access more local data, get more behavioural patterns, more tracking, etc ...
If anything, users have been (mentally) strong armed not to care about their privacy, or in some situation gaslit if they care, and thus, why not fully exploit that vulnerability.
Chromix_@reddit
You can always have more, yes, which (mostly) requires more app permissions. But if users are used to "tap on this button to give the app all it needs to work correctly" then that's of course no hindrance. The server-side version can be done without requiring anything extra on the client side.
noiserr@reddit
As we all know running these models isn't cheap. For a free service it make sense for it to be supported with ads. As long as we don't get the same situation with TV. Where you get ads even after paying for the service I'm fine with this.
gggghhhhiiiijklmnop@reddit
What’s the best general purpose local model that fits in 24gb right now?
Privocado@reddit
many options. take a look to https://artificialanalysis.ai/models/open-source/small
AppearanceHeavy6724@reddit
Oh fuck no, artificial Analysis again. Their name checks out BTW.
AppearanceHeavy6724@reddit
Mistral Small 3.2.
HasGreatVocabulary@reddit
guys i have a brillliant and universally lovable business idea, we'll add ads in the product and then charge users to remove the ads we added
Chromix_@reddit
Yes, make adds overly annoying, while offering a "premium" subscription as the way out. Then start showing sponsored content to those who are paying the monthly plan, to nudge them to upgrade to the "ultimate" subscription that then unlocks the "sponsored content setting" option, which allows you to skip sponsored content 3 times per day. You can of course always upgrade to "VIP" mode to enable the new and innovative "direct to content feature", and you can even subscribe to a multi-device plan for this on top. Isn't it great?
Ok-Lobster-919@reddit
Hey respectfully, fuck off with your fake youtube premium strawman. It's not even real, there is no sponsored content (by google/yt) there are ZERO ADS for premium. Just pick something else.
AppearanceHeavy6724@reddit
Yea, I have premium plan, called uBlock ultimate plan
MaybeIWasTheBot@reddit
i've never seen someone get on their knees for a corporate so enthusiastically
qroshan@reddit
vs sad, pathetic losers want everything free without contributing anything
fooo12gh@reddit
Choosing between using chatgpt for free with some ads vs non being able to use it at all - I'll choose the 1st option.
Privocado@reddit
It depends on how much you value your privacy.
Ok-Pipe-5151@reddit
It doesn't depend. Chatgpt users are uploading sexual health report to chatgpt 😭🥀. They don't care about privacy at all
darkmaniac7@reddit
I understand the dislike for ads as much as anybody else. But who didn't see this coming?
Trillions being dropped into AI, increasing API costs and still being laughably unprofitable for every major AI company? 95+% of GPT use is still free-tier last I heard.
This was 100% bound to happen. I think Perplexity tried it as well, but they made almost nothing from the revenue since LLMs don't really work great (they found) for Sponsored or Directed ads.
Ok-Pipe-5151@reddit
Personalized ad injection will be primary "feature" of every commercial chatbots in coming days. And guess what? Typical js based adblocker unlikely to be effective. The blocker will itself require LLM integration to detect ad injection, which makes local llms even more of a necessity than ever.
redditscraperbot2@reddit
I'm shocked it hasn't already happened yet. So many people open up to chatbots about their issues. It's almost a no-brainer for companies to inject product recommendations into replies.
CoUsT@reddit
I'm sure there are some laws that state something like "you can't inject ads into the content stream" or something like that.
That's why all adblockers work I assume. All websites have dedicated ad blocks, even ads on twitch are streamed with some metadata that allows adblockers to just filter them out.
Just a guess from my observations, maybe an expert can share more insights into this.
Goupilverse@reddit
This is not a legal contraption but a business need.
Ads need to be trackable to be explain to the advertising company the reach & impact of the ad they paid for.
If not, you give dollars to advertise your thing and you have NO idea if it add any impact or rentability
Ok-Pipe-5151@reddit
Gemini web has recently introduced dynamic view (which is nothing by custom html layout). It will potentially serve as paving ground for ad injection. Linking the product alone doesn't work, the presentation also matters.
aeroumbria@reddit
"edit the screen such that advertisements are no longer visible"
oodelay@reddit
And we're back at ads during tv shows
mrdevlar@reddit
Enshittification is the theme of this moment in history.
swaglord1k@reddit
just use adblock.... it's 2025...
NeonRitual@reddit
Local models might be trained on ads too
IllllIIlIllIllllIIIl@reddit
My worry is they won't just be trained to deliver ads, they'll be trained to push certain ideologies or viewpoints. Obviously any kind of alignment training already is that to some extent, but it could be a lot worse than it is.
Fine-Will@reddit
I can't imagine a world where that doesn't happen.
ForsookComparison@reddit
They all definitely are to some extent, whether on purpose or not.
OP is highlighting that the actual ChatGPT Android app has several classes with names that suggest they might be used for ads. This doesn't prove anything, heck it might just be the way the shopping feature of the app grabs real buyable products instead of trusting raw search data.
lisploli@reddit
You can have that local too. And it actually works right now!
I'm aware that untargeted and unpaid adds would be pointless for the provider, but it makes little difference for the user. So enjoy the future.
Clearly labelling marketing content (like DSA) is a political issue.
ANR2ME@reddit
Well ads is a feature 😏