My older coworkers have accepted AI as the source of truth

Posted by randomname945@reddit | sysadmin | View on Reddit | 227 comments

I am a 25 y.o mid level engineer in an older classic on prem infra team (average age around 45) and we manage a nice mix of Linux / Windows servers.
We are also in business critical so we can't just blindly copy and paste data into the LLM of our choice (like other teams in our org do), so my coworkers experience was a bit limited.
I love my job, I love being technical and I love working with my team, until recently...

After making fun of our customers for the last 2 years because they are requesting ridiculous features with the reasoning "but chatgpt/gemini/copilot said it is easy" I had a meeting with my manager about an incident that I thought was solved. He looked at me and said "yeah, well I ran it through gemini and gemini says this" and he just drops me a 1000+ word (??) answer in our chat. He didn't read it to me. He did not explain it to me. He just said "yeah that should solve it".

I looked at him like a sheep in the rain.

I read the text and just asked him if he could explain what he wanted me to follow up on, as I did not want to just forward his gemini slop (that I do not even understand).

He just looked at me like a sheep in the rain.

"Just ask gemini to explain it to you if you do not understand it?"

This man, who I have learned a lot from, has made a 180 degree turn after always explaining everything and taking the time and moved on to "just ask gemini?". The worst part is he fully expected me to just blindly copy and paste his nIcElY pReFoRmAtEd ReSpOnSe to the team dealing with the incident?

I don't know if I am just not accepting the facts, am too young to understand corporate politics and behavior or LLMs are turning people (that are smart and capable) into idiots.

Bonus highlight:
After coming back from vacation one of my coworkers and me were talking and discussion started about an upcoming project. I explained the whole architecture to him and how everything works and asked him if he can look up a flag for a CLI tool to get some benchmarks on the white board.

"Can you write me a prompt for that?"

This man just asked me, after I spent 30 minutes explaining everything to him, if I could write him a prompt? To find a flag? For a CLI tool? What happened to using google or reading documentation?
He then proceeded to show me his "research" that he did while I was gone which was just a chat with gemini? Half of the stuff was hallucinated 5 chats into the topic. The conclusions were wrong. And when we tried stuff I told him "oh this will be a waste of time, this will be 2x slower", the answer I get is "no, gemini says it will be better".
It ends up being 2.2x slower and he just looks at me like a sheep in the rain.

"bUt GeMiNi SaId It WiLl Be FaStEr"

How can I explain to these people that LLMs are very useful tools that need to be double checked and not blindly trusted? These are not dumb people, they are very knowledgable peers that taught me a lot but turned into blindly copy pasting commands, configs and spreading the information they get "with their research".

Don't get me started on their revolutionising open claw ideas...