low hanging fruit for AI- small manufacturing company
Posted by minus_343@reddit | sysadmin | View on Reddit | 30 comments
We have a small IT team (2) at my company My boss, the CFO, who is very much against cloud technology, tasked me with finding options for AI for our company. Because of their stance on cloud, they requested on prem options. What's some low hanging fruit that has worked for you? We are a manufacturing company with only about 200 employees, so if you're of the same size, have you started implementing anything that has made any significant impact.
latent_process@reddit
Most companies in your position start by picking a tool instead of picking a problem. That's backwards.
For a 200-person manufacturer running on-prem with a small IT team, there are a few things worth trying that won't eat your budget.
Your ERP data idea is solid. Export demand or sales numbers weekly and look for customers who stopped ordering, parts with weird volume swings, or gaps between forecast and actual. A script that flags anomalies and sends a summary would already be more than most shops have.
If you have maintenance requests or quality tickets, somebody is probably sorting those by hand right now. A lightweight model can tag and route them, and pull up similar past issues. This one tends to save more time than people expect.
Then there's the doc problem. Most manufacturing teams have SOPs and quality docs scattered across ten different folders and two SharePoint sites nobody remembers the URL for. A local search tool that lets people ask "have we seen this before?" saves your ops and maintenance crews from digging.
latent_process@reddit
Most companies in your situation start by picking tools instead of problems.
For a 200 person manufacturer with 2 IT people, I’d keep it simple:
your ERP idea is actually pretty good. just exporting demand weekly and flagging customers or parts that drop off would already be useful. most places don’t even have that visibility.
another easy one is ticket triage. if maintenance or quality issues are getting sorted manually, even basic tagging / grouping helps a lot.
and honestly docs are usually a mess. SOPs spread across folders, sharepoint, etc. just being able to quickly find “have we seen this before” is a bigger win than people expect.
I wouldn’t jump into big systems or hardware yet. just find one thing that saves time consistently.
latent_process@reddit
Most companies in your situation start by picking tools instead of problems.
For a 200 person manufacturer with 2 IT people, I’d keep it simple:
your ERP idea is actually pretty good. just exporting demand weekly and flagging customers or parts that drop off would already be useful. most places don’t even have that visibility.
another easy one is ticket triage. if maintenance or quality issues are getting sorted manually, even basic tagging / grouping helps a lot.
and honestly docs are usually a mess. SOPs spread across folders, sharepoint, etc. just being able to quickly find “have we seen this before” is a bigger win than people expect.
I wouldn’t jump into big systems or hardware yet. just find one thing that saves time consistently.
latent_process@reddit
Local_Penalty_6517@reddit
I mean... hot off the press here Raspberry Pi Announced AI HAT+2
ElectricalLevel512@reddit
tbf, ran into this exact wall last year with a team of two yeah wild times i know, we started with stuff that doesn’t break things or freak people out first, like predictive maintenance using basic ai models and local data, had a raspberry pi running a local instance just to prove it works, kept it small and under the radar, monday service has some clever ai workflow stuff but yeah cloud is a no go for you right now, if you ever get them to budge even slightly keep it on radar, for now maybe try a cheap local llm for quality checks, it’s fast, noninvasive, and no one needs to know it’s ai unless it blows up
ShadoWolf@reddit
On prem LLM models.... for 200 users.... that going to be pricey ... like multiple H100 would be needed and that like 40K a pop for 80GB of vram... and I assume this will have multiple users... so you're going to need a few of these. And it's going to depend the model size you want... and you don't have a use case layout.
Like these model are powerful and they are general reasoning engines. But you still need to plan around there limitation double so when you dealing with a weaker model.
So.. ya I really wouldn't recommend investing in any sort of large scale on prem solution, not until you are 100% sure what you want to use it for is viable . You also need to factor in your not dealing with super stable hardware either.. GPU servers are hot and use a lot of power.
CardboardAnalyst@reddit
no other direction than "finding options for AI"? Seems like the CFO just likes the buzzword.
minus_343@reddit (OP)
this is true. and most of his requests are general without context.
the lowest hanging fruit to me would be utilize meeting summaries from copilot.
Frothyleet@reddit
You really need to go back to your boss and ask for specific business problems he's looking to solve. On prem or cloud, you aren't going to be able to just buy some AI and realize any significant benefits.
minus_343@reddit (OP)
Ok, what real life business problems has AI solved for you and provided some benefit?
shammahllamma@reddit
300 hours of calls diarized, qa’d, redacted, and scored a day
Frothyleet@reddit
It's been hit or miss but we have had some success with automating ticket triaging. Probably not going to be very applicable to you.
I'm not totally sold on it but we have a product trawling our SIEM. I am not sure it's "AI" in the sense that marketing people use it, but it's certainly algorithmic.
Our help desk uses a variety of LLMs to help with scripting and troubleshooting but that's mostly ad hoc.
Again, unless you are a business analyst or AI consultant it's sort of silly for you to be just grasping for things to throw AI at; your C-suite is supposed to be coming up with the big picture things they want to automate or streamline, and then you have a goal you can work for.
If I was your CFO, I'd start with "what is my ERP and what AI are they trying to sell us already"; even if that isn't a product I want, that will help give me ideas about automations that would be applicable to my existing tool stack and industry vertical.
KindlyGetMeGiftCards@reddit
We let users have AI to come up with solutions to their problems, there is no way that the IT department will know every possible use for it or even implant something without their input. You have someone that wants to implement the solution before they know what problem it fixes.
Valdaraak@reddit
You need to identify time-consuming workflows that AI can help address. If you're limited to on-prem options, you're likely to find the answer is "not much" and the results will be subpar.
shammahllamma@reddit
Local models are incredibly capable but will take effort and tuning along with decent hardware.
Frothyleet@reddit
And specific problems to solve!
pdp10@reddit
On-premises requires hardware. Maybe an AMD Strix Halo with 128GiB memory, maybe a recent Mac with lot of extra memory, something along those lines. So, to plan this, you need to know the fiscal budget and the manpower budget, plus any other constraints besides being on-premises.
SpotlessCheetah@reddit
There is no actionable information here.
minus_343@reddit (OP)
I'm looking for the low hanging fruit to propose ideas. Have you used AI for anything actually useful with your own internal company information?
Something more than using chatgpt to make this email sound better, or help me make this code more efficient, ect...
I'm not sure if I can do this or not, but can I dump a spreadsheet of demand from our ERP for sales orders into sharepoint each week and then ask copilot to analyze the demand from the last month to see which parts or customers are falling off a cliff.
I'm looking for real examples from small manufacturing companies where they've actually seen benefit.
SpotlessCheetah@reddit
Honestly, I'd tackle it the same way as I would tackle it 10 yrs ago. If you want to find a way to make operations more efficient, you can always start with productivity upgrades for operations first before you get to manufacturing.
At this point in time, every piece of SaaS in your stack is adding some sort of "AI" component. PD for staff is always good too because they always get left behind and trying to figure out things for yourself isn't always productive vs learning as a group in a singular direction.
progenyofeniac@reddit
I assume you’re not an M365 customer then? Copilot chat can be contained pretty well if you are. Gotta figure out what he wants to do with AI first, though.
minus_343@reddit (OP)
Besides meeting summaries and basic queries for excel formulas, what big things has copilot helped with for you?
man__i__love__frogs@reddit
copilot is great at analyzing large amounts of data quickly. Like how does this vendors soc2 compare to our required controls? It can read thru packet traces and find oddities lickity split, same with event viewer logs.
In general it's helped me out in IT a lot, for basic business use the business teams have built out AI assistants, but I'm really not sure how useful they've been lol.
minus_343@reddit (OP)
one of my ideas might be to use copilot to this do this but I'm not sure if I can do this or not, but can I dump a spreadsheet of demand from our ERP for sales orders into sharepoint each week and then ask copilot to analyze the demand from the last month to see which parts or customers are falling off a cliff. Currently our ERP only has current forecast data, and not a history of any point in time.
progenyofeniac@reddit
Seems you need to find out what your boss wants AI for before you get too deep into anything else. Like if your foreman said to go buy tools and you didn’t know what kind of work he wants done.
But Copilot has become my new Google, and my scripting partner. Explain what you’re trying to do, ask it to give suggestions and ask for clarity where needed, and it’ll summarize 20 websites to give you the info you need, distilled into a couple of paragraphs.
Add the paid M365 license and it’ll do that across whatever SharePoint sites you have access to, plus your emails and messages.
It’s a rare day I start fewer than 5 conversations with it. And more often than not I wish I’d gone to it first instead of muddling through code that I know how to slowly write, but which it can spit out in a fraction of the time.
It’s not for everybody, but as you find what it’s good at, it can be a huge timesaver. I’m not bluffing when I say I wouldn’t take a job that didn’t allow access to either it or ChatGPT, and I’ll never script without GitHub Copilot again.
minus_343@reddit (OP)
How have you used copilot to help you muddle through your emails? Have you done anything specific to save you a bunch of time? Same with sharepoint, what do you use it for with Copilot? Just load a bunch of company documents into it so users can search across them easily? Policies, ect? I'm trying to think of specific use cases that I can then bring up as the low hanging fruit to the CFO since he doesn't seem to have an idea of specific business use cases yet.
progenyofeniac@reddit
A couple of things to remember first: Copilot will only search emails and SharePoint if each user wanting that functionality has the $30/mo license. That said, I do have it, and I’m part of a larger org with data scattered across SP. So I’ll ask Copilot what the naming convention is for network switches, and it’ll find the docs explaining that.
As for email, same applies: you need the license. But with it, I can get added to a long email chain or come back from PTO to long threads and with a click or two it summarizes all of it and I can tell whether I’m needed, and can speak to the matter. I can ask it to summarize all conversations (email + Teams) I’ve had with a person or about a topic.
But even without a license, enterprise data protection applies to chats, and the web search is worlds better than Google, mostly for the summarization aspect.
shammahllamma@reddit
You really need a specific use case to even begin to consider what kind of hardware to purchase. Automated pipelines, general llm chat - what's the goal? The hardware is expensive, but the ROI can be quick compared to aaS or api based options.
Warm_Share_4347@reddit
I doubt you can find AI solutions and on prem on the same provider. If you convince your cfo to be able to check security practices of the providers, sign legal stuff you might be able to convince him/her to get into cloud. That’s being said, you can have a look at the ai of Siit. One of their agents is plug and play and can do some cool stuff such as article suggestion, auto triage for accurate data in your case or even app access on autopilot