Smallest basic ai model for working
Posted by Future_Tonight_6626@reddit | LocalLLaMA | View on Reddit | 6 comments
So I wanted to make my own ai from scratch but we got some pretrained small ai models right....
So I wanna take a smallest posible ai and train it against my specific data so it can be pecialised in that field....
I thought of t5 model but I kinda got a hard limitations
My model have to analyse reports I give it do some thinking somehow connect dots and answer to user query based on data user gave and by re-evaluating itself against its knowledge...
Well this thing is like a piece of cake for most of ai models today... But making a completely new one specifically making it accomplish this kind of task is 😅😅....
So tell me a good ai model I am thinking like an empty ai model and I go on training it against my datasets 🤣🤣
Also I don't have any gpu pure vram, disk space and cpu...
reginakinhi@reddit
You are asking for impossibilities here. There can't be such a thing as an empty AI model, as any training creates / fills the AI model & you need tons of resources to fine-tune a model. Less so for QLoRA, but still a decent amount of VRAM depending on the model. If you have no GPU to use, I recommend you go with qwen3 30b if you have enough RAM or qwen3 4B / 8B if you don't. If you need domain specific knowledge (which you shouldn't use fine-tuning to instil anyway), I recommend a vector database for RAG.
Future_Tonight_6626@reddit (OP)
I am not specifically asking for an empty ai model but similar one with low bloated thoughts 😅
reginakinhi@reddit
What is that even supposed to mean????
Future_Tonight_6626@reddit (OP)
I need some knowledge on how we can smartly do these things without going in a brute force manner...
Feztopia@reddit
I hope your datasets contains: -analysing reports -some thinking -connecting dots and answer to user query based on data user gave and by re-evaluating itself
Otherwise an "empty ai" won't magically be able to do this stuff.
Future_Tonight_6626@reddit (OP)
yeah yeah i got around 40gb of data ready to train it but I got stuck at this model 😠play