Suggestion for Android Local LLM
Posted by red__AI@reddit | LocalLLaMA | View on Reddit | 2 comments
I am building one app, nothing new, just for fun.
Task is simple i just need to enhnace of rephrase the input it not need to add any new data kind of grammer and setence correction
I tried phi-3 model which is doing great job but the problem is its slow. Its taking around 15-20 seconds even though my phone is Vivo X300 Pro. So i wanted a suggestion which model i should use for this job
ttkciar@reddit
Please respond to this thread in the model recommendation megathread only! https://old.reddit.com/r/LocalLLaMA/comments/1sknx6n/best_local_llms_apr_2026/
myreala@reddit
Use Gemini liteRT models, I don't know if they can be used outside the edge app, but some people have released it in other formats as well.