Suggestion for Android Local LLM

Posted by red__AI@reddit | LocalLLaMA | View on Reddit | 2 comments

I am building one app, nothing new, just for fun.

Task is simple i just need to enhnace of rephrase the input it not need to add any new data kind of grammer and setence correction

I tried phi-3 model which is doing great job but the problem is its slow. Its taking around 15-20 seconds even though my phone is Vivo X300 Pro. So i wanted a suggestion which model i should use for this job