Oh. If I wasn't clear enough that pretty much all graphics drivers are terrible, that's on me. The real problem is that they're all terrible in different ways (which makes graphics programming, and by extension GPU runtimes for LLM inference, much, much worse than the nice, shiny programming standards would like you to believe).

I've seen enough complaints about bugs in graphics drivers to be impressed that any complex software runs on GPUs at all. Obviously this is slightly exaggerated and a bit unfair (GPUs are complex, graphics APIs are complex, operating systems are complex, and getting things right is hard), but Android in particular exacerbates the problem by having multiple layers of abstraction between those having the problem and those in a position to do something to fix it. Chip manufacturers go out of their way to have proprietary drivers that even device manufacturers might not get to modify, there aren't many chips/GPUs with good documentation, and the sheer variety of combinations of chips and driver versions means developers can't expect any versions of their software to rely on any released improvements in drivers.

It's honestly one of the most impressive things I can think of that anything works reasonably well on Android GPUs across more than one GPU/driver combination.