the WebSerial bit is the part I like here. WebGPU local inference is cool, but wiring the action loop straight to browser APIs keeps the trust boundary small: model sees camera/frame state, JS does the motor command, nothing leaves the machine.

if you want to make the demo easier to verify, overlay the actual prompt + selected tool call before each movement. even just observe -> decide -> serial.write() on screen would make it way clearer that Gemma is driving it instead of a hidden script.