WebGPU powered Gemma 2 2B by MLC WebLLM!

Posted by vaibhavs10@reddit | LocalLLaMA | View on Reddit | 4 comments

Reply to Post

4 Comments

[-]

l33t-Mt@reddit

I implemented this into my an offshoot of my LlamaCards project. Thank You! I now have a WebGPU/web-llm example you can try by simply opening [https://github.com/l33tkr3w/LlamaCards/blob/main/LlamaCards\_Webllm.html](https://github.com/l33tkr3w/LlamaCards/blob/main/LlamaCards_Webllm.html)

[-]

silenceimpaired@reddit

No luck on iOS :/

[-]

Danmoreng@reddit

How is this different from their official site? https://chat.webllm.ai/

[-]

vaibhavs10@reddit (OP)

Check it out here: https://huggingface.co/spaces/mlc-ai/webllm-simple-chat GitHub: https://github.com/mlc-ai/web-llm