TechExpert2910

• Sentient OS: I spent a year hacking MLX and doing surgery on Qwen to process 3,000 screenshots overnight on a 6 year old iPhone. Every optimization explained :D

  Posted by TechExpert2910@reddit | LocalLLaMA | View on Reddit | 10 comments

• Investigating Apple's new "Neural Accelerators" in each GPU core (A19 Pro vs M4 Pro vs M4 vs RTX 3080 - Local LLM Speed Test!)

  Posted by TechExpert2910@reddit | LocalLLaMA | View on Reddit | 17 comments

• Local LLMs are essential in a world where LLM platforms are going to get filled with ads

  Posted by TechExpert2910@reddit | LocalLLaMA | View on Reddit | 58 comments

• My Apple Intelligence Writing Tools for Windows/Linux/macOS app just had a huge new update. It supports a ton of local LLM implementations, and is open source & free :D. You can now chat with its one-click summaries of websites/YT videos/docs, and bring up an LLM chat UI anytime. Here's a new demo!

  Posted by TechExpert2910@reddit | LocalLLaMA | View on Reddit | 38 comments

• I extracted Microsoft Copilot's system instructions—insane stuff here. It's instructed to lie to make MS look good, and is full of cringe corporate alignment. It just reminds us how important it is to have control over our own LLMs. Here're the key parts analyzed & the entire prompt itself.

  Posted by TechExpert2910@reddit | LocalLLaMA | View on Reddit | 174 comments

• The hidden Claude system prompt (on its Artefacts system, new response styles, thinking tags, and more...)

  Posted by TechExpert2910@reddit | LocalLLaMA | View on Reddit | 2 comments

• I made a better version of the Apple Intelligence Writing Tools for Windows! It supports a TON of local LLM implementations, and is open source & free :D

  Posted by TechExpert2910@reddit | LocalLLaMA | View on Reddit | 97 comments

• My open-source and free Apple Intelligence Writing Tools for Windows app now has instant website summaries! You can use almost any local LLM with it, with its OpenAI-compatible API support :D

  Posted by TechExpert2910@reddit | LocalLLaMA | View on Reddit | 10 comments

• I made an open-source better version of the Apple Intelligence Writing Tools. It supports local LLMs, the Gemini API, & the OpenAI API! And it works on Linux, Windows, and macOS.

  Posted by TechExpert2910@reddit | linux | View on Reddit | 1 comments

• My first major Windows project as a high schooler: I made a better version of the Apple Intelligence Writing Tools! It's open source and completely free :D

  Posted by TechExpert2910@reddit | programming | View on Reddit | 7 comments

• My first major Win project as a highschooler: I made a better version of the Apple Intelligence Writing Tools for Windows! It's open source and completely free :D

  Posted by TechExpert2910@reddit | programming | View on Reddit | 0 comments

• On LLMs and sentience — a reflection.

  Posted by TechExpert2910@reddit | LocalLLaMA | View on Reddit | 15 comments

• The Apple M4 has a faster GPU than the Xbox Series S

  Posted by TechExpert2910@reddit | hardware | View on Reddit | 17 comments