My open-source and free Apple Intelligence Writing Tools for Windows app now has instant website summaries! You can use almost any local LLM with it, with its OpenAI-compatible API support :D

Posted by TechExpert2910@reddit | LocalLLaMA | View on Reddit | 8 comments

[-]

Wow, this is really cool. Originally I couldn't get it working with text-gen-webui, but now that I have (I needed to tell it the api key was text-generation-web-ui and to add /v1 after my local OpenAI compatible API) it's super handy.

[-]

TechExpert2910@reddit (OP)

Haha yeah. A Large Language Model can actually proofread text much better than Grammarly Premium, which uses rule-based algorithms and very rudimentary ML models.

[-]

LSXPRIME@reddit

I've been waiting for this update. One potential enhancement could be the addition of a Refactor button, allowing users to refactor a selected code block, as well as addressing the issue with the expanded settings panel.

[-]

TechExpert2910@reddit (OP)

the next update should have customisable buttons (where you can change the name and system prompt of each button), so you could create your own refactor button instead of having to type “refactor…” into the `Describe your change…` box.

i’m also going to add a scroll bar to settings soon, which should fix the settings being too big for some screens :)

[-]

Barubiri@reddit

Great I was waiting for an update, because every time I tried to use my own prompt instead of just choosing rewritte it will not work.

[-]

CarpenterHopeful2898@reddit

it's cool

[-]

TechExpert2910@reddit (OP)

https://github.com/theJayTea/WritingTools

⬆️Feel free to check it out if you'd find it useful! It's a passion project I've been working on.

At a glance:

Writing Tools is an Apple Intelligence-inspired application for Windows and Linux that supercharges your writing with AI LLMs. It lets you fix up grammar and more with one hotkey press, system-wide. It's currently the world's most intelligent system-wide grammar assistant, and has been featured on Beebom, XDA, Neowin, and more!

Aside from being the only Windows/Linux program that works like Apple's Writing Tools:

Versatile AI LLM Support: Jump in quickly with support for the free Gemini API, or use an extensive range of local LLMs (via Ollama, llama.cpp, KoboldCPP, TabbyAPI, vLLM, etc.) or cloud-based LLMs (ChatGPT, Mistral AI, etc.) with Writing Tools' OpenAI-API-Compatibility.
System-wide Functionality: Works instantly in any application where you can select text. Does not overwrite your clipboard.
Completely free and Open-source: No subscriptions, no hidden costs. Bloat-free & uses pretty much 0% of your CPU.
Chat Mode: Invoke Writing Tools with no text selected to enter a chat mode for quick queries and assistance.
Privacy-focused: Your API key and config files stay on your device. NO logging, diagnostic collection, tracking, or ads. Invoked only on your command. Local LLMs keep your data on your device & work without the internet.
Supports Many Languages: Works for any language! It can even translate text across languages better than Google Translate (type "translate to [language]" in "Describe your change...").
Code Support: Select code and ask Writing Tools to work on it (fix, improve, convert languages) through "Describe your change...".
Themes, Dark Mode, & Customization: Choose between 2 themes: a blurry gradient theme and a plain theme that resembles the Windows + V pop-up! Also has full dark mode support. Set your own hotkey for quick access.