lm studio alternative
Posted by tuananh_org@reddit | LocalLLaMA | View on Reddit | 29 comments
i'm looking for sth like lm studio but open source, easy to use.
- able to stay up to date with llama.cpp or select custom engine.
- easy to discover & download models
what do you guys recommend?
i can't for the life of me, remember all the flags of llama.cpp
legit_split_@reddit
https://www.reddit.com/r/LocalLLaMA/comments/1tbyyee/textgen_is_now_a_native_desktop_app_opensource/
BustyMeow@reddit
The UI doesn't look polished to me (just my subjective opinion)
nopanolator@reddit
Sorry to be blunt but if you find LM Studio hard to use and to maintain ... you're just doomed \^\^ (it's running on llama.cpp by the way).
tuananh_org@reddit (OP)
i like lm studio. but they are quite slow when it comes to updating llamacpp
BustyMeow@reddit
Recently the beta channel has been updating more frequently.
nopanolator@reddit
I prefer slow consolidated updates than a rat race on the newest personally, but i do nothing enough critical to depend on the last nightly llama.cpp. So it's biased i guess. By the way you can select the branch you want in the settings, if you like to run on glowing embers \^\^ Force-update too. And others stuffs like this.
For the OSS part, it's doomed even if the team is quite open to talk, wich is quite rare in the game now.
Now if you find a llama.cpp work that run MCPs, LM Link clone, Plugins, Rag, that is barebone ... i'll jump. The only thing that i dislike in LMS is the hidden sysprompts for users using it as main chat interface and not as an inferences services. The bloat is not big but this layer is disturbing for little models and a total waste of compute power for local models; the prompts are not even systems or a good code but useless prose "you are a smart assistant, blablabla ...". I'm astonished that a bunch of respectfull companies are still RPing their products today, make no sense for me with the backward we have now in 2026 on what is really happening in the latent space of LLMs \^\^ Even very contradictory with the maths behind this lol
ComplexType568@reddit
You could try these:
- Catapult (https://github.com/pwilkin/catapult)
- Unsloth Studio (i did not have a fun time setting it up but maybe its different now??)
- base llama.cpp (if you want highest customizability + control, is a CLI though) or ik_llama.cpp if you want to go experimental
I've heard good things about llama-swap but I've personally not touched them.
tuananh_org@reddit (OP)
Catapult is nice. looks like just what i need. thank you
OutrageousMinimum191@reddit
llama.cpp server itself
orak7ee@reddit
Awwtifishal@reddit
-m for the model, --mmproj for the mmproj, and nowadays you don't need much else. Llama.cpp does autofit pretty well.
For qwen 3.6 I would add
--chat-template-kwargs '{"preserve_thinking": true}'ziphnor@reddit
Jan - Open-Source ChatGPT Replacement
Unsloth - Train and Run Models Locally
orak7ee@reddit
I quite like Jan, it can be plugged to remote API endpoint in addition to run local models (via llama.cpp or MLX). But its llama.cpp version is lagging behind.
ziphnor@reddit
It also seemed nice to me, but I haven't used the desktop apps much after i started adding GPUs to my home linux server 😄
drillmast3r@reddit
Jan is always works for me.
Pleasant-Shallot-707@reddit
Wasn’t there someone who posted here a week ago about their open source project that they’d been working on for a few years that is meant to do what LM Studio does, but better?
pokemonplayer2001@reddit
“what do you guys recommend?”
Spending like 30 seconds searching. 🤷
tuananh_org@reddit (OP)
i'm aware of some of the options. i just want people's opinion
silenceimpaired@reddit
You have to realize people only want to share their opinions when you’re not looking for them.
AlpacaDC@reddit
If nobody asks than there is nothing to find, and regarding to LLM I feel like every other week something is outdated.
ziphnor@reddit
Things move fast in AI, I think it's fair enough to ask, and besides there were some specific criteria. This sub can be so grumpy:)
Ryanmonroe82@reddit
Msty Studio!
Speedping@reddit
Just run llama.cpp and craft HTTP requests with curl. It's the most convenient way to do it
MoneyPowerNexis@reddit
Its certainly the mode code efficient chat harness for llama.cpp
Quirky-Persimmon3342@reddit
ollama with open webui is probably the closest match for what you're describing. easy model download, decent UI, and ollama actually runs llama.cpp under the hood so backend compatibility is solid.
jacek2023@reddit
if llama.cpp is too difficult to use then look at https://github.com/oobabooga/textgen
Wise-Hunt7815@reddit
I have an inexpensive solution developed in Java. The initial goal was to make it easy for me to remotely manage my two machines (Strix Halo and 3090 *2) via the web. However, I did not provide an English version of the README.
https://github.com/IIIIIllllIIIIIlllll/llama.cpp-hub
aigemie@reddit
Maybe Unsloth Studio
Amazing_Athlete_2265@reddit
Unsloth studio.
Llama-swap for the hard core.