How to unlock Gemma 4 MLX support in LM Studio right now (it's already there, just blocked)

Posted by Artistic_Unit_5570@reddit | LocalLLaMA | View on Reddit | 10 comments

WARNING:It may come with risks, but in my experience it works perfectly on my M4 PRO.

If you're getting this error when loading Gemma 4 with MLX in LM Studio:

 Failed to load the model
ValueError: Gemma 4 support is not ready yet, stay tuned!

Turns out the support is already fully bundled  mlx-vlm 0.4.3, mlx-lm 0.31.2, the gemma4 model module, everything. LM Studio's mlx-engine even has the code to handle gemma4. But there's a manual block in generate.py that raises a ValueError before it even tries to load.

1. Backup

Update LM studio to the latest version before starting and everything related

cp -r ~/.lmstudio/extensions/backends/vendor/_amphibian/app-mlx-generate-mac14-arm64@21 ~/.lmstudio/extensions/backends/vendor/_amphibian/app-mlx-generate-mac14-arm64@21_backup

2. Comment out the block

sed -i '' 's/    if model_type == "gemma4":/    #if model_type == "gemma4":/' ~/.lmstudio/extensions/backends/vendor/_amphibian/app-mlx-generate-mac14-arm64@21/lib/python3.11/site-packages/mlx_engine/generate.py

sed -i '' 's/        raise ValueError("Gemma 4 support is not ready yet, stay tuned!")/        #raise ValueError("Gemma 4 support is not ready yet, stay tuned!")/' ~/.lmstudio/extensions/backends/vendor/_amphibian/app-mlx-generate-mac14-arm64@21/lib/python3.11/site-packages/mlx_engine/generate.py

3. Clear the Python cache

rm ~/.lmstudio/extensions/backends/vendor/_amphibian/app-mlx-generate-mac14-arm64@21/lib/python3.11/site-packages/mlx_engine/__pycache__/generate.cpython-311.pyc

4. Quit LM Studio (Cmd+Q) and relaunch

That's it. Gemma 4 loads and runs on MLX.

Tested on macOS 26.4.1 , Apple Silicon, LM Studio MLX v1.5.0.