Intro

I heard about the recent addition of MCP support to llama-server and I was interested in getting it working.

I have only briefly toyed with MCP, so I'm not super familiar with the ins and outs of it.

I spent a while screwing around getting it working, so I am offering this brief guide for my fellow noobs so they can spend less time spinning their wheels, and more time playing with the new feature.

Guide

• First, ensure that uv is installed: https://docs.astral.sh/uv/getting-started/installation/

• Create a config file in the directory of your choice with some MCP servers:

config.json { "mcpServers": { "time": { "command": "uv", "args": ["run", "mcp-server-time", "--local-timezone=America/Chicago"] }, "fetch": { "command": "uvx", "args": ["mcp-server-fetch"] }, "ddg-search": { "command": "uvx", "args": ["duckduckgo-mcp-server"] } } }

• From the same directory, run this command:

  uvx mcp-proxy --named-server-config config.json --allow-origin "*" --port 8001 --stateless

• When you run this, it will list the name of each MCP server. You will need to replace the sse at the end of each URL with mcp for a given MCP server to work in the llama-server web UI config

• In the llama-server web UI, go to Settings -> MCP -> Add New Server, and add each server in your config. For example:

  http://127.0.0.1:8001/servers/ddg-search/mcp

• Click Add to finish adding the server, the check the toggle to activate it.

The configured MCP servers should now work in the llama-server web UI!

Hopefully this is helpful to someone else!