Getting Started

This project tests the initial LiteLLM MCP implementation with a few other MCP servers and clients. In particular the go-based mcp server and client from mark3labs

Requirements

You need to have the following installed

• go 1.24.1
• uv

Setup deps

uv venv --python 3.13
source .venv/bin/activate # windows -- source .venv/Scripts/active
uv pip install -r bridge/requirements.txt

# cd into each and install dependencies
cd client;go mod download; cd ..
cd server; go mod download; cd ..

Setup litellm proxy

Or via docker

cd bridge
docker compose up

Running MCP Go server

cd server
go mod download
go run main.go -t sse -p 8080 # transport over http network with port 8080

Running MCP Go client

# run go mcp server first on sse transport
cd client
go run main.go -mcpUri 'http://localhost:8080/sse' # connect to mcp server on uri

Testing Litellm sdk MCP client

# run go mcp server first on sse transport

# run client
cd bridge
python litellm_client.py