API & MCP reference

Run the AI where you want — cloud, local, or your own servers

The Deputy and Posse are provider-agnostic — the SAME features run wherever you point them. The heavy compute lives wherever the model runs, so your workstation only needs a big spec when the model runs ON it.

1) CLOUD (bring your own key) — Anthropic / OpenAI / Gemini. Workstation stays minimal; secrets are redacted before anything is sent. Fastest to start, top model quality.

2) LOCAL (Ollama on this workstation) — fully private, works offline, but this box needs ~32 GB + a GPU (see 'What SubnetSlinger needs').

3) YOUR OWN INFERENCE SERVER (private) — point the Deputy at a server on your network and every workstation you point at it runs at the minimum spec:

  • Ollama: set the Ollama Host to your server, e.g. http://ollama.lan:11434 (server: OLLAMA_HOST=0.0.0.0:11434).
  • Any OpenAI-compatible endpoint: pick the OpenAI-compatible provider and set the Base URL to your endpoint —

self-hosted vLLM / LM Studio, Azure OpenAI, or an enterprise model-serving platform (e.g. a Databricks

serving endpoint). Set base URL + key + model.

4) YOUR DATA (MCP) — connect the Deputy to your systems of record over MCP so it reasons over YOUR network data: ServiceNow, Cisco DNAC, NetBox, a CMDB, or a SQL source. Today this is a generic MCP server you configure in the Deputy's MCP panel; a one-click connector catalog is planned.

PRIVACY & REDACTION: secrets (passwords, SNMP/TACACS+/RADIUS keys) are ALWAYS masked in the copy sent to the model — every backend is treated the same, cloud or local Ollama. You still see the real values in the transcript; only the model's copy is scrubbed, so nothing sensitive leaks into what the model sees or into a saved transcript, Incident, or export.

SPEC NOTE: cloud AI and any inference you host elsewhere keep the workstation at the MINIMUM spec — only a model running locally on the box needs the 32 GB + GPU. Put ONE GPU server on your network and keep every workstation you point at it at the minimum spec.

How it works
Cloud — bring your own key
💻 Workstation
minimum spec
redacted
☁ Anthropic / OpenAI / Gemini
Local — Ollama on the box
💻 Workstation
32 GB + GPU
🧠 local model
nothing leaves
Private LLM server — shared
💻 Workstations
minimum spec
LAN
🖥 Ollama / vLLM
GPU · 32 GB+
stays in your network
Private stack + your data
💻 Engineers
🖥 Private LLM
MCP
🗄 ServiceNow · DNAC · NetBox

Cloud & any server you host keep the workstation at the minimum — only a local model needs the big box. Secrets are always redacted before any model.

This page mirrors the in-app help. Open the same article any time from the app's Docs panel. Spot something unclear? Tell us.