Account

AI model

Choose whether AI Evaluation uses Guardian's platform model or your own model and API key, and what is sent to your provider.

AI Evaluation in MCP Scan uses an AI model. By default it is the Guardian platform model. On the AI model page you can use your own model with your own API key instead, for your whole company.

Admins, Managers and Engineers can manage it. For other roles the page isn't in the menu. To open it, select your name in the top-right corner, then Account settings, then AI model in the side menu.

Platform model or your own

The page shows Platform default until you set your own model. Once you do, it shows Your own model with the Provider, Model, API key (only its last 4 characters), when it was set and who set it.

Use your own model

  1. Under Use your own model, choose the Provider: Anthropic or OpenAI.
  2. Enter the Model name, 1 to 128 visible characters.
  3. Enter your API key.
  4. Read the notes on the page, then select Save.

The key is stored encrypted. It is never shown again, only its last 4 characters. To change the provider or the model, enter the key again. To change only the key, select Replace key or model.

Every Admin of your company gets an email when the key is set, replaced or cleared.

There is no fallback

If your key or model stops working, Guardian does not switch to the platform model. AI Evaluation shows "AI unavailable" until you fix the key or clear it. Check your provider account if that happens.

What is sent to your provider

  • The tool names, descriptions and input schemas of the server under test.
  • Requests the model itself wrote.
  • The model's tool calls and the masked, truncated tool results.
  • The answers the model wrote.
  • The titles of the failing checks, for the summary.

Your submitted config, headers, URL, and any session or user data are never sent.

Go back to the platform model

Select Clear your own model, then Clear model and key. Your key is deleted and the company returns to the platform model.