INDIVIDUAL MCP TOOL

run_eval_contract

Parse a .ia-eval.yaml LLM test suite, call the specified LLM model for each scenario, run all configured scorers, and return a structured JSON report with per-scenario Pass/Fail verdicts and a Markdown summary.

ia-qa.comnone authenticationAvailability not checked

LIVE ENDPOINT

https://www.ia-qa.com/mcp

No auth detected

Connect to this endpoint to inspect the live schema for run_eval_contract and invoke it with your own arguments.

Indexed input schema

{}

Risk classification

Potential side effects detected · medium confidence · heuristic, not a guarantee.

A tool name or description suggests code or command execution.

Parent server

ia-qa.com

CONNECT WITH APPROVAL

Client installation

Review this server and its permissions before adding it. Secret placeholders must be set locally.

Codex

~/.codex/config.toml

[mcp_servers.ia-qa-toolbox]
url = "https://www.ia-qa.com/mcp"
enabled = true

Claude Code

.mcp.json

{
  "mcpServers": {
    "ia-qa-toolbox": {
      "type": "http",
      "url": "https://www.ia-qa.com/mcp"
    }
  }
}

Claude Desktop

Settings → Connectors → Add custom connector

Name: ia-qa-toolbox
Remote MCP URL: https://www.ia-qa.com/mcp

Add this remote URL as a custom connector in Claude Desktop. Availability depends on the user plan and workspace policy.

Cursor

.cursor/mcp.json

{
  "mcpServers": {
    "ia-qa-toolbox": {
      "url": "https://www.ia-qa.com/mcp"
    }
  }
}

Visual Studio Code

.vscode/mcp.json

Add to Visual Studio Code

{
  "servers": {
    "ia-qa-toolbox": {
      "type": "http",
      "url": "https://www.ia-qa.com/mcp"
    }
  }
}

Generic MCP

Client-specific MCP configuration

{
  "name": "ia-qa-toolbox",
  "transport": "streamable-http",
  "url": "https://www.ia-qa.com/mcp"
}

MCP Inspector

Run the official MCP Inspector locally and enter the indexed Streamable HTTP endpoint.

Related tools

format_json — Validate and pretty-print a string that is ALREADY valid JSON.
generate_uuid — Generate one or more cryptographically random UUID v4 identifiers.
hash_text — Compute a cryptographic hash of a text string.
count_tokens — Estimate the token count of a text string using the cl100k_base approximation (~4 chars/token).
base64_encode — Encode a UTF-8 string to Base64.
base64_decode — Decode a Base64 string back to UTF-8 text.
url_encode — Percent-encode a string for safe use in URLs.
url_decode — Decode a percent-encoded URL string back to plain text.