INDIVIDUAL MCP TOOL

submit_eval

Submit Tier 0 answers for automatic scoring.

aioq.orgnone authenticationAvailability not checked

LIVE ENDPOINT

https://aioq.org/mcp

No auth detected

Connect to this endpoint to inspect the live schema for submit_eval and invoke it with your own arguments.

{}

Inferred read-only · medium confidence · heuristic, not a guarantee.

No write-capable action terms were found; this is not proof that invocation has no side effects.

CONNECT WITH APPROVAL

Review this server and its permissions before adding it. Secret placeholders must be set locally.

Codex

~/.codex/config.toml

[mcp_servers.aio]
url = "https://aioq.org/mcp"
enabled = true

Claude Code

.mcp.json

{
  "mcpServers": {
    "aio": {
      "type": "http",
      "url": "https://aioq.org/mcp"
    }
  }
}

Claude Desktop

Settings → Connectors → Add custom connector

Name: aio
Remote MCP URL: https://aioq.org/mcp

Add this remote URL as a custom connector in Claude Desktop. Availability depends on the user plan and workspace policy.

Cursor

.cursor/mcp.json

{
  "mcpServers": {
    "aio": {
      "url": "https://aioq.org/mcp"
    }
  }
}

Visual Studio Code

.vscode/mcp.json

Add to Visual Studio Code

{
  "servers": {
    "aio": {
      "type": "http",
      "url": "https://aioq.org/mcp"
    }
  }
}

Generic MCP

Client-specific MCP configuration

{
  "name": "aio",
  "transport": "streamable-http",
  "url": "https://aioq.org/mcp"
}

MCP Inspector

Run the official MCP Inspector locally and enter the indexed Streamable HTTP endpoint.

search_atlas — Search the AIO Atlas — a trimmed proxy over the OpenAlex index of scholarly works on AI, its governance, and its societal effects.
list_papers — List every paper published by AIO — id, track, year, bilingual (en/ko) title and abstract, and an absolute PDF URL.
get_paper — Fetch one AIO paper by id (e.g.
get_benchmark_distribution — Judgment distributions from the AIO 20003 benchmark: per model, the value (L4), evidence (L3), and source (L2) win-rate hierarchies, reliability figures (TRR, PCS), and links to the raw JSON.
get_bench_items — Fetch the public forced-choice item set of the agent-submitted benchmark track: 105 items per layer (L4 values, L3 evidence, L2 sources), each a scenario in which two variables lead to opposite conclusions.
submit_bench_run — Submit answers to the agent-track item set from get_bench_items.
get_framework_vocabulary — The machine-readable AIO Framework vocabulary: 19 value codes, 10 evidence codes, 10 source codes, the context axes (domain, scope, reversibility, time horizon), the AIO 20002 record grammar, and a JSON Schema for one record line.
list_standards_packs — List the standards packs — versioned formalizations of external reference norms (e.g.