Tool result records: opencode
The verdict line for each probe run, with a link to the record and its captures. The cross-client matrix is on Tool result handling, verified.
170 records, versions 0.0.0-a98e3fa, 2.2.6, registry entry opencode. Overlay data/verified/opencode.json.
| Scenario | Config | Run | At | Version | Verdict |
|---|---|---|---|---|---|
| app_only | default | http | 2025-11-25 |
0.0.0-a98e3fa | {…} structuredContent only (1x, as json) |
| app_only | default | http | 2025-11-25 |
2.2.6 | {…} structuredContent only (1x, as json) |
| app_only | default | stdio | 2025-11-25 |
0.0.0-a98e3fa | {…} structuredContent only (1x, as json) |
| app_only | default | stdio | 2025-11-25 |
2.2.6 | {…} structuredContent only (1x, as json) |
| app_only | codemode-off | stdio | 2025-11-25 |
0.0.0-a98e3fa | […] content only (1x, as text) |
| app_only | codemode-off | stdio | 2025-11-25 |
2.2.6 | […] content only (1x, as text) |
| app_only | execute-denied | stdio | 2025-11-25 |
0.0.0-a98e3fa | […] content only (1x, as text) |
| app_only | execute-denied | stdio | 2025-11-25 |
2.2.6 | […] content only (1x, as text) |
| app_only | protocol-2026-07-28 | stdio | 2026-07-28 |
0.0.0-a98e3fa | […] content only (1x, as text) |
| app_only | protocol-2026-07-28 | stdio | 2026-07-28 |
2.2.6 | […] content only (1x, as text) |
| meta_only | default | http | 2025-11-25 |
0.0.0-a98e3fa | […] content only (1x, as text, _meta did not reach the model) |
| meta_only | default | http | 2025-11-25 |
2.2.6 | […] content only (1x, as text, _meta did not reach the model) |
| meta_only | default | stdio | 2025-11-25 |
0.0.0-a98e3fa | […] content only (1x, as text, _meta did not reach the model) |
| meta_only | default | stdio | 2025-11-25 |
2.2.6 | […] content only (1x, as text, _meta did not reach the model) |
| meta_only | codemode-off | stdio | 2025-11-25 |
0.0.0-a98e3fa | […] content only (1x, as text, _meta did not reach the model) |
| meta_only | codemode-off | stdio | 2025-11-25 |
2.2.6 | […] content only (1x, as text, _meta did not reach the model) |
| meta_only | execute-denied | stdio | 2025-11-25 |
0.0.0-a98e3fa | […] content only (1x, as text, _meta did not reach the model) |
| meta_only | execute-denied | stdio | 2025-11-25 |
2.2.6 | […] content only (1x, as text, _meta did not reach the model) |
| meta_only | protocol-2026-07-28 | stdio | 2026-07-28 |
0.0.0-a98e3fa | […] content only (1x, as text, _meta did not reach the model) |
| meta_only | protocol-2026-07-28 | stdio | 2026-07-28 |
2.2.6 | […] content only (1x, as text, _meta did not reach the model) |
| with_meta | default | http | 2025-11-25 |
0.0.0-a98e3fa | {…} structuredContent only (1x, as json, _meta did not reach the model) |
| with_meta | default | http | 2025-11-25 |
2.2.6 | {…} structuredContent only (1x, as json, _meta did not reach the model) |
| with_meta | default | stdio | 2025-11-25 |
0.0.0-a98e3fa | {…} structuredContent only (1x, as json, _meta did not reach the model) |
| with_meta | default | stdio | 2025-11-25 |
2.2.6 | {…} structuredContent only (1x, as json, _meta did not reach the model) |
| with_meta | codemode-off | stdio | 2025-11-25 |
0.0.0-a98e3fa | […] content only (1x, as text, _meta did not reach the model) |
| with_meta | codemode-off | stdio | 2025-11-25 |
2.2.6 | […] content only (1x, as text, _meta did not reach the model) |
| with_meta | execute-denied | stdio | 2025-11-25 |
0.0.0-a98e3fa | […] content only (1x, as text, _meta did not reach the model) |
| with_meta | execute-denied | stdio | 2025-11-25 |
2.2.6 | […] content only (1x, as text, _meta did not reach the model) |
| with_meta | protocol-2026-07-28 | stdio | 2026-07-28 |
0.0.0-a98e3fa | […] content only (1x, as text, _meta did not reach the model) |
| with_meta | protocol-2026-07-28 | stdio | 2026-07-28 |
2.2.6 | […] content only (1x, as text, _meta did not reach the model) |
| audience_user | default | http | 2025-11-25 |
0.0.0-a98e3fa | {…} structuredContent only (1x, as json) |
| audience_user | default | http | 2025-11-25 |
2.2.6 | {…} structuredContent only (1x, as json) |
| audience_user | default | stdio | 2025-11-25 |
0.0.0-a98e3fa | {…} structuredContent only (1x, as json) |
| audience_user | default | stdio | 2025-11-25 |
2.2.6 | {…} structuredContent only (1x, as json) |
| audience_user | codemode-off | stdio | 2025-11-25 |
0.0.0-a98e3fa | […] content only (1x, as text) |
| audience_user | codemode-off | stdio | 2025-11-25 |
2.2.6 | […] content only (1x, as text) |
| audience_user | execute-denied | stdio | 2025-11-25 |
0.0.0-a98e3fa | […] content only (1x, as text) |
| audience_user | execute-denied | stdio | 2025-11-25 |
2.2.6 | […] content only (1x, as text) |
| audience_user | protocol-2026-07-28 | stdio | 2026-07-28 |
0.0.0-a98e3fa | […] content only (1x, as text) |
| audience_user | protocol-2026-07-28 | stdio | 2026-07-28 |
2.2.6 | […] content only (1x, as text) |
| empty_object | default | http | 2025-11-25 |
0.0.0-a98e3fa | "…" no marker reached the model; payload: "null" |
| empty_object | default | http | 2025-11-25 |
2.2.6 | "…" no marker reached the model; payload: "null" |
| empty_object | default | stdio | 2025-11-25 |
0.0.0-a98e3fa | "…" no marker reached the model; payload: "null" |
| empty_object | default | stdio | 2025-11-25 |
2.2.6 | "…" no marker reached the model; payload: "null" |
| empty_object | codemode-off | stdio | 2025-11-25 |
0.0.0-a98e3fa | "…" no marker reached the model; payload: "null" |
| empty_object | codemode-off | stdio | 2025-11-25 |
2.2.6 | "…" no marker reached the model; payload: "null" |
| empty_object | execute-denied | stdio | 2025-11-25 |
0.0.0-a98e3fa | "…" no marker reached the model; payload: "null" |
| empty_object | execute-denied | stdio | 2025-11-25 |
2.2.6 | "…" no marker reached the model; payload: "null" |
| empty_object | protocol-2026-07-28 | stdio | 2026-07-28 |
0.0.0-a98e3fa | "…" client error text, no fixture field: "{"error":{"type":"tool.execution","message":"MCP tool \"probe_empty_object\" on " |
| empty_object | protocol-2026-07-28 | stdio | 2026-07-28 |
2.2.6 | "…" client error text, no fixture field: "{"error":{"type":"tool.execution","message":"MCP tool \"probe_empty_object\" on " |
| large | default | http | 2025-11-25 |
0.0.0-a98e3fa | {…} structuredContent only (1x, as text) |
| large | default | http | 2025-11-25 |
2.2.6 | {…} structuredContent only (1x, as text) |
| large | default | stdio | 2025-11-25 |
0.0.0-a98e3fa | {…} structuredContent only (1x, as text) |
| large | default | stdio | 2025-11-25 |
2.2.6 | {…} structuredContent only (1x, as text) |
| large | codemode-off | stdio | 2025-11-25 |
0.0.0-a98e3fa | […] content only (1x, as text) |
| large | codemode-off | stdio | 2025-11-25 |
2.2.6 | […] content only (1x, as text) |
| large | execute-denied | stdio | 2025-11-25 |
0.0.0-a98e3fa | […] content only (1x, as text) |
| large | execute-denied | stdio | 2025-11-25 |
2.2.6 | […] content only (1x, as text) |
| large | protocol-2026-07-28 | stdio | 2026-07-28 |
0.0.0-a98e3fa | […] content only (1x, as text) |
| large | protocol-2026-07-28 | stdio | 2026-07-28 |
2.2.6 | […] content only (1x, as text) |
| no_content_key | default | http | 2025-11-25 |
0.0.0-a98e3fa | {…} structuredContent only (1x, as json) |
| no_content_key | default | http | 2025-11-25 |
2.2.6 | {…} structuredContent only (1x, as json) |
| no_content_key | default | stdio | 2025-11-25 |
0.0.0-a98e3fa | {…} structuredContent only (1x, as json) |
| no_content_key | default | stdio | 2025-11-25 |
2.2.6 | {…} structuredContent only (1x, as json) |
| no_content_key | codemode-off | stdio | 2025-11-25 |
0.0.0-a98e3fa | {…} structuredContent only (1x, as json) |
| no_content_key | codemode-off | stdio | 2025-11-25 |
2.2.6 | {…} structuredContent only (1x, as json) |
| no_content_key | execute-denied | stdio | 2025-11-25 |
0.0.0-a98e3fa | {…} structuredContent only (1x, as json) |
| no_content_key | execute-denied | stdio | 2025-11-25 |
2.2.6 | {…} structuredContent only (1x, as json) |
| no_content_key | protocol-2026-07-28 | stdio | 2026-07-28 |
0.0.0-a98e3fa | "…" client error text, no fixture field: "{"error":{"type":"tool.execution","message":"MCP tool \"probe_no_content_key\" o" |
| no_content_key | protocol-2026-07-28 | stdio | 2026-07-28 |
2.2.6 | "…" client error text, no fixture field: "{"error":{"type":"tool.execution","message":"MCP tool \"probe_no_content_key\" o" |
| is_error | default | http | 2025-11-25 |
0.0.0-a98e3fa | […] content only (1x, as text) |
| is_error | default | http | 2025-11-25 |
2.2.6 | […] content only (1x, as text) |
| is_error | default | stdio | 2025-11-25 |
0.0.0-a98e3fa | […] content only (1x, as text) |
| is_error | default | stdio | 2025-11-25 |
2.2.6 | […] content only (1x, as text) |
| is_error | codemode-off | stdio | 2025-11-25 |
0.0.0-a98e3fa | ⟨…⟩ envelope (content 1x, structuredContent 0x) |
| is_error | codemode-off | stdio | 2025-11-25 |
2.2.6 | ⟨…⟩ envelope (content 1x, structuredContent 0x) |
| is_error | execute-denied | stdio | 2025-11-25 |
0.0.0-a98e3fa | ⟨…⟩ envelope (content 1x, structuredContent 0x) |
| is_error | execute-denied | stdio | 2025-11-25 |
2.2.6 | ⟨…⟩ envelope (content 1x, structuredContent 0x) |
| is_error | protocol-2026-07-28 | stdio | 2026-07-28 |
0.0.0-a98e3fa | ⟨…⟩ envelope (content 1x, structuredContent 0x) |
| is_error | protocol-2026-07-28 | stdio | 2026-07-28 |
2.2.6 | ⟨…⟩ envelope (content 1x, structuredContent 0x) |
| with_image | default | http | 2025-11-25 |
0.0.0-a98e3fa | {…} structuredContent only (1x, as json) |
| with_image | default | http | 2025-11-25 |
2.2.6 | {…} structuredContent only (1x, as json) |
| with_image | default | stdio | 2025-11-25 |
0.0.0-a98e3fa | {…} structuredContent only (1x, as json) |
| with_image | default | stdio | 2025-11-25 |
2.2.6 | {…} structuredContent only (1x, as json) |
| with_image | codemode-off | stdio | 2025-11-25 |
0.0.0-a98e3fa | […] content only (1x, as text) |
| with_image | codemode-off | stdio | 2025-11-25 |
2.2.6 | […] content only (1x, as text) |
| with_image | execute-denied | stdio | 2025-11-25 |
0.0.0-a98e3fa | […] content only (1x, as text) |
| with_image | execute-denied | stdio | 2025-11-25 |
2.2.6 | […] content only (1x, as text) |
| with_image | protocol-2026-07-28 | stdio | 2026-07-28 |
0.0.0-a98e3fa | […] content only (1x, as text) |
| with_image | protocol-2026-07-28 | stdio | 2026-07-28 |
2.2.6 | […] content only (1x, as text) |
| schema_match | default | http | 2025-11-25 |
0.0.0-a98e3fa | {…} structuredContent only (1x, as json) |
| schema_match | default | http | 2025-11-25 |
2.2.6 | {…} structuredContent only (1x, as json) |
| schema_match | default | stdio | 2025-11-25 |
0.0.0-a98e3fa | {…} structuredContent only (1x, as json) |
| schema_match | default | stdio | 2025-11-25 |
2.2.6 | {…} structuredContent only (1x, as json) |
| schema_match | codemode-off | stdio | 2025-11-25 |
0.0.0-a98e3fa | […] content only (1x, as text) |
| schema_match | codemode-off | stdio | 2025-11-25 |
2.2.6 | […] content only (1x, as text) |
| schema_match | execute-denied | stdio | 2025-11-25 |
0.0.0-a98e3fa | […] content only (1x, as text) |
| schema_match | execute-denied | stdio | 2025-11-25 |
2.2.6 | […] content only (1x, as text) |
| schema_match | protocol-2026-07-28 | stdio | 2026-07-28 |
0.0.0-a98e3fa | […] content only (1x, as text) |
| schema_match | protocol-2026-07-28 | stdio | 2026-07-28 |
2.2.6 | […] content only (1x, as text) |
| schema_mismatch | default | http | 2025-11-25 |
0.0.0-a98e3fa | {…} structuredContent only (1x, as json) |
| schema_mismatch | default | http | 2025-11-25 |
2.2.6 | "…" client error text, no fixture field: "MCP tool "probe_schema_mismatch" on server "probe" failed: Structured content do" |
| schema_mismatch | default | stdio | 2025-11-25 |
0.0.0-a98e3fa | {…} structuredContent only (1x, as json) |
| schema_mismatch | default | stdio | 2025-11-25 |
2.2.6 | "…" client error text, no fixture field: "MCP tool "probe_schema_mismatch" on server "probe" failed: Structured content do" |
| schema_mismatch | codemode-off | stdio | 2025-11-25 |
0.0.0-a98e3fa | […] content only (1x, as text) |
| schema_mismatch | codemode-off | stdio | 2025-11-25 |
2.2.6 | "…" client error text, no fixture field: "{"error":{"type":"tool.execution","message":"MCP tool \"probe_schema_mismatch\" " |
| schema_mismatch | execute-denied | stdio | 2025-11-25 |
0.0.0-a98e3fa | […] content only (1x, as text) |
| schema_mismatch | execute-denied | stdio | 2025-11-25 |
2.2.6 | "…" client error text, no fixture field: "{"error":{"type":"tool.execution","message":"MCP tool \"probe_schema_mismatch\" " |
| schema_mismatch | protocol-2026-07-28 | stdio | 2026-07-28 |
0.0.0-a98e3fa | […] content only (1x, as text) |
| schema_mismatch | protocol-2026-07-28 | stdio | 2026-07-28 |
2.2.6 | "…" client error text, no fixture field: "{"error":{"type":"tool.execution","message":"MCP tool \"probe_schema_mismatch\" " |
| mirror | default | http | 2025-11-25 |
0.0.0-a98e3fa | payload once (as json) |
| mirror | default | http | 2025-11-25 |
2.2.6 | payload once (as json) |
| mirror | default | stdio | 2025-11-25 |
0.0.0-a98e3fa | payload once (as json) |
| mirror | default | stdio | 2025-11-25 |
2.2.6 | payload once (as json) |
| mirror | codemode-off | stdio | 2025-11-25 |
0.0.0-a98e3fa | payload once (as json) |
| mirror | codemode-off | stdio | 2025-11-25 |
2.2.6 | payload once (as json) |
| mirror | execute-denied | stdio | 2025-11-25 |
0.0.0-a98e3fa | payload once (as json) |
| mirror | execute-denied | stdio | 2025-11-25 |
2.2.6 | payload once (as json) |
| mirror | protocol-2026-07-28 | stdio | 2026-07-28 |
0.0.0-a98e3fa | payload once (as json) |
| mirror | protocol-2026-07-28 | stdio | 2026-07-28 |
2.2.6 | payload once (as json) |
| sc_empty | default | http | 2025-11-25 |
0.0.0-a98e3fa | "…" no marker reached the model; payload: "{}" |
| sc_empty | default | http | 2025-11-25 |
2.2.6 | "…" no marker reached the model; payload: "{}" |
| sc_empty | default | stdio | 2025-11-25 |
0.0.0-a98e3fa | "…" no marker reached the model; payload: "{}" |
| sc_empty | default | stdio | 2025-11-25 |
2.2.6 | "…" no marker reached the model; payload: "{}" |
| sc_empty | codemode-off | stdio | 2025-11-25 |
0.0.0-a98e3fa | […] content only (1x, as text) |
| sc_empty | codemode-off | stdio | 2025-11-25 |
2.2.6 | […] content only (1x, as text) |
| sc_empty | execute-denied | stdio | 2025-11-25 |
0.0.0-a98e3fa | […] content only (1x, as text) |
| sc_empty | execute-denied | stdio | 2025-11-25 |
2.2.6 | […] content only (1x, as text) |
| sc_empty | protocol-2026-07-28 | stdio | 2026-07-28 |
0.0.0-a98e3fa | […] content only (1x, as text) |
| sc_empty | protocol-2026-07-28 | stdio | 2026-07-28 |
2.2.6 | […] content only (1x, as text) |
| sc_null | default | http | 2025-11-25 |
0.0.0-a98e3fa | "…" client error text, no fixture field: "MCP tool "probe_sc_null" on server "probe" failed: Invalid result for tools/call" |
| sc_null | default | http | 2025-11-25 |
2.2.6 | "…" client error text, no fixture field: "MCP tool "probe_sc_null" on server "probe" failed: Invalid result for tools/call" |
| sc_null | default | stdio | 2025-11-25 |
0.0.0-a98e3fa | "…" client error text, no fixture field: "MCP tool "probe_sc_null" on server "probe" failed: Invalid result for tools/call" |
| sc_null | default | stdio | 2025-11-25 |
2.2.6 | "…" client error text, no fixture field: "MCP tool "probe_sc_null" on server "probe" failed: Invalid result for tools/call" |
| sc_null | codemode-off | stdio | 2025-11-25 |
0.0.0-a98e3fa | "…" client error text, no fixture field: "{"error":{"type":"tool.execution","message":"MCP tool \"probe_sc_null\" on serve" |
| sc_null | codemode-off | stdio | 2025-11-25 |
2.2.6 | "…" client error text, no fixture field: "{"error":{"type":"tool.execution","message":"MCP tool \"probe_sc_null\" on serve" |
| sc_null | execute-denied | stdio | 2025-11-25 |
0.0.0-a98e3fa | "…" client error text, no fixture field: "{"error":{"type":"tool.execution","message":"MCP tool \"probe_sc_null\" on serve" |
| sc_null | execute-denied | stdio | 2025-11-25 |
2.2.6 | "…" client error text, no fixture field: "{"error":{"type":"tool.execution","message":"MCP tool \"probe_sc_null\" on serve" |
| sc_null | protocol-2026-07-28 | stdio | 2026-07-28 |
0.0.0-a98e3fa | […] content only (1x, as text) |
| sc_null | protocol-2026-07-28 | stdio | 2026-07-28 |
2.2.6 | […] content only (1x, as text) |
| sc_string | default | http | 2025-11-25 |
0.0.0-a98e3fa | "…" client error text, no fixture field: "MCP tool "probe_sc_string" on server "probe" failed: Invalid result for tools/ca" |
| sc_string | default | http | 2025-11-25 |
2.2.6 | "…" client error text, no fixture field: "MCP tool "probe_sc_string" on server "probe" failed: Invalid result for tools/ca" |
| sc_string | default | stdio | 2025-11-25 |
0.0.0-a98e3fa | "…" client error text, no fixture field: "MCP tool "probe_sc_string" on server "probe" failed: Invalid result for tools/ca" |
| sc_string | default | stdio | 2025-11-25 |
2.2.6 | "…" client error text, no fixture field: "MCP tool "probe_sc_string" on server "probe" failed: Invalid result for tools/ca" |
| sc_string | codemode-off | stdio | 2025-11-25 |
0.0.0-a98e3fa | "…" client error text, no fixture field: "{"error":{"type":"tool.execution","message":"MCP tool \"probe_sc_string\" on ser" |
| sc_string | codemode-off | stdio | 2025-11-25 |
2.2.6 | "…" client error text, no fixture field: "{"error":{"type":"tool.execution","message":"MCP tool \"probe_sc_string\" on ser" |
| sc_string | execute-denied | stdio | 2025-11-25 |
0.0.0-a98e3fa | "…" client error text, no fixture field: "{"error":{"type":"tool.execution","message":"MCP tool \"probe_sc_string\" on ser" |
| sc_string | execute-denied | stdio | 2025-11-25 |
2.2.6 | "…" client error text, no fixture field: "{"error":{"type":"tool.execution","message":"MCP tool \"probe_sc_string\" on ser" |
| sc_string | protocol-2026-07-28 | stdio | 2026-07-28 |
0.0.0-a98e3fa | […] content only (1x, as text) |
| sc_string | protocol-2026-07-28 | stdio | 2026-07-28 |
2.2.6 | […] content only (1x, as text) |
| structured_only | default | http | 2025-11-25 |
0.0.0-a98e3fa | {…} structuredContent only (1x, as json) |
| structured_only | default | http | 2025-11-25 |
2.2.6 | {…} structuredContent only (1x, as json) |
| structured_only | default | stdio | 2025-11-25 |
0.0.0-a98e3fa | {…} structuredContent only (1x, as json) |
| structured_only | default | stdio | 2025-11-25 |
2.2.6 | {…} structuredContent only (1x, as json) |
| structured_only | codemode-off | stdio | 2025-11-25 |
0.0.0-a98e3fa | {…} structuredContent only (1x, as json) |
| structured_only | codemode-off | stdio | 2025-11-25 |
2.2.6 | {…} structuredContent only (1x, as json) |
| structured_only | execute-denied | stdio | 2025-11-25 |
0.0.0-a98e3fa | {…} structuredContent only (1x, as json) |
| structured_only | execute-denied | stdio | 2025-11-25 |
2.2.6 | {…} structuredContent only (1x, as json) |
| structured_only | protocol-2026-07-28 | stdio | 2026-07-28 |
0.0.0-a98e3fa | {…} structuredContent only (1x, as json) |
| structured_only | protocol-2026-07-28 | stdio | 2026-07-28 |
2.2.6 | {…} structuredContent only (1x, as json) |
| summary_and_data | default | http | 2025-11-25 |
0.0.0-a98e3fa | {…} structuredContent only (1x, as json) |
| summary_and_data | default | http | 2025-11-25 |
2.2.6 | {…} structuredContent only (1x, as json) |
| summary_and_data | default | stdio | 2025-11-25 |
0.0.0-a98e3fa | {…} structuredContent only (1x, as json) |
| summary_and_data | default | stdio | 2025-11-25 |
2.2.6 | {…} structuredContent only (1x, as json) |
| summary_and_data | codemode-off | stdio | 2025-11-25 |
0.0.0-a98e3fa | […] content only (1x, as text) |
| summary_and_data | codemode-off | stdio | 2025-11-25 |
2.2.6 | […] content only (1x, as text) |
| summary_and_data | execute-denied | stdio | 2025-11-25 |
0.0.0-a98e3fa | […] content only (1x, as text) |
| summary_and_data | execute-denied | stdio | 2025-11-25 |
2.2.6 | […] content only (1x, as text) |
| summary_and_data | protocol-2026-07-28 | stdio | 2026-07-28 |
0.0.0-a98e3fa | […] content only (1x, as text) |
| summary_and_data | protocol-2026-07-28 | stdio | 2026-07-28 |
2.2.6 | […] content only (1x, as text) |