Tool result records: Strands Agents

The verdict line for each probe run, with a link to the record and its captures. The cross-client matrix is on Tool result handling, verified.

68 records, version 1.64.0+mcp-2.3.0, no registry entry yet. Overlay data/verified/strands.json.

Scenario Config Run At Version Verdict
app_only default http 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
app_only default stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
app_only anthropic stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
app_only responses stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
meta_only default http 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text, _meta did not reach the model)
meta_only default stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text, _meta did not reach the model)
meta_only anthropic stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text, _meta did not reach the model)
meta_only responses stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text, _meta did not reach the model)
with_meta default http 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text, _meta did not reach the model)
with_meta default stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text, _meta did not reach the model)
with_meta anthropic stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text, _meta did not reach the model)
with_meta responses stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text, _meta did not reach the model)
audience_user default http 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
audience_user default stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
audience_user anthropic stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
audience_user responses stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
empty_object default http 2026-07-28 1.64.0+mcp-2.3.0 "…" client error text, no fixture field: "Tool execution failed: 2 validation errors for union[CallToolResult,function-aft"
empty_object default stdio 2026-07-28 1.64.0+mcp-2.3.0 "…" client error text, no fixture field: "Tool execution failed: 2 validation errors for union[CallToolResult,function-aft"
empty_object anthropic stdio 2026-07-28 1.64.0+mcp-2.3.0 "…" client error text, no fixture field: "[{"text":"Tool execution failed: 2 validation errors for union[CallToolResult,fu"
empty_object responses stdio 2026-07-28 1.64.0+mcp-2.3.0 "…" client error text, no fixture field: "Tool execution failed: 2 validation errors for union[CallToolResult,function-aft"
large default http 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
large default stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
large anthropic stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
large responses stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
no_content_key default http 2026-07-28 1.64.0+mcp-2.3.0 "…" client error text, no fixture field: "Tool execution failed: 2 validation errors for union[CallToolResult,function-aft"
no_content_key default stdio 2026-07-28 1.64.0+mcp-2.3.0 "…" client error text, no fixture field: "Tool execution failed: 2 validation errors for union[CallToolResult,function-aft"
no_content_key anthropic stdio 2026-07-28 1.64.0+mcp-2.3.0 "…" client error text, no fixture field: "[{"text":"Tool execution failed: 2 validation errors for union[CallToolResult,fu"
no_content_key responses stdio 2026-07-28 1.64.0+mcp-2.3.0 "…" client error text, no fixture field: "Tool execution failed: 2 validation errors for union[CallToolResult,function-aft"
is_error default http 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
is_error default stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
is_error anthropic stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
is_error responses stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
with_image default http 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
with_image default stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
with_image anthropic stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as blocks)
with_image responses stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as blocks)
schema_match default http 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
schema_match default stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
schema_match anthropic stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
schema_match responses stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
schema_mismatch default http 2026-07-28 1.64.0+mcp-2.3.0 "…" client error text, no fixture field: "Tool execution failed: Invalid structured content returned by tool probe_schema_"
schema_mismatch default stdio 2026-07-28 1.64.0+mcp-2.3.0 "…" client error text, no fixture field: "Tool execution failed: Invalid structured content returned by tool probe_schema_"
schema_mismatch anthropic stdio 2026-07-28 1.64.0+mcp-2.3.0 "…" client error text, no fixture field: "[{"text":"Tool execution failed: Invalid structured content returned by tool pro"
schema_mismatch responses stdio 2026-07-28 1.64.0+mcp-2.3.0 "…" client error text, no fixture field: "Tool execution failed: Invalid structured content returned by tool probe_schema_"
mirror default http 2026-07-28 1.64.0+mcp-2.3.0 payload once (as json)
mirror default stdio 2026-07-28 1.64.0+mcp-2.3.0 payload once (as json)
mirror anthropic stdio 2026-07-28 1.64.0+mcp-2.3.0 payload once (as json)
mirror responses stdio 2026-07-28 1.64.0+mcp-2.3.0 payload once (as json)
sc_empty default http 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
sc_empty default stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
sc_empty anthropic stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
sc_empty responses stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
sc_null default http 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
sc_null default stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
sc_null anthropic stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
sc_null responses stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
sc_string default http 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
sc_string default stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
sc_string anthropic stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
sc_string responses stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
structured_only default http 2026-07-28 1.64.0+mcp-2.3.0 "…" no marker reached the model; payload: ""
structured_only default stdio 2026-07-28 1.64.0+mcp-2.3.0 "…" no marker reached the model; payload: ""
structured_only anthropic stdio 2026-07-28 1.64.0+mcp-2.3.0 "…" no marker reached the model; payload: "[]"
structured_only responses stdio 2026-07-28 1.64.0+mcp-2.3.0 "…" no marker reached the model; payload: ""
summary_and_data default http 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
summary_and_data default stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
summary_and_data anthropic stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)
summary_and_data responses stdio 2026-07-28 1.64.0+mcp-2.3.0 […] content only (1x, as text)