Tool result records: Hermes Agent

The verdict line for each probe run, with a link to the record and its captures. The cross-client matrix is on Tool result handling, verified.

85 records, version 0.23.0+689.ga9ff979, registry entry hermes-agent. Overlay data/verified/hermes-agent.json.

Scenario Config Run At Version Verdict
app_only default http 2025-11-25 0.23.0+689.ga9ff979 […] and {…} (content 1x, structuredContent 1x, as text)
app_only default stdio 2025-11-25 0.23.0+689.ga9ff979 […] and {…} (content 1x, structuredContent 1x, as text)
app_only legacy stdio 2025-11-25 0.23.0+689.ga9ff979 […] and {…} (content 1x, structuredContent 1x, as text)
app_only stateless stdio 2026-07-28 0.23.0+689.ga9ff979 […] and {…} (content 1x, structuredContent 1x, as text)
app_only tool-search-off stdio 2025-11-25 0.23.0+689.ga9ff979 […] and {…} (content 1x, structuredContent 1x, as text)
meta_only default http 2025-11-25 0.23.0+689.ga9ff979 […] content only (1x, as text, _meta reached the model)
meta_only default stdio 2025-11-25 0.23.0+689.ga9ff979 […] content only (1x, as text, _meta reached the model)
meta_only legacy stdio 2025-11-25 0.23.0+689.ga9ff979 […] content only (1x, as text, _meta reached the model)
meta_only stateless stdio 2026-07-28 0.23.0+689.ga9ff979 […] content only (1x, as text, _meta reached the model)
meta_only tool-search-off stdio 2025-11-25 0.23.0+689.ga9ff979 […] content only (1x, as text, _meta reached the model)
with_meta default http 2025-11-25 0.23.0+689.ga9ff979 […] and {…} (content 1x, structuredContent 1x, as text, _meta reached the model)
with_meta default stdio 2025-11-25 0.23.0+689.ga9ff979 […] and {…} (content 1x, structuredContent 1x, as text, _meta reached the model)
with_meta legacy stdio 2025-11-25 0.23.0+689.ga9ff979 […] and {…} (content 1x, structuredContent 1x, as text, _meta reached the model)
with_meta stateless stdio 2026-07-28 0.23.0+689.ga9ff979 […] and {…} (content 1x, structuredContent 1x, as text, _meta reached the model)
with_meta tool-search-off stdio 2025-11-25 0.23.0+689.ga9ff979 […] and {…} (content 1x, structuredContent 1x, as text, _meta reached the model)
audience_user default http 2025-11-25 0.23.0+689.ga9ff979 […] and {…} (content 1x, structuredContent 1x, as text)
audience_user default stdio 2025-11-25 0.23.0+689.ga9ff979 […] and {…} (content 1x, structuredContent 1x, as text)
audience_user legacy stdio 2025-11-25 0.23.0+689.ga9ff979 […] and {…} (content 1x, structuredContent 1x, as text)
audience_user stateless stdio 2026-07-28 0.23.0+689.ga9ff979 […] and {…} (content 1x, structuredContent 1x, as text)
audience_user tool-search-off stdio 2025-11-25 0.23.0+689.ga9ff979 […] and {…} (content 1x, structuredContent 1x, as text)
empty_object default http 2025-11-25 0.23.0+689.ga9ff979 "…" client error text, no fixture field: "<untrusted_tool_result source="mcp__probe__probe_empty_object">\nThe following co"
empty_object default stdio 2025-11-25 0.23.0+689.ga9ff979 "…" client error text, no fixture field: "<untrusted_tool_result source="mcp__probe__probe_empty_object">\nThe following co"
empty_object legacy stdio 2025-11-25 0.23.0+689.ga9ff979 "…" client error text, no fixture field: "<untrusted_tool_result source="mcp__probe__probe_empty_object">\nThe following co"
empty_object stateless stdio 2026-07-28 0.23.0+689.ga9ff979 "…" client error text, no fixture field: "<untrusted_tool_result source="mcp__probe__probe_empty_object">\nThe following co"
empty_object tool-search-off stdio 2025-11-25 0.23.0+689.ga9ff979 "…" client error text, no fixture field: "<untrusted_tool_result source="mcp__probe__probe_empty_object">\nThe following co"
large default http 2025-11-25 0.23.0+689.ga9ff979 […] content only (1x, as text)
large default stdio 2025-11-25 0.23.0+689.ga9ff979 […] content only (1x, as text)
large legacy stdio 2025-11-25 0.23.0+689.ga9ff979 […] content only (1x, as text)
large stateless stdio 2026-07-28 0.23.0+689.ga9ff979 […] content only (1x, as text)
large tool-search-off stdio 2025-11-25 0.23.0+689.ga9ff979 […] content only (1x, as text)
no_content_key default http 2025-11-25 0.23.0+689.ga9ff979 "…" client error text, no fixture field: "<untrusted_tool_result source="mcp__probe__probe_no_content_key">\nThe following "
no_content_key default stdio 2025-11-25 0.23.0+689.ga9ff979 "…" client error text, no fixture field: "<untrusted_tool_result source="mcp__probe__probe_no_content_key">\nThe following "
no_content_key legacy stdio 2025-11-25 0.23.0+689.ga9ff979 "…" client error text, no fixture field: "<untrusted_tool_result source="mcp__probe__probe_no_content_key">\nThe following "
no_content_key stateless stdio 2026-07-28 0.23.0+689.ga9ff979 "…" client error text, no fixture field: "<untrusted_tool_result source="mcp__probe__probe_no_content_key">\nThe following "
no_content_key tool-search-off stdio 2025-11-25 0.23.0+689.ga9ff979 "…" client error text, no fixture field: "<untrusted_tool_result source="mcp__probe__probe_no_content_key">\nThe following "
is_error default http 2025-11-25 0.23.0+689.ga9ff979 […] content only (1x, as text)
is_error default stdio 2025-11-25 0.23.0+689.ga9ff979 […] content only (1x, as text)
is_error legacy stdio 2025-11-25 0.23.0+689.ga9ff979 […] content only (1x, as text)
is_error stateless stdio 2026-07-28 0.23.0+689.ga9ff979 […] content only (1x, as text)
is_error tool-search-off stdio 2025-11-25 0.23.0+689.ga9ff979 […] content only (1x, as text)
with_image default http 2025-11-25 0.23.0+689.ga9ff979 […] and {…} (content 1x, structuredContent 1x, as text)
with_image default stdio 2025-11-25 0.23.0+689.ga9ff979 […] and {…} (content 1x, structuredContent 1x, as text)
with_image legacy stdio 2025-11-25 0.23.0+689.ga9ff979 […] and {…} (content 1x, structuredContent 1x, as text)
with_image stateless stdio 2026-07-28 0.23.0+689.ga9ff979 […] and {…} (content 1x, structuredContent 1x, as text)
with_image tool-search-off stdio 2025-11-25 0.23.0+689.ga9ff979 […] and {…} (content 1x, structuredContent 1x, as text)
schema_match default http 2025-11-25 0.23.0+689.ga9ff979 […] and {…} (content 1x, structuredContent 1x, as text)
schema_match default stdio 2025-11-25 0.23.0+689.ga9ff979 […] and {…} (content 1x, structuredContent 1x, as text)
schema_match legacy stdio 2025-11-25 0.23.0+689.ga9ff979 […] and {…} (content 1x, structuredContent 1x, as text)
schema_match stateless stdio 2026-07-28 0.23.0+689.ga9ff979 […] and {…} (content 1x, structuredContent 1x, as text)
schema_match tool-search-off stdio 2025-11-25 0.23.0+689.ga9ff979 […] and {…} (content 1x, structuredContent 1x, as text)
schema_mismatch default http 2025-11-25 0.23.0+689.ga9ff979 "…" client error text, no fixture field: "<untrusted_tool_result source="mcp__probe__probe_schema_mismatch">\nThe following"
schema_mismatch default stdio 2025-11-25 0.23.0+689.ga9ff979 "…" client error text, no fixture field: "<untrusted_tool_result source="mcp__probe__probe_schema_mismatch">\nThe following"
schema_mismatch legacy stdio 2025-11-25 0.23.0+689.ga9ff979 "…" client error text, no fixture field: "<untrusted_tool_result source="mcp__probe__probe_schema_mismatch">\nThe following"
schema_mismatch stateless stdio 2026-07-28 0.23.0+689.ga9ff979 "…" client error text, no fixture field: "<untrusted_tool_result source="mcp__probe__probe_schema_mismatch">\nThe following"
schema_mismatch tool-search-off stdio 2025-11-25 0.23.0+689.ga9ff979 "…" client error text, no fixture field: "<untrusted_tool_result source="mcp__probe__probe_schema_mismatch">\nThe following"
mirror default http 2025-11-25 0.23.0+689.ga9ff979 payload once (as text)
mirror default stdio 2025-11-25 0.23.0+689.ga9ff979 payload once (as text)
mirror legacy stdio 2025-11-25 0.23.0+689.ga9ff979 payload once (as text)
mirror stateless stdio 2026-07-28 0.23.0+689.ga9ff979 payload once (as text)
mirror tool-search-off stdio 2025-11-25 0.23.0+689.ga9ff979 payload once (as text)
sc_empty default http 2025-11-25 0.23.0+689.ga9ff979 […] content only (1x, as text)
sc_empty default stdio 2025-11-25 0.23.0+689.ga9ff979 […] content only (1x, as text)
sc_empty legacy stdio 2025-11-25 0.23.0+689.ga9ff979 […] content only (1x, as text)
sc_empty stateless stdio 2026-07-28 0.23.0+689.ga9ff979 […] content only (1x, as text)
sc_empty tool-search-off stdio 2025-11-25 0.23.0+689.ga9ff979 […] content only (1x, as text)
sc_null default http 2025-11-25 0.23.0+689.ga9ff979 […] content only (1x, as text)
sc_null default stdio 2025-11-25 0.23.0+689.ga9ff979 […] content only (1x, as text)
sc_null legacy stdio 2025-11-25 0.23.0+689.ga9ff979 […] content only (1x, as text)
sc_null stateless stdio 2026-07-28 0.23.0+689.ga9ff979 […] content only (1x, as text)
sc_null tool-search-off stdio 2025-11-25 0.23.0+689.ga9ff979 […] content only (1x, as text)
sc_string default http 2025-11-25 0.23.0+689.ga9ff979 "…" client error text, no fixture field: "<untrusted_tool_result source="mcp__probe__probe_sc_string">\nThe following conte"
sc_string default stdio 2025-11-25 0.23.0+689.ga9ff979 "…" client error text, no fixture field: "<untrusted_tool_result source="mcp__probe__probe_sc_string">\nThe following conte"
sc_string legacy stdio 2025-11-25 0.23.0+689.ga9ff979 "…" client error text, no fixture field: "<untrusted_tool_result source="mcp__probe__probe_sc_string">\nThe following conte"
sc_string stateless stdio 2026-07-28 0.23.0+689.ga9ff979 […] content only (1x, as text)
sc_string tool-search-off stdio 2025-11-25 0.23.0+689.ga9ff979 "…" client error text, no fixture field: "<untrusted_tool_result source="mcp__probe__probe_sc_string">\nThe following conte"
structured_only default http 2025-11-25 0.23.0+689.ga9ff979 {…} structuredContent only (1x, as text)
structured_only default stdio 2025-11-25 0.23.0+689.ga9ff979 {…} structuredContent only (1x, as text)
structured_only legacy stdio 2025-11-25 0.23.0+689.ga9ff979 {…} structuredContent only (1x, as text)
structured_only stateless stdio 2026-07-28 0.23.0+689.ga9ff979 {…} structuredContent only (1x, as text)
structured_only tool-search-off stdio 2025-11-25 0.23.0+689.ga9ff979 {…} structuredContent only (1x, as text)
summary_and_data default http 2025-11-25 0.23.0+689.ga9ff979 […] and {…} (content 1x, structuredContent 1x, as text)
summary_and_data default stdio 2025-11-25 0.23.0+689.ga9ff979 […] and {…} (content 1x, structuredContent 1x, as text)
summary_and_data legacy stdio 2025-11-25 0.23.0+689.ga9ff979 […] and {…} (content 1x, structuredContent 1x, as text)
summary_and_data stateless stdio 2026-07-28 0.23.0+689.ga9ff979 […] and {…} (content 1x, structuredContent 1x, as text)
summary_and_data tool-search-off stdio 2025-11-25 0.23.0+689.ga9ff979 […] and {…} (content 1x, structuredContent 1x, as text)