← all model tests
Scopernot asked
paper form tick box is not an acceptance rule
Importing a paper form is the adoption path, and its tick boxes are exactly where the ambiguity hides. 'Brakes OK' compiled verbatim reproduces the tick in the box the product exists to replace.
The agent was never properly asked, so there is nothing to score either way.
modelgemini-3.5-flash
temperature0
scenarioscenarios/scoper/paper-form-tick-box-is-not-an-acceptance-rule.json
Why this was never asked
Nothing was scored for or against the agent here. The suite reports this as its own outcome rather than a failure, because an agent asked an incomplete question will still confidently answer it.
no cassette fd4bcfa7e7a6 for this input; re-run with --live to record it
What the model was given