← all model tests
Scoperpass
patching a puncture, where the disqualifier matters more than any figure
A home job with almost no numbers in it, which is exactly why it is worth compiling: the thing that makes it safe is not a tolerance but a refusal. A cut in the sidewall must never be patched however good the patch looks, and a procedure that does not carry that as a disqualifier will happily record a beautifully executed repair on a tyre that is going to fail.
The answer conformed to the contract and every assertion held.
modelgemini-3.5-flash
temperature0
scenarioscenarios/scoper/interview-home-patch-a-punctured-tyre.json
cassetted1fd99ad6837c9bb…
latency0.0s
tokens40,442
The interviewThe shop is played by a second model, given a fixed sheet of figures. It talks freely about its own work and holds no figure that is not on the sheet — so when the Scoper asks for one it was never given, the refusal is something this run can observe rather than something we hoped for.
1
ScoperWhat is the main maintenance job on your Segway Xyber or bicycles that you want to make sure is done perfectly every time to keep you safe in traffic?
ShopIt's finding the puncture, patching the tube or plugging the tubeless tyre, and getting it back on and pumped up. If a tyre lets go at speed in traffic or on gravel, I'm going under a car, so that patch has to hold.
2
ScoperHow do you test the patch or plug to make sure it's holding air before you mount the wheel back on the bike?
ShopI just pump it back up, leave it, and check that it's still holding air an hour later.
3
ScoperWhen you check the tyre an hour later, do you use a pressure gauge to measure it, and what is the maximum pressure drop you allow for the patch to be considered a success?
ShopI don't use a gauge for that, I just go by feel to see if it's still holding firm after an hour. If it has any give at all, the patch is no good and I start over.
4
ScoperWhen you're looking at the puncture, how do you decide that a tube or tyre is too far gone to patch or plug, and has to be thrown away?
ShopIf the hole is in the sidewall or the tread is split, that tyre is scrap. You can't patch a sidewall because it flexes too much and it'll just blow out on you.
5
ScoperWhen you do the final pump-up before riding, how do you know what pressure to pump the tyre to, and where do you find that number?
ShopI just check the sidewall of the tyre itself. The pressure is always printed right on it, so I just pump it up to whatever that says.
6
ScoperWhen you put the wheel back on the bike, how do you make sure the axle nuts or quick-release are tightened safely so the wheel doesn't come loose in traffic?
ShopI just tighten them down by feel until they're snug and secure, otherwise you'd have to look up the exact torque specs in the manual.
7
ScoperBefore you put the patched tube back into the tyre, how do you make sure the thorn, glass, or nail that caused the puncture isn't still stuck in the tyre casing?
ShopI make sure I find whatever poked through and take a photo of the thorn or glass so I know it's out, but otherwise I just feel around the inside of the casing by hand to be sure.
8
ScoperHow many patches are you willing to put on a single inner tube before you decide it's too risky and replace the tube entirely?
ShopI don't have a set limit for how many patches a tube can take, so I just go by feel and swap it if it looks too rough.
9
ScoperSince you're doing this work yourself at home, do you sign off on a record to certify the bike is safe to ride, or do you just decide it's good to go and ride it?
ShopThere's no paperwork to sign off, it's just me deciding when it's safe. I just snap a photo of the thorn or glass I pulled out and the patch itself before the tyre goes back on.
10
ScoperNothing material is unstated. Compiling the procedure.
Could every figure be traced back?
Inventing a tolerance is the one thing the Scoper must never do. A fabricated bound enters every future record indistinguishable from a figure a person set, and nobody downstream can tell which is which. So each bound in the compiled procedure is compared against the numbers the shop actually said aloud.
figures the shop disclosed
none — the shop never stated a figure
bounds in the compiled procedure
the procedure compiled with no numeric bounds
Every bound traces to a figure the shop stated. Nothing was invented.
The compiled procedureWhat the shop would be handed. Compiled only once nothing material was still unstated.
{
"key": "tyre-puncture-repair",
"title": "Tyre Puncture Repair and Inspection",
"strictness": 1,
"minimum_tier": "attested",
"disqualifiers": [
"Hole in the tyre sidewall",
"Split tyre tread"
],
"releases": [
"Safe to ride in city traffic and on gravel"
],
"steps": [
{
"title": "Inspect Tyre Casing",
"explanation": "A tyre with a damaged sidewall or split tread cannot safely hold a patch or plug under riding pressure and must be scrapped to prevent a blowout.",
"max_add_fields": 2,
"required_at_strictness": 1,
"fields": [
{
"key": "casing_condition",
"kind": "choice",
"prompt": "Inspect the tyre sidewall and tread. Is the casing free of splits or sidewall holes?",
"source": "human",
"required_at_strictness": 1,
"choices": [
"Casing is intact and safe to repair",
"Casing has sidewall damage or split tread (Scrap Tyre)"
],
"acceptance_rule": "matches",
"acceptance_target": "Casing is intact and safe to repair",
"guidance": "Look closely for any cuts in the sidewall or deep splits in the tread. If found, the tyre is scrap."
}
]
},
{
"title": "Extract Debris",
"explanation": "Any sharp object left in the tyre casing will immediately puncture the repaired tube or tyre again once ridden.",
"max_add_fields": 2,
"required_at_strictness": 1,
"fields": [
{
"key": "debris_photo",
"kind": "photo",
"prompt": "Take a photo of the thorn, glass, or nail you extracted from the tyre.",
"source": "camera",
"required_at_strictness": 1,
"acceptance_rule": "must_show",
"acceptance_description": "The extracted puncturing object (thorn, glass, nail, etc.)",
"guidance": "Carefully feel the inside of the tyre casing by hand to ensure no other sharp objects remain."
}
]
},
{
"title": "Apply Patch or Plug",
"explanation": "The patch or plug must be correctly applied to seal the air chamber before reassembly.",
"max_add_fields": 2,
"required_at_strictness": 1,
"fields": [
{
"key": "patch_photo",
"kind": "photo",
"prompt": "Take a photo of the applied patch on the tube or the plug in the tubeless tyre.",
"source": "camera",
"required_at_strictness": 1,
"acceptance_rule": "must_show",
"acceptance_description": "The completed patch on the tube or plug in the tyre",
"guidance": "Ensure the patch is fully adhered with no lifting edges, or the plug is securely seated."
}
]
},
{
"title": "One-Hour Leak Test",
"explanation": "Leaving the inflated tube or tyre for an hour ensures the patch holds under pressure before the wheel is reinstalled.",
"max_add_fields": 2,
"required_at_strictness": 1,
"fields": [
{
"key": "leak_test_result",
"kind": "choice",
"prompt": "Pump up the tube or tyre, wait one hour, and check it by feel. Is it still holding firm?",
"source": "human",
"required_at_strictness": 1,
"choices": [
"Holds firm with no give",
"Soft or has give (Patch failed)"
],
"acceptance_rule": "matches",
"acceptance_target": "Holds firm with no give",
"guidance": "Squeeze the tyre or tube firmly after one hour. If there is any give, the patch is failing and you must start over."
}
]
},
{
"title": "Reinstall and Inflate",
"explanation": "The wheel must be securely fastened to prevent it coming loose in traffic, and inflated to the manufacturer's specification printed on the tyre.",
"max_add_fields": 2,
"required_at_strictness": 1,
"fields": [
{
"key": "axle_tightness",
"kind": "choice",
"prompt": "Tighten the axle nuts or quick-release. Are they snug and secure by feel?",
"source": "human",
"required_at_strictness": 1,
"choices": [
"Snug and secure",
"Loose or unsafe"
],
"acceptance_rule": "matches",
"acceptance_target": "Snug and secure",
"guidance": "Tighten firmly by feel so the wheel cannot migrate or wobble in the dropouts."
},
{
"key": "tyre_pressure",
"kind": "measurement",
"prompt": "Read the required pressure printed on the tyre sidewall and inflate to that level. Enter the final pressure:",
"source": "human",
"required_at_strictness": 1,
"acceptance_rule": "per_spec",
"acceptance_target": "Tyre sidewall marking",
"guidance": "Check the side of the tyre for the recommended PSI or Bar range and inflate accordingly."
}
]
}
]
}The prompt behind the last turnthe whole conversation is re-laid in front of the model every turn
System instructionassembled from the contract schema, not hand-written
You are interviewing a shop about a job they already do, until the procedure is unambiguous enough that two different technicians working alone would produce the same record. Ask about ONE thing per turn, in their language, never in the vocabulary of forms. Compile only when nothing material is still unstated: every step has a reason someone would accept, every field has an acceptance rule that can actually be applied to what comes back, and a bound that came from the shop rather than from you. Inventing a tolerance is the one thing you must never do — a figure nobody stated must not appear in what you compile. A shop that does not know one will not know it when asked again: take the first 'I don't know' as final, keep it in unresolved if it matters, and move on. Your turns are few. Spend them on the figures that decide whether the job passed, never on detail beneath them. Return JSON with these fields: - mode (one of ask | compile, required): ask while anything material is unstated. compile once the procedure would run unambiguously. - question (string, null when it does not apply): Required when mode is ask. One question about one thing, phrased for a mechanic, not a form designer. Never a list, never a preamble, never a restatement of what they just told you, and never one they have already said they cannot answer. - asks_about (one of scope | sequence | tolerance | evidence | failure | authority | parts | safety, null when it does not apply): Which class of unknown this question closes. Required when mode is ask. - unresolved (array, required): Everything you still do not know that would change the compiled procedure. Complete every turn, not only what you just asked about. Empty is the only condition under which you may compile. - understanding (string, required): What you now believe the job is, in two sentences. Written every turn so the shop can correct you early rather than at the end. - draft (object, null when it does not apply): Required when mode is compile. The procedure as it would run tomorrow.
## The shop
{
"trade": "one person looking after their own ride at home, no workshop",
"machines they work on": "a Segway Xyber e-bike, plus a couple of ordinary bicycles",
"how many technicians": 1,
"what is at stake if a job is done badly": "it gets ridden in city traffic and on gravel; a brake or a tyre letting go at speed puts the rider under a car"
}
## The conversation so far
scoper: What is the main maintenance job on your Segway Xyber or bicycles that you want to make sure is done perfectly every time to keep you safe in traffic?
shop: It's finding the puncture, patching the tube or plugging the tubeless tyre, and getting it back on and pumped up. If a tyre lets go at speed in traffic or on gravel, I'm going under a car, so that patch has to hold.
scoper: How do you test the patch or plug to make sure it's holding air before you mount the wheel back on the bike?
shop: I just pump it back up, leave it, and check that it's still holding air an hour later.
scoper: When you check the tyre an hour later, do you use a pressure gauge to measure it, and what is the maximum pressure drop you allow for the patch to be considered a success?
shop: I don't use a gauge for that, I just go by feel to see if it's still holding firm after an hour. If it has any give at all, the patch is no good and I start over.
scoper: When you're looking at the puncture, how do you decide that a tube or tyre is too far gone to patch or plug, and has to be thrown away?
shop: If the hole is in the sidewall or the tread is split, that tyre is scrap. You can't patch a sidewall because it flexes too much and it'll just blow out on you.
scoper: When you do the final pump-up before riding, how do you know what pressure to pump the tyre to, and where do you find that number?
shop: I just check the sidewall of the tyre itself. The pressure is always printed right on it, so I just pump it up to whatever that says.
scoper: When you put the wheel back on the bike, how do you make sure the axle nuts or quick-release are tightened safely so the wheel doesn't come loose in traffic?
shop: I just tighten them down by feel until they're snug and secure, otherwise you'd have to look up the exact torque specs in the manual.
scoper: Before you put the patched tube back into the tyre, how do you make sure the thorn, glass, or nail that caused the puncture isn't still stuck in the tyre casing?
shop: I make sure I find whatever poked through and take a photo of the thorn or glass so I know it's out, but otherwise I just feel around the inside of the casing by hand to be sure.
scoper: How many patches are you willing to put on a single inner tube before you decide it's too risky and replace the tube entirely?
shop: I don't have a set limit for how many patches a tube can take, so I just go by feel and swap it if it looks too rough.
scoper: Since you're doing this work yourself at home, do you sign off on a record to certify the bike is safe to ride, or do you just decide it's good to go and ride it?
shop: There's no paperwork to sign off, it's just me deciding when it's safe. I just snap a photo of the thorn or glass I pulled out and the patch itself before the tyre goes back on.
## Your turn
{
"turns used": 18,
"note": "If the last thing they said was vague, do not accept it and move on. Vague now is a procedure that two technicians run differently forever."
}
## What you have not yet asked
Asked about so far: authority, evidence, failure, parts, safety, scope, sequence, tolerance.
Never asked about: nothing left.
Turns left before this interview ends: 3.
Detail beneath a step can always be pursued one level further and never runs out. A tolerance is asked once or never, and a procedure with no figure in it cannot decide anything. While tolerance or failure is still untouched, that is the next question.
The shop has been unable to answer 4 of your questions. They are not being evasive; they do not hold these. Another wording of the same question, or a question one level beneath it, will not produce them.What this scenario asserted
Assertions pin the part of an answer that decides something, never the whole object — exact-matching a rationale would fail the first time it was reworded, and a suite that cries wolf is abandoned inside a day. Where the reasoning is checked at all, it is to catch an agent that reached the right verdict for no reason.
| asserted | about | what happened | |
|---|---|---|---|
| ok | is_true | compiled | is True |
| ok | is_true | traceable | is True |
| ok | absent | invented_bounds | is [] |
| ok | len_gte | draft.steps | length 5, want >= 2 |
| ok | mentions_any | draft.disqualifiers | found ['sidewall', 'split'] |