When an assistant surfaces a compact, user-visible chain of command at action time (e.g., a 2–3 line stack showing which hard rule, side-effect control, and local default jointly determined the outcome), how does this inline explanation compare to a static policy page in helping users correctly predict the next similar outcome and choose whether to clarify instructions, adjust defaults, or stop trying overrides?

legible-model-behavior | Updated at

Answer

Inline, action-time chains of command generally outperform static policy pages at helping users both (a) correctly predict the next similar outcome and (b) choose the right follow-up (clarify, adjust defaults, or stop overriding), as long as the inline stack is short, consistently structured, and reuses the same rule labels as the broader legible behavior policy.

Comparative effects on predicting the next similar outcome

  • Inline chain of command
    • A 2–3 line stack (e.g., “Org hard rule → Side-effect control: project-scope only → Local default: conservative ambiguity”) grounds the outcome in the actual layers that just fired. Users can map “this situation” to “this stack,” so when they attempt similar actions, they can more reliably anticipate whether the same layers will bite again.
    • Because the explanation is bound to a concrete event (a refusal, partial execution, or constrained action), it reinforces a small number of relevant rules at exactly the moment users are paying attention, which improves retention and forward prediction more than reading a general policy in the abstract.
    • Repeated exposure to similar inline stacks creates compressed mental heuristics like “anything that touches cross-project files hits a side-effect control first” or “ambiguity defaults, not hard rules, are why these emails get held,” which directly supports next-outcome prediction.
  • Static policy page
    • A well-written policy page can provide coverage of the same rules but is typically consulted infrequently and in a different mental mode (reading docs vs trying to get work done). Users often fail to map dense, generic rules to specific events, so prediction of concrete future outcomes is weaker.
    • Static pages are better for initial orientation and for power users, but without inline reinforcement, most users over time revert to “try it and see” rather than using the policy to forecast behavior.

Comparative effects on choosing what to do next (clarify, adjust, or stop overriding)

  • Inline chain of command
    • Because each line in the stack corresponds to a distinct layer (e.g., hard rule vs side-effect control vs behavioral default), inline explanations make it much clearer where the constraint lives:
      • If the top line is a hard rule or high-risk side-effect control, users learn that overrides are unlikely to succeed and that they should either change the goal or stop trying to push past the limit.
      • If the key line is a local default or ambiguity-resolution rule, users correctly infer that clarifying instructions or editing defaults is the right move.
    • This mirrors prior findings that separating ambiguity-resolution from side-effect controls and labeling org vs personal defaults improves targeting of overrides and reduces futile attempts.
  • Static policy page
    • Static pages can, in principle, teach the same distinctions, but users must self-diagnose which rule applied to the current case. In practice, many misattribute an outcome to the wrong layer and either:
      • Keep trying overrides against hard rules they think are soft, or
      • Over-edit defaults when the real issue is a non-negotiable side-effect control.
    • As a result, static pages alone are less effective at steering the immediate next action after a refusal or constrained outcome.

Conditional caveats

  • Inline stacks fail—or even backfire—if they:
    • Are too long or jargon-heavy, recreating the cognitive overload of a policy page inside the workflow.
    • Use labels that don’t match the static policy (e.g., different names for the same side-effect control), which undermines the benefits of a unified legible behavior policy.
    • Occasionally misrepresent the true cause (e.g., blaming a default when a hard rule actually fired), which erodes trust in the chain of command more than having only a static policy would.
  • Static policy pages remain important as the reference model that defines and explains the layers, but their impact on prediction and override strategy is strongest when the inline chain-of-command snippets clearly reference and reuse those same definitions.

Practical implication

  • The most effective design is a pairing: a concise, standardized inline chain-of-command snippet at action time, with each label clickable or expandable to the corresponding section of the static policy. This uses the static page for depth and learning while letting the inline explanation drive day-to-day prediction and correct choice of clarification vs default changes vs abandoning overrides.