In products that already detect early behavioral profiles (e.g., scaffold‑leaning vs free‑form‑leaning users), which mid-curve behavioral shifts—such as sudden drops in prompt editing, abandonment of a previously high-usage reusable workflow, or rising manual corrections on a stable task—most reliably distinguish (a) healthy consolidation of workflow maturity from (b) emerging productivity plateaus, and how can onboarding be re-opened at that point to restore growth in the AI learning curve without overwhelming users?

anthropic-learning-curves | Updated at

Answer

Key mid-curve shifts and what they usually mean, plus how to re-open onboarding without overload:

  1. Mid-curve behavioral shifts that signal healthy consolidation vs plateau

a) Sudden drop in prompt editing

  • Likely healthy when:
    • Runs per workflow are stable or rising.
    • Manual corrections are flat or falling.
    • Task cadence matches external rhythms (e.g., weekly reports).
    • Ownership is clear (a power user edits occasionally; others mostly run).
  • Likely plateau when:
    • Edits drop but corrections rise or stay high.
    • Users start bypassing the workflow (more ad-hoc prompts or manual work).
    • Run frequency declines for still-relevant tasks.

b) Abandonment of a previously high-usage reusable workflow

  • Likely healthy when:
    • Usage migrates to a small set of newer workflows with overlapping scope.
    • New workflows have higher reuse and lower correction rates.
    • Abandonment coincides with known process or policy changes.
  • Likely plateau when:
    • No clear successor workflow appears.
    • Covered tasks are still done, but mostly manually or via one-off prompts.
    • Users show more help-seeking and longer task times.

c) Rising manual corrections on a stable task

  • Likely healthy when:
    • Corrections cluster around a new constraint (policy, style, segment) and stabilize after a few runs.
    • A power user edits the workflow soon after the spike, after which corrections drop.
  • Likely plateau when:
    • Corrections rise and stay high across many runs.
    • Edits remain low or are local per-user patches (same fixes each time).
    • Users increasingly copy results out to other tools for heavy rework.
  1. Simple rule-of-thumb signals

Treat a mid-curve change as healthy consolidation if you see:

  • Fewer edits + equal or better quality (lower corrections/rewrites).
  • Same or higher reuse of a small number of workflows.
  • Edits concentrated in a few owner accounts, followed by team-wide quality gains.

Treat it as an emerging plateau if you see:

  • Fewer edits + worse or unchanged quality.
  • Declining reuse without a clear successor workflow.
  • More manual work or exploration that never converts into updated workflows.
  1. How to re-open onboarding at mid-curve without overwhelming users

Trigger re-opening when plateau patterns persist for N runs (e.g., 5–10) rather than on first sign.

a) For scaffold-leaning users

  • Use micro-prompts, not full courses:
    • At run time: “You often fix X. Want to make this a setting?” with one suggested toggle/parameter.
    • For abandoned workflows: “You stopped using Workflow A for this task. Should we adapt it to your recent examples?” with 1–2 quick options.
  • Offer guided upgrade paths:
    • One-click “create improved version” that pre-fills parameters from observed corrections.
    • Short, inline explanation of what changed.

b) For free-form-leaning users

  • Channel exploration back into assets:
    • Detect clusters of similar ad-hoc prompts and suggest “Save as reusable workflow” at a quiet moment.
    • Show “compare to your existing workflow” with a minimal diff.
  • Offer lightweight strategy tips, tied to their own data:
    • Very short pattern cards (“You always add customer segment manually; consider a ‘segment’ input.”).

c) For teams with shared workflows

  • Target power users when signals are team-wide:
    • Rising corrections across many users → prompt owners with a short “update wizard” seeded from recent corrections.
    • Abandoned shared workflow → ask owner to confirm: retire, replace, or refit.
  • Keep end-user re-onboarding minimal:
    • Inline change highlights (“This workflow now asks for region; we’ll use it to handle tone differences automatically.”).
  1. Guardrails to avoid overwhelming users
  • Limit interventions per user/time window (e.g., max 1–2 nudges per week).
  • Keep each nudge single-step and reversible.
  • Prefer task-time nudges for small fixes; defer structural suggestions (new workflows, merges) to end-of-session summaries.

Net effect: use combinations of edit rate, reuse, corrections, and bypass behavior to distinguish consolidation from plateau, then re-open onboarding with small, context-specific nudges that either (a) turn repeated corrections into parameters or updates, or (b) convert recurring ad-hoc use into improved or new reusable workflows.