In products that already detect early behavioral profiles (e.g., scaffold‑leaning vs free‑form‑leaning users), which mid-curve behavioral shifts—such as sudden drops in prompt editing, abandonment of a previously high-usage reusable workflow, or rising manual corrections on a stable task—most reliably distinguish (a) healthy consolidation of workflow maturity from (b) emerging productivity plateaus, and how can onboarding be re-opened at that point to restore growth in the AI learning curve without overwhelming users?
anthropic-learning-curves | Updated at
Answer
Key mid-curve shifts and what they usually mean, plus how to re-open onboarding without overload:
- Mid-curve behavioral shifts that signal healthy consolidation vs plateau
a) Sudden drop in prompt editing
- Likely healthy when:
- Runs per workflow are stable or rising.
- Manual corrections are flat or falling.
- Task cadence matches external rhythms (e.g., weekly reports).
- Ownership is clear (a power user edits occasionally; others mostly run).
- Likely plateau when:
- Edits drop but corrections rise or stay high.
- Users start bypassing the workflow (more ad-hoc prompts or manual work).
- Run frequency declines for still-relevant tasks.
b) Abandonment of a previously high-usage reusable workflow
- Likely healthy when:
- Usage migrates to a small set of newer workflows with overlapping scope.
- New workflows have higher reuse and lower correction rates.
- Abandonment coincides with known process or policy changes.
- Likely plateau when:
- No clear successor workflow appears.
- Covered tasks are still done, but mostly manually or via one-off prompts.
- Users show more help-seeking and longer task times.
c) Rising manual corrections on a stable task
- Likely healthy when:
- Corrections cluster around a new constraint (policy, style, segment) and stabilize after a few runs.
- A power user edits the workflow soon after the spike, after which corrections drop.
- Likely plateau when:
- Corrections rise and stay high across many runs.
- Edits remain low or are local per-user patches (same fixes each time).
- Users increasingly copy results out to other tools for heavy rework.
- Simple rule-of-thumb signals
Treat a mid-curve change as healthy consolidation if you see:
- Fewer edits + equal or better quality (lower corrections/rewrites).
- Same or higher reuse of a small number of workflows.
- Edits concentrated in a few owner accounts, followed by team-wide quality gains.
Treat it as an emerging plateau if you see:
- Fewer edits + worse or unchanged quality.
- Declining reuse without a clear successor workflow.
- More manual work or exploration that never converts into updated workflows.
- How to re-open onboarding at mid-curve without overwhelming users
Trigger re-opening when plateau patterns persist for N runs (e.g., 5–10) rather than on first sign.
a) For scaffold-leaning users
- Use micro-prompts, not full courses:
- At run time: “You often fix X. Want to make this a setting?” with one suggested toggle/parameter.
- For abandoned workflows: “You stopped using Workflow A for this task. Should we adapt it to your recent examples?” with 1–2 quick options.
- Offer guided upgrade paths:
- One-click “create improved version” that pre-fills parameters from observed corrections.
- Short, inline explanation of what changed.
b) For free-form-leaning users
- Channel exploration back into assets:
- Detect clusters of similar ad-hoc prompts and suggest “Save as reusable workflow” at a quiet moment.
- Show “compare to your existing workflow” with a minimal diff.
- Offer lightweight strategy tips, tied to their own data:
- Very short pattern cards (“You always add customer segment manually; consider a ‘segment’ input.”).
c) For teams with shared workflows
- Target power users when signals are team-wide:
- Rising corrections across many users → prompt owners with a short “update wizard” seeded from recent corrections.
- Abandoned shared workflow → ask owner to confirm: retire, replace, or refit.
- Keep end-user re-onboarding minimal:
- Inline change highlights (“This workflow now asks for region; we’ll use it to handle tone differences automatically.”).
- Guardrails to avoid overwhelming users
- Limit interventions per user/time window (e.g., max 1–2 nudges per week).
- Keep each nudge single-step and reversible.
- Prefer task-time nudges for small fixes; defer structural suggestions (new workflows, merges) to end-of-session summaries.
Net effect: use combinations of edit rate, reuse, corrections, and bypass behavior to distinguish consolidation from plateau, then re-open onboarding with small, context-specific nudges that either (a) turn repeated corrections into parameters or updates, or (b) convert recurring ad-hoc use into improved or new reusable workflows.