When apparent productivity plateaus coincide with stable use of high-performing reusable workflows, how do different coaching targets and triggers—such as coaching power users on portfolio-level refactors versus coaching individual contributors on local parameterization and step edits, triggered by patterns like recurrent near-misses or variant sprawl—differ in their impact on lifting team-level workflow maturity and preventing long-run stagnation in the AI learning curve?
anthropic-learning-curves | Updated at
Answer
Power‑user portfolio coaching and IC local coaching help in different ways and should be triggered by different plateau signals.
- Relative impact on team workflow maturity
- Power‑user portfolio coaching
- Best for: raising the ceiling of team workflows.
- Focus: merge overlapping workflows, define params, codify best variants, align with business cadences.
- Effect: fewer, stronger shared assets; faster propagation of improvements; higher baseline quality for all users.
- IC local parameter/step coaching
- Best for: reducing friction and keeping ICs engaged.
- Focus: turn recurrent edits into params, tweak steps, add small pre/post steps.
- Effect: better fit to local tasks; higher reuse of existing assets; smoother AI learning curve for more people.
Net: portfolio coaching moves asset quality and structure; IC coaching moves coverage and fit. Both are needed to avoid stagnation.
- Triggers and recommended coaching by pattern
-
Recurrent near‑misses (same step often corrected, outcomes "almost right")
- Power‑user coaching: update the shared workflow step, add guardrails/examples, possibly add a param that captures the recurring correction.
- IC coaching: in‑run tips like “save this change as a default” or “promote this tweak into the workflow.”
- Expected impact: lowers correction rates across many runs; converts improvisation into reusable structure.
-
Variant sprawl (many similar workflows/variants with small differences)
- Power‑user coaching: consolidate into a few parameterized workflows, retire low‑run variants, define naming and ownership.
- IC coaching: teach users to use params/toggles instead of forking, plus light guidance on when a true new variant is warranted.
- Expected impact: concentrates learning in fewer assets; makes plateaus more visible and fixable.
-
Stable high performance but zero edit activity
- Power‑user coaching: periodic portfolio reviews to check for drift, new use cases, and cross‑tool integration; add new inputs/outputs if needed.
- IC coaching: small nudges to try attachments, new data sources, or sharing when patterns suggest under‑use rather than true saturation.
- Expected impact: prevents silent obsolescence; nudges expansion without forcing churn.
- When each coaching focus helps most against long‑run stagnation
-
Favor power‑user portfolio coaching when:
- A few workflows dominate runs.
- Edits and variants are already concentrated in a small group.
- Plateaus coexist with variant sprawl or repeated near‑misses across many users.
→ Main lever: restructure and harden the shared assets.
-
Favor IC local coaching when:
- Many users make similar manual tweaks but rarely save them.
- Near‑misses are localized to specific teams or clients.
- Variant sprawl is light, but runs show repeated param‑like edits.
→ Main lever: convert everyday edits into parameters/steps.
-
Combine both when:
- Plateaus sit alongside both heavy variant sprawl and many local corrections.
→ Coach power users to rationalize the portfolio, while coaching ICs to express needs as params/feedback instead of silent forks.
- Plateaus sit alongside both heavy variant sprawl and many local corrections.
- Implications for preventing AI learning‑curve stagnation
- Power‑user coaching mainly shapes the team curve: bigger step‑changes from occasional refactors.
- IC coaching mainly shapes the within‑user curve: smoother progress and less drop‑off when workflows almost fit but not quite.
- Systems that prioritize portfolio‑level refactors at clear plateau signals, and support ICs with low‑friction parameter/step coaching on near‑misses, are most likely to maintain upward movement instead of flatlining once first strong workflows are in place.