When onboarding systems dynamically choose between “example-first” scaffolds (rich galleries, prebuilt flows) and “exploration-first” scaffolds (guided free-form prompting, sandbox tasks), which observable early behaviors—like diversity of attempted tasks, tolerance for failure, or frequency of help-seeking—best predict which scaffold mix will minimize time to first durable workflow maturity without inducing an earlier productivity plateau, and how should those behavior-based assignments be updated after the first 2–3 weeks of usage?
anthropic-learning-curves | Updated at
Answer
Early behaviors that best predict scaffold mix:
- High-exploration profile → start exploration-first, sprinkle examples
- Signals in first 3–5 active days:
• High task diversity: many distinct tasks/tools per session.
• High failure tolerance: frequent retries/variants after bad outputs.
• Low persistent help-seeking: uses help/examples briefly, then returns to free-form. - Recommended mix:
• Default: guided free-form prompt surface + light guardrails.
• Inline examples at task-time, not heavy galleries.
• Early “save as workflow” nudges once the same pattern appears ≥3 times. - Rationale: they learn by probing; too many examples risks premature lock‑in and early plateau.
- High-structure-seeking profile → start example-first, with gradual un-locking
- Signals in first 3–5 active days:
• Low task diversity: stays near 1–2 task types.
• Low failure tolerance: abandons after 1–2 bad runs; few variants.
• High help-seeking: browses galleries/docs; uses suggested prompts heavily. - Recommended mix:
• Default: curated example sets and prebuilt flows for common tasks.
• Gentle prompts to tweak parameters, then to duplicate/modify flows.
• Later introduction of sandboxes once they reach independent execution on one reusable workflow. - Rationale: they need scaffolds to reach a first durable win; pure exploration leads to churn.
- Import-heavy / prior-skill profile → workflow-conversion-first
- Signals:
• Long, structured pasted prompts; low in-session editing (cf. cross-ecosystem patterns).
• Early task cadence visible (similar prompt used across days). - Recommended mix:
• Tools to convert pasted prompts into reusable workflows.
• Example-first only around decomposition and parameterization, not basic prompting.
• Exploration-first space for testing variants of their imported flows.
Assignment updates after 2–3 weeks
Use mid-curve shifts and reuse patterns to re-classify:
A) If an exploration-first user shows:
• 1–2 workflows with stable reuse, but rising same-step corrections or bypasses (plateau signals).
• Little movement toward parameterization or chaining.
→ Increase example-first elements around their actual tasks:
• Show task-specific exemplars and alternative decompositions.
• Offer micro-tutorials and upgrade wizards on brittle steps.
• Keep free-form available for new tasks.
B) If an example-first user shows:
• Stable reuse of at least one workflow with falling corrections.
• Direct invocation of workflows with reduced help-seeking.
→ Shift toward more exploration-first:
• Introduce sandboxes seeded from their existing flows.
• Nudge them to generalize flows to nearby tasks (clone-and-edit, small parameter changes).
C) If any user shows:
• Abandonment of early workflows with migration to better ones and lower corrections.
• Emergence of multi-step chains and cross-document reuse.
→ Treat as entering compounding phase:
• Reduce heavy onboarding; keep lightweight, event-triggered “level-up” hints (parameterization, scheduling, collaboration).
D) If any user shows:
• Decline in reuse, persistent high corrections, or reversion to manual tools.
→ Temporarily tilt back toward example-first for those tasks plus brief exploration tasks aimed at diagnosing mismatch.
Overall rule of thumb:
- First week: classify mainly on diversity, failure tolerance, and help-seeking → choose initial mix.
- Week 2–3: update based on reuse, correction trends, and chaining/abandonment patterns → move high-exploration users toward targeted examples when they plateau, and move high-structure users toward exploration once they have one or two solid reusable workflows.