When onboarding systems dynamically choose between “example-first” scaffolds (rich galleries, prebuilt flows) and “exploration-first” scaffolds (guided free-form prompting, sandbox tasks), which observable early behaviors—like diversity of attempted tasks, tolerance for failure, or frequency of help-seeking—best predict which scaffold mix will minimize time to first durable workflow maturity without inducing an earlier productivity plateau, and how should those behavior-based assignments be updated after the first 2–3 weeks of usage?

anthropic-learning-curves | Updated at

Answer

Early behaviors that best predict scaffold mix:

  1. High-exploration profile → start exploration-first, sprinkle examples
  • Signals in first 3–5 active days: • High task diversity: many distinct tasks/tools per session.
    • High failure tolerance: frequent retries/variants after bad outputs.
    • Low persistent help-seeking: uses help/examples briefly, then returns to free-form.
  • Recommended mix: • Default: guided free-form prompt surface + light guardrails.
    • Inline examples at task-time, not heavy galleries.
    • Early “save as workflow” nudges once the same pattern appears ≥3 times.
  • Rationale: they learn by probing; too many examples risks premature lock‑in and early plateau.
  1. High-structure-seeking profile → start example-first, with gradual un-locking
  • Signals in first 3–5 active days: • Low task diversity: stays near 1–2 task types.
    • Low failure tolerance: abandons after 1–2 bad runs; few variants.
    • High help-seeking: browses galleries/docs; uses suggested prompts heavily.
  • Recommended mix: • Default: curated example sets and prebuilt flows for common tasks.
    • Gentle prompts to tweak parameters, then to duplicate/modify flows.
    • Later introduction of sandboxes once they reach independent execution on one reusable workflow.
  • Rationale: they need scaffolds to reach a first durable win; pure exploration leads to churn.
  1. Import-heavy / prior-skill profile → workflow-conversion-first
  • Signals: • Long, structured pasted prompts; low in-session editing (cf. cross-ecosystem patterns).
    • Early task cadence visible (similar prompt used across days).
  • Recommended mix: • Tools to convert pasted prompts into reusable workflows.
    • Example-first only around decomposition and parameterization, not basic prompting.
    • Exploration-first space for testing variants of their imported flows.

Assignment updates after 2–3 weeks

Use mid-curve shifts and reuse patterns to re-classify:

A) If an exploration-first user shows: • 1–2 workflows with stable reuse, but rising same-step corrections or bypasses (plateau signals).
• Little movement toward parameterization or chaining.
→ Increase example-first elements around their actual tasks: • Show task-specific exemplars and alternative decompositions.
• Offer micro-tutorials and upgrade wizards on brittle steps.
• Keep free-form available for new tasks.

B) If an example-first user shows: • Stable reuse of at least one workflow with falling corrections.
• Direct invocation of workflows with reduced help-seeking.
→ Shift toward more exploration-first: • Introduce sandboxes seeded from their existing flows.
• Nudge them to generalize flows to nearby tasks (clone-and-edit, small parameter changes).

C) If any user shows: • Abandonment of early workflows with migration to better ones and lower corrections.
• Emergence of multi-step chains and cross-document reuse.
→ Treat as entering compounding phase: • Reduce heavy onboarding; keep lightweight, event-triggered “level-up” hints (parameterization, scheduling, collaboration).

D) If any user shows: • Decline in reuse, persistent high corrections, or reversion to manual tools.
→ Temporarily tilt back toward example-first for those tasks plus brief exploration tasks aimed at diagnosing mismatch.

Overall rule of thumb:

  • First week: classify mainly on diversity, failure tolerance, and help-seeking → choose initial mix.
  • Week 2–3: update based on reuse, correction trends, and chaining/abandonment patterns → move high-exploration users toward targeted examples when they plateau, and move high-structure users toward exploration once they have one or two solid reusable workflows.