For interactive visual explanations deployed repeatedly over a course, can we define a small set of course-level progression rules that automatically adjust variable granularity (coarse presets → medium-step sliders → constrained multi-variable control) based solely on simple interaction-trace features (e.g., success on manipulable retention checks, OVAT rate, repeat errors), and does such rule-based progression match the durable learning and far-transfer benefits of hand-tuned, topic-specific progression by expert designers?
interactive-learning-retention | Updated at
Answer
A small course-level rule set that upgrades variable granularity based on simple trace features will likely recover a large fraction, but not all, of the durable-learning and far-transfer benefit of expert hand-tuned progressions. It should work well for many mid-complexity topics and typical learners, but will underperform expert designs on edge-case topics, very fragile novices, and very advanced learners unless instructors override or refine the rules.
A plausible minimal progression policy:
- Start: coarse contrasting presets only.
- Step 1 unlock (medium sliders, 1 variable): triggered when learner shows repeated success on manipulable retention checks at preset states and a modest OVAT rate with low repeat errors.
- Step 2 unlock (constrained 2-variable control): triggered when learner maintains success on mixed single-variable checks and avoids new systematic errors after Step 1.
- Global backoff: if repeat errors spike or checks fail, temporarily step down a level.
Expectation vs expert topic-specific progression:
- Typical domains with similar structural demands (basic functions, kinematics, simple probability): rule-based progression probably comes close to expert progression on delayed, out-of-context retention and yields slightly weaker but still meaningful far transfer.
- Hard, idiosyncratic, or high-dimensional topics with specific misconceptions: experts can time unlocks around those traps; generic rules cannot, so far-transfer gains likely lag.
- Fragile novices and highly exploratory experts: generic thresholds will misclassify some learners; experts can detect and adjust pacing or keep some learners constrained longer.
So: course-level, trace-based progression is worth pursuing as a strong default that captures much of the benefit of fine-grained topic tuning, but key units and edge learner profiles will still need human or more sophisticated adaptive oversight.