Tomorrow Ready · Evaluating AI Output

Before the Method, the Judgement

Evaluation Gate — Mathematics Years 11–13
Subject adaptation · Years 11–13 · Mathematics and Statistics · Field-Based STEM · Tony Jones
A correct answer reached through a method the student cannot justify is not evidence of statistical reasoning. It is evidence that a method was available.
Phase 1
Candidates Named
Phase 2
Criterion Set
Phase 3
Method Justified
Phase 4
Calculation Begins

The Strategy

  1. Before any tool or calculation begins, students name two or three candidate methods that could address the problem.
  2. Students identify one criterion for choosing between them, such as fit to the data type, assumptions met, or appropriateness to the question asked.
  3. Students compare each candidate against that criterion in writing, in two or three sentences per method.
  4. Students justify their final method choice before any calculation or tool use begins.
  5. The justification is timestamped and assessed as process evidence alongside the final statistical analysis.

In Practice

Statistical Investigation
Before analysing a dataset, students name candidate summary or inferential methods, choose one criterion (such as distribution shape), and justify their selection before running any calculation.
Probability Modelling
Students name two candidate models for a scenario, justify which assumptions each requires, and commit to one before generating any simulation or calculation.
Bivariate or Time Series Analysis
Students weigh candidate relationships or trend models against a named criterion before fitting any line or model, then justify the final choice in writing.

Implementation Notes

Decision Checkpoint
The gate closes the moment a tool or calculation opens. A justification written after the analysis has already run is a rationalisation, not evidence.
Teacher Judgement Note
A correct final method choice is not the marker of quality here. A clearly reasoned wrong choice shows more statistical thinking than an unexplained right one.
Related Frameworks
Position First Protocol · Verification Slip · Trace Map
Tony Jones · Founder, Field-Based STEM · Tomorrow Ready Resources · Free to use and share