How to Measure Learning Outcomes in EdTech Products

To measure learning outcomes in an EdTech product, define the specific knowledge or skill your product improves, measure it before and after use with a consistent instrument, and separate genuine learning gains from engagement metrics like time on task. Outcome evidence — not usage data — is what convinces schools, buyers, and investors.

Why engagement metrics aren't enough

Daily active users, session length, and completion rates tell you people use your product; they don't tell you anyone learned anything. Education buyers know this. A procurement lead comparing two products will discount "students love it" in favour of "students improved by X on this measure". Engagement metrics still matter — no one learns from a product they abandon — but they're a precondition for impact, not proof of it.

Step 1: Define the outcome precisely

"Improves maths" is not measurable; "improves fluency in single-digit multiplication for Year 3 pupils" is. A good outcome definition names the learner group, the specific skill or knowledge, and the timeframe. This is the logic-model work UCL EdTech Labs founders do in Stage 1 of the accelerator: getting crystal clear on who you serve and how you'll measure success.

Step 2: Choose a credible measure

• Existing validated assessments — standardised tests or published instruments are most credible because no one suspects you designed them to flatter your product
• Curriculum-aligned tasks — teacher-marked work aligned to the curriculum, marked consistently before and after
• In-product measures — useful for rapid iteration, but treat them as internal signals unless they're validated against external measures

Step 3: Compare against something

A before/after gain means little on its own — students improve over a term anyway. Credibility comes from comparison: a comparable class not using the product, a waitlist group that starts later, or published norms for expected progress. You don't need a full randomised trial to start; you need an honest answer to "compared to what?". Our guide to running EdTech pilots covers how to structure this in a real school.

Step 4: Report the metrics that matter to each audience

• Schools and teachers care about learning gains, time saved, and fit with their curriculum and safeguarding requirements
• Investors care about impact metrics tied to growth — retention driven by results, procurement wins driven by evidence
• Your own team needs leading indicators: which features correlate with the outcome gains you've validated

Turning validated outcomes into an investor-ready story is exactly what Stage 4 of the accelerator covers — impact metrics that matter, wrapped in a narrative that lands. Independent frameworks help too: UCL EdTech Labs' delivery partner EdTech Impact provides independent reviews that help schools compare and trust products.

Common pitfalls

• Claiming causation from correlation ("our users score higher" — did stronger students self-select?)
• Measuring immediately after use only — learning that doesn't persist isn't learning
• Reporting only the average — check whether gains hold across learner groups
• Changing the measure between studies so results can't be compared

For the foundations behind all of this, start with what is evidence-based EdTech?