article_11-1024x572 Can You Actually Prove Competency? Introducing the Evidence Maturity Model.

A practical framework for understanding where your learning evidence is now and where it needs to go.

Here is a question worth sitting with.

Pick the most important training program in your organisation. The one that carries the most regulatory weight, the most workplace safety consequence, or the most significant impact on the people going through it.

Now imagine someone walks in today and asks you to prove that every person who completed that program is genuinely competent. Not that they enrolled. Not that they finished the course. That they can actually do the thing.

What would you be able to show them?

For some organisations, the answer is straightforward. The evidence is structured, connected, and ready to produce. For many others, the honest answer sits somewhere between uncomfortable and uncertain. Not because the training is poor. Not because the assessors are not doing their jobs. But because the systems around the evidence were not set up with that question in mind.

That is the gap the Evidence Maturity Model is designed to help you see clearly.

What the model is

The Evidence Maturity Model is a five-level framework for understanding how well an organisation captures, holds, and uses evidence of competency.

It is not a compliance checklist. It is not a technology roadmap. It is a practical lens for assessing where your organisation currently sits, and what the next step looks like from there.

Each level describes a real organisational state. Most organisations will recognise themselves immediately in one of them. Many will find that different parts of their training portfolio sit at different levels, which is normal and worth knowing.

The model is deliberately broad. It applies equally to registered training organisations working under regulatory frameworks, corporate L&D teams managing workforce capability, and any organisation where a competency decision has real consequences for safety, performance, or compliance.

Level 1: Completion is the record

At Level 1, the training record and the completion record are the same thing. Someone enrolled, someone finished, a certificate was issued. The LMS shows a tick and a date.

There is no evidence of what was learned or demonstrated. There is no link to performance criteria. The record tells you the training event occurred. It tells you nothing about what happened as a result.

Most organisations have more of their training portfolio sitting at Level 1 than they realise. For low-stakes awareness training, that may be proportionate. The problem is when Level 1 evidence is used to support high-stakes decisions about competency, authorisation, or qualification.

The tell-tale sign: When asked to prove competency, the first response is to pull a completion report.

Level 2: Assessment exists but the record does not hold together

At Level 2, genuine assessments are happening. Trainers are observing performance, reviewing evidence, and making professional judgements. The assessment is real.

But the record of that assessment is fragmented. Paper checklists in filing cabinets. Scanned forms in shared drives. Assessor notes that never made it into any formal system. The decision was sound. The evidence that informed it does not connect back to the decision in any coherent or auditable way.

Level 2 is where a significant number of organisations currently sit. The assessment practice is solid. The evidence infrastructure is not. And when a trainer leaves, the knowledge of what actually happened often leaves with them.

The tell-tale sign: When asked to produce an assessment record, the response is “let me chase that up” rather than “let me pull that record.”

Level 3: Connected evidence

At Level 3, assessment evidence is captured digitally and linked to the competency decision at the moment it is made. The record holds together. An auditor can look at a learner’s file and see not just that a decision was made, but what evidence was reviewed, which criteria were assessed, who conducted the assessment, and when.

This is a meaningful step forward. The fragmentation problem is solved. The audit question is answerable. The limitation at Level 3 is typically portability: the evidence record lives inside a specific platform, and changing that platform means a migration project.

Level 3 organisations have solved the audit problem. They have not yet solved the architecture problem.

The tell-tale sign: You can produce a clean evidence record on demand, but the thought of changing platforms makes you nervous about the historical data.

Level 4: Interoperable and portable data

At Level 4, the evidence record lives in a Learning Record Store that sits outside any single platform. xAPI is being used to capture structured learning experience data from multiple sources: the LMS, the assessment tool, the workplace observation workflow, the simulation environment.

The record is not owned by a vendor. It is owned by the organisation. When platforms change, the data stays. When new tools are added, they write to the same store. The learning record is genuinely portable and durable, and the question “show me the evidence for this cohort” is answered by a query, not a search.

At Level 4 the architecture becomes a genuine organisational asset, not just an administrative function.

The tell-tale sign: Changing your LMS is an operational decision, not a data crisis.

Level 5: Insight drives action

Level 5 is where the data starts working for the organisation rather than just documenting what happened.

The rich, structured, interoperable evidence record built at Level 4 is being actively interrogated. Assessor consistency is tracked across sites and cohorts. Capability gaps are surfaced before they become performance or safety issues. Learning pathways are adjusted based on evidence of what is and is not working.

AI tools at Level 5 are genuinely useful because they are working with meaningful, contextual data rather than completion flags. The learning record is not a compliance artefact. It is a strategic asset that informs decisions about workforce capability.

The tell-tale sign: Your learning data is informing decisions about workforce capability, not just confirming that training occurred.

A few honest notes about the model

Most organisations are not at a single level across the board. High-stakes compliance training might sit at Level 3 while mandatory induction sits at Level 1. That is not a failure. The goal is to ensure the level of evidence is proportionate to the stakes involved.

Moving from Level 1 to Level 5 does not happen in a single project. The organisations that get there do it incrementally, starting with one use case that matters, building the evidence practice around it, and expanding from there.

And Level 5 is not a final destination. The regulatory environment, the technology landscape, and the expectations around capability evidence are all continuing to evolve. The goal is an evidence infrastructure that can keep pace with that evolution, not one that arrives somewhere and stops.

Where to start

The model is only useful if the starting point is honest.

Go back to the program you picked at the beginning of this article. Apply the five levels. Ask where the evidence currently sits, not where the policy says it should sit.

That gap between the policy and the reality is where the work begins.

The next articles in this series will go deeper on each level: what moving from one to the next actually looks like in practice, what tools and decisions are involved, and where organisations most commonly get stuck.

Leave a Reply

Your email address will not be published. Required fields are marked *

Are you human? Please solve:Captcha


© The Digital Learning Guy | xapi.com.au
ABN 364 4183 4283