Is Your Quality Improvement Plan Working?

A well-written Quality Improvement Plan (QIP) is a cornerstone of effective quality assurance. But its value is not in the document itself - it's in the tangible, positive impact it has on the learner and apprentice experience. Too often, we focus on completing the actions on the plan, without rigorously checking if they have actually led to the intended improvement.

Evaluating impact moves your quality cycle from a compliance-driven task to a powerful engine for genuine enhancement. It answers the critical question: 'So what?'

Define Your Success Criteria First

Before you can measure impact, you must define what success looks like. For every action on your QIP, you need to be clear about the specific, measurable change you expect to see. This should be done before the initiative is even launched.

Link to an evaluation area: Explicitly connect the QIP action to a whole-provider or provision-type evaluation area, such as 'Achievement' or 'Participation and development'.
Describe the desired outcome: What will be different for learners and apprentices? For example, instead of 'Deliver CPD on questioning', the outcome is 'Learners will consistently be challenged to think more deeply and make connections in their learning'.
Identify key indicators: Determine the evidence you will look for. This should be a mix of quantitative data (e.g., attendance figures, achievement rates) and qualitative evidence (e.g., feedback from focus groups, examples from learner work).
Establish a baseline: Know your starting point. You cannot measure progress without understanding where you began. What does your baseline data and evidence tell you?

Gather a Range of Impact Evidence

To build a convincing picture of impact, you must look beyond a single source of evidence. Relying solely on achievement data, for example, may not tell you why a change has occurred. Effective evaluation requires triangulation from multiple perspectives.

First-hand observation: What does the initiative look like in practice? Use professional conversations, joint activity, and observation of teaching, training and assessment to see the change in action.
Learner and apprentice voice: Systematically gather feedback through surveys, focus groups, and informal conversations. Are learners and apprentices noticing a difference? Does it feel like an improvement to them?
Stakeholder feedback: Engage with employers, parents (where appropriate), and other strategic partners. Are they seeing improvements in the skills, knowledge, and professional behaviours of your learners and apprentices?
Performance data: Analyse your provider's data through the lens of your QIP action. Look for trends in retention, attendance, achievement, and positive destinations, paying close attention to different learner groups.

Assess Typicality, Not Anecdotes

A successful pilot in one department is a great start, but the goal of a QIP is usually broader, systemic improvement. Your evaluation must determine if the positive impact is 'typical' across the intended area, whether that's a whole provision-type or the entire organisation.

Sample evidence broadly: Ensure your evidence gathering (e.g., learning walks, scrutiny of work, professional conversations) covers different curriculum areas, sites, and modes of delivery.
Analyse by learner group: Disaggregate your data. Has the initiative benefited all learners and apprentices, including those with high needs or from disadvantaged backgrounds? This is a key aspect of inclusion.
Talk to a range of staff: Are new approaches and strategies being implemented consistently by all relevant staff, including part-time and temporary colleagues? Do they understand the 'why' behind the change?

Analyse, Document, and Act

The evaluation process is not complete until the findings are analysed and used to inform your next steps. This closes the loop on the quality cycle, ensuring that improvement is continuous and evidence-led.

Schedule review points: Build impact reviews into your annual quality calendar. This ensures evaluation is a planned process, not an afterthought.
Distinguish evidence from judgement: Document your evidence clearly, then provide a concise analysis of what it means. State plainly whether the action had the desired impact, a partial impact, or no impact.
Learn from what didn't work: A failed initiative is a learning opportunity. Being honest about what isn't working and understanding why is a sign of a mature quality culture.
Feed into your SAR: Use your impact evaluations as the evidence base for your Self-Assessment Report (SAR), creating a clear and credible narrative of your improvement journey.

Where this fits in QualityHero

Evaluating impact is a core function within QualityHero. The QIP module allows you to log not just actions and responsibilities, but also the evidence and analysis of their impact. This evidence can be triangulated from sources gathered in Toolkit Areas, which helps you assess typicality across provision types. The analysed findings then form the backbone of your evidence-based narrative in the SAR module, while Leadership Reports can visualise key performance data over time to demonstrate measurable improvement.