Is Your Assessment Testing the Right Skill?

You have designed an assessment to test a specific piece of subject knowledge or a vocational skill. But what if the task is accidentally testing something else entirely - like a learner's reading speed, digital prowess, or cultural background? This is 'task contamination', and it undermines the validity of your assessment outcomes.

Task contamination occurs when unintended barriers within an assessment prevent learners from demonstrating their true competence in the target skill. It leads to inaccurate judgements of achievement and can create significant disadvantages for some learners. Recognising and removing these hidden hurdles is crucial for fair and effective assessment practice.

Spotting Unintended Hurdles

Contamination can creep into tasks in several ways. The key is to look at the assessment not just from your expert perspective, but from the perspective of a learner who may not share your assumptions. Common culprits include:

• Overly Complex Language: When instructions, scenarios, or questions use jargon, complex sentence structures, or vocabulary that is more advanced than the subject matter itself. This risks turning a practical skills test into a high-level reading comprehension exam.
• Assumed Digital Proficiency: A task that requires learners to use unfamiliar software, navigate a complex VLE interface, or format a document in a specific way may be assessing their IT skills more than their subject knowledge. Unless digital skills are an explicit learning outcome, the technology should be an invisible facilitator, not an obstacle.
• Implicit Contextual Knowledge: Scenarios or questions that rely on specific life experiences, cultural references, or workplace contexts that have not been explicitly taught. This can disadvantage learners from different backgrounds who may not grasp the assumed context.
• Poor Formatting and Layout: A cluttered page, an illogical flow of questions, a hard-to-read font, or instructions separated from the main task can test a learner's ability to decipher a confusing document, rather than their actual knowledge and skills.

The Impact on Achievement and Inclusion

Task contamination isn't just a minor design flaw - it has a direct, negative impact on key areas of your provision. It systematically distorts your understanding of learner progress and undermines your commitment to inclusion.

At a provision-type level, it corrupts your assessment of Achievement. If a capable learner fails because they couldn't understand the convoluted instructions, your data will wrongly suggest they haven't made progress. This leads to inaccurate judgements about the quality of your provision and could trigger unnecessary interventions.

At a whole-provider level, it is an Inclusion issue. Contaminated tasks create inequitable barriers. A learner with dyslexia may be penalised by overly complex text, a learner with a processing disorder may struggle with a confusing layout, and an EAL learner may be blocked by culturally specific idioms. A truly inclusive provider works to dismantle these barriers, not build them into its assessment tools.

How to Decontaminate Your Assessments

Ensuring your assessments are clean and focused is an essential part of the quality cycle. It requires a proactive and collaborative approach.

• Peer Review with a 'Contamination' Lens: Before you use an assessment, ask a trusted colleague - ideally from a different subject area - to try it. If they stumble over the wording, the instructions, or the technology, it's a clear red flag that your learners will too.
• Separate the Skills: If you need to assess both vocational competence and a wider skill like report writing, consider doing it separately or being very explicit. For example, you could provide a clear template for the report, so you are only assessing the quality of its content, not the learner's formatting ability.
• Pilot and Gather Learner Feedback: Test a new assessment type with a small group of learners in a low-stakes environment. Ask them directly: 'Was any part of this confusing?' or 'Did anything get in the way of you showing what you know?'. Their feedback is invaluable.
• Write in Plain English: Prioritise clarity and simplicity in all instructions and questions. Avoid ambiguity and use direct language. Run your text through a readability checker to ensure it is accessible. This isn't about 'dumbing down' the task; it's about ensuring the challenge is in the subject, not the sentence structure.

Where this fits in QualityHero

Designing, reviewing, and standardising assessments to ensure they are valid, reliable, and free from contamination is a core quality assurance process. You can build these checks into your standardisation or course review workflows using the Toolkit Areas module to document your process. Evidencing how you ensure fair assessment contributes directly to evaluations of 'Curriculum, teaching and training' and 'Achievement' at the provision-type level, and demonstrates a proactive approach to 'Inclusion' at the whole-provider level.