Definition
The degree to which a test or assessment accurately predicts or correlates with real-world performance of the task it is meant to measure. In aviation training, criterion validity means a test result reliably reflects how well the applicant can actually perform the skill in the aircraft.
Plain English
A test has criterion validity when doing well on the test means you can actually do the job, and doing poorly means you cannot. The test result matches real performance.
Context Anchor
Seen in aviation instructor training when comparing course lessons, stage checks, and test items to the skills and knowledge required by the Airman Certification Standards.
Derivation
From Latin criterium, meaning a standard for judging, and validus, meaning strong or sound. Together: 'soundness measured against a standard.' The 'standard' here is real-world performance.
Why Pilots Care
It confirms that passing required tests reflects genuine readiness for safe operations rather than just test-taking skill.
Analogy
A bathroom scale has good criterion validity for body weight, but not for judging whether someone can run safely. In the same way, an aviation test must match the actual flying knowledge or skill being judged.
Grounding Statement
If a student does well on a training evaluation with strong criterion validity, that result should line up with the student’s ability to perform the required aviation task.
Intuition Check
Criterion validity does not mean a test is “valid” simply because it is official or well written. It means the test result matches the outside standard or real task it is meant to judge.
Example Sentence 1
The ACS was designed to improve criterion validity by aligning written test questions with the tasks pilots actually perform in flight.
Example Sentence 2
Strong criterion validity in training standards helps instructors know their students will handle real-world scenarios after certification.