Setting the pass mark
We use the Modified Angoff method to set the pass mark. Several subject matter experts (SMEs) estimate a percentage of minimally competent candidates who would answer the question correctly. The SMEs’ ratings are averaged per question and this average rating is the Angoff score for each question.
The pass mark for the exam is then determined by averaging all Angoff scores for all questions. As a result of this process, the pass mark may vary across years according to the exam difficulty.
Reviewing the exam
We review the exam before results are released. The performance for each question is analysed and the pass mark is reviewed. All analysis is done without identifying candidates.
During this process, questions may be removed from the exam and the pass mark adjusted. Once finalised, candidate results are calculated and final outcomes are assigned.