I don't think it will change the pass rates that much. Two reasons:
1) With 240 questions at L1, 120 questions at L2, and 60 questions at L3, you have to be AWFULLY lucky to get 60%+ by simple guessing. Marginal candidates will have a slight advantage, perhaps, but most of us are by definition NOT marginal candidates.
2) The Angoff method of setting the minimum passing score will probably take into account the smaller number of answers. This will essentially push up the minimum passing score, because the method will probably assume that a large number of "minimally qualified candidates" will get the answer right. As a result, the overall pass rates will not change all that much.
There will definitely be an initial perception that the exam is easier because of having only three choices. However, if we see similar failure rates on a test that has 3-choice answers, maybe it will seem even more dramatically difficult to the public.
I just wonder how the 3-answer format is going to work with the two-fer questions like:
Is knowing the answer a violation, and is writing down the answer a violation.
Violation, Violation
No Violation, Violation
Violation, No Violation
No Violation, No Violation
How are they going to put those into a three-answer form?
Edited 1 time(s). Last edit at Monday, December 1, 2008 at 05:16PM by bchadwick.