Education for Health

ORIGINAL RESEARCH ARTICLE
Year
: 2018  |  Volume : 31  |  Issue : 2  |  Page : 65--71

Choosing medical assessments: Does the multiple-choice question make the grade?


Hannah Pham1, Monique Trigg2, Shaopeng Wu1, Alice O'Connell1, Christopher Harry1, John Barnard2, Peter Devitt1 
1 Department of Surgery, University of Adelaide, Adelaide, South Australia
2 Excel Psychological and Educational Consultancy, Victoria, Australia

Correspondence Address:
Hannah Pham
Adelaide Medical School, University of Adelaide, Adelaide, South Australia 5000
South Australia

Background: The multiple-choice question (MCQ) has been shown to measure the same constructs as the short-answer question (SAQ), yet the use of the latter persists. The study aims to evaluate whether assessment using the MCQ alone provides the same outcomes as testing with the SAQ. Methods: A prospective study design was used. A total of 276 medical students participated in a mock examination consisting of forty MCQs paired to forty SAQs, each pair matched in cognitive skill level and content. Each SAQ was marked by three independent markers. The impact of item-writing flaws (IWFs) on examination outcome was also evaluated. Results: The intraclass correlation coefficient (ICC) was 0.75 for the year IV examinations and 0.68 for the year V examinations. MCQs were more prone to IWFs than SAQs, but the effect when present in the latter was greater. Removal of questions containing IWFs from the year V SAQ allowed 39% of students who would otherwise have failed to pass. Discussion: The MCQ can test higher order skills as effectively as the SAQ and can be used as a single format in written assessment provided quality items testing higher order cognitive skills are used. IWFs can have a critical role in determining pass/fail results.


How to cite this article:
Pham H, Trigg M, Wu S, O'Connell A, Harry C, Barnard J, Devitt P. Choosing medical assessments: Does the multiple-choice question make the grade?.Educ Health 2018;31:65-71


How to cite this URL:
Pham H, Trigg M, Wu S, O'Connell A, Harry C, Barnard J, Devitt P. Choosing medical assessments: Does the multiple-choice question make the grade?. Educ Health [serial online] 2018 [cited 2020 Sep 24 ];31:65-71
Available from: http://www.educationforhealth.net/article.asp?issn=1357-6283;year=2018;volume=31;issue=2;spage=65;epage=71;aulast=Pham;type=0