Towards quality in multiple-choice assessment

St Hill, Rod and Carmichael, Colin (2006) Towards quality in multiple-choice assessment. International Journal of Business and Management Education, Special Issue. pp. 33-47. ISSN 1832-0236

Abstract

To many researchers in the area of teaching and learning, the above title may be an oxymoron. However, the use of multiple-choice in assessment programs has been and continues to be a popular choice amongst academics in the tertiary sector. Anecdotal evidence suggests that, while academics using multiple-choice tests may check the overall associated mark distribution for a test, few check its psychometric properties (for example, test reliability) and fewer still check the psychometric properties of the items within the test. The building blocks of quality multiple-choice tests are quality multiple-choice items. The psychometric quality of an item can be determined in part through an assessment of its ability to discriminate adequately between students of high and low ability. In a pilot study of three Faculty of Business courses at the University of Southern Queensland, statistical tests associated with the application of Rasch models to multiple-choice test results were used to identify items that failed to discriminate between students of high and low ability. This article reports on the findings of this study, discusses the consequences of using items with low discrimination and examines simple precautions that academics can take in order to avoid using such items.


Statistics for USQ ePrint 15189
Statistics for this ePrint Item
Item Type: Article (Commonwealth Reporting Category C)
Refereed: Yes
Item Status: Live Archive
Faculty / Department / School: Historic - Faculty of Business - No Department
Date Deposited: 30 Nov 2007 11:47
Last Modified: 26 Feb 2018 04:20
Uncontrolled Keywords: multiple-choice items; Rasch models; quality assessment
Fields of Research : 13 Education > 1301 Education Systems > 130103 Higher Education
15 Commerce, Management, Tourism and Services > 1503 Business and Management > 150313 Quality Management
13 Education > 1303 Specialist Studies in Education > 130303 Education Assessment and Evaluation
Socio-Economic Objective: C Society > 93 Education and Training > 9301 Learner and Learning > 930101 Learner and Learning Achievement
URI: http://eprints.usq.edu.au/id/eprint/15189

Actions (login required)

View Item Archive Repository Staff Only