Search engine for discovering works of Art, research articles, and books related to Art and Culture
ShareThis
Javascript must be enabled to continue!

Evaluating Functional and Non-Functional Distractors and Their Relationship with Difficulty and Discrimination Indices in Four-Option Multiple-Choice Questions

View through CrossRef
Multiple-choice questions-one best answer (MCQ-OBA) is the most frequently accepted assessment tool in Iran’s medical universities. Writing functional distractors (FDs) is an important aspect of framing MCQ-OBA. This study aimed to assess FDs and non-functional distractors (NFDs) in MCQ-OBA and the association of distractor efficiency with difficulty and discrimination indices. This cross-sectional study was conducted at the Department of Immunology, the Ahvaz Jundishapur University of Medical Sciences. A total of 734 MCQ-OBA were reviewed, including 2,936 options (2,202 distractors and 734 correct responses). NFDs were defined as options chosen by <5% of examinees. Of the 734 MCQ-OBAs, 265 (36.1%) had 0 NFDs, 231 (31.5%) had 1 NFD, 146 (19.9%) had 2 NFDs, and 92 (12.5%) had 3 NFDs. The Pearson’s correlation showed a significant relationship between the difficulty index and the number of NFDs (r = 0.453; P < 0.0001). However, the correlation between the discrimination index and the number of NFDs was insignificant (r = 0.055; P = 0.135). The findings revealed that NFDs inversely affected the test quality of items. Items with more NFDs were easier and had poorer discriminatory power. The distractor function analysis and revision of NFDs serve as an important method to improve the quality of MCQ-OBA.
Title: Evaluating Functional and Non-Functional Distractors and Their Relationship with Difficulty and Discrimination Indices in Four-Option Multiple-Choice Questions
Description:
Multiple-choice questions-one best answer (MCQ-OBA) is the most frequently accepted assessment tool in Iran’s medical universities.
Writing functional distractors (FDs) is an important aspect of framing MCQ-OBA.
This study aimed to assess FDs and non-functional distractors (NFDs) in MCQ-OBA and the association of distractor efficiency with difficulty and discrimination indices.
This cross-sectional study was conducted at the Department of Immunology, the Ahvaz Jundishapur University of Medical Sciences.
A total of 734 MCQ-OBA were reviewed, including 2,936 options (2,202 distractors and 734 correct responses).
NFDs were defined as options chosen by <5% of examinees.
Of the 734 MCQ-OBAs, 265 (36.
1%) had 0 NFDs, 231 (31.
5%) had 1 NFD, 146 (19.
9%) had 2 NFDs, and 92 (12.
5%) had 3 NFDs.
The Pearson’s correlation showed a significant relationship between the difficulty index and the number of NFDs (r = 0.
453; P < 0.
0001).
However, the correlation between the discrimination index and the number of NFDs was insignificant (r = 0.
055; P = 0.
135).
The findings revealed that NFDs inversely affected the test quality of items.
Items with more NFDs were easier and had poorer discriminatory power.
The distractor function analysis and revision of NFDs serve as an important method to improve the quality of MCQ-OBA.

Related Results

Assessment of Chat-GPT, Gemini, and Perplexity in Principle of Research Publication: A Comparative Study
Assessment of Chat-GPT, Gemini, and Perplexity in Principle of Research Publication: A Comparative Study
Abstract Introduction Many researchers utilize artificial intelligence (AI) to aid their research endeavors. This study seeks to assess and contrast the performance of three sophis...
Generating Distractors for Reading Comprehension Questions from Real Examinations
Generating Distractors for Reading Comprehension Questions from Real Examinations
We investigate the task of distractor generation for multiple choice reading comprehension questions from examinations. In contrast to all previous works, we do not aim at preparin...
TO STUDY OF CHARACTERISTICS OF OBJECTIVE MULTIPLE-CHOICE TEST FOR MEDICAL MODULES
TO STUDY OF CHARACTERISTICS OF OBJECTIVE MULTIPLE-CHOICE TEST FOR MEDICAL MODULES
Background: The objective multiple-choice test is an assessment method that has been applied widely in universities. The meticulous judgment of complication and differentiation lev...
Timing Flickers across Sensory Modalities
Timing Flickers across Sensory Modalities
In tasks requiring a comparison of the duration of a reference and a test visual cue, the spatial position of test cue is likely to be implicitly coded, providing a form of a congr...
Neural correlates of crowding in macaque area V4
Neural correlates of crowding in macaque area V4
AbstractVisual crowding refers to the phenomenon where a target object that is easily identifiable in isolation becomes difficult to recognize when surrounded by other stimuli (dis...
Determination of Difficulty Index in End of Block Examinations of Preclinical Undergraduate Medical Students
Determination of Difficulty Index in End of Block Examinations of Preclinical Undergraduate Medical Students
Background: Multiple Choice Questions (MCQs) are considered a good choice for undergraduate formative assessment as they have higher reliability and are generally feasible. The obj...
Colour Mechanisms Underlying Visual Search with Heterochromatic Distractors
Colour Mechanisms Underlying Visual Search with Heterochromatic Distractors
We studied the colour mechanisms involved in a visual search task. The test stimulus consisted of a coloured target randomly positioned among heterogeneous distractors of two colou...

Back to Top