Search engine for discovering works of Art, research articles, and books related to Art and Culture
Javascript must be enabled to continue!
ChatGPT performance on scenario-based multiple-choice questions (MCQs) in medical physiology
View through CrossRef
Abstract
Background and objective:
With the rapid advancement of artificial intelligence, natural language processing models like ChatGPT have gained prominence in various educational domains. This study investigated the performance of ChatGPT in answering scenario-based multiple-choice questions (MCQs) within the intricate field of medical physiology.
Materials and methods
A comprehensive dataset of 50 scenario based MCQs covering cardiovascular system, respiratory system, Endocrinology, Renal system, central nervous system topics in medical physiology was compiled. ChatGPT was then tested with these questions, and its responses were evaluated based on accuracy and contextual appropriateness. The first response obtained was taken as the final answer for scoring and analysis. If the correct option was chosen by ChatGPT, 1 mark was awarded, and the wrong option was awarded zero mark.
Results
Out of 50 MCQs in various topics in medical physiology, ChatGPT attempted all the MCQs, and total score obtained is 30/50 (60%) marks. ChatGPT performed most accurately in respiratory system MCQs with 70% (7/10) and least accurately in renal system MCQs 50% (5/10).
Conclusion
ChatGPT attempted the scenario based MCQs and attained a satisfactory score.
Title: ChatGPT performance on scenario-based multiple-choice questions (MCQs) in medical physiology
Description:
Abstract
Background and objective:
With the rapid advancement of artificial intelligence, natural language processing models like ChatGPT have gained prominence in various educational domains.
This study investigated the performance of ChatGPT in answering scenario-based multiple-choice questions (MCQs) within the intricate field of medical physiology.
Materials and methods
A comprehensive dataset of 50 scenario based MCQs covering cardiovascular system, respiratory system, Endocrinology, Renal system, central nervous system topics in medical physiology was compiled.
ChatGPT was then tested with these questions, and its responses were evaluated based on accuracy and contextual appropriateness.
The first response obtained was taken as the final answer for scoring and analysis.
If the correct option was chosen by ChatGPT, 1 mark was awarded, and the wrong option was awarded zero mark.
Results
Out of 50 MCQs in various topics in medical physiology, ChatGPT attempted all the MCQs, and total score obtained is 30/50 (60%) marks.
ChatGPT performed most accurately in respiratory system MCQs with 70% (7/10) and least accurately in renal system MCQs 50% (5/10).
Conclusion
ChatGPT attempted the scenario based MCQs and attained a satisfactory score.
Related Results
Exploring Large Language Models Integration in the Histopathologic Diagnosis of Skin Diseases: A Comparative Study
Exploring Large Language Models Integration in the Histopathologic Diagnosis of Skin Diseases: A Comparative Study
Abstract
Introduction
The exact manner in which large language models (LLMs) will be integrated into pathology is not yet fully comprehended. This study examines the accuracy, bene...
Use of Objective Tests in Examining Law Courses at Daystar University
Use of Objective Tests in Examining Law Courses at Daystar University
The use of multiple-choice questions (MCQs) in law schools has not gained widespread acceptance, unlike in medical schools where they enjoy global usage. Law Schools traditionally ...
Assessment of Chat-GPT, Gemini, and Perplexity in Principle of Research Publication: A Comparative Study
Assessment of Chat-GPT, Gemini, and Perplexity in Principle of Research Publication: A Comparative Study
Abstract
Introduction
Many researchers utilize artificial intelligence (AI) to aid their research endeavors. This study seeks to assess and contrast the performance of three sophis...
Emerging Evidence of IgG4-Related Disease in Pericarditis: A Systematic Review
Emerging Evidence of IgG4-Related Disease in Pericarditis: A Systematic Review
Abstract
Introduction
Immunoglobulin G4-related disease (IgG4-RD) is a recently identified immune-mediated condition that is debilitating and often overlooked. While IgG4-RD has be...
ChatGPT Knowledge Evaluation in Basic and Clinical Medical Sciences: Multiple Choice Question Examination-Based Performance
ChatGPT Knowledge Evaluation in Basic and Clinical Medical Sciences: Multiple Choice Question Examination-Based Performance
The Chatbot Generative Pre-Trained Transformer (ChatGPT) has garnered great attention from the public, academicians and science communities. It responds with appropriate and articu...
Medical knowledge of ChatGPT in public health, infectious diseases, COVID-19 pandemic, and vaccines: multiple choice questions examination based performance
Medical knowledge of ChatGPT in public health, infectious diseases, COVID-19 pandemic, and vaccines: multiple choice questions examination based performance
BackgroundAt the beginning of the year 2023, the Chatbot Generative Pre-Trained Transformer (ChatGPT) gained remarkable attention from the public. There is a great discussion about...
AI versus human-generated multiple-choice questions for medical education: a cohort study in a high-stakes examination
AI versus human-generated multiple-choice questions for medical education: a cohort study in a high-stakes examination
Abstract
Background
The creation of high-quality multiple-choice questions (MCQs) is essential for medical education assessments but is resource-...
ChatGPT's Capabilities for Use in Anatomy Education and Anatomy Research
ChatGPT's Capabilities for Use in Anatomy Education and Anatomy Research
Dear Editors,
Recently, the discussion of an artificial intelligence (AI) - fueled platform in several articles in your journal has attracted the attention of many researchers [1, ...