Search engine for discovering works of Art, research articles, and books related to Art and Culture
Javascript must be enabled to continue!
Factors Affecting Chinese Raters’ Rating of High-Stakes English Exam Essays
View through CrossRef
AbstractThis study consists of two questionnaire surveys conducted in two stages to investigate factors that high-stakes exam essay raters believe to affect their rating behavior. Raters were all university Chinese teachers of English majors. Seventy-three participants in stage one and 75 in stage two responded to the same questionnaire. Both exploratory factor analysis and confirmatory factor analysis were used in data analysis. Results showed that there were generally six broad factors interfering with the rating process: rating scale, rater training, rating supervision, rater characteristics, eye-catching text features and rating condition. The interaction of those factors reflected the tension between the constraints executed by the test institution and raters’ own knowledge and understanding of essay rating. This study may shed light on measures taken to improve essay rating quality.
Title: Factors Affecting Chinese Raters’ Rating of High-Stakes English Exam Essays
Description:
AbstractThis study consists of two questionnaire surveys conducted in two stages to investigate factors that high-stakes exam essay raters believe to affect their rating behavior.
Raters were all university Chinese teachers of English majors.
Seventy-three participants in stage one and 75 in stage two responded to the same questionnaire.
Both exploratory factor analysis and confirmatory factor analysis were used in data analysis.
Results showed that there were generally six broad factors interfering with the rating process: rating scale, rater training, rating supervision, rater characteristics, eye-catching text features and rating condition.
The interaction of those factors reflected the tension between the constraints executed by the test institution and raters’ own knowledge and understanding of essay rating.
This study may shed light on measures taken to improve essay rating quality.
Related Results
Aviation English - A global perspective: analysis, teaching, assessment
Aviation English - A global perspective: analysis, teaching, assessment
This e-book brings together 13 chapters written by aviation English researchers and practitioners settled in six different countries, representing institutions and universities fro...
Eastern Samar State University Student Application and Exam Results Tracking System
Eastern Samar State University Student Application and Exam Results Tracking System
Introduction: Information technology has greatly improved education by making transactions faster, more accurate, and efficient. An exam result management system benefits both scho...
Registered report: Social face evaluation: ethnicity-specific differences in the judgement of trustworthiness of faces and facial parts
Registered report: Social face evaluation: ethnicity-specific differences in the judgement of trustworthiness of faces and facial parts
Abstract
Social face evaluation is a common and consequential element of everyday life based on the judgement of trustworthiness. However, the particular facial reg...
Comparison of Automatic and Expert Teachers’ Rating of Computerized English Listening-Speaking Test
Comparison of Automatic and Expert Teachers’ Rating of Computerized English Listening-Speaking Test
Through Many-Facet Rasch analysis, this study explores the rating differences between 1 computer automatic rater and 5 expert teacher raters on scoring 119 students in a computeriz...
Construction and Validation of “Abisus Scale”: A Tool for Assessing Examination Fear Among University Students
Construction and Validation of “Abisus Scale”: A Tool for Assessing Examination Fear Among University Students
In this study, we aimed to construct and validate the "Abisus scale", a new tool for assessing exam fear among
university students.A set of questions addressed the physical, emotio...
Marathon, Hurdling, or Sprint? The Effects of Exam Scheduling on Academic Performance
Marathon, Hurdling, or Sprint? The Effects of Exam Scheduling on Academic Performance
Abstract
Would you prefer a tighter or a more prolonged exam schedule? Would you prefer to take an important exam first or last? We exploit quasi-random variation in...
The Effects of Probabilistic Forecasts and Stakes on Electoral Participation in an Exterminal Setting
The Effects of Probabilistic Forecasts and Stakes on Electoral Participation in an Exterminal Setting
This study looks at the effect of probabilistic forecasts and policy stakes on vote intention in an experimental setting. This study examined stakes and forecasts through exposing ...
OSCE: An Effective Tool of Assessment for Medical Students
OSCE: An Effective Tool of Assessment for Medical Students
Background: To assess the competency of a student different tools are used. Since its introduction in 1975 by Dr. Harden and his team, OSCE has gained tremendous strides to assess ...