Search engine for discovering works of Art, research articles, and books related to Art and Culture
Javascript must be enabled to continue!
Comparison of Automatic and Expert Teachers’ Rating of Computerized English Listening-Speaking Test
View through CrossRef
Through Many-Facet Rasch analysis, this study explores the rating differences between 1 computer automatic rater and 5 expert teacher raters on scoring 119 students in a computerized English listening-speaking test. Results indicate that both automatic and the teacher raters demonstrate good inter-rater reliability, though the automatic rater indicates less intra-rater reliability than college teacher and high school teacher raters under the stringent infit limits. There’s no central tendency and random effect for both automatic and human raters. This research provides evidence for the automatic rating reform of the computerized English listening-speaking test (CELST) in Guangdong NMET and encourages the application of MFRM in actual score monitoring.
Title: Comparison of Automatic and Expert Teachers’ Rating of Computerized English Listening-Speaking Test
Description:
Through Many-Facet Rasch analysis, this study explores the rating differences between 1 computer automatic rater and 5 expert teacher raters on scoring 119 students in a computerized English listening-speaking test.
Results indicate that both automatic and the teacher raters demonstrate good inter-rater reliability, though the automatic rater indicates less intra-rater reliability than college teacher and high school teacher raters under the stringent infit limits.
There’s no central tendency and random effect for both automatic and human raters.
This research provides evidence for the automatic rating reform of the computerized English listening-speaking test (CELST) in Guangdong NMET and encourages the application of MFRM in actual score monitoring.
Related Results
Aviation English - A global perspective: analysis, teaching, assessment
Aviation English - A global perspective: analysis, teaching, assessment
This e-book brings together 13 chapters written by aviation English researchers and practitioners settled in six different countries, representing institutions and universities fro...
The Development of English Speaking Proficiency to Increase Students’ Communication Skill in A Business and Technology College
The Development of English Speaking Proficiency to Increase Students’ Communication Skill in A Business and Technology College
English speaking proficiency is very important to participate in the wider world of work. The speaking proficiency is measured in terms of the ability to carry out a conversation i...
The Study of the Effectiveness of Coaching Program for Pre-service Teachers to Communicative Listening-Speaking Skills
The Study of the Effectiveness of Coaching Program for Pre-service Teachers to Communicative Listening-Speaking Skills
This study aimed to investigate the effectiveness of the coaching program in communicative listening-speaking skills for pre-service teachers. The subjects for the study were 20 pr...
Incidental Collocation Learning from Different Modes of Input and Factors That Affect Learning
Incidental Collocation Learning from Different Modes of Input and Factors That Affect Learning
Collocations, i.e., words that habitually co-occur in texts (e.g., strong coffee, heavy smoker), are ubiquitous in language and thus crucial for second/foreign language (L2) learne...
Second Language Listening
Second Language Listening
Listening comprehension plays a key role in both first and second language acquisition, and although out of the four communication skills listening takes up more time than any of t...
ENHANCING STUDENTS’ SPEAKING AND LISTENING SKILLS THROUGH TEAM GAMES: A CREATIVE APPROACH TO LANGUAGE LEARNING
ENHANCING STUDENTS’ SPEAKING AND LISTENING SKILLS THROUGH TEAM GAMES: A CREATIVE APPROACH TO LANGUAGE LEARNING
Language abilities that complement one another include speaking and listening. This study used the team games-based language learning (TG-BLL) paradigm to assist students in develo...
An Analysis of Speaking English Routine on Students’ Competences at Basic Level of Genta English Course Pare-Kediri
An Analysis of Speaking English Routine on Students’ Competences at Basic Level of Genta English Course Pare-Kediri
This study aims at improving the speaking competence of the basic level students of Genta English Course Pare Kediri. Speaking English routine were used in this study. This study i...
Implementando o teste adaptativo computadorizado
Implementando o teste adaptativo computadorizado
Traditionally, the assessment of knowledge consists of items, who students answered the same items at the same time, such as test of a specific subject. This assessment may be cons...