محمد احمدی صفا

This study examined the effect of rater training on promoting inter-rater reliability in oral language assessment. It also investigated whether rater training and the consideration of the examinees’ expectations by the examiners have any effect on test-takers’ perceptions of being fairly evaluated. To this end, four raters scored 31 Iranian intermediate EFL learners’ oral performance on the speaking module of the IELTS in two stages (i.e. pre- and post-training stage). Furthermore, following Kunnan’s (2004) Test Fairness Framework, a questionnaire on fairness in oral language assessment was developed, and after pilot testing and validating, it was administered to the examinees at both stages. The examinees’ expectations were taken into account in the second round of the speaking test. The results indicated that rater training is likely to promote inter-rater reliability and, in turn, enhances the fairness of the decisions made based on the test scores. It was also concluded that considering students’ expectations of a fair test would improve their overall perceptions of being fairly evaluated. The results of this study sought to provide second language teachers, oral test developers, and oral examiners and raters with useful insights into addressing fairness-related issues in oral assessment.

A major concern of language testing researchers has for long been the identification of construct-irrelevant influential cognitive and psychological bias factors in test takers’ language test performance and recently the identification of the tentative models of interactions among such factors. With the same purpose in mind, the present study investigated the direct and indirect interrelationships among EFL learners’ test anxiety, test-wiseness, reading metacognitive awareness, and reading comprehension test performance through a path analytic research design. To this end and on the basis of the related literature and the previous research findings, first a hypothesized model of the interrelationship among the variables was assumed. Next, 317 undergraduate and graduate students took the related questionnaires and tests. Finally, the obtained data were analyzed through AMOS statistical package and the hypothesized model of the interrelationship among variables was tested. According to the final verified model, test-wiseness directly predicted reading comprehension test performance, while test anxiety did not. Moreover, while reading strategies metacognitive awareness did not directly predict reading comprehension test performance, it was indirectly associated with reading comprehension test performance through the mediation of test-wiseness. In addition, both correlational and path analyses confirmed a strong negative relationship between reading strategies metacognitive awareness, and test anxiety. The findings highlight the importance of the language test takers' less test anxiety and enhanced metacognitive awareness of reading strategies and test-wiseness for their more reliable test-taking performances.