محمد احمدی صفا

This study examined the effect of rater training on promoting inter-rater reliability in oral language assessment. It also investigated whether rater training and the consideration of the examinees’ expectations by the examiners have any effect on test-takers’ perceptions of being fairly evaluated. To this end, four raters scored 31 Iranian intermediate EFL learners’ oral performance on the speaking module of the IELTS in two stages (i.e. pre- and post-training stage). Furthermore, following Kunnan’s (2004) Test Fairness Framework, a questionnaire on fairness in oral language assessment was developed, and after pilot testing and validating, it was administered to the examinees at both stages. The examinees’ expectations were taken into account in the second round of the speaking test. The results indicated that rater training is likely to promote inter-rater reliability and, in turn, enhances the fairness of the decisions made based on the test scores. It was also concluded that considering students’ expectations of a fair test would improve their overall perceptions of being fairly evaluated. The results of this study sought to provide second language teachers, oral test developers, and oral examiners and raters with useful insights into addressing fairness-related issues in oral assessment.

The identification of the cognitive, affective, social and even physiological factors affecting second or foreign language learning routes and rate has for long been a challenging aspiration for second language researchers. However, a recent preoccupation of the researchers in this area has been the study of the combinatorial impacts of such factors on second or foreign language learning processes and products. As a partial undertaking in this regard, this study investigated the relations pattern among some psychological and cognitive variables and foreign language learning achievement rate. The studied factors were self-regulation, goal-orientation, tolerance of ambiguity, and autonomy on the one hand and English as Foreign Language (EFL) learners’ ultimate achievement on the other hand. To this end, 250 Iranian BA level EFL students majoring English literature or English translation were selected based on convenience sampling procedure. Next, having obtained the participants' informed consent to participate in the study, the researchers administered Trait Self-Regulation Questionnaire (TSRQ), Goal Orientation, Tolerance of Ambiguity, and Learner Autonomy scales to them. In addition, concerning their L2 achievement rate measure, their BA level general English courses' GPA was obtained from the education office of the related universities. The data were statistically analyzed and the hypothetical model of interrelations among the given variables was tested using Structural Equation Modeling procedures. The results indicated that goal orientation and self-regulation significantly predicted L2 achievement; however, tolerance of ambiguity and learner autonomy were not found as strong predictors of L2 achievement. On the other hand, while self-regulation strongly predicted goal orientation, it was not verified to be a strong predictor of tolerance of ambiguity. The results also showed that goal orientation could strongly predict learner autonomy. A ready-made implication of the findings might be that the combinatorial effects of the psychological variables on cognitive processes like second language learning is quite complicated and different from the effects of each individual variable.      

A major concern of language testing researchers has for long been the identification of construct-irrelevant influential cognitive and psychological bias factors in test takers’ language test performance and recently the identification of the tentative models of interactions among such factors. With the same purpose in mind, the present study investigated the direct and indirect interrelationships among EFL learners’ test anxiety, test-wiseness, reading metacognitive awareness, and reading comprehension test performance through a path analytic research design. To this end and on the basis of the related literature and the previous research findings, first a hypothesized model of the interrelationship among the variables was assumed. Next, 317 undergraduate and graduate students took the related questionnaires and tests. Finally, the obtained data were analyzed through AMOS statistical package and the hypothesized model of the interrelationship among variables was tested. According to the final verified model, test-wiseness directly predicted reading comprehension test performance, while test anxiety did not. Moreover, while reading strategies metacognitive awareness did not directly predict reading comprehension test performance, it was indirectly associated with reading comprehension test performance through the mediation of test-wiseness. In addition, both correlational and path analyses confirmed a strong negative relationship between reading strategies metacognitive awareness, and test anxiety. The findings highlight the importance of the language test takers' less test anxiety and enhanced metacognitive awareness of reading strategies and test-wiseness for their more reliable test-taking performances.