محمدرضا عروجی

Performance testing including the use of rating scales has become highly widespread in the evaluation of second/foreign oral assessment. However, few studies have used a pre-, post-training design investigating the impact of a training program on the reduction of raters’ biases to the rating scale categories resulting in increase in their consistency measures. Besides, no study has used MFRM including the facets of test takers’ ability, raters’ severity, task difficulty, group expertise, scale category, and test version all in a single study. 20 EFL teachers rated the oral performances produced by 200 test takers before and after a training program using an analytic rating scale including fluency, grammar, vocabulary, intelligibility, cohesion and comprehension categories. The outcome of the study indicated that MFRM can be used to investigate raters’ scoring behavior and can result in enhancement in rater training and validating the functionality of the rating scale descriptors. Training can also result in higher levels of interrater consistency and reduced levels of severity/leniency; however, it cannot turn raters into duplicates of one another, but can make them more self-consistent. Training helped raters use the descriptors of the rating scale more efficiently of its various band descriptors resulting in reduced halo effect. Finally, the raters improved consistency and reduced rater-scale category biases after the training program. The remaining differences regarding bias measures could probably be attributed to the result of different ways of interpreting the scoring rubrics which is due to raters’ confusion in the accurate application of the scale.

This study was an attempt to investigate the relationship between test anxiety and writing performance among Iranian intermediate EFL students. To achieve this goal, 50 participants of EFL students (male and female) at Iran, Tehran, were selected on the basis of sampling convenience. The instruments used in this research consisted of the proficiency test and TAQ (Test Anxiety) questionnaire. After homogenizing the students via a proficiency test (Cambridge Placement Test, 2010), those students who were selected as upper-intermediate ones were allowed to take part in this research. Their age range was between 20 and 40. Having collected the results, the researchers recorded the scores in computer files for statistical analysis using the Statistical Package for the Social Sciences (SPSS) version 25.00. In order to measure the relationship between the variables (test anxiety & written performance) Pearson Correlation tests were run. The results illustrated that there were significant relationships between writing performance and text anxiety and all its sub-scales of worry and emotionality. In addition, it was proved that there was not any significant difference between male and female in respect to writing performance. It must be reiterated that a Pearson Correlation test was also run to measure the Inter-Rater Reliability. The results of this study will provide insights to help EFL learners reduce their test anxiety and increase the level of their confidence.