درخت حوزه‌های تخصصی

Using a mixed methods design, the present study attempted to identify the factors influencing Iranian untrained EFL raters in rating group oral discussion tasks. To fulfil this aim, 16 language learners of varying proficiency levels were selected and randomly assigned to groups of four and performed a group discussion task. Thirty two untrained raters were also selected based on their volunteer participations. They listened to the audio files of the group discussions and assigned a score of one to six to each language learners based on their own judgments. They also provided comments on each language learners’ performance pointing to why they assigned such scores. The researchers had an interview with the raters after the rating session as well. The quantitative phase investigated whether linguistic features of accuracy, fluency, complexity and amount of talk were attended to by the raters in terms of having any relationship to the scores the raters assigned. Speech rate as an index of fluency and amount of talk turned out to be significantly correlated with the scores. Of more importance was the qualitative phase with the aim of identifying other factors that may account for the scores. The comments provided by the raters on each score and the interviews were codified based on Content Analysis (CA) approach. It was found that the raters attend not only to the linguistic features in rating oral group discussions, but they are also sensitive to the interactional features like the roles the participants take in groups tasks and the overall interaction patterns of the groups. The findings of this study may shed light on group oral assessment in terms of training the raters rating group oral tests and developing rating scales specific for group oral assessment.

The present study examines the role of gender in reading comprehension of short stories taught through awareness-raising among Iranian EFL learners. In so doing, twelve male and eighteen female learners with lower intermediate English proficiency were selected as the research sample. Next, they were randomly divided into two fifteen-member groups (i.e., a control group and an experimental group). The control group followed the conventional methods and the experimental group was taught the same short stories using awareness-raising activities. Consequently, an independent sample t-test was run. The obtained results indicate the experimental group demonstrates a better performance than the control one. According to the means, the female learners in both groups outperformed the male ones. 

In this study, the researcher used the many-facet Rasch measurement model (MFRM) to detect two pervasive rater errors among peer-assessors rating EFL essays. The researcher also compared the ratings of peer-assessors to those of teacher assessors to gain a clearer understanding of the ratings of peer-assessors. To that end, the researcher used a fully crossed design in which all peer-assessors rated all the essays MA students enrolled in two Advanced Writing classes in two private universities in Iran wrote. The peer-assessors used a 6-point analytic rating scale to evaluate the essays on 15 assessment criteria. The results of Facets analyses showed that, as a group, peer-assessors did not show central tendency effect and halo effect; however, individual peer-assessors showed varying degrees of central tendency effect and halo effect. Further, the ratings of peer-assessors and those of teacher assessors were not statistically significantly different

Although investigating the factors that influence test scores is important, a majority of stakeholders show a paucity of attention towards individual learner differences due to having large classes of L2 learners. This study sought to explore the possible effect of working memory and cognitive style on L2 learners’ metaphorical test performance. The study was conducted in 2 phases. The first phase was quantitative, and the second consisted of a series of case studies using “think-aloud protocol” and “retrospection.” In the statistical phase, aimed at shedding light on the effect of the cognitive style of field (in)dependence (FI/FD) on metaphorical test performance, 80 senior undergraduates majoring in English Translation were selected through a truncated test of TOEFL adopted from Barron (2004). Metaphorical test performance was analyzed through recognition, text-based true-false, and scripturally implicit questions, refined by conducting factor analysis. Moreover, the participants’ cognitive style of FI/FD was identified via GEFT. In the qualitative part, after analyzing the verbal reports of 8 informants, the participants’ strategy preferences were examined. Results revealed the impact of the cognitive style of FI/FD and working memory on the participants’ strategy preferences. Due to the advent of learner-centered approaches, this study has some implications for L2 pedagogy discussed in the paper.