درخت حوزه‌های تخصصی

Though dynamic assessment (DA) has gained strong theoretical and empirical support over the last decades, second language (L2) practitioners have blamed it for its applicability in large classes. To ameliorate this limitation, peer-dynamic assessment (peer-DA), rooted in the conceptualization of zone of proximal development (ZPD), can be introduced and practiced as an alternative approach. Thus, this study aimed to investigate the effects of peer-DA on cultivating Iranian upper-intermediate EFL learners’ interlanguage pragmatic (ILP) competence. Additionally, it was to disclose how peer-DA leads to improving the learners’ ILP competence. To achieve these aims, a sample of 84 upper-intermediate EFL learners, including females was selected through a convenience sampling method at Iran Language Institute in Borujerd City, Iran. Then, a total of 37 EFL learners whose scores fell around the mean score were selected and randomly assigned to two groups, namely an experimental (n = 19) and a control (n = 18). Then, they went through a pre-test, interventions (lasting 16 one-hour sessions held two times a week), and a post-test. The experimental group’s interactions were meticulously recorded. The collected data were analyzed through two independent samples t-tests, and the microgenetic development approach. Findings documented a statistically significant difference between the experimental group and control group concerning the gains of ILP competence on the post-test. Furthermore, the results of the microgenetic development analysis evidenced how the gradual, contingent prompts could lead to noticeable improvements in the learning of ILP features. These findings may have some pedagogical implications for different stakeholders.

Multiple-choice (MC) item format is commonly used in educational assessments due to its economy and effectiveness across a variety of content domains. However, numerous studies have examined the quality of MC items in high-stakes and higher education assessments and found many flawed items, especially in terms of distractors. These faulty items lead to misleading insights about the performance of students and the final decisions. The analysis of distractors is typically conducted in educational assessments with multiple-choice items to ensure high quality items are used as the basis of inference. Item response theory (IRT) and Rasch models have received little attention for analyzing distractors. For that reason, the purpose of the present study was to apply the Rasch model, to a grammar test to analyze items’ distractors of the test. To achieve this, the current study investigated the quality of 10 instructor-written MC grammar items used in an undergraduate final exam, using the items responses of 310 English as a foreign language (EFL) students who had taken part in an advanced grammar course. The results showed the acceptable fit to the Rasch model and high reliability. Malfunctioning distractors were identified.

Testing organizations are faced with increasing demand to provide subscores in addition to the total test score. However, psychometricians argue that most subscores do not have added value to be worth reporting. To have added value, subscores need to meet a number of criteria: they should be reliable, distinctive, and distinct from each other and from the total score. In this study, the quality of subscores from two subscore augmentation models (Wainer and Yen) were compared in terms of distinctness and variability. The reliabilities of the Wainer-augmented subscores were also examined. The models were applied to a high-stakes English language proficiency test in Iran. The results of the study showed that Yen better satisfied subscore distinctness while Wainer best preserved variability and had high-reliability subscores. In other words, Yen-augmented subscores had lower correlations while Wainer-augmented subscores better discriminated examinees with different ability levels. Thus, none of the examined models of subscoring satisfied all criteria. The results of the study are discussed and suggestions for future research are provided.