درخت حوزه‌های تخصصی

This study aimed at evaluating PISA-like reading test developed by teachers participating in the teacher training for teaching PISA-like reading. To serve the purpose, an experimental test was administered to 107 students aged 15-16 using a set of text and questions constructed according to the criteria of PISA Reading test Level 1. Item analysis was performed following the sampling using Rasch Measurement, deemed essential for determining the ideal index of test items relative to students’ ability in making correct response. The component of the calculation comprises reliability, separation, dan standard error. The Rasch model was constructed manually using Microsoft Excel to obtain the result of the calculation, and a Wright Map was also made manually to illustrate the result of the calculation. The results of the item analysis indicated that the test and the items the teachers constructed have met good criteria. The results revealed an even distribution of test item difficulty at the targeted level. The samples’ ability to make correct answers, however, was decentralized towards the test items of moderate level of difficulty. Only a limited number of students have showed good ability in their response to test items of higher difficulty.

With the incremental integration of technology in writing assessment, technology-generated feedback has found its way to take further steps toward replacing human correcting and rating. Yet, further investigation is deemed necessary regarding its potential use either as a supplement to or replacement for human feedback. This embedded mixed-method research aims to investigate three groups of Iranian intermediate IELTS applicants who received automated, teacher, and blended (automated + teacher) feedback modes on different aspects of writing when practicing for the writing skill of IELTS. Furthermore, a structured written interview was conducted to explore learners’ perception (attitude, clarity, preference) of the mode of feedback they received. Findings revealed that students who received teacher-only and blended feedback performed better in writing. Also, the blended feedback group outperformed the others regarding task response, the teacher feedback group in cohesion and coherence, and the automated feedback group in lexical resource. The analysis of the interviews revealed that learners had high opinion regarding the clarity of all feedback modes and learners’ attitude about feedback modes were positive. However, they highly preferred the blended one. The findings suggest new ideas that can facilitate learning and assessing writing and recommend that teachers provide comprehensive, accurate, and continuous feedback as a means of formative assessment.

Diagnostic classification models (DCMs) have recently become very popular both for research purposes and for real testing endeavors for student assessment. A plethora of DCM models give researchers and practitioners a wide range of options for student diagnosis and classification. One intriguing option that some DCM models offer is the possibility of examining the nature of the interactions among the attributes underlying a skill. Attributes in second/foreign language (L2) may interact with each other in a compensatory/non-compensatory manner. Subskill/attribute relationship has been studied using diagnostic classification models. The present study provides a mini review of the DCM studies on the attribute relationships in L2 reading, listening, and writing. The criteria based on which interaction between the attributes have been inferred are reviewed. The results showed that the majority of DCM studies have investigated reading comprehension and more studies are required on the productive skills of writing and speaking. Furthermore, suggestions for future studies are provided.