درخت حوزه‌های تخصصی

Language testing and assessment has grown in popularity and gained significance in the last few decades, and there is a rising need for assessment literate stakeholders in the field of language education. As teachers play a major role in assessing students, there is a need to make sure they have the right level of assessment knowledge and skills to accomplish their duties as assessors. The present study sought to develop and validate an assessment literacy test. To this end, a thirty-five scenario-based Language Assessment Literacy Test (LALT) was developed based on the seven standards covered by the Standards for Teacher Competence in Educational Assessment of Students (1990). Construct validity of the test was investigated by collecting data from 168 Iranian EFL teachers. To investigate the validity of the measure, tests of reliability, item difficulty, and item discrimination were carried out. The test was then subjected to EFA (Exploratory Factor Analysis whose results showed a seven-factor solution for the test items. The implications of the study for EFL teachers, language testers, teacher trainers, and curriculum developers are discussed.

Modern teaching practices emphasize learner autonomy and learner-centered approaches to language learning. Such teaching methods require corresponding assessment approaches. Self-assessment is viewed as an assessment mode which matches modern learner-centered teaching methodologies. However, the validity and reliability of self-assessments are not yet conclusively established. This study aimed to provide validity and reliability evidence for self-assessments among Iranian EFL university learners. The Common European Framework of Reference (CEFR) Self-Assessment Grid was translated into Persian and was given to a sample of Iranian undergraduate students of English. A C-Test battery containing four passages was used as a criterion for concurrent validation. Self-assessments of university EFL learners were examined for internal consistency and test-retest reliability. Findings showed that while self-assessments are highly reliable they lack validity as evidenced with low correlations between components of self-assessment grid and the C-Test. The implications of the study for the application of self-assessments in foreign language education are discussed.

Abstract Formative assessment has been often encouraged recently as a pivot component in the methodology of evaluation but the student's view of how this affects the improvement of language learning in some countries is disregarded in a way. Therefore, the following study investigates the experiences of students (pre-service teachers) in formative assessment and the tools used for its implementation. Teaching and evaluation are based on learning outcomes and students' approach to the activities that students are liable to convey in the course of English for teachers in the Department of Education. The study analyzed students' perceptions and their approach to formative assessment utilization. The Formative Assessment appears as a dignified way to raise the quality of learning, and as a result, the students achieve their goal to pass the exam successfully and get high grades. To acquaint their perspectives, 85 students as study respondents took part in the research in which both quantitative and qualitative methods were used. The quantitative research data from the questionnaire were analyzed through the SPSS platform, while the qualitative research data extracted from the focus group are presented through descriptive analysis, in the form of quotations. The findings of the questionnaires evinced the students' views on formative assessment and further, data from focus group discussions validated the reasonableness of what the students perceived in the questionnaire. Implications recommended that in addition to the tiresome work of continuously preparing during the teaching, EFL teachers are able to meet the individual needs of the students depending on the differences they have among themselves.

Cognitive diagnostic models (CDMs) have received much interest within the field of language testing over the last decade due to their great potential to provide diagnostic feedback to all stakeholders and ultimately improve language teaching and learning. A large number of studies have demonstrated the application of CDMs on advanced large-scale English proficiency exams, such as IELTS, TOEFL, MELAB, and ECPE. However, too little attention has been paid to the utility of CDMs on elementary and intermediate high-stakes English exams. The current study aims to diagnose the reading ability of test takers in the B1 Preliminary test, previously known as the Preliminary English Test (PET), using the generalized deterministic input, noisy, “and” gate (G-DINA; de la Torre, 2011) model. The G-DINA is a general and saturated model which allows attributes to combine in both compensatory and non-compensatory relationships and each item to select the best model. To achieve the purpose of the study, an initial Q-matrix based on the theory of reading comprehension and the consensus of content experts was constructed and validated. Item responses of 435 test takers to the reading comprehension section of the PET were analyzed using the “G-DINA” package in R. The results of attribute profiles suggested that lexico-grammatical knowledge is the most difficult attribute, and making an inference is the easiest one.

Cognitive diagnostic models (CDMs) have received sustained attention in educational settings because they can be used to operationalize formative assessment to provide diagnostic feedback and inform instruction. A large number of CDMs have been developed over the past few years. An important component of all CDMs is a Q-matrix that specifies a particular hypothesis about the relationship between each test item and its required attributes. The purpose of this study was to construct and validate a Q-matrix for the reading comprehension section of the Islamic Azad University English Proficiency Test (IAUEPT), as an advanced English placement test designed to measure language ability of Ph.D. candidates who tend to pursue their studies in the IAU. To achieve this, using item responses of 1152 candidates to twenty items of the reading section of the test, an initial Q-matrix was constructed based on theories and models of second/foreign language (L2) reading comprehension, previous applications of CDMs on L2 reading comprehension, and brainstorming and consensus of five content experts. Then, the initial Q-matrix was empirically validated using the method proposed by de la Torre and Chiu (2016) and checking mesa plots, and heatmap plot. Five attributes were derived for the reading comprehension section: vocabulary, grammar, making an inference, understanding specific information, and identifying explicit information. Finally, the analysis of the Generalized Deterministic Inputs, Noisy “and” Gate (GDINA) regarding absolute fit at item- and test-level as well as three residual-based statistics showed the accuracy of the Q-matrix and a perfect model-data fit.

 Juxtaposing the ubiquitous facets of mobile technology as everyware (Greenfield, 2010) and vocabulary as one of the most axial aspects of language learning (Bowles & Cogo, 2016; Schmitt & Schmitt, 2020) , besides the importance of considering learners’ attributes and needs (Taghizadeh, 2019) while developing a mobile vocabulary application (app), necessitates analyzing the relationship and impact of all these elements in a single structural model. To tackle the issue, first, via a mixed-methods design, the researcher developed a bespoke mobile application using the task model and the principles of agile methodology. and then investigated the impact of using the app on a sample of 62 Iranian EFL university students’ vocabulary recognition and recall, the results of which were published in two other articles. In this study, the researcher integrated the obtained data within a proposed structural model and assessed the model's fitness to investigate the interaction and interrelationship among the latent variables mentioned above. The results obtained from SEM-PLS analyses revealed that within the unified structural model, the learners’ preferences and needs were favorably influenced by their learning style orientation and technology savviness. Similarly, the findings verified the positive impact of considering learners’ preferences and needs during the agile app development lifecycle on the target participants’ vocabulary knowledge, encompassing vocabulary recognition and recall. Finally, the fitness of the proposed structural model was verified based on the criteria for model assessment mentioned by Sparks and Alamer (2022) . The SEM-PLS data analyses and the implications of the study are presented and discussed.

To date, with the everyday growth of technology and the increase of online classes, busy modern teachers seek to lighten their burdens and boost their learners’ autonomy. Thus, this multi-method action research aimed to probe the differences between receiving computer-generated and direct corrective feedback (CF) on the syntactic accuracy and complexity of female adolescent Iranian EFL learners’ writing. Two intact classes took part in the study; one group (Group C) received CF from an AWE (Automated Writing Evaluation) tool, called Ginger software, and the other group (Group T) received CF from their teacher. Subject-verb agreement and verb form errors were considered to measure the syntactic accuracy while the average sentence length and verb form variation were regarded as the syntactic complexity. Moreover, via a questionnaire, the students’ perceptions of the kind of CF they had received were taken into account to see which one was more effective. Findings obtained from MANOVA revealed that both groups made significant improvements regarding syntactic accuracy. Group C produced more complex outputs after being exposed to the treatment while Group T didn’t make such progress. The results obtained from the questionnaire also indicated that both groups found the CF satisfactory. However, Group C held more positive attitudes. Not only was the Ginger application effective in decreasing the number of students’ writing errors but also it motivated them to be better writers and write more. The study further points to the likely merits of technology-enhanced feedback in improving EFL learners' writing ability in general, and their written syntactic accuracy/complexity in particular.