High-stakes Tests

A rich research base suggests that high-stakes tests reforms serve as vehicles for promoting quality of learning, standards of teaching, and credible forms of accountability. Iran’s last decade policies to reform its University Entrance Examinations (UEEs) heralded such a case. What sparked off this reform was the long-lasting pernicious impact of the UEEs on curriculum, instruction, learning, and on societal values and access to the upward social mobility. However, attempts to introduce intended changes are often not as effective as their planners hoped. A scrutiny of change ‘antecedent conditions’ as well as its initial ‘process of diffusion’ i.e., a ‘baseline study’ will ameliorate such a failure (Weir & Roberts, 1994, Fekete et al, 1999). Assessing the feasibility of the UEEs reform through such a ‘baseline study’ is a gap in Iran’s reform initiatives. As such, the authors applied Henrichsen’s (1989) Hybrid Diffusion Model (HDM), underscoring an awareness of and a need for evaluation of any changed program from a multiplex of factors, as its theoretical framework to critically evaluate the reformed program. The paper thus first presents the policy deliberations and steering National Documents that pushed through an assessment-led reform in Iran’s education. Then it sketches a detailed discussion of the contextual policies and practices of the long-lasting UEEs program, its alternative and associated stakes. While the results highlight key political dynamics which drove national policymaking, they are suggestive of the challenges, controversies, and risks that thwart the success rate of ideals intended by the underpinning policies.

Research on high-stakes tests indicates that increasing the stakes of large-scale English language tests will have consequential influence on teaching and learning performance and practices. However, evidence for influence on student ‘motivation for learning English (MLE)’ within such a context is still scarce. Taken this, the present study investigated the motivational level of high school students learning English as a foreign language (EFL) in the context of university entrance requirement tests change in Iran (introducing high school national English achievement tests-NEATs- as new requirements for entrance into nation-state universities). For such a purpose, the MLE scale, taken from Gardner’s (2004) Attitude/Motivation Test Battery, was translated into Persian, administered among 451 randomly selected students supposed to take the NEATs for their admission to universities, and subjected to confirmatory factor analyses. The results obtained through within-group ANOVA comparisons of the construct-validated subscales revealed that under increased stakes of the NEATs the participants maintained moderately high level of motivation for the two components of ‘desire to learn English’ and ‘attitudes towards learning’; however, the level for the component of ‘motivational intensity’ was neutral/moderate. Similar result (i.e., moderate level) was found in the participants’ perspective of their overall MLE. The findings, overall, indicate that the NEATs-admission programme has not demotivated the learners yet they are not as highly motivated as intended by the change planners. Such a divergence between the ideal policies (i.e., high level of MLE) and what was observed in practice (i.e., neutral/moderate MLE level) has implications for test change contexts and their driving policies.

High-stakes tests exert impacts on teachers’ perceptions, methodology, practices, and materials used in the classroom. However, previous research studies have overlooked the role of teachers’ past experiences in the tests and their instructional planning prior to, during, and after the preparation courses. This study inspected the washback effect of IELTS examination on Iranian EFL teachers’ instructional planning considering their IELTS related experiences. Through a mixed-methods research design, two sets of questionnaires were distributed among 120 Iranian IELTS instructors to examine the IELTS washback effect on their perceptions of instructional planning. Afterward, a semi-structured interview was held with 15 instructors, selected from among 120 initial participants, to supplement the previously collected data. The results of one sample t-test and Wilcoxon signed-ranks test indicated that the current level of Instructional planning at item and total score level was beyond average. Likewise, the results of Spearman rho indicated a positive and significant relationship between instructors’ instructional planning and their past IELTS related experiences. It was also found that the IELTS examination made the instructors develop exam-oriented plans by focusing on the students’ test performance. The results are invaluable for IELTS instructors in that they can raise their knowledge and awareness about the nature and scope of IELTS washback effect and ways to develop exam-oriented plans.

This explanatory sequential mixed-method study aimed to investigate the washback effect of a local English Proficiency Exam (the Ministry of Science, Research and Technology Test (MSRT)) on Iranian Ph.D. candidates' English language learning skills. The study also examined the changes Iranian Ph.D. candidates perceive as essential to make the MSRT module implementation more useful for English learning. To this end, a sample of 150 Ph.D. candidates with differences in gender, age, and major were invited from Islamic Azad universities of Shiraz and Marvdasht to complete a questionnaire designed in terms of MSRT washback. The participants were chosen through a combination of stratified and convenience sampling methods. Furthermore, a sample of 20 PhD candidates from the same population was selected based on purposeful sampling and participated in the semi-structured interview sessions. The results of the data analysis represented some positive and negative washback effects on MSRT. Moreover, the participants suggested some recommendations on necessary changes and alterations for the MSRT test to facilitate university English learning further. Their feedback was in line with their viewpoints on why MSRT preparation had not satisfactorily prepared them to manage university workloads. The pedagogical implications will be discussed.