High-Stakes Test

Individuals are controlled by tests in every advanced society when they want to be admitted in educational courses, to proceed from one stage to the next, or to be given a certificate (Shohamy, 2001b). Accordingly, the present study was carried out to construct and validate educational, social, and psychological consequences questionnaires of English Language Proficiency (EPT) as a high-stakes test in Iran. To achieve the goals, after initial piloting of the item pool, a total number of 252 non-English PhD students completed the final researcher-made questionnaires developed using a comprehensive review of the related literature, experts’ opinions, documents, and interviews. A number of statistical procedures were taken to validate the current questionnaires including Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA). EFA was utilized to determine the underlying factors of the scale that affect the variables in a data structure without setting any predefined structure to the outcome and to verify the number of factors; subsequently, these results were confirmed in the CFA phase. Ultimately, the results were discussed and implications of the questionnaires were presented as follows.

Washback refers to the effect of testing on teaching and learning. The university entrance exam for Iranian MA candidates of Teaching English as a Foreign Language (hereinafter TEFL MA UEE) is a nationwide high-stakes test administered every year, and significant decisions will be made based on the examinees’ performance on this exam; therefore, it is prone to bring about degrees of washback at the micro and macro levels. This study was an attempt to examine the washback effect of TEFL MA UEE on Iranian lecturers’ classroom activities. Therefore, a mixed-method approach was used to collect, analyze, and integrate both quantitative and qualitative data in order to obtain a better grasp of the research topic and to enhance validity and reliability of the information. Based on a sequential design, two phases of data collection were conducted with a two-week interval. In the first phase, a valid and reliable researcher-made questionnaire was administered to a sample of 16 Iranian university lecturers. In the second phase, five lecturers agreed to be interviewed. For this purpose, an interview protocol was developed and it was checked for the validity and reliability. The findings showed that TEFL MA UEE did not induce a high level of washback on the lecturers’ classroom activities and their teaching methodology. The findings could have practical implications for TEFL MA UEE constructors and policymakers in Iran and could also be of use to the researchers in the field of washback studies by providing some guidelines for this complicated phenomenon.

Iranian National University Entrance Exam (INUEE) as a nationwide high-stakes test is held annually to screen Iranian high school graduates and admit them into higher education programs in universities. This high-stakes examination has a wide range of impacts on test takers as the primary stake-holders and the parents, teachers, and high school principals as the secondary stakeholders. This study reports the impacts of INUEE on high school teachers and principals. To this aim, 27 teachers and 18 principals from three western provinces of Iran sat for a structured interview. Each interview lasted nearly 30 minutes. All the interviews were audio-recorded and transcribed. Next, following the Grounded Theory (Glaser & Strauss, 1967) as the basis of analysis, the transcriptions were subjected to content analysis to extract common patterns and recurring themes. Content analysis was applied to codify the transcribed interview data through an inductive process of frequent moving back and forth to extract common patterns and recurring themes of the data. After coding and 'quantitizing' the data (Dörnyei, 2007), the basic themes were identified, frequency counted, and tabulated. The results indicated that from the majority of the participants' perspective, the INUEE has detrimental consequences for students, teachers, school principals, and the educational curriculum. The findings of the study underscore the consequential invalidity and unfairness of the test and its negative impacts on different aspects of the educational system. The findings provide practical implications for educational policy-makers, school principals, and teachers highlighting the necessity of their awareness of negative consequences of INUEE.

To explore the characteristics of the items of the Teaching English as a Foreign Language (TEFL) MA Admission Test (henceforth TMAAT) as a high-stakes test in Iran, the current research utilized a three-parameter logistic Item Response Theory (IRT) calibration of the test items. The three-parameter logistic IRT model is the most comprehensive among the three models of IRT for it takes into account all the three effective parameters of item difficulty, item discrimination, and guessing simultaneously. The data were a random selection of 1000 TMAAT candidates taking the test in 2020 collected from Iran’s National Organization of Educational Testing (NOET). The software used to analyze the data was jMetrik (Version 4.1.1), which is the newest version so far. As the results indicated, the TMAAT worked well in discriminating the higher and lower ability candidates and preventing the candidates from guessing the responses by chance, but it was not much acceptable regarding the difficulty level of the items as the items were far too difficult for the test-takers. The most important beneficiaries of the present investigation are test developers, testing experts, and policy-makers in Iran since they are responsible to improve the quality of the items in such a high-stakes test.