غلامرضا کیانی

A rich research base suggests that high-stakes tests reforms serve as vehicles for promoting quality of learning, standards of teaching, and credible forms of accountability. Iran’s last decade policies to reform its University Entrance Examinations (UEEs) heralded such a case. What sparked off this reform was the long-lasting pernicious impact of the UEEs on curriculum, instruction, learning, and on societal values and access to the upward social mobility. However, attempts to introduce intended changes are often not as effective as their planners hoped. A scrutiny of change ‘antecedent conditions’ as well as its initial ‘process of diffusion’ i.e., a ‘baseline study’ will ameliorate such a failure (Weir & Roberts, 1994, Fekete et al, 1999). Assessing the feasibility of the UEEs reform through such a ‘baseline study’ is a gap in Iran’s reform initiatives. As such, the authors applied Henrichsen’s (1989) Hybrid Diffusion Model (HDM), underscoring an awareness of and a need for evaluation of any changed program from a multiplex of factors, as its theoretical framework to critically evaluate the reformed program. The paper thus first presents the policy deliberations and steering National Documents that pushed through an assessment-led reform in Iran’s education. Then it sketches a detailed discussion of the contextual policies and practices of the long-lasting UEEs program, its alternative and associated stakes. While the results highlight key political dynamics which drove national policymaking, they are suggestive of the challenges, controversies, and risks that thwart the success rate of ideals intended by the underpinning policies.

To launch an evidence source for successive judgment and decision making, program evaluation of any educational institute is an indispensable process, and language institutes are not the exceptions. In an attempt to propose a solution for a fundamental problem as the lack of a standard evaluation program for English language institutes, this study used a new method to be implemented in the context of ‘English language institutes (ELIs)’ of Iran. In this country, evaluation of nongovernmental centers, including ELIs, is carried out by the Ministry of Education (ME) using a performance evaluation framework which mainly collects the required data through a survey form (locally known as ‘Form 322’). We adopted and applied the survey form 322 into developing a specific questionnaire. Ninety ELIs administrators of Mazandaran were surveyed through an instrument that was piloted and validated through the obtained data. The extracted results from the questionnaire were sorted into the categories of “validation”, “improvement”, “redesigning”, and “researchers’ opinion”. The results showed that the original form, long used in the country, needs to be redesigned. To cross-validate the obtained data and the emerging results, fifteen volunteers from the participating institutes were interviewed for their ideas through Skype and direct interview. Consistent with the results, not only for Iran are an online platform and a standard evaluation and monitoring process recommended, but also an international integrated performance evaluation standard is strongly suggested for English language institutes.

The present study is an attempt to contribute to the L2 acquisition research through finding an appropriate answer to the question usually asked by both language teachers and learners, namely how to learn vocabulary and how to retain meanings in memory over time. We have chosen to discover the effects of two major types of productive exercises, writing and oral production exercises, on the remembrance of word meanings over time: 24 hours, one week, and one month after learning the vocabulary. For this purpose, two linguistically homogeneous L2 classes received ten sessions of treatment each: in one of these classes, 100 vocabulary items were practiced through controlled writing exercises and the other class practiced the same items through controlled oral exercises. The preliminary results indicate the positive influence of oral production exercises on meaning rememberance over time, i.e., after one month, while the two exercise types did not show any significant differences in their effects on in class vocabulary learning processes.

Long’s Interactional Input Hypothesis and Smith’s Input Enhancement Hypothesis hold both foci on Zellig Harris's (1976) formalist approach. Accordingly, the pivotal role of learner’s attention as one of the subcomponents of focus-on-form approach may have confused instruction types. However, whether such learning theories on drawing learners' attention on target language forms suit all types of learners, has not been adequately investigated. Of interest were to explore the significant effect of the two input types as interactionally modified input (IM) and textual input enhancement (TIE) and the interactional effect of learning styles of either visual, auditory, or kinesthetic (VAK) style on knowledge gain of causative constructions. A hundred and twenty female subjects were selected as a homogenous sample out of the 300-member population based on the TOEFL test. A pretest and two posttests were conducted immediately and about one month after the instructional interventions based on either IM technique or TIE technique. To address research questions, two paired samples t-tests and a two-way ANOVA were conducted. Considering the learner’s VAK learning style, the results revealed TIE and IM techniques positively facilitated the development of knowledge of the target features immediately after the instructional interventions. The results, however, failed to indicate the merging effect of the two input types of the study with the leaner’s VAK learning style and the learner’s gain of target grammar knowledge marginally decreased over time. The findings may contribute to the understanding of the integration of learning styles and input-based instructional programs in foreign language education policy.

Performance evaluation is one of the important components of each organization, and educational organizations are not the exceptions. Teachers are believed by many researchers as the single most important factor influencing student academic success or failure. Therefore, they need to be at the center of attempts to improve or reform the educational system of any country. Considering the pivotal role of teachers, educational systems need to be assured that teachers perform their best to enhance student learning, and also they should try to improve by identifying the strengths and weaknesses of teachers' practice for further professional development. The present study tries to examine the effectiveness of the current teacher evaluation system in Iran from EFL teachers’ perspectives. For that matter, a survey consisting of both Likert-scaled and open-ended questions was developed based on theoretical underpinnings of purposes for teacher evaluation, experts’ views, and the purposes of foreign language education as stated by the National Curriculum. 423 English language teachers were asked to answer the questions included in the survey. The results indicated the current teacher evaluation system did not contribute to teacher professional development nor could it assure teacher accountability. The results of the study as well as the requirements for developing an alternative model for EFL teacher evaluation are discussed

As a controversial subject, globalization has affected various aspects of our lives. Today, the intertwined world is run through complicated relationships and the education of competent human capitals has gained more significance than before. Recently, there has been a movement, known as Global Citizenship Education (GCE), toward a pervasive orientation to education in which issues such as Quality Education are the critical goals. The main aim of this study was to explore the extent to which The Iranian National Curriculum, The Doctrine of General Formal Education System and The Fundamental Reform Document of Education promote the GCE goals in formal English language education. Using a multi-concept model based on the GCE goals, the documents were the subject of scrutiny through document analysis. A survey questionnaire and a semi-structured interview were also utilized. Among 198 participants, 12 individuals accepted to be interviewed. The results of the document analysis and the questionnaire approved the documents’ theoretical promotion of the GCE goals. However, they were criticized for being idealistic and incoherent in the interviews and literature review. Also, their appropriate implementation, practical efficiency and convincing educational achievement were disapproved. The study emphasizes global-oriented approaches in the country’s formal education. 

The contemporary era of learning-oriented assessment demands for teacher professional efforts to appropriately and accurately assess learners' attainment and use the assessment results for the enhancement of learning. In second/foreign language (L2) teaching discipline, this has recently brought language assessment literacy (LAL) to the forefront, with an increasing emphasis on teachers' professionalism of this concept. Given this, L2 teachers' mastery of practical and technical skills, as prescribed by the exiting LAL models, could not be entirely complete nor enhanced without their conceptions of assessment and beliefs system. To illuminate these dimensions, the present study aimed to develop and validate a LAL scale which could have relevance to L2 localized contexts. Exploratory and confirmatory analyses of data from a sample of L2 teachers (N=213) provided empirical evidence supporting the utility and validity of the scale. The paper concludes with the importance of teachers' conceptions of LAL and implications of the findings.

The area of Individual Differences (IDs) and their interactions with instructional conditions have recently been a point of interest in second language acquisition. However, the effect of such interaction on aural implicit grammar knowledge has not been researched exhaustively. This study thus examined the interactive effects of aptitude and treatment conditions on implicit grammar knowledge as elicited aurally. Grammar knowledge was operationalized as the ability to comprehend past/present simple passive verbs. To this end, 120 EFL learners were randomly assigned to four groups: three teacher-generated experimental (Isolated Form-Focused Instruction, henceforth FFI, Integrated FFI, and Incidental) conditions, each lasting for six treatment sessions, and a control group receiving the same content with no instruction. Initially, learners took a pre-test and cognitive tests (LLAMA-D, LLAMA-F, and LSPAN). They then received the treatments, and three days after the treatments, they took an Aural Timed Grammaticality Judgment Test as a measure of implicit grammar knowledge. Results of a general linear model revealed a significant effect for treatment. Additionally, LSPAN was found to mediate the effectiveness of instruction, with the highest effect on implicit grammar knowledge under the Isolated FFI condition. Post-hoc analyses also demonstrated that instruction made a significant difference compared with no instruction, though, in comparison with other conditions, Integrated FFI proved to be more effective. Results provide EFL teachers and curriculum developers with awareness concerning the interaction between instruction and cognitive differences. For improving the effectiveness of instruction and acquiring implicit knowledge, cognitive tasks, especially those boosting working memory, are suggested.

Despite its role in achieving the frontiers of knowledge and interacting with the international community, English does not have its proper place in the Iranian General Education system, resulting in poor English education in school, hence, students’ poor command of English. This study explores the feasibility of outsourcing English teaching and entrusting this enterprise to the private sector. To this end, a questionnaire was developed from expert interviews to canvass 376 English teachers, students, and parents, as primary stakeholders, across the country. An exploration of respondents’ attitudes toward outsourcing English teaching indicated the agreement of the majority of the respondents with this idea of English education privatization. Moreover, political and ideological perspectives imply that a shift from school to institute is needed if we expect effective communication-based language teaching and learning. This may necessitate a radical reform in the language policy of the country and may even lead to the decentralization of English education due to regional and cultural needs. The study has implications regarding possible fundamental changes in language planning in the formal education system of the country.    

Testing the comprehension of spoken language is of primary importance. A lot of factors may affect the performance of EFL learners on listening comprehension tests, among which are the use of visual advance organizers, and types of listening passages (dialogues or monologues). As B-Ikeguchi (1997) states a few studies have been carried out on the effects of these factors on EFL learners’ listening comprehension with controversial results. And even fewer studies have concentrated on the effects of these factors on EFL learners’ performance on listening comprehension tests, which is the purpose of this study. In the present study, 180 advanced EFL learners were randomly selected by administering the Oxford Placement Test (OPT). The subjects were randomly assigned to three groups each consisting of 60 students. As far as the performance of subjects on listening comprehension test was concerned, the following results were obtained: 1) There was a significant difference between the presence vs. lack of visual advance organizer; 2) There was a significant difference between the uses of short-interval vs. long-interval advance organizer; 3) There was a significant difference between different types of listening passages (dialogues vs. monologues); and 4) There was no significant interaction between the use of visual advance organizer and different types of listening passages.

Changing the English textbook of the first grade junior high school at Iran’s public schools after 27 years has sparked researchers’ interests in conducting evaluations of the new English textbook to get insights into its strengths and weaknesses. In line with this trend, this study aimed at evaluating the new textbook (Prospect 1) from teachers’ perspectives. To attain this objective, 30 junior high school teachers were interviewed and the data were then analyzed by qualitative content analysis. The results revealed that from teachers’ perspectives, there were some pitfalls with the new textbook such as applying an unsuitable method of literacy instruction; over-attention to the communication skills at the expense of literacy skills; over-localization of the content; overlooking the development of intercultural competence in students; and lack of authenticity in the presentation of the content. Finally, as the central figures in the process of educational change, the participant teachers offered some suggestions to amend the new textbook with the hope that their voices be heard by the pertinent authorities.

Consequential validity, a component of construct validity as a unified concept introduced by Messick(1989), deals with the impacts of tests on teaching, learning, individual test takers, teachers, society, and educational system within a country. Although the impacts of language tests on teaching and learning have been somehow studied, the consequences of ESP tests on individual test takers and teachers have not been given appropriate attention. The present study aimed at exploring the possible consequences of ESP tests, as parts of master and doctoral entrance examinations to post graduate universities in Iran, on the stake holders and society. In doing so, a qualitative research method was applied. The participants were 31 master and doctoral students, and 5 ESP instructors. The data were analyzed in terms of the content. Four main themes with a variety of sub-themes emerged from the content analysis. The results indicated that ESP tests have negative psychological (anxiety, stress, disappointment, self-confidence, teaching efficacy, disappointment), social (deprivation from education, ethical issues, acceptance of nonqualified candidates), financial, and family consequences on the learners and teachers. The society is also influenced as the result of ESP tests scores.

This paper examines the effect of gender and type of stem on Iranian test takers’ performance on the grammar section of a nation-wide language proficiency test. In so doing, the scores of 2931 examinees (1107 female and 1824 male) who sat Tarbiat Modares English proficiency test were obtained. The examinees’ scores on three types of MC grammar items with different kinds of stems (i.e., blank filling, error recognition, and cloze) were compared to see if the type of stem has any effect on performance. Grammar scores of males and females were also compared to see if there is an effect for gender on the examinees’ performance on the grammar test in general and on its three item types in particular. The results indicated that test takers performed better on cloze items than the other two types. It was also found that females outperformed males on both the whole test, and also on items with blank filling and cloze types of stems. Due to the particularity of the context and the small effect sizes found, the study calls for more research to be conducted on this topic.

Scholarship on English as an International Language (EIL) has called for more research on the beliefs of nonnative teachers and learners of English about the inclusion of linguistic and cultural norms of EIL in ELT textbooks. To address this call, the present study examined the beliefs of 251 teachers and 254 learners of English in Iranian private language institutes. Data for the study were collected through an adapted questionnaire and follow-up interviews. The results of the study unraveled the teachers' advocacy of the inclusion of cultural and language norms of nonnative English varieties into the textbooks. Regarding learners’ beliefs, the results of the study showed that they disagreed with the inclusion of nonnative varieties in language teaching materials, and agreed only with the representation of native cultures in the textbooks. Contrary to these findings, it was found that both teachers and learners disapproved of teaching EIL in ELT classrooms, signifying their preference for the prioritization of Anglo-American norms. The findings have implications for ELT materials development and the need to raise teachers' and learners' awareness of EIL.