محمد احمدی صفا

The significance of fairness in assessment is not a subject of doubt for educationalists even with fundamentally contrastive perspectives, but the study of methodological means for safeguarding this concept in educational classroom contexts has only received the scant attention of the researchers and educationalists. On this basis, this study intended to conceptualize foreign language (FL) classroom assessment fairness from EFL teachers' perspective. For this purpose and as a part of a larger enterprise, the researchers first strived for the creation and validation of a Classroom Assessment Fairness Scale (CAFS). This process was informed by the related literature and applied a critical incident technique. To verify the scale's validity and reliability, it was first expert viewed and modified accordingly; next pilot-tested on a group of 250 teachers, and finally, the amassed data were subjected to exploratory and confirmatory factorial analyses and internal consistency measures. The validated scale was taken by 120 Iranian EFL teachers. Descriptive analyses indicated that the EFL teachers were familiar with fairness principles in classroom assessment practices. They were aware of the significance of the opportunity to learn, the opportunity to demonstrate learning, the no-harm principle, the constructive classroom environment, and transparency as the constructive elements of classroom assessment practices' fairness. However, the same familiarity and awareness were not guaranteed for the score pollution component. The results further demonstrated that the teachers' gender, educational degree, teaching experience, and teaching context led to statistically significant differences among EFL teachers' attitudes to classroom assessment fairness.

Iranian National University Entrance Exam (INUEE) as a nationwide high-stakes test is held annually to screen Iranian high school graduates and admit them into higher education programs in universities. This high-stakes examination has a wide range of impacts on test takers as the primary stake-holders and the parents, teachers, and high school principals as the secondary stakeholders. This study reports the impacts of INUEE on high school teachers and principals. To this aim, 27 teachers and 18 principals from three western provinces of Iran sat for a structured interview. Each interview lasted nearly 30 minutes. All the interviews were audio-recorded and transcribed. Next, following the Grounded Theory (Glaser & Strauss, 1967) as the basis of analysis, the transcriptions were subjected to content analysis to extract common patterns and recurring themes. Content analysis was applied to codify the transcribed interview data through an inductive process of frequent moving back and forth to extract common patterns and recurring themes of the data. After coding and 'quantitizing' the data (Dörnyei, 2007), the basic themes were identified, frequency counted, and tabulated. The results indicated that from the majority of the participants' perspective, the INUEE has detrimental consequences for students, teachers, school principals, and the educational curriculum. The findings of the study underscore the consequential invalidity and unfairness of the test and its negative impacts on different aspects of the educational system. The findings provide practical implications for educational policy-makers, school principals, and teachers highlighting the necessity of their awareness of negative consequences of INUEE.

A major concern of language testing researchers has for long been the identification of construct-irrelevant influential cognitive and psychological bias factors in test takers’ language test performance and recently the identification of the tentative models of interactions among such factors. With the same purpose in mind, the present study investigated the direct and indirect interrelationships among EFL learners’ test anxiety, test-wiseness, reading metacognitive awareness, and reading comprehension test performance through a path analytic research design. To this end and on the basis of the related literature and the previous research findings, first a hypothesized model of the interrelationship among the variables was assumed. Next, 317 undergraduate and graduate students took the related questionnaires and tests. Finally, the obtained data were analyzed through AMOS statistical package and the hypothesized model of the interrelationship among variables was tested. According to the final verified model, test-wiseness directly predicted reading comprehension test performance, while test anxiety did not. Moreover, while reading strategies metacognitive awareness did not directly predict reading comprehension test performance, it was indirectly associated with reading comprehension test performance through the mediation of test-wiseness. In addition, both correlational and path analyses confirmed a strong negative relationship between reading strategies metacognitive awareness, and test anxiety. The findings highlight the importance of the language test takers' less test anxiety and enhanced metacognitive awareness of reading strategies and test-wiseness for their more reliable test-taking performances.

Language learners' test performance is affected by individual attributes that are not part of test takers’ language ability (Bachman, 1990). The identification of such factors and the study of their association/impact with/on EFL learners' test performance has been a real test validity concern for language testing researchers (Bachman, 1990, 2004). This study was designed to explore the relation of a number of cognitive and psychological attributes and English as a Foreign Language (EFL) learners' test performance. To this end, two hundred male (100) and female (100) Iranian intermediate EFL learners selected through convenience sampling procedure took Goal-orientation Scale, Test Preparation and Test-taking Strategy Scale, and Examination Stress Scale and a sample Test of English as a Foreign Language Junior Standard (TOEFL Junior). Regression analyses of the questionnaires and the TOEFL test results demonstrated that mastery goal orientation, performance goal orientation, test-taking strategy and test anxiety all correlated with EFL learners' test performance; however, test taking strategy was the strong cognitive predictor and performance goal orientation was the strongest psychological predictor of the EFL learners' test performance. The results seem to indicate that in addition to previously identified factors like test anxiety and test taking strategies some factors like performance and mastery goal orientations which were once deemed as construct irrelevant factors in EFL learners' test performance need to be added to the battery of personal attributes that are influential factors in this regard.

One important aspect of pragmatic competence is the ability to comprehend and/or produce speech acts appropriately in different contexts. The acquisition and use of such an ability by non-native speakers of a language has been a major research line in interlanguage pragmatic competence (ILP) studies. Among different speech acts, the speech act of thanking is one of the most recurring acts, which has been comparatively less under the spotlight of ILP researchers. The purpose of this study is to explore how Iranian EFL learners express their gratitude and what thanking strategies they use in 14 different thanking situations. For this purpose, data were collected from 59 Iranian female advanced EFL learners through Written Discourse Completion Tasks (WDCT). Quantitative and qualitative analyses of data demonstrated a variety of thanking strategies were used by the participants in different thanking situations; however, the direct expression of gratitude without any preceding or succeeding complementary expression was the most frequently used strategy. Moreover, the diversity of different thanking strategies were almost similar in different thanking situations. The obtained results might imply that Iranian EFL learners need to be made more sensitive to both less direct and a wider variety of thanking speech act realization strategies.   

Discourse Markers (DMs) are pragmatic ties representing the relationship between different concepts in a discourse. As Fraser (2009) puts it, these lexical expressions are free morphemes that signal a special message about or in addition to the basic message. Given the importance of DMs in the written discourse of English as foreign language (EFL) learners, this study investigated the effectiveness of two methods of interaction in improving Iranian EFL learners’ use of discourse markers (DMs) in writing compositions. The data were drawn from comparing the compositions of two virtual groups of EFL learners who were exposed to two types of online interactions within which different flipped instructional activities were assigned. The data were analyzed both quantitatively and qualitatively. The results showed that the learners who engaged in online discussions used higher numbers of DM in terms of both type and token. The results also showed an increase in the length of compositions in the case of those groups who embarked on online interactions and discussions of flipped content. The findings suggest that once supported by the provision of flipped content, online interactions help create authentic opportunities for learner-centered discussions, which lead to an increased authenticity level of the EFL learners’ language production. The findings might also underscore the significance of flipped content and online interactions in developing other aspects of EFL learners’ pragmatic competence.

The identification of the cognitive, affective, social and even physiological factors affecting second or foreign language learning routes and rate has for long been a challenging aspiration for second language researchers. However, a recent preoccupation of the researchers in this area has been the study of the combinatorial impacts of such factors on second or foreign language learning processes and products. As a partial undertaking in this regard, this study investigated the relations pattern among some psychological and cognitive variables and foreign language learning achievement rate. The studied factors were self-regulation, goal-orientation, tolerance of ambiguity, and autonomy on the one hand and English as Foreign Language (EFL) learners’ ultimate achievement on the other hand. To this end, 250 Iranian BA level EFL students majoring English literature or English translation were selected based on convenience sampling procedure. Next, having obtained the participants' informed consent to participate in the study, the researchers administered Trait Self-Regulation Questionnaire (TSRQ), Goal Orientation, Tolerance of Ambiguity, and Learner Autonomy scales to them. In addition, concerning their L2 achievement rate measure, their BA level general English courses' GPA was obtained from the education office of the related universities. The data were statistically analyzed and the hypothetical model of interrelations among the given variables was tested using Structural Equation Modeling procedures. The results indicated that goal orientation and self-regulation significantly predicted L2 achievement; however, tolerance of ambiguity and learner autonomy were not found as strong predictors of L2 achievement. On the other hand, while self-regulation strongly predicted goal orientation, it was not verified to be a strong predictor of tolerance of ambiguity. The results also showed that goal orientation could strongly predict learner autonomy. A ready-made implication of the findings might be that the combinatorial effects of the psychological variables on cognitive processes like second language learning is quite complicated and different from the effects of each individual variable.      

This study examined the effect of rater training on promoting inter-rater reliability in oral language assessment. It also investigated whether rater training and the consideration of the examinees’ expectations by the examiners have any effect on test-takers’ perceptions of being fairly evaluated. To this end, four raters scored 31 Iranian intermediate EFL learners’ oral performance on the speaking module of the IELTS in two stages (i.e. pre- and post-training stage). Furthermore, following Kunnan’s (2004) Test Fairness Framework, a questionnaire on fairness in oral language assessment was developed, and after pilot testing and validating, it was administered to the examinees at both stages. The examinees’ expectations were taken into account in the second round of the speaking test. The results indicated that rater training is likely to promote inter-rater reliability and, in turn, enhances the fairness of the decisions made based on the test scores. It was also concluded that considering students’ expectations of a fair test would improve their overall perceptions of being fairly evaluated. The results of this study sought to provide second language teachers, oral test developers, and oral examiners and raters with useful insights into addressing fairness-related issues in oral assessment.

This study investigated the comparative effects of audio-visually prompted collaborative dialogue on the listening comprehension development of symmetrical, asymmetrical, and asymmetrical teacher-fronted EFL learner groups. Besides, it explored the attitude of the participants of the groups concerning the effectiveness of collaborative dialogue for their listening comprehension improvement. The participants of the study were 120 Iranian female EFL learners who were conveniently chosen from several English language institutes and put into three experimental and one control groups, each with 30 learners. In the first experimental group, coequal learners engaged in collaborative dialogue. In the second experimental group, the expert peer(s) and less knowledgeable peers applied collaborative dialogue, and in the third experimental group, in addition to the peers, the teacher was involved in collaborative dialogue with the group members. As for the control group, the collaborative dialogue was abandoned and the participants worked individually. Quantitative and qualitative analyses revealed that collaborative dialogue in asymmetrical teacher-fronted, asymmetrical peer and symmetrical peer groups were respectively the most effective procedures for listening comprehension development of the EFL learners. Also, it was found that the participants of the asymmetrical teacher fronted group had a more positive attitude towards the efficacy of audio-visually prompted collaborative dialogue compared with asymmetrical and symmetrical peer groups. The findings underscore the cognitive and affective efficiency of a more knowledgeable source, either a teacher or a peer, in asymmetrical dyadic interactions for the less knowledgeable partners' ZPD sensitive development.   

A key component of any educational program is the “textbook”, the efficiency of which greatly contributes to the accomplishment of the pedagogical goals of the program. The grave significance of the textbook necessitates its rigorous evaluation (Tomlinson, 2008). This study aimed to investigate EFL teachers’ and students’ perspectives on a recently developed Iranian EFL junior high school textbook entitled “Prospect 3”. The participants were 218 third-grade junior high school students and 103 EFL teachers conveniently selected from different junior high schools of Khuzestan, Golestan, Hamedan, and Qom provinces. The evaluation of the textbook was carried out quantitatively through a 5-point Likert scale questionnaire. The analyses revealed that EFL teachers were partially satisfied with Prospect 3; however, EFL students were rather neutral. For the teachers ,                                                                       “Vocabulary and Grammar” was the most meritorious aspect, while “ Language Type ” was the least acceptable dimension. From the students’ perspective, the most meritorious aspect of the text was “ Vocabulary and Grammar” ,  while “ Layout and Physical Appearance ” was viewed as the least satisfactory dimension. The findings of this work might be of interest to Iranian EFL teachers, syllabus designers, materials developers, and the stakeholders involved in the materials preparation Bureaus of the Iranian Ministry of General Education.  

This study, on the one hand, investigated whether or not strategies like Lexical Inferencing (LI) and Morphological Instruction (MI) can significantly affect English as a Foreign Language (EFL)learners’ reading comprehension, and on the other hand, it examined their effects on the learners’ vocabulary retention over time. For this purpose, 60 homogeneous EFLlearners were randomly assigned to two experimental and one control group each one consisting of 20 participants. After the pre-test, participants of the first experimental group received lexical inferencing strategy training for six 45-minute sessions. The second experimental group was also provided with morphological instruction for six 45-minute sessions and as for the control group, the participants followed their regular reading comprehension course without any specific strategy training. After the treatment, two post- tests with a short time interval were administered to the three groups and the obtained data were fed to different statistical tests to spot the probable differences among the three groups' first post- test performance as a measure of their learning differences and the second post-test performance as a measure of the learners’ vocabulary retention differences over time. Results of the paired t-tests for comparison of the within group differences showed that lexical inferencing instruction had statistically significant effect on EFL learners' reading comprehension development. On the other hand, it was found that morphological instruction had no statistically significant effect on EFL learners' reading comprehension development. The ANOVA analyses revealed that there was no statistically significant difference between the effects of lexical inferencing and morphological instruction on EFL learners' reading comprehension development. Furthermore, no significant difference was found between the effects of lexical inferencing and morphological instruction on EFL learners' reading comprehension development over time.

Abstract: The widespread use of test scores for different educational and social decision making purposes has made the washback effect of tests a distinct educational phenomenon (Cheng, 1997).The high school third grade final exam in the general educational system of Iran has for long been a high stake test designed to assess the achievement of high school graduates in different school subjects. The present study aimed to investigate the washback effect of this nation-wide exam on EFL teachers’ teaching methodology, assessment procedures, and attitudes towards different aspects of the educational system. For this purpose, a researcher made, validated questionnaire was administered to 160 EFL teachers. The results indicated that the third grade nation-wide final exam adversely affects EFL teachers’ teaching methodology and increases teaching to the test effect quite noticeably as they try to teach according to the content and format of the test. The results further showed an even stronger negative effect of the exam on EFL teachers’ assessment procedures. However, the teachers’ attitude towards different aspects of the educational system was not found to be as strongly affected as the other two variables. The findings of the study are of importance for testing and assessment bureaus in charge of extensive high stake tests development. Moreover, raising teachers’ awareness of the drawback of teaching-to-the test effect of such a high stake test might help them improve their teaching and evaluation practices.

توسعه توانشهای زیر مجموعه زبان دوم تحت تاثیر عوامل مختلفی چون عوامل شناختی، فردی، و اجتماعی است ( الیس، 1994) که در این میان طیف وسیعی از عوامل فردی در مطالعات آموزش زبان مورد تحقیق و بررسی قرار گرفته اند لیکن تاکنون در این مطالعات هوش هیجانی به عنوان یک عامل فردی مورد توجه جدی قرار نگرفته است (پیشقدم، 2009). از سوی دیگر برخی از کنشهای زبانی که از جمله عناصر اصلی توانش کاربردشناسی زبان بینابین به شمار می رود دارای ویژگی «تهدید وجهه» می باشد. این نکته تاثیر و یا ارتباط هوش هیجانی - که ارتباط مستقیم با توانایی و مهارت افراد در مدیریت و کنترل احساسات دارد – را با توانش کاربرد شناسی زبان بینابین بسیار محتمل می سازد. در مطالعه حاضر محقق به بررسی این ارتباط محتمل می پردازد و با این هدف پرسشنامه «بار-آن» به عنوان معیار هوش هیجانی ، آزمون تافل به عنوان معیار سطح مهارت و توانایی زبانی و دو آزمون کاربرد شناسی زبان بینابین بر روی 52 زبان آموز ایرانی اجرا شده است. نتایج حاصل از تجزیه و تحلیل داده ها نشانگرعدم وجود ارتباط موثر و معنا دار میان هوش هیجانی و توانش کاربرد شناسی و سطح مهارت زبانی زبان آموزان می باشد در حالی که میان توانش کاربرد شناسی زبان بینابین و سطح مهارت زبانی ارتباطی معنا دار و موثر وجود دارد. افزون بر این نتایج به دست آمده بیانگر آن است که هوش هیجانی نمی تواند به عنوان معیار مناسبی برای پیش بینی میزان توسعه توانش کاربردشناسی زبان بینابین و یا سطح مهارت زبانی مورد استفاده قرار گیرد و در نتیجه با استناد به نتایج تحقیق حاضر می توان گفت که در فرآیند یادگیری زبان دوم به طور عام و توسعه توانش کاربرد شناسی زبان بینابین به طور خاص نمی توان هوش هیجانی را به عنوان یک عامل فردی تاثیر گذار و مهم به شمار آورد.