علیرضا احمدی

This study investigated the answer changing behavior of the Iranian university students and its relationship to the academic course, gender, and field of study. 362 students at the University of Isfahan took part in the study. 76 English language teachers were also surveyed for their attitude toward answer changing on MC tests. The results indicated that 42.11% of the teachers had a negative attitude toward answer changing as they believed that the first answer selected is intuitively the best one and should not be changed. The results also indicated that answer changing would basically have positive effects on the total test scores. It was found that 63.09% of the answer changes were beneficial (from Wrong to Right choices). In contrast, 15.18% of the answer changes were negative (from Right to Wrong options), and 21.73% had no effect on the test scores (from Wrong to Wrong options). As for the effect of gender, no significant difference was found between males and females. Concerning the effect of academic course, the only significant difference lay in the number of Right to Wrong changes. Finally, it was found that field of study would make a difference only when Right to Wrong changes were considered.

Dynamic assessment (DA) which is rooted in Vygotsky’s (1978) sociocultural theory involves the integration of instruction and assessment in a dialectical way to achieve two main purposes: enhancing learners' development and understanding about their learning potential. However, the feasibility and appropriateness of mediation are two main concerns of DA. The former is concerned with the application of DA for a large number of students, while the latter is concerned with providing test takers with appropriate hints. The purpose of the current study was three-fold: to examine the difference between dynamic and nondynamic tests, to understand about test takers' potential for learning, and to find out how mediation works for high and low ability students. To achieve these aims, computer software was developed. The software is capable of both providing the test takers with graduated hints for each item automatically, and adapting the overall difficulty level of the test to the test takers' proficiency level. To test the efficiency of the software in employing dynamic assessment, 83 Iranian university students participated in the study. The results of the study indicated that the computerized dynamic test made significant contribution both to enhancing students' grammar ability and to obtaining information about their potential for learning. Based on the findings of the study, it can be concluded that the use of dynamic assessment can simultaneously lead to the development of the test takers' ability and provide a more comprehensive picture of learning potential. Accordingly, teachers are recommended to use dynamic assessment to make more informed decisions about their students.

Using a mixed methods design, the present study attempted to identify the factors influencing Iranian untrained EFL raters in rating group oral discussion tasks. To fulfil this aim, 16 language learners of varying proficiency levels were selected and randomly assigned to groups of four and performed a group discussion task. Thirty two untrained raters were also selected based on their volunteer participations. They listened to the audio files of the group discussions and assigned a score of one to six to each language learners based on their own judgments. They also provided comments on each language learners’ performance pointing to why they assigned such scores. The researchers had an interview with the raters after the rating session as well. The quantitative phase investigated whether linguistic features of accuracy, fluency, complexity and amount of talk were attended to by the raters in terms of having any relationship to the scores the raters assigned. Speech rate as an index of fluency and amount of talk turned out to be significantly correlated with the scores. Of more importance was the qualitative phase with the aim of identifying other factors that may account for the scores. The comments provided by the raters on each score and the interviews were codified based on Content Analysis (CA) approach. It was found that the raters attend not only to the linguistic features in rating oral group discussions, but they are also sensitive to the interactional features like the roles the participants take in groups tasks and the overall interaction patterns of the groups. The findings of this study may shed light on group oral assessment in terms of training the raters rating group oral tests and developing rating scales specific for group oral assessment.

Flipped learning is an instructional approach that underlines the efficient use of classroom time by shifting the conventional activities of learners and educators in and out of the class. In flipped learning, students' roles as passive listeners change to active participants in classroom activities. The present study was designed to build a model of flipped classroom instruction (FCI) for the general IELTS writing. Additionally, this research intended to examine if there is a meaningful difference between the students’ general IELTS writing scores in the flipped class and those in the conventional class. An FCI model was carefully developed based on the thematic analysis of the previous flipped classroom studies about writing. Then it was operationally explained for a general IELTS writing class. The participants of the study consisted of 100 male and female Iranian EFL learners. Fifty learners were randomly selected to experience FCI and the other fifty learners received conventional classroom instruction. The findings revealed that the learners in the flipped classes, on average, acquired higher scores than the learners in conventional classes.   

The studies conducted so far on the effectiveness of resolution methods including the discussion method in resolving discrepancies in rating have yielded mixed results. What is left unnoticed in the literature is the potential of discussion to be used as a training tool rather than a resolution method. The present study addresses this research gap by exploring the data coming from rating behaviors of 5 Iranian raters of English. Qualitative analysis of the data indicated that the discussion method can serve the function of training raters. It helped raters rate more easily, quickly and confidently. Furthermore, it helped them improve their understanding and application of the rating criteria and enabled them justify their scoring decisions. Many-faceted Rasch analysis also supported the beneficial effects of discussion in terms of improvement in raters’ severity, consistency in scoring, and the use of scale categories. The findings provide insight into the potential of discussion to be used as a training tool especially in EFL contexts in which lack of access to expert raters can be an obstacle to holding training programs. The author argues for future studies to focus on how discussion may function depending on the rating scale used.

The aim of the present study was to investigate the effects of two types of paragraph on EFL learners’ written production. It addressed the issue of how three aspects of language production (i.e. complexity, accuracy, and fluency) vary among two types of paragraphs (i.e. paragraphs of chronology and cause-effect) written by EFL learners. Thirty intermediate level learners of English participated in the study. Each learner wrote the two specified types of paragraphs in the final exam of their writing course. In the first phase of the study, separate paired t-tests were conducted on each dependent variable to see whether there were any statistically significant differences in measures of complexity, accuracy, and fluency across the paragraph types. In the second phase of the study, to investigate if the raters detect the inconsistencies in the complexity, accuracy, and fluency of paragraphs written by a learner, four raters were asked to rate 12 paragraphs written by six learners whose paragraphs differed extremely in one of the three features. The findings revealed that EFL learners performed significantly better in paragraphs of chronology than the paragraphs of cause-effect in terms of fluency and accuracy. However, the analysis of complexity measures showed that there was no significant difference between the two types of paragraphs. In the qualitative analysis, it was found that raters did not consistently consider these three features in their examining the quality of the paragraphs. They paid attention to qualities such as coherence, cohesion and unity more consistently.

Although most researchers have recently considered the role of test-taking strategies as one of the most vital factors in test taking process, it has been ignored by most EFL teachers in educational and academic settings including Iran. Because of the importance of test-taking strategies in EFL learners’ performance in tests, this research was set out to examine what strategies Iranian EFL test takers employed in reading comprehension tests. Furthermore, the present paper aimed at finding any possible relationship between test-taking strategies and test takers’ performance on reading comprehension tests. Discovering the best predictors of EFL reading test performance among several categories of test-taking strategies was also investigated. To this end, 135 EFL students were chosen based on their availability. All of the students were female, majoring in different fields of study. Three kinds of materials including multiple-choice reading comprehension tests, a questionnaire, and interviews were utilized to investigate the research questions. Data analysis included descriptive statistics, Pearson Product Correlation, and stepwise regression. The results showed a significant, positive, but low correlation between the students’ total reading score and planning and also monitoring strategies. Furthermore, planning strategy proved to be a predictor of English reading comprehension test.

Purpose: In participatory approach to second language teaching and learning, students actively engage in their own learning process and collaborate with others (Cobb, 1994; Greeno, 1998) to achieve their goals. Also, collaborative learning has been shown to encourage the growth of student interdependence (Bruffee, 1999), responsibility (Totten, Sills, Digby, & Russ, 1991), interpersonal skills (Rymes, 1997), and cognitive and critical thinking skills (Johnson & Johnson, 1986). Methodology: Adopting a sociocultural perspective, the present study has attempted to explore the attitude of teachers and learners toward the effectiveness of the method. In so doing, 60 Iranian EFL learners from two intact classes participated in the study, in which the learners from the two classes were randomly assigned to one control group and one experimental group. For fourteen sessions, the researcher in the control group class followed her regular teaching practice through the conventional book-based method of conducting an English class. In the experimental group class, however, the researcher adopted the participatory approach tasks and activities, in which she applied various participatory approach-based techniques, activities, role play, and problem solving activities, group work and collaborative tasks in the classroom instruction. Findings: Results of the comparison of the effects of the experimental participatory group and the control conventional group revealed that although the students in both groups improved their scores on the IELTS posttest, there was no statistically significant difference between the experimental group’s overall performance and that of the control group. Conclusion: Results of the interview with the students and teachers also revealed that both the students and the teachers had positive attitudes towards implementing the participatory approach and they were willing to use at least some of the tasks and activities in their future courses.

As a fascinating and colorful part of English language, idioms highly affect fluency, but they are quite difficult to teach and learn, and they have often been neglected particularly in ESL/EFL settings. Considering the large number of English idioms, corpus linguistics can be of great benefit in prioritizing materials in language classrooms based on the frequency information. Accordingly, the present corpus-based study aimed at identifying the most frequent idioms in English language by analyzing the data coming from the Corpus of Contemporary American English (COCA), composed of more than 520 million words. The study involved writing a special script using Hypertext Preprocessor (PHP) language which resulted in the development of five idiom lists, each containing 50 most frequently used idioms in each one of the five genres in COCA including academic, fiction, spoken, newspaper, and magazine along with their frequency of occurrences. Comparison was then made across the mentioned five genres. It was found that the spoken genre included more idioms whereas the academic genre was the least idiomatic. Furthermore, various levels of overlap was found among different genres. The least and the highest levels of overlap was found between the academic and fiction genres and between the magazine and newspaper genres respectively. The academic genre had more overlap with the newspaper and magazine genres. The findings can benefit EFL materials developers, teachers, and learners in recognizing and including frequently-used authentic idioms in language classrooms and textbooks.

Educators often employ various training techniques to reduce raters’ subjectivity. Negotiation is a technique which can assist novice raters to co-construct a shared understanding of the writing assessment when rating collaboratively. There is little research, however, on rating behaviors of novice raters while employing negotiation techniques and the effect of negotiation on their understanding of writing and rubric features. This study uses a qualitative method to keep track of 11 novice raters’ scoring behaviors and examine their textual foci during three phases of scoring through an analytic rubric: pre-negotiation, negotiation, and post-negotiation. To ensure triangulation, multiple sources of data including raters’ verbal protocols of independent scoring during the initial and final phases, audio-recorded interactions in the negotiation phase, and semi-structured interviews were gathered and analyzed. Results indicated that in their initial independent rating, raters mostly scored based on their understanding of the writing skill and the writing features that were important to them, but negotiation sessions aided them to refine their judgments and attend to a wider array of textual features more consistently and in line with the rubric, thereby expanding their understanding of the rubric categories. Post-negotiation ratings were also more similar to negotiation than prenegotiation ratings, meaning that the raters attended to more features of the rubric for scoring. The findings may have implications for rater training. In the absence of expert raters to train novice raters, negotiation can be considered a useful technique to improve raters’ understanding of the rubric features.

Researchers and scholars have been attracted by the idea of using integrated writing task along with independent writing task to best assess the EFL learners’ writing competence. This study was conducted to compare the writing performance of EFL students in integrated and independent writing tasks. It also aimed to find out if writing performance varies with task types. A number of thirty Iranian EFL students participated in this study, and each student wrote on two writing tasks of IELTS Academic module. The written essays were rated by three experienced raters using IELTS rubrics. Paired sample t-tests revealed that test takers performances did not differ significantly across these two tasks. Besides, two one-way ANOVAs indicated the difference between the raters in rating integrated writing task while they were not performed differently in rating independent task. The results are followed by a number of suggestions with the aim of improving the EFL students’ performance in writing skill.