علیرضا احمدی

Researchers and scholars have been attracted by the idea of using integrated writing task along with independent writing task to best assess the EFL learners’ writing competence. This study was conducted to compare the writing performance of EFL students in integrated and independent writing tasks. It also aimed to find out if writing performance varies with task types. A number of thirty Iranian EFL students participated in this study, and each student wrote on two writing tasks of IELTS Academic module. The written essays were rated by three experienced raters using IELTS rubrics. Paired sample t-tests revealed that test takers performances did not differ significantly across these two tasks. Besides, two one-way ANOVAs indicated the difference between the raters in rating integrated writing task while they were not performed differently in rating independent task. The results are followed by a number of suggestions with the aim of improving the EFL students’ performance in writing skill.

The score reliability of language performance tests has attracted increasing interest. Classical Test Theory cannot examine multiple sources of measurement error. Generalizability theory extends Classical Test Theory to provide a practical framework to identify and estimate multiple factors contributing to the total variance of measurement. Generalizability theory by using analysis of variance divides variances into their corresponding sources, and finds their interactions. This study used generalizability theory as a theoretical framework to investigate the effect of raters’ gender on the assessment of EFL students’ writing. Thirty Iranian university students participated in the study. They were asked to write on an independent task and an integrated task. The essays were holistically scored by 14 raters. A rater training session was held prior to scoring the writing samples. The data were analyzed using GENOVA software program. The results indicated that the male raters’ scores were as reliable as those of the female raters for both writing tasks. Large rater variance component revealed the low score generalizability in case of using one rater. The implications of the results in the educational assessment are elaborated.

The aim of the present study was to investigate the effects of two types of paragraph on EFL learners’ written production. It addressed the issue of how three aspects of language production (i.e. complexity, accuracy, and fluency) vary among two types of paragraphs (i.e. paragraphs of chronology and cause-effect) written by EFL learners. Thirty intermediate level learners of English participated in the study. Each learner wrote the two specified types of paragraphs in the final exam of their writing course. In the first phase of the study, separate paired t-tests were conducted on each dependent variable to see whether there were any statistically significant differences in measures of complexity, accuracy, and fluency across the paragraph types. In the second phase of the study, to investigate if the raters detect the inconsistencies in the complexity, accuracy, and fluency of paragraphs written by a learner, four raters were asked to rate 12 paragraphs written by six learners whose paragraphs differed extremely in one of the three features. The findings revealed that EFL learners performed significantly better in paragraphs of chronology than the paragraphs of cause-effect in terms of fluency and accuracy. However, the analysis of complexity measures showed that there was no significant difference between the two types of paragraphs. In the qualitative analysis, it was found that raters did not consistently consider these three features in their examining the quality of the paragraphs. They paid attention to qualities such as coherence, cohesion and unity more consistently.

Oral Communication Strategies are conscious techniques that L2 interlocutors employ to overcome the communication breakdowns in the target language. Hence, they can help to promote the effectiveness of communication ability. However, it must be noted that many variables can influence the use of these strategies. The present study, therefore, aimed to investigate the role of language proficiency and cultural background variables on the use of oral communication strategies. After piloting the Oral Communication Strategy Inventory and Cultural Milieu and examining the reliability analysis as well as the construct validity, the questionnaires were administered to 320 participants majoring in the English language at B.A and M.A levels. Then, SPSS 18.0 computer program was used to analyze the collected data. Next, an interview was held to gain more information on the use of strategies by the Iranian EFL learners. The results of this inquiry revealed that there is no significant difference between learners at different language proficiency levels in terms of oral communication strategies use, while there is a significant difference between different cultural backgrounds in the use of OCSs. The findings of this research can be useful for developing the use of oral communication strategies among EFL learners, particularly with Persian and Turkish cultural backgrounds.

Purpose: In participatory approach to second language teaching and learning, students actively engage in their own learning process and collaborate with others (Cobb, 1994; Greeno, 1998) to achieve their goals. Also, collaborative learning has been shown to encourage the growth of student interdependence (Bruffee, 1999), responsibility (Totten, Sills, Digby, & Russ, 1991), interpersonal skills (Rymes, 1997), and cognitive and critical thinking skills (Johnson & Johnson, 1986). Methodology: Adopting a sociocultural perspective, the present study has attempted to explore the attitude of teachers and learners toward the effectiveness of the method. In so doing, 60 Iranian EFL learners from two intact classes participated in the study, in which the learners from the two classes were randomly assigned to one control group and one experimental group. For fourteen sessions, the researcher in the control group class followed her regular teaching practice through the conventional book-based method of conducting an English class. In the experimental group class, however, the researcher adopted the participatory approach tasks and activities, in which she applied various participatory approach-based techniques, activities, role play, and problem solving activities, group work and collaborative tasks in the classroom instruction. Findings: Results of the comparison of the effects of the experimental participatory group and the control conventional group revealed that although the students in both groups improved their scores on the IELTS posttest, there was no statistically significant difference between the experimental group’s overall performance and that of the control group. Conclusion: Results of the interview with the students and teachers also revealed that both the students and the teachers had positive attitudes towards implementing the participatory approach and they were willing to use at least some of the tasks and activities in their future courses.

Using a mixed methods design, the present study attempted to identify the factors influencing Iranian untrained EFL raters in rating group oral discussion tasks. To fulfil this aim, 16 language learners of varying proficiency levels were selected and randomly assigned to groups of four and performed a group discussion task. Thirty two untrained raters were also selected based on their volunteer participations. They listened to the audio files of the group discussions and assigned a score of one to six to each language learners based on their own judgments. They also provided comments on each language learners’ performance pointing to why they assigned such scores. The researchers had an interview with the raters after the rating session as well. The quantitative phase investigated whether linguistic features of accuracy, fluency, complexity and amount of talk were attended to by the raters in terms of having any relationship to the scores the raters assigned. Speech rate as an index of fluency and amount of talk turned out to be significantly correlated with the scores. Of more importance was the qualitative phase with the aim of identifying other factors that may account for the scores. The comments provided by the raters on each score and the interviews were codified based on Content Analysis (CA) approach. It was found that the raters attend not only to the linguistic features in rating oral group discussions, but they are also sensitive to the interactional features like the roles the participants take in groups tasks and the overall interaction patterns of the groups. The findings of this study may shed light on group oral assessment in terms of training the raters rating group oral tests and developing rating scales specific for group oral assessment.

Dynamic assessment (DA) which is rooted in Vygotsky’s (1978) sociocultural theory involves the integration of instruction and assessment in a dialectical way to achieve two main purposes: enhancing learners' development and understanding about their learning potential. However, the feasibility and appropriateness of mediation are two main concerns of DA. The former is concerned with the application of DA for a large number of students, while the latter is concerned with providing test takers with appropriate hints. The purpose of the current study was three-fold: to examine the difference between dynamic and nondynamic tests, to understand about test takers' potential for learning, and to find out how mediation works for high and low ability students. To achieve these aims, computer software was developed. The software is capable of both providing the test takers with graduated hints for each item automatically, and adapting the overall difficulty level of the test to the test takers' proficiency level. To test the efficiency of the software in employing dynamic assessment, 83 Iranian university students participated in the study. The results of the study indicated that the computerized dynamic test made significant contribution both to enhancing students' grammar ability and to obtaining information about their potential for learning. Based on the findings of the study, it can be concluded that the use of dynamic assessment can simultaneously lead to the development of the test takers' ability and provide a more comprehensive picture of learning potential. Accordingly, teachers are recommended to use dynamic assessment to make more informed decisions about their students.

مطالعه حاضر با استناد به فلسفه ی انکارپذیری پوپر سعی بر آن داشته تا به طور تجربی بررسی کند که آیا عواملی مانند جنسیت، آشنایی با موضوع متن، علاقه به موضوع یا محتوای متن، حدس زدن جواب سوالات، و عوامل مربوط به بافت اجتماعی می توانند بر پایه ی قوی از فلسفه ی انکارپذیری استوار باشند. در این مطالعه عملکرد آزمون درک مطلب 203 دانشجوی زبان ایرانی شامل 110 زن و 93 مرد به وسیله ی مدل آماری رگراسیون لوجستیک و نظریه پاسخ-سوال (IRT) مورد بررسی قرار گرفت. نتایج نشان داد که برای عوامل آشنایی با متن و جنسیت تنها مدل رگراسیون توانست عملکرد افتراقی را نشان دهد که این نتایج تاثیر جنسیت را تایید می کرد ولی نتایج مربوط به آشنایی با متن کاملا متناقض بود. نتایج حاصل از دو مدل رگراسیون و IRT در خصوص درآمد و حدس زدن جواب سوالات در تضاد با یکدیگر قرار داشتند ولی نتایج مربوط به تحصیلات والدین و محل سکونت با هم همراستا بوده و تاثیری معنادار بر عملکرد افتراقی سوالات آزمون درک مطلب داشتند.

In response to the increasing interest in and need for a practical brief measure in language testing, this study explored the properties of an offline short-form test (OSF) versus a conventional lengthy test. From the total of 98 vocabulary items pooled from the Iranian National University Entrance Exams, 60 items were selected for the conventional test (CT). To build the OSF, we created an item bank by examining the item response theory (IRT) parameter estimates. Data for the IRT calibration included the responses of 774,258 examinees. Upon the results of the item calibration, 43 items with the highest discrimination power and minimal guessing values from different levels of ability were selected for the item bank. Then, using the responses of 253 EFL learners, we compared the measurement properties of the OSF scores with those of the CT scores in terms of the score precision, score comparability, and consistency of classification decisions. The results revealed that although the OSF generally did not achieve the same level of measurement precision as the CT, it still achieved a desired level of precision while lessening the negative effects of a lengthy test. The results also signified an excellent degree of correspondence between OSF and CT scores and classification results. In all, findings suggest that OSF can stand as a reasonable alternative for a longer test, especially when conditions dictate that a very short test be used.