علیرضا احمدی

This study applied multi-faceted Rasch measurement to investigate the halo effect in the performance-based assessment of writing across rubric criteria. Five raters who had received specialized training applied a four-criteria rating rubric to analytically rate writing scripts on two argumentative topics. Facets, a Rasch computer program, was utilized to pinpoint the halo effect by analyzing rater and rubric criteria interactions. After examining the appropriateness of the rubric in terms of functionality, the results showed that except for one rater, the raters did not exhibit any sign of the halo effect across rubric criteria. Generally, the severity hierarchies for raters and difficulty levels for rubric criteria suggested that raters’ training and their perceptions of the importance of criteria were associated with their manifestation of the halo effect. Pedagogically, through a detailed facet analysis of interactions between raters and rubric criteria, rater trainers may better realize how to design effective training programs to minimize raters’ variance including the halo effect and improve the overall objectivity of human rating.

Background: Sports facilities are one of the most commonly used services in the city with a significant role in improving the physical and mental health condition of citizens thus a proper procedure is required to locate and distribute them. Aim : The purpose of this study is to design a comprehensive model for the optimal location of sports facilities. Materials and Methods: The research method is descriptive-analytic based on information gathering and is applied research based on objectives. The opinions of 20 experts have been used to design the model using the Delphi method, and weighting the effective criteria in the sports facilities location. The weight of each criterion has been obtained as population density (0.47), access (0.31), development potential (0.14), and adjacency (0.08); furthermore, the Kendall coefficient of concordance (0.74) in the third step of the Delphi method shows the strong agreement between the experts, regarding the proposed model. The proposed model consisted of six steps: 1. Aim; 2. Verification of the functional area of the existing sport facilities and specific restrictions of the area; 3. Introducing and weighting the important criteria in the sports facilities location; 4. Identifying the most suitable locations for constructing the sports facilities; 5. Evaluating the needs of users; 6. Selecting the best spaces and prioritizing them. Results: The results of the model showed that the most important criteria for locating sport facilities are population density, access, development potential, and adjacency. Additionally, it was indicated that the agreement between the experts increased over time. Conclusion: According to the proposed model, it is possible to identify the points that are suitable for constructing the new sports facilities.

Score decision-making is largely an undocumented process in performance assessment. To conduct a more in-depth cognitive study in scoring, one must ask if these underlying processes can be identified efficiently and objectively. To this end, the present study attempted to shed some light on how Iranian teachers as untrained raters rate speech samples of learners and how their cognition functions in the decision-making process in terms of the scores they assign. A series of monologues were obtained from a group of language learners; afterward, English language teachers were asked to rate them. The raters were asked both to assign a score and provide comments regarding why they assigned a specific score. Having rated the samples, the raters were individually interviewed. The results of the recorded interviews and the comments they had provided on scores were subjected to qualitative analysis like coding and extracting both idiosyncratic and shared features of the raters’ cognition. The results revealed that some of the factors attended to by the raters were both linguistic and relevant to speaking proficiency construct like fluency, accuracy, and complexity. Some other factors influencing the raters while rating were non-linguistic and not directly related to speaking proficiency construct like the tone of voice, personality feature of the testee, etc. It seemed that the untrained raters did not have a clear definition of oral proficiency construct. The implications of the study for rater training programs have been discussed.

As a fascinating and colorful part of English language, idioms highly affect fluency, but they are quite difficult to teach and learn, and they have often been neglected particularly in ESL/EFL settings. Considering the large number of English idioms, corpus linguistics can be of great benefit in prioritizing materials in language classrooms based on the frequency information. Accordingly, the present corpus-based study aimed at identifying the most frequent idioms in English language by analyzing the data coming from the Corpus of Contemporary American English (COCA), composed of more than 520 million words. The study involved writing a special script using Hypertext Preprocessor (PHP) language which resulted in the development of five idiom lists, each containing 50 most frequently used idioms in each one of the five genres in COCA including academic, fiction, spoken, newspaper, and magazine along with their frequency of occurrences. Comparison was then made across the mentioned five genres. It was found that the spoken genre included more idioms whereas the academic genre was the least idiomatic. Furthermore, various levels of overlap was found among different genres. The least and the highest levels of overlap was found between the academic and fiction genres and between the magazine and newspaper genres respectively. The academic genre had more overlap with the newspaper and magazine genres. The findings can benefit EFL materials developers, teachers, and learners in recognizing and including frequently-used authentic idioms in language classrooms and textbooks.

Educators often employ various training techniques to reduce raters’ subjectivity. Negotiation is a technique which can assist novice raters to co-construct a shared understanding of the writing assessment when rating collaboratively. There is little research, however, on rating behaviors of novice raters while employing negotiation techniques and the effect of negotiation on their understanding of writing and rubric features. This study uses a qualitative method to keep track of 11 novice raters’ scoring behaviors and examine their textual foci during three phases of scoring through an analytic rubric: pre-negotiation, negotiation, and post-negotiation. To ensure triangulation, multiple sources of data including raters’ verbal protocols of independent scoring during the initial and final phases, audio-recorded interactions in the negotiation phase, and semi-structured interviews were gathered and analyzed. Results indicated that in their initial independent rating, raters mostly scored based on their understanding of the writing skill and the writing features that were important to them, but negotiation sessions aided them to refine their judgments and attend to a wider array of textual features more consistently and in line with the rubric, thereby expanding their understanding of the rubric categories. Post-negotiation ratings were also more similar to negotiation than prenegotiation ratings, meaning that the raters attended to more features of the rubric for scoring. The findings may have implications for rater training. In the absence of expert raters to train novice raters, negotiation can be considered a useful technique to improve raters’ understanding of the rubric features.

Flipped learning is an instructional approach that underlines the efficient use of classroom time by shifting the conventional activities of learners and educators in and out of the class. In flipped learning, students' roles as passive listeners change to active participants in classroom activities. The present study was designed to build a model of flipped classroom instruction (FCI) for the general IELTS writing. Additionally, this research intended to examine if there is a meaningful difference between the students’ general IELTS writing scores in the flipped class and those in the conventional class. An FCI model was carefully developed based on the thematic analysis of the previous flipped classroom studies about writing. Then it was operationally explained for a general IELTS writing class. The participants of the study consisted of 100 male and female Iranian EFL learners. Fifty learners were randomly selected to experience FCI and the other fifty learners received conventional classroom instruction. The findings revealed that the learners in the flipped classes, on average, acquired higher scores than the learners in conventional classes.   

The purpose of the study was to investigate the effect of mediation on the development of a novice teacher and in turn the effect of transformation of the teacher on the behaviors and emotions of the learners using Vygotskian sociocultural view of learning. For this purpose, a novice teacher teaching the general English course at an Iranian university was selected. To develop an understanding of the instructional setting and to diagnose her weaknesses and strengths, she was observed by a teacher educator during the first five sessions. Different instruments and tools like the teacher and students’ narratives, stimulated recall of voice-recorded actual teaching, and observation were also used during the study to trace the teacher’s cognitive and emotional development. As most of her practices displayed over-reliance on translation and deductive teaching of grammar, and her oral narration showed instances of cognitive/emotional dissonance, strategic mediations, both implicit and explicit, based on her needs were offered after the fifth session in a face-to-face interaction to help her develop gradually. Analysis of the results showed the gradual development of her and the positive attitudes and active engagement of the learners during she was being mediated. Implications of the findings are presented and discussed.

The studies conducted so far on the effectiveness of resolution methods including the discussion method in resolving discrepancies in rating have yielded mixed results. What is left unnoticed in the literature is the potential of discussion to be used as a training tool rather than a resolution method. The present study addresses this research gap by exploring the data coming from rating behaviors of 5 Iranian raters of English. Qualitative analysis of the data indicated that the discussion method can serve the function of training raters. It helped raters rate more easily, quickly and confidently. Furthermore, it helped them improve their understanding and application of the rating criteria and enabled them justify their scoring decisions. Many-faceted Rasch analysis also supported the beneficial effects of discussion in terms of improvement in raters’ severity, consistency in scoring, and the use of scale categories. The findings provide insight into the potential of discussion to be used as a training tool especially in EFL contexts in which lack of access to expert raters can be an obstacle to holding training programs. The author argues for future studies to focus on how discussion may function depending on the rating scale used.

Although most researchers have recently considered the role of test-taking strategies as one of the most vital factors in test taking process, it has been ignored by most EFL teachers in educational and academic settings including Iran. Because of the importance of test-taking strategies in EFL learners’ performance in tests, this research was set out to examine what strategies Iranian EFL test takers employed in reading comprehension tests. Furthermore, the present paper aimed at finding any possible relationship between test-taking strategies and test takers’ performance on reading comprehension tests. Discovering the best predictors of EFL reading test performance among several categories of test-taking strategies was also investigated. To this end, 135 EFL students were chosen based on their availability. All of the students were female, majoring in different fields of study. Three kinds of materials including multiple-choice reading comprehension tests, a questionnaire, and interviews were utilized to investigate the research questions. Data analysis included descriptive statistics, Pearson Product Correlation, and stepwise regression. The results showed a significant, positive, but low correlation between the students’ total reading score and planning and also monitoring strategies. Furthermore, planning strategy proved to be a predictor of English reading comprehension test.