علیرضا احمدی

This study applied multi-faceted Rasch measurement to investigate the halo effect in the performance-based assessment of writing across rubric criteria. Five raters who had received specialized training applied a four-criteria rating rubric to analytically rate writing scripts on two argumentative topics. Facets, a Rasch computer program, was utilized to pinpoint the halo effect by analyzing rater and rubric criteria interactions. After examining the appropriateness of the rubric in terms of functionality, the results showed that except for one rater, the raters did not exhibit any sign of the halo effect across rubric criteria. Generally, the severity hierarchies for raters and difficulty levels for rubric criteria suggested that raters’ training and their perceptions of the importance of criteria were associated with their manifestation of the halo effect. Pedagogically, through a detailed facet analysis of interactions between raters and rubric criteria, rater trainers may better realize how to design effective training programs to minimize raters’ variance including the halo effect and improve the overall objectivity of human rating.

Background: Sports facilities are one of the most commonly used services in the city with a significant role in improving the physical and mental health condition of citizens thus a proper procedure is required to locate and distribute them. Aim : The purpose of this study is to design a comprehensive model for the optimal location of sports facilities. Materials and Methods: The research method is descriptive-analytic based on information gathering and is applied research based on objectives. The opinions of 20 experts have been used to design the model using the Delphi method, and weighting the effective criteria in the sports facilities location. The weight of each criterion has been obtained as population density (0.47), access (0.31), development potential (0.14), and adjacency (0.08); furthermore, the Kendall coefficient of concordance (0.74) in the third step of the Delphi method shows the strong agreement between the experts, regarding the proposed model. The proposed model consisted of six steps: 1. Aim; 2. Verification of the functional area of the existing sport facilities and specific restrictions of the area; 3. Introducing and weighting the important criteria in the sports facilities location; 4. Identifying the most suitable locations for constructing the sports facilities; 5. Evaluating the needs of users; 6. Selecting the best spaces and prioritizing them. Results: The results of the model showed that the most important criteria for locating sport facilities are population density, access, development potential, and adjacency. Additionally, it was indicated that the agreement between the experts increased over time. Conclusion: According to the proposed model, it is possible to identify the points that are suitable for constructing the new sports facilities.

Score decision-making is largely an undocumented process in performance assessment. To conduct a more in-depth cognitive study in scoring, one must ask if these underlying processes can be identified efficiently and objectively. To this end, the present study attempted to shed some light on how Iranian teachers as untrained raters rate speech samples of learners and how their cognition functions in the decision-making process in terms of the scores they assign. A series of monologues were obtained from a group of language learners; afterward, English language teachers were asked to rate them. The raters were asked both to assign a score and provide comments regarding why they assigned a specific score. Having rated the samples, the raters were individually interviewed. The results of the recorded interviews and the comments they had provided on scores were subjected to qualitative analysis like coding and extracting both idiosyncratic and shared features of the raters’ cognition. The results revealed that some of the factors attended to by the raters were both linguistic and relevant to speaking proficiency construct like fluency, accuracy, and complexity. Some other factors influencing the raters while rating were non-linguistic and not directly related to speaking proficiency construct like the tone of voice, personality feature of the testee, etc. It seemed that the untrained raters did not have a clear definition of oral proficiency construct. The implications of the study for rater training programs have been discussed.

As a fascinating and colorful part of English language, idioms highly affect fluency, but they are quite difficult to teach and learn, and they have often been neglected particularly in ESL/EFL settings. Considering the large number of English idioms, corpus linguistics can be of great benefit in prioritizing materials in language classrooms based on the frequency information. Accordingly, the present corpus-based study aimed at identifying the most frequent idioms in English language by analyzing the data coming from the Corpus of Contemporary American English (COCA), composed of more than 520 million words. The study involved writing a special script using Hypertext Preprocessor (PHP) language which resulted in the development of five idiom lists, each containing 50 most frequently used idioms in each one of the five genres in COCA including academic, fiction, spoken, newspaper, and magazine along with their frequency of occurrences. Comparison was then made across the mentioned five genres. It was found that the spoken genre included more idioms whereas the academic genre was the least idiomatic. Furthermore, various levels of overlap was found among different genres. The least and the highest levels of overlap was found between the academic and fiction genres and between the magazine and newspaper genres respectively. The academic genre had more overlap with the newspaper and magazine genres. The findings can benefit EFL materials developers, teachers, and learners in recognizing and including frequently-used authentic idioms in language classrooms and textbooks.

Educators often employ various training techniques to reduce raters’ subjectivity. Negotiation is a technique which can assist novice raters to co-construct a shared understanding of the writing assessment when rating collaboratively. There is little research, however, on rating behaviors of novice raters while employing negotiation techniques and the effect of negotiation on their understanding of writing and rubric features. This study uses a qualitative method to keep track of 11 novice raters’ scoring behaviors and examine their textual foci during three phases of scoring through an analytic rubric: pre-negotiation, negotiation, and post-negotiation. To ensure triangulation, multiple sources of data including raters’ verbal protocols of independent scoring during the initial and final phases, audio-recorded interactions in the negotiation phase, and semi-structured interviews were gathered and analyzed. Results indicated that in their initial independent rating, raters mostly scored based on their understanding of the writing skill and the writing features that were important to them, but negotiation sessions aided them to refine their judgments and attend to a wider array of textual features more consistently and in line with the rubric, thereby expanding their understanding of the rubric categories. Post-negotiation ratings were also more similar to negotiation than prenegotiation ratings, meaning that the raters attended to more features of the rubric for scoring. The findings may have implications for rater training. In the absence of expert raters to train novice raters, negotiation can be considered a useful technique to improve raters’ understanding of the rubric features.

Flipped learning is an instructional approach that underlines the efficient use of classroom time by shifting the conventional activities of learners and educators in and out of the class. In flipped learning, students' roles as passive listeners change to active participants in classroom activities. The present study was designed to build a model of flipped classroom instruction (FCI) for the general IELTS writing. Additionally, this research intended to examine if there is a meaningful difference between the students’ general IELTS writing scores in the flipped class and those in the conventional class. An FCI model was carefully developed based on the thematic analysis of the previous flipped classroom studies about writing. Then it was operationally explained for a general IELTS writing class. The participants of the study consisted of 100 male and female Iranian EFL learners. Fifty learners were randomly selected to experience FCI and the other fifty learners received conventional classroom instruction. The findings revealed that the learners in the flipped classes, on average, acquired higher scores than the learners in conventional classes.