MSRT

Perhaps the degree of test difficulty is one of the most significant characteristics of a test. However, no empirical research on the difficulty of the MSRT test has been carried out. The current study attempts to fill the gap by utilizing a two-parameter item response model to investigate the psychometric properties (item difficulty and item discrimination) of the MSRT test. The Test Information Function (TIF) was also figured out to estimate how well the test at what range of ability distinguishes respondents. To this end, 328 graduate students (39.9% men and 60.1% women) were selected randomly from three universities in Isfahan. A version of MSRT English proficiency test was administered to the participants. The results supported the unidimensionality of the components of MSRT test. Analysis of difficulty and discrimination indices of the total test revealed that 14% of the test items were either easy / very easy, 38% were medium, and 48% were either difficult or very difficult. In addition, 14% of the total items were classified as nonfunctioning. They discriminated negatively or did not discriminate at all. 7% of the total items discriminated poorly, 17% discriminated moderately, and 62% discriminated either highly or perfectly, however they differentiated between high-ability and higher-ability test takers. Thus, 38% of the items displayed satisfactory difficulty. Too easy (14%) and too difficult (48%) items could be one potential reason why some items have low discriminating power. An auxiliary inspection of items by the MSRT test developers is indispensable.

This explanatory sequential mixed-method study aimed to investigate the washback effect of a local English Proficiency Exam (the Ministry of Science, Research and Technology Test (MSRT)) on Iranian Ph.D. candidates' English language learning skills. The study also examined the changes Iranian Ph.D. candidates perceive as essential to make the MSRT module implementation more useful for English learning. To this end, a sample of 150 Ph.D. candidates with differences in gender, age, and major were invited from Islamic Azad universities of Shiraz and Marvdasht to complete a questionnaire designed in terms of MSRT washback. The participants were chosen through a combination of stratified and convenience sampling methods. Furthermore, a sample of 20 PhD candidates from the same population was selected based on purposeful sampling and participated in the semi-structured interview sessions. The results of the data analysis represented some positive and negative washback effects on MSRT. Moreover, the participants suggested some recommendations on necessary changes and alterations for the MSRT test to facilitate university English learning further. Their feedback was in line with their viewpoints on why MSRT preparation had not satisfactorily prepared them to manage university workloads. The pedagogical implications will be discussed.