Authentic assessment

For the first time, this study combined models and principles of authentic assessment from two parallel fields of applied linguistics as well as general education to investigate the authenticity of the TOEFL iBT speaking module. The study consisted of two major parts, namely task analysis and task survey. Utilizing Bachman and Palmer’s (1996) definition of authenticity, the task analysis examined the degree of the correspondence between the characteristics of the speaking module tasks in the TOEFL iBT test and those of target language use (TLU) tasks. In the task survey, a Likert Scale questionnaire of authenticity was developed by the researcher based on Herrington and Herrington’s (1998; 2006) four criteria of authentic assessment. The questionnaire was sent through email to 120 subjects who had already taken the test in order to elicit their attitudes towards the degree of the authenticity of the speaking section tasks. The results of the task analysis revealed a limited correspondence between the characteristics of the test tasks and those of the TLU tasks. However, the results of the task survey indicated that except for one factor (indicators), most of the test takers had a positive view toward the authenticity of the speaking module tasks in terms of the three other factors (context, student factor, task factor).

Authenticity has always been the concern of test developers in the history of second language assessment. This study was an attempt to investigate the authenticity of the present researchers' innovative idea of “Language Town” as a method for assessing learners’ speaking ability. To this end, a simulated town was designed like a real town in an outdoor space of about 400 square meters. The participants in this study were 31 undergraduate students of Translation Studies at Jahrom University who were taking the 4-credit course of Conversation 2. First, the students’ speaking ability was measured based on the IELTS testing system. Then each student was sent to the Language Town with a few definite missions determined in advance by the teacher; e.g. ordering food in the restaurant, depositing/withdrawing money in a bank, etc. Using IELTS band descriptors, each student’s speaking ability was measured by two raters in both tests. Then the correlation between the two sets of scores obtained from the IELTS test and the one in the Language Town were calculated. Using open-ended questions, a survey was also conducted to extract the students’ attitudes towards the Language Town. The results of the statistical analyses showed a weak correlation (0.36) between the two sets of scores. The survey also revealed that almost all the students were interested in and had positive views towards Language Town as an authentic method of assessment. A Virtual Language Town (VLT) could be a solution to the practicality problems of the Language Town.