مطالب مرتبط با کلیدواژه
۱.
۲.
۳.
۴.
۵.
۶.
۷.
۸.
۹.
۱۰.
۱۱.
۱۲.
۱۳.
۱۴.
۱۵.
۱۶.
۱۷.
۱۸.
Assessment literacy
حوزه های تخصصی:
Professionalism requires that language teachers be assessment literate so as to assess students’ performance more effectively. However, assessment literacy (AL) has remained a relatively unexplored area. Given the centrality of AL in educational settings, in the present study, we identified the factors constituting AL among university instructors and examined the ways English Language Instructors (ELIs) and Content Instructors (CIs) differed on AL. A researcher-made, 50-item questionnaire was constructed and administered to both groups: ELIs (N = 155) and CIs (N = 155). A follow-up interview was conducted to validate the findings. IBM SPSS (version 21) was used to analyse the data quantitatively. Results of exploratory factor analysis showed that AL included three factors: theoretical dimension of testing, test construction and analysis, and statistical knowledge. Further, results revealed statistically significant differences between ELIs and CIs in AL. Qualitative results showed that the differences were primarily related to the amount of training in assessment, methods of evaluation, purpose of assessment, and familiarity with psychometric properties of tests. Building on these findings, we discuss implications for teachers’ professional development.
An Investigation of Assessment Literacy Among Native and Non-Native English Teachers(مقاله علمی وزارت علوم)
حوزه های تخصصی:
The current study aimed at examining the relationship between English language teachers’ assessment literacy and their teaching experience. In other words, it intended to inspect the relationship between native and non-native English language teachers’ assessment literacy and their teaching experience. To achieve such goals, 100 native and non-native English teachers from ESL and EFL contexts were picked out on the basis of a combination of availability sampling and snowball sampling procedures. They were asked to take part in the study by filling out Classroom Assessment Literacy Inventory developed by Cynthia Campbell and Craig Mertler (2004). The results revealed that there was a positive relationship between native English language teachers’ perspectives regarding assessment literacy and their experience. Besides, 32 percent of shared variances between native teachers’ perspectives regarding assessment literacy and their experiences. However, there was not any significant relationship between non-native English language teachers’ perspectives regarding assessment literacy and their experience.Keywords: Assessment Literacy, Native Teachers, Non- Native Teachers, Teaching Experience
Features of Language Assessment Literacy in Iranian English Language Teachers' Perceptions and Practices(مقاله علمی وزارت علوم)
منبع:
Teaching Language Skills (JTLS), Volume ۳۸, Issue ۱, Spring ۲۰۱۹
191 - 223
حوزه های تخصصی:
Language assessment literacy (LAL), mainly defined as knowledge and skills of language assessment, in the last two decades, has started to receive the attention it deserves. As one of the significant findings, based on a plethora of research, many second language (L2) teachers have been indicated to be professionally incompetent in terms of LAL. To investigate the status of LAL among Iranian English teachers, the present study was conducted. Three hundred and nine English teachers participated in answering a questionnaire. Besides, 24 teachers were interviewed based on a semi-structured interview. Both qualitative and quantitative data analysis and interpretation techniques were employed to find answers to the research questions which sought to investigate the features of language assessment literacy in language teachers' perceptions. The findings indicated that, overall, LAL is of concern to Iranian L2 (English) teachers. However, they also agree that their current level of both knowledge and practice in terms of LAL is not ideal. Furthermore, it was found that, as the teachers perceive it, assessment promotes learning and teaching; the nature of teacher-learner relationships affects evaluation; and, testing and assessment are seen as challenging notions due to their mathematical concepts and statistics. The findings will contribute to a more profound perception of LAL and better planning and executing the programs for L2 teachers regarding the issue.
Probing into EFL Teachers’ Assessment Literacy and Teaching Experience: The Case of Native ESL and Non-native EFL Teachers(مقاله علمی وزارت علوم)
حوزه های تخصصی:
The present study was an attempt to extend our knowledge on the perspectives of English language native and non-native teachers about assessment literacy. Furthermore, it was intended to find if there was any significant relationship between native and non-native English language teachers’ perceptions regarding assessment literacy and their experience. To achieve such goals, a mixed methods design was utilized. In the quantitative phase, Classroom Assessment Literacy Inventory developed by Campbell and Mertler (2004) was utilized which consisted of five scenarios. Through a combination of availability sampling and snowball sampling procedures, the researcher either distributed the questionnaire among 100 native and non-native English teachers or sent it by E-mail to them. In the qualitative phase, a semi-structured interview was selected as a qualitative tool for collecting data. To this end, 10 teachers volunteered to take part. Based on the quantitative findings, there was a positive relationship between native English language teachers’ perceptions regarding assessment literacy and their experience. However, there was not any significant relationship between non-native English language teachers’ perceptions regarding assessment literacy and their experience. Based on the qualitative results, seven codes were classified according to three themes, namely, assessment assumptions, assessment targets, and professional development. These seven codes were classroom observations, assessment consistency, formative assessments, summative assessment, higher-order thinking skills, lack of assessment literacy of coursework, and lack of technology assessment literacy. Thus, it is concluded that teachers should assume the role of classroom observation and consistency of the assessment as two major assumptions of assessment.
Demystifying Language Assessment Literacy among High School Teachers of English as a Foreign Language in Iran: Implications for Teacher Education Reforms
منبع:
International Journal of Language Testing, Volume ۱۰, Issue ۲, Summer and Autumn ۲۰۲۰
129 - 144
حوزه های تخصصی:
The promotion of language assessment literacy (LAL) among teachers and assessment developers has been deadly called and emphasized by professionals and scholars in the field of language assessment. In line with this urgent call for research, the present study sets out to investigate the EFL teachers’ literacy assessment with the aim of bringing modifications for teacher education reforms. To meet the objectives of the study, a total of 200 EFL teachers (N=88, with a TEFL background and N=112, with a non-TEFL background) with B.A. (N=125) and M.A. (N= 75) degrees were selected through stratified random sampling at high schools of West Azerbaijan Province, Iran. The required data were gathered using Plake, Impara, and Fager’s (1993) Teacher Assessment Literacy Scale (TALS). Hence, the participants’ knowledge concerning components of assessment literacy (AL) was sought for. A multivariate analysis of variances (MANOVA) was run and the results, in general, revealed that the participants were not significantly familiar with assessment literacy principles and procedures. Specifically, the results indicated that EFL teachers with a TEFL background and those with a non-TEFL background differed in terms of their assessment literacy competence, especially in terms of their perceptions of AL components. The implications of the findings for teacher education programs, teacher educators and EFL teachers are discussed and some suggestions for further research are offered.
دانش و فعالیت عملی سواد سنجش معلمین ضمن خدمت و پیش سرویس: ساکن در برج عاج(مقاله علمی وزارت علوم)
منبع:
Issues in Language Teaching (ILT), Vol. ۹, No. ۲, ِDecember ۲۰۲۰
347 - 375
حوزه های تخصصی:
سواد سنجش معلم نقش محوری در برنامه های آموزش معلمان بازی میکند، با این حال به نظر میرسد هم در سواد سنجش و هم در اجرای آن کاستی هایی وجود دارد. مطالعه حاضر با استفاده از یک کلاس سنجش آنلاین، که شامل مباحث تئوری و همچنین عملی میشود، سواد سنجش 16 معلم (8 معلم ضمن خدمت و 8 معلم پیش سرویس) و میزان استفاده از سواد سنجش آنها را بررسی میکند. بخش کمی مطالعه سواد سنجش معلمان، و بخش کیفی صحت نتایج بخش کمی و همچنین میزان استفاده معلمان از سواد سنجش در قلمرو عملی را مورد بررسی قرار میدهند. داده های این تحقیق با استفاده از پرسشنامه های معتبرجمع آوری شدند، که یکی از آنها از Mertler (2013) اقتباس شد و دو مورد دیگر به وسیله محققین طراحی شدند. به علاوه، از یک پروژه ارزیابی عملی نیز برای جمع آوری داده ها استفاده شده است. یافته های تحقیق نشان میدهند اگرچه معلمین ضمن خدمت به واسطه تجربه بیشتر، در ابتدای تحقیق از سواد سنجش بیشتری برخوردار بوده اند، در انتهای تحقیق و در مقایسه با معلمین پیش سرویس از درجه کمتری از سواد سنجش برخوردارند. یافته های بخش کیفی تحقیق نیز نشان دهنده عدم ترجیح معلمان برای استفاده از سواد سنجش در فعالیت های کلاسی است. نتایج تحقیق حاضر گنجاندن هم جنبه های تئوری و هم جنبه های عملی سواد سنجش معلمان را در برنامه های آموزش معلمان پیشنهاد میدهد. به علاوه، بررسی دقیق موانعی که مانع استفاده سواد سنجش تئوری معلمان در عمل میشود نیز پیشنهاد میشود.
Examining 'Assessment Literacy in Practice' in an Iranian Context: Does it Differ for Instructors and Learners?(مقاله علمی وزارت علوم)
حوزه های تخصصی:
The study reported here is survey research that aims to examine the assessment literacy (AL) of the instructors (N=12) as well as graduate and postgraduate students (N=46) in the Department of Foreign Languages and Linguistics at Shiraz University. To this end, interview questions were designed using Pastore and Andrade's (2019) three-dimensional AL framework. The questions, having been field-tested and their validity having been approved by three experts, were used to interview the participants. The interviews were transcribed and idea units in them were specified and coded according to a coding scheme designed based on Pastore and Andrade (2019). At the conceptual dimension, the results suggested that most of the participants in both groups believed in the learning potential of assessment, and most of the instructors used multiple tasks throughout the term to gather on the students' learning, especially at the MA and Ph.D. levels. At the praxiological dimension that concerned the integration of assessment with instruction, the students mentioned using the results of summative assessment to alter their studying approach, while only a few instructors used assessment results to modify their teaching practices. At the socio-emotional dimension, discrepancies existed among the instructors and between instructors and learners in how ethical issues should be observed in assessment. The results are discussed, and implications are provided for designing teacher education programs and for future research.
A Gap Analysis between EFL Teachers' Assessment Literacy in Iranian Public Schools and Their Pre-service Assessment Curriculum(مقاله علمی وزارت علوم)
حوزه های تخصصی:
The design, implementation and outcomes of curriculums must be ongoingly evaluated. Using quantitative gap analysis, this study evaluated Iranian EFL teachers’ satisfaction with their pre-service education in developing their assessment literacy in reference to the perceived importance of knowledge and skills areas of classroom language assessment. To this end, the study included 100 EFL teachers who graduated from state universities in Iran with at least a Bachelor’s degree and three to five years of teaching experience at public schools. Data were collected using a 44-item researcher-made semantic differential Likert scale. It involved two parts tapping into their perceptions of importance and the level of their pre-service preparation. Descriptive analysis and inferential statistics revealed that the teachers rated all the areas almost highly (M ≥ 4.67 out of 6). The participants attached the highest importance to the areas of "assessing different language skills and sub-skills". In contrast, the areas relating to "interpreting students’ test performance” and “making the appropriate decision about the students’ test results and test washback" were perceived to be the least significant in classroom assessment. The gap analysis also indicated that there was a significant difference between the teachers’ perception of the importance of assessment knowledge and skills areas and their level of pre-service education, construed as their under-preparedness for classroom assessment. Further, the gaps were perceived to be sharper in assessment skills areas. The study discusses the implications of the findings in the context of teacher education and classroom assessment in Iran.
Assessment Literacy in Light of Teachers’ Discipline: hard Sciences, soft sciences, and ELT(مقاله علمی وزارت علوم)
حوزه های تخصصی:
The current study attempted to investigate and compare the perceptions of Iranian in-service hard disciplines, soft disciplines, and English teachers of their prognostic, formative, and summative assessment literacy. To this end, a total number of 282 high school teachers (94 teachers from each disciplinary groups) were asked to complete the modified and validated version of Rahimi and Rastgoo’s (2017) questionnaire. To enrich the quantitative phase, 90 teachers (30 ones in each group of disciplines) were also interviewed. The results of one-way ANOVA and multiple comparisons revealed a significant difference between hard disciplines and English teachers in terms of their prognostic and summative assessment literacy. However, no significant difference was found among the three groups in terms of their formative assessment literacy. The content analysis of the interviews cast light on the commonalities and discrepancies of assessment perceptions and practices depending on the teachers’ disciplines. The findings can be transferred to teacher education programs to enhance the teachers’ subject-specific assessment competencies.
Examining Teacher Assessment Literacy and Instructional Improvement of Iranian High School Teachers on Various Fields of Study
حوزه های تخصصی:
Assessment literacy refers to the knowledge teachers have about definitions of testing and the employment of this knowledge to classroom practices. This study inspected the extent to which high school teachers of English, mathematics, science, and social studies utilize assessment literacy and instructional improvement practices in their classrooms and the probable relationship between these two factors. To this end, ninety-seven teachers from sixty high schools across Zanjan province in Iran were selected based on convenient sampling. The instrument used was a 32-item questionnaire designed by researchers and validated by experts. A confirmatory factor analysis (CFA) was also conducted in order to validate the factor structure of the questionnaire. The results showed a strong positive relationship between assessment literacy and instructional improvement practices in all four subject areas through correlations. This suggests that showing an understanding of assessment literacy results in a greater understanding of instructional improvement in the classroom. Moreover, a one-way ANOVA was performed in order to determine if there is a significant difference in the use of assessment literacy practices and instructional improvement among different subject areas. The data revealed no statistically significant differences between neither assessment literacy nor instructional improvement scores by subject area. The study can be beneficial to school districts and teachers since the review of existing teaching practices and an increase in ongoing professional development in assessment literacy theories and practices may improve instructional improvement in all subject areas.
EFL Teachers Assessment Literacy Needs Inventory: A Case of Fulcher’s Assessment Literacy Framework(مقاله علمی وزارت علوم)
منبع:
Issues in Language Teaching (ILT), Vol. ۱۱, No. ۱, June ۲۰۲۲
131 - 156
حوزه های تخصصی:
Language assessment literacy has been addressed in a wealth of research. However, many studies have attempted to measure teachers’ assessment literacy, there is still a gap that prompted us to investigate the area from the EFL teachers' assessment literacy needs perspective. To accomplish the purpose, in line with the changes in classroom assessment over the past decades, this study was an attempt to develop and validate an inventory on Teachers Assessment Literacy Needs (TALNs). As the first stage, a set of items was generated through an extensive review of the relevant studies. In the quantitative phase, the developed inventory was administered to 159 English as a foreign language teachers selected through convenience sampling. An inventory construction and validation framework consisting of exploratory analyses was used to examine the construct validity of the proposed inventory. The results indicated that the inventory can be best explained by four components which are knowledge of language assessment literacy, consequences of language assessment literacy, processes of language assessment literacy and teachers’ expectations of Continuing Professional Development (CPD) programs. The TALNs inventory developed in this study aimed to help practitioners and researchers to investigate teachers’ needs in assessment literacy. Fulcher’s (2012) assessment literacy framework was drawn on as the analytic model guiding the study.
A Study on the Assessment Literacy of Novice and Experienced ESP Instructors with TEFL and non-TEFL Backgrounds in Iranian Academic Context(مقاله علمی وزارت علوم)
The present study was an attempt to investigate assessment literacy among ESP instructors in the Iranian academic context. A mixed-methods sequential explanatory study was designed, and 100 novice/experienced ESP instructors with TEFL/non-TEFL backgrounds at the Ph.D. level were selected through criterion sampling to complete a questionnaire and a scale. Then, from among the mentioned participants, 20 were selected for classroom observations and in-depth, semi-structured interviews based on convenience sampling. First, the quantitative data were collected using observation checklists and analyzed through running Chi-square to compare the assessment practices of novice/experienced instructors with TEFL/non-TEFL backgrounds. Next, the qualitative data were collected through taking notes and applying interviews. All interviews were transcribed, categorized, and analyzed through content analysis of themes and open/axial coding. The findings indicated that the instructors with TEFL backgrounds significantly practiced assessment methods more than the ones with non-TEFL backgrounds. Furthermore, it was found that novice instructors significantly practiced assessment methods more than the experienced ones. Likewise, it was identified that novice TEFL instructors perceived assessment components better than their non-TEFL or experienced counterparts. The findings of this study can be useful for executive administrators in the ministry of higher education, university instructors and students.
Assessment Literacy Components Predicting EFL Teachers’ Job Demand-Resources: A Focus on Burnout and Engagement
حوزه های تخصصی:
Much has been done on assessment literacy (AL) components and job demand-resources (JD-R). However, an interdisciplinary look at AL components as the predictors of JD-R and its possible consequences in the engagement and burnout of teachers’ assessment performance has been neglected. To fill this gap, the present study explored this issue in the context of Iran. To this end, through convenience sampling, 146 Iranian EFL teachers were selected to answer questionnaires on AL, JD-R, burnout and engagement. A series of multiple regression analyses were run to analyze the collected data. The results showed that some components of AL such as test construction, administering, rating, and interpreting test, psychometric properties of a test, using and interpreting statistics and authenticity were significant predictors of job demand. Moreover, the results revealed that alternative and digital-based assessment, recognizing test type, distinction and function, and authenticity were significant predictors of job resource. Furthermore, test construction, administering, rating, and interpreting test, psychometric properties of a test, and using and interpreting statistics could significantly predict teachers’ burnout. In addition, alternative and digital-based assessment, giving feedback in assessment, and ethical and cultural considerations in assessment turned out to significantly predict teachers’ engagement. These findings can have theoretical and practical implications for stakeholders.
EFL/ESL Teachers’ Writing Assessment Literacy: State of the Arts(مقاله علمی وزارت علوم)
حوزه های تخصصی:
The ability to assess the language learners’ progress has been known as one of the most important parts of EFL/ESL teachers’ literacy. Language assessment literacy (LAL). The notion of LAL has evolved over time, as a large number of researchers showed to be enthusiastic to study this research area. However, the number of studies on teachers’ Writing Assessment Literacy (WAL) is scanty. As writing skill is very necessary for language learners to communicate with native speakers of the English language, it is very important for writing teachers to develop assessment tasks to positively contribute to the rate of learners’ progress in writing skill. Therefore, it is of much significance to review the related studies on assessment literacy, language assessment literacy, and writing assessment literacy. In this review study, the relevant studies were reviewed and further directions for writing assessment literacy of EFL/ESL teachers are suggested to the researchers interested in the field.
Moving toward a Democratic Assessment Framework: Iranian EFL Teachers' Critical Language Assessment Literacy
حوزه های تخصصی:
In spite of the resurgence of interest in teachers' language assessment literacy (LAL), teachers' critical language assessment literacy (CLAL) has not garnered satisfactory prominence. This constitutes a substantial void in the extant corpus of literature that this study will address. To this illumination, a cross-sectional survey research approach utilizing the Critical Language Assessment Literacy (CLAL) scale (Tajeddin et al., 2022) was employed to accomplish the stated purpose of the study. The current study conveniently selected 120 Iranian EFL teachers in different language institutes and universities in Tehran and Kermanshah province. To analyze data, descriptive (e.g., mean and standard deviation) and inferential statistics (e.g., one sample t-test) were employed to illustrate a comprehensive answer to the study's primary research question. The results of the one-sample t-test and the mean value for all CLAL items showed that teachers have moderate or low knowledge of CLAL factors. In addition, the findings signposted that effective teachers must retain high linguistic competence, teaching/learning cognition, and knowledge of critical language assessment literacy factors; this could be accomplished by including these factors in teacher training programs. These findings displaying shortcomings and gaps in the critical language assessment literacy (CLAL) level of Iranian EFL teachers hold many theoretical and pedagogical implications for teacher development in the realm of assessment and testing at the practice, policy, and professional development levels.
Iranian EFL Teachers’ Oral/Aural Skills Language Assessment Literacy: Instrument Development and Validation
حوزه های تخصصی:
Despite widespread studies on language assessment literacy (LAL), there are still many unexplored areas about LAL (Gan & Lam, 2022). One of these areas is identifying various aspects of LAL regarding different language skills and scrutinizing the English as a foreign language (EFL) teachers’ involvement with these aspects. Accordingly, this study attempted to (a) explore Iranian EFL teachers’ perceptions, preferences, and difficulties of oral/aural skills LAL and (b) develop a scale to measure these teachers’ oral/aural skills LAL. The study was carried out in two phases. First, semi-structured interviews were conducted with 10 Iranian EFL teachers to identify their perceptions, preferences, and difficulties of oral/aural skills LAL. Second, the researchers developed a questionnaire based on a review of the literature on assessing oral/aural skills and the results of interviews. The questionnaire was reviewed by experts, revised accordingly, and administered to 150 Iranian EFL teachers who were selected through convenience sampling. The reliability of the questionnaire and its construct validity were then checked. The results of both phases of the study were compatible. The outcomes showed that almost all teachers represented dissatisfaction about their oral/aural skills LAL and they were enthusiastic to participate in assessment training courses. Furthermore, it was found that due to their lack of knowledge about oral/aural skills assessment, traditional techniques of assessment were widely used by Iranian EFL teachers.
Demystifying Iranian EFL Teachers' Alternative Assessment Literacy Beliefs, Practices, and Challenges: A Mixed Methods Study
حوزه های تخصصی:
The present study investigated Iranian EFL teachers' alternative assessment literacy (AAL). The study employed a sequential explanatory mixed methods design, including qualitative and quantitative approaches. To achieve more accurate results, the AAL inventory (Mertler & Campbell, 2005) and an interview with ten teachers (to explore their challenges) were used to collect the data. The study participants were 306 Iranian TEFL teachers teaching English in different language institutes in Tehran. The study results revealed that Iranian EFL teachers enjoyed moderate knowledge of AAL. Also, their beliefs in employing AAL standards in L2 classroom assessment and its related methods were valuable and appreciated presenting their awareness of the issue. In addition, they claimed to have used specific alternative assessment-related strategies and practices in the L2 classroom. The findings imply that EFL teachers' AAL is inadequate as they cannot perform well in practice, while theoretically, they are knowledgeable enough. Therefore, continuous in-service training programs on educational assessment and AAL should be considered to cater to teachers' assessment literacy problems in the Iranian context.
Language Assessment Practices and Training Preferences of EL Teachers: Iranian EFL Teachers in Focus(مقاله علمی وزارت علوم)
حوزه های تخصصی:
This research explores language assessment practices and training preferences in Iranian English as a Foreign Language (EFL) teaching, aiming to provide valuable insights into the current landscape among 363 Iranian EFL teachers. Data collection included diverse demographics, facilitating a thorough analysis of assessment practices and preferences. Statistical analyses, such as chi-square tests, revealed a significant gap between the perceived importance and the actual proficiency of Iranian EFL teachers. Speaking skills are prioritized while listening comprehension is least emphasized. Common assessment methods include active class participation, oral presentations, and closed-ended tests, with underutilized methods suggesting a need for broader teacher development programs. The study underscores the diverse terminology used for teacher-mediated assessments, emphasizing the multifaceted nature of EFL assessment practices. In summary, the paper highlights the significance of tailored assessment literacy programs to bridge the gap and enhance English language teaching in Iran.