Validation

The present study aimed to design and validate a “Critical Understanding of the Global Spread of English” Scale (CUGSES). To this end, a framework was designed based on the tenets of linguistic imperialism, English as an International Language (EIL), and globalization. The scale was then administered to a population of 425 participants, comprising English language teachers in language institutes, English language learners in language institutes, parents whose children attended English language institutes, university students majoring in English and English-major university professors. Rasch measurement was utilized to substantiate the construct validity of the instrument. The results of the Rasch analysis revealed that except for three items, the scale is unidimensional and meets the criteria to fit to the Rasch model. Next, exploratory factor analysis (EFA) was conducted to extract the factors underlying the scale. Five components were extracted and labeled as: domination of English language and culture, preference for home culture and language, age and medium of instruction, native speakerism, and localization in ELT. Implications of the newly- designed scale in the Iranian EFL context were then provided.

The role of teachers in the educational context could go beyond simply teaching the subject matter. It is not uncommon for some students to be greatly influenced by certain teachers and even consider them as their role models. An interesting and novel way of inferring the impact a teacher has on the students is through revealing the status of the teacher as perceived by the students. The present study pursued two goals: first, to construct and validate a teacher status scale (TSS); and second, to reveal the relative status of English language teachers as compared to other school teachers in students’ perceptions. Regarding the first goal, an 18-item teacher status scale was designed and, using the data collected from 200 students, its construct validity was substantiated through Rasch model. As for the second goal, 650 junior high school students rated their 300 teachers. The data was then analyzed using Chi-square test. In addition, 135 students participated in short interviews and a total of 530 minutes of recorded interviews constituted the qualitative data. Based on the results, English teachers were found to have the highest status of all school teachers as perceived by the students. Finally, statistical results were discussed, and implications were provided for English language teaching in the formal context of education.

The concept of teacher change is critical in second language teaching and English as a Foreign Language (EFL) context due largely to the fact that, almost, whatever we do in teacher education looks for initiating change of one sort or another. A substantial body of research has been dedicated to investigate teacher change (TC) from various perspectives. However, having studied the related literature, we found no robust, valid and reliable measure for TC in EFL context. Accordingly, effort was made to develop and validate a reliable and valid measure that could assess TC in an EFL context. The review of the prior research resulted in the collection of 186 items affecting TC out of which a temporary data driven model of teacher change was developed. 324 Ph.D. and M.A. graduated EFL teachers took part in exploratory and confirmatory factor analyses of the initial measure. Finally, a 66-item scale consisting of three components and thirteen sub-components was developed.The results showed both factorial validity andinternal consistency reliability for the measure.The TCSsubscales also had strong validity evidence based on the associationsfound. This study has various applications for language teachers and practitioners in the field.

Although decades of research have well elaborated on teacher professional development, we still do not have a thorough picture about what teacher professional development could entail and what components it consists of. The present study aims to develop and validate a teacher professional development scale in an Iranian English foreign language context. An initial tentative model with 130 items was piloted and tested through exploratory and confirmatory data analyses on a sample of 400 EFL teachers. This level resulted in the removal of 28 items in our sample loaded, resulting in a final 102 teacher professional development inventory. The developed inventory measures the extent to which EFL teachers are professionally developed and makes teachers aware of multiple characteristics of professionally developed teachers. These competencies are essential components of teacher professional development, enabling the teachers to utilize them in everyday teaching and learning practices in the classroom settings which, as a result, leads to student achievement. As teachers fulfill important professional roles, they need valid instruments to assess their day-to-day functioning in the class. With the instrument developed and validated in the current research, we, in fact, allow language teachers to assess their extent of professional development in different pedagogical contexts.

Mathematical models have the potential to provide a cost-effective, objective, and flexible approach to assessing management decisions, particularly when these decisions are strategic alternatives. In some instances, mathematical model is the only means available for evaluating and testing alternatives. However, in order for this potential to be realized, models must be valid for the application and must provide results that are credible and reliable. The process of ensuring validity, credibility, and reliability typically consists of three elements: verification, validation, and calibration. Model verification, validation and calibration are essential tasks for the development of the models that can be used to make predictions with quantified confidence. Quantifying the confidence and predictive accuracy of model provides the decision-maker with the information necessary for making high-consequence decisions. There appears to be little uniformity in the definition of each of these three process elements. There also appears to be a lack of consensus among model developers and model users, regarding the actions required to carry out each process element and the division of responsibilities between the two groups. This paper attempts to provide mathematical model developers and users with a framework for verification, validation and calibration of these models. Furthermore, each process element is clearly defined as is the role of model developers and model users. In view of the increasingly important role that models play in the evaluation of alternatives, and in view of the significant levels of effort required to conduct these evaluations, it is important that a systematic procedure for the verification, validation and calibration of mathematical models be clearly defined and understood by both model developers and model users.

The purpose of this study was to design and validate the environmental curriculum framework based on the upstream documents in the middle school, which was carried out using a qualitative-quantitative method with exploratory design in two sections. The research population in the first section of the research was upstream documents. The sampling method from this population was criterion-based. The data collection tool comprised a checklist and taking notes whose validity was assessed and approved by experts, masters, and professors. The output of this section was the environmental curriculum framework in the format of four elements of the curriculum (purpose, content, method, evaluation), which was used to validate the 42-item questionnaire. The validity of the questionnaire approved from the experts' point of view and reliability by Cronbach's alpha coefficient. The statistical population of the study in the validation section comprised 2259 people of the experts and masters of the social sciences, experimental sciences, and Farsi literature from six districts of education in Isfahan in the academic year of 2018-19, of which, 329 people were selected by categorized relative random sampling. The data obtained from this section were analyzed using confirmatory factor analysis method using Lisrel software. The results showed that the fitness was appropriate for the proposed model based on the indexes (X2/df=1.947), (GFI = 0.95), (AGFI = 0.90), (RMR = 0.81).

This study was an endeavor to develop a model of cultural identity among Iranian advanced EFL learners. To achieve this end, a multiphase design was implemented. Initially, it was attempted to investigate different factors of cultural identity to propose and validate a model. Thus, 20 EFL learners studying in Safir English language institute in Tehran were interviewed about their views of their cultural identity in the qualitative phase. After extracting four factors of cultural identity including: “religion, culture, nationality, and language”, a questionnaire was constructed which reflected these factors. Then, in the quantitative phase, the 30-item questionnaire went through an exploratory factor analysis for the sake of validity and after its validity and reliability were corroborated through a pilot study with 183 learners, it was distributed among 384 EFL learners. In addition, Structural Equation Modeling (SEM) analysis was run through LISREL 8.8. to confirm that the final proposed model enjoyed validity for future research. To do so, a confirmatory factor analysis was run and the model of cultural identity was developed. Eventually, the possible relationship between 384 EFL learners’ cultural identity and their English language achievement scores was examined and the results of this phase indicated that there was a significant and positive relationship between learners’ cultural identity and their English language achievement scores. The findings of this study can enhance awareness among English teachers, materials developers, and syllabus designers to equip themselves with the updated techniques to handle the possible challenges that may occur in EFL learning contexts.

Despite being trained in pre-service teacher education programs, most EFL teachers are underprepared when faced with language assessment-related activities. Part of the problem emanates from the fact that Language Assessment Literacy (LAL) as a construct has not been well defined by experts. The purpose of this study was to pinpoint the components of LAL in the Iranian EFL context using an adapted version of Fulchers' (2012) LAL survey with two types of constructed and closed response items. The participants were 280 English language teachers from seventeen different provinces in Iran. Exploratory and confirmatory factor analyses and cross validation were used to define LAL as a construct. Furthermore, qualitative data analysis procedures were employed to analyze the data obtained from constructed response items. The results indicate that LAL in the Iranian context is comprised of four factors, namely: test design and development, large-scale standardized testing and classroom assessment, beyond-the-test aspects (which mainly includes social and ethical aspects of language testing/assessment), and reliability and validity. Furthermore, the results show that the EFL teachers in this study believe that besides the theoretical issues of assessment, they should also receive hands-on skills-based instruction in language assessment. These results can have direct implications for future teacher education programs with the aim of enhancing EFL teachers' LAL.

Grammatical competence constitutes an important component of communicative ability, the acquisition of which takes sustained effort, resilience, and planning, otherwise known as the capacity for self-regulated learning. It follows that assessing the self-regulatory capacity in grammar learning (SRCgram) is of prime importance. This paper reports on the development and validation of a scale for measuring SRCgram. Focus group interviews were conducted with 26 participants and a pool of 52 items was created and piloted. Exploratory and confirmatory factor analyses were then conducted to examine the psychometric properties of the instrument. Preliminary fit indices, internal structure fit of the model, and overall model fit provided evidence for the validity of the scale.  In addition, the SRCgram scale appeared to be unidimensional and of satisfactory reliability. Thus, SRCgram scale can be proposed as a diagnostic and self-assessment tool to be used by EFL teachers and learners to diagnose, assess, and foster self-regulation in grammar learning.

The present research aimed to conceptualize the construct of Teacher Assessment Identity (TAI) by designing and validating a questionnaire in the Iranian EFL context. In so doing, a tentative scale with 96 items was piloted on 340 novice and experienced Iranian EFL teachers using Exploratory and Confirmatory Factor Analysis (EFA, CFA). The results of the analyses led to the removal of 33 items, leaving the questionnaire with 61 items on a five-point Likert scale. Moreover, the results revealed that the construct of TAI has 12 factors including assessment “knowledge”, “beliefs”, “attitudes”, “skills and confidence”, “practices”, “use assurance”, “feedback”, “rubric/criteria”, “consistency and consequence”, “grading/scoring”, “question-types”, and “roles”. Likewise, the convergent validity and reliability of the instrument to measure the construct of concern was statistically confirmed (p>.05). The findings have various implications for EFL teachers, teacher trainers, course designers, and language researchers by raising their awareness of assessment identity and its underlying components.

Simultaneous with the emergence of numerous new concerns and techniques in carrying out research in English language teaching (ELT) contexts, conducting ELT research has turned into a multi-dimensional process, and ELT researchers seem to require advanced research skills in order to address different pedagogical issues. Focusing on quantitative research, the present study was undertaken to develop and validate a quantitative research literacy (QRL) instrument for English as a foreign language (EFL) teacher training context. To this objective, a four-component model of QRL, encompassing developing research topic knowledge, research design knowledge, procedural knowledge, and data analysis knowledge was developed based on experts’ opinion and an extensive review of the related literature. Testing of the tentative model through exploratory and confirmatory data analyses on a sample of 1180 EFL teachers across three education levels indicated that a 4-factor model of QRL with 9 sub-factors and 50 items could best explain QRL.

Abstract Addressing the limitations and criticisms of cloze tests, Klein-Braley and Raatz suggested a modified version of the cloze test called the C-test where the ‘C’ stands for cloze. They introduced the C-test as a better representation of the reduced-redundancy principle. In C-tests, several shorter texts involving a larger number of items completed within a shorter amount of time while cloze tests usually consist of one or two longer texts with less items. This study reports on the results of a research program carried out to validate the C-test amongst Afghan EFL learners. One hundred advanced English majors were administered two different language tests namely a language proficiency test (composed of listening, reading, and writing) and a C-test composed of four different texts to measure the overall language ability of the participants. Various analyses were to measure the validity and reliability of the C-test. The results of the study confirmed that the C-test is a reliable and valid test which can be used as a general English language proficiency test among Afghan students of English as a foreign language.

Introduction: One of the basic human needs that plays a vital role in sustainable development is mental health. In the digital age, Internet addiction is a threat to mental health. So this study aimed at validating the treatment entry questionnaire for Tehran University students in 2019. Method: Participants were 324 undergraduate and postgraduate students of state universities in Tehran, who were selected through one-step cluster random sampling. All participants completed the Urbanoski and Wild’s (2012) Treatment Entry Questionnaire, the Miler and Tonigan (1996) Change Readiness and Treatment Eagerness Scale, and the Young Internet Addiction Questionnaire. Results: Data were analyzed using the confirmatory factor analysis model. Confirmatory factor analysis of the data showed that the three-factor structure of the identified, intrinsic, and extrinsic treatment motivation has a good fit, and the validity of the scale was confirmed by face and content validity. Convergent validity evidence confirmed the positive relationship between identified, intrinsic, and extrinsic treatment motivation with subscales of recognition, taking the step, and ambivalence of the Readiness for Change and Treatment Motivation scale. Cronbach's alpha test was used to assess the reliability of the whole scale (0.95) and each subscale of identified motivation (0.94), intrinsic motivation (0.89), and extrinsic motivation (0.86). Conclusion: The results showed that the Persian version of the treatment entry scale for the student population has acceptable psychometric properties and can be used as a valid tool in psychological research.

INTRODUCTION: Maintaining the mental health of relief workers requires improving their psychological abilities. The present study is carried out with the aim to identify the components affecting the psychological empowerment of the relief workers and to construct a tool appropriate to the psychological requirements and characteristics of the relief activities to measure the components of the occupational psychological empowerment among them. METHODS: This was an applied study performed with quantitative and qualitative methods (Mixed Method) in different stages in accordance with the study objective. FINDINGS: In this study, 351 relief workers cooperated with an average age of 28.56 and standard deviation 8.13. The findings from the completion of questionnaires confirmed the six factors of resilience, self-management, psychological hardiness, problem-solving ability, decision-making, and emotional intelligence (EI) on the researcher-made scale. The most important factor in this study was the resilience factor with the greatest impact on the job psychological empowerment of the relief workers.

Objective:   This research aims to design and validation of youth high-risk behaviors short scale. Methods:  In this research, the descriptive-survey method was used. The statistical population was all students of Mashhad universities which 681 students were randomly selected from multi-stage cluster types. The tools used also included: youth high-risk behaviors short-scale developed by the researcher, as well as the Big Five-Inventory (2007) and Psychological Well-being Scale (1989). Results: The results showed that 14-item high-risk behaviors scale has good psychometric properties and is the norm with Iranian society. The validity of the scale was good with the methods of construct validity (confirmatory factor analysis) and convergent and divergent validity (p<0.01). The results of confirmatory factor analysis also confirmed the seven-factor nature of the scale, and the obtained model had a good fit with the research data. The Cronbach's alpha coefficient of the whole scale was 0.82. Conclusion: Therefore, researchers and health professionals can use this tool in their future studies due to its unique features.

Purpose: The purpose of this study was to design an internal positioning model of state-owned banking services and accreditation. Method: The present study was applied and exploratory. The statistical population of the qualitative stage were the managers of the branches of agricultural, national and housing banks of Khorasan Razavi province and university professors in the field of management who were selected as the sample size by theoretical saturation method. According to Morgan's table, 284 people were selected by simple random sampling as the sample size. For data collection in the qualitative part of the interview and in the quantitative part of the researcher-made questionnaire was used. In order to analyze the data in the qualitative part, the theory of grounded theory and the method of Strauss and Corbin and Maxquda software and in the quantitative part, the technique of structural equations and PLS2 software have been used. Results: The results showed that the model presented in 6 dimensions of causal factors, contextual, intervening, pivotal, strategies and consequences has a good fit. Conclusion: Based on the research findings, they should pay attention to social and personal interactions in order to strengthen their relationships with customers.

Purpose: Epistemology as one of the philosophical foundations in the field of education can play an important role in blended learning, ie using more than one method, strategy and technique for learning. Therefore, the present study was conducted with the aim of designing and validation the epistemological model in blended learning Methodology: The present study was applied from type of qualitative-quantitative. The population of the qualitative section was the documents related to epistemology and blended learning in the years 1990 to 2020 which 80 books, 60 dissertations and 60 articles were selected by purposive sampling method and in addition, included experts in the field of philosophy of education and distance learning which based on the principle of theoretical saturation number of 10 people of them were selected by purposive sampling method. The population of the quantitative section were faculty members and doctoral students of the department of philosophy of education and distance learning of Payame Noor University in 2020-2021 years which based on Krejcie and Morgan's table number of 200 people of them were selected by stratified random sampling method with using the teacher and student ratio. The tool of the qualitative section was the recording of books, dissertations and articles and interviews with experts, and the tool of the quantitative section was a researcher-made questionnaire whose psychometric indicators were confirmed. Data were analyzed by coding method in MAXQDA software and exploratory factor analysis and one-sample t-test in SPSS software. Findings: Findings showed that the epistemological model in blended learning had 60 subcategories in 9 categories including purpose, evaluation, educational correction, content, teaching method, teacher, learner, media and cognitive presence that its model was drawn. Also, validation of model indicated that the factor load of all 6 questions related to validation of model was higher than 0.30, their validity was higher than 0.50 and their reliability was higher than 0.70. In addition, the mean of all 6 questions was higher than the hypothetical mean of the population (P<0.001). Conclusion: The findings showed that the designed model for epistemology in blended learning had good validity. Therefore, curriculum specialists and planners can use this model along with other models to improve blended learning

The measurement of test-taking strategies and practices, mostly studied through qualitative methods, has been an important aspect of language testing and assessment research. The current study examines the test-taking strategies of International English Language Testing System (IELTS) test-takers and reports the process of designing and validating an IELTS test-taking strategy questionnaire. To achieve this aim, a questionnaire with 62 items was developed and piloted on 534 IELTS test-takers. To ensure its validity, the questionnaire results were analyzed through Exploratory and Confirmatory Factor Analyses (EFA and CFA). The final 49-item instrument with eight factors, “test-management (TM)” and “test-wiseness (TW)” strategies in each skill, had adequate psychometric properties. The findings revealed positive correlations between TM and TW strategies, representing strong correlations between Reading TM and Listening TM, Reading TW and Listening TW, and Listening TM and Speaking TM. The developed questionnaire can serve as a diagnostic tool to monitor test-takers’ performance and strategies, mainly in high-stakes tests like IELTS.

Dictation is a traditional technique for both teaching and testing overall language ability and listening comprehension. In a dictation, a passage is read aloud by the teacher and examinees write down what they hear. Due to the peculiar form of dictations, psychometric analysis of dictations is challenging. In a dictation, there is no clear boundary between the items and every word in the text is potentially an item. This makes the analysis of dictations with classical and modern test theories rather difficult. In this study, we suggest a procedure to make dictations analyzable with psychometric models. Our strategy entailed using several independent short passages instead of a single long passage. The number of mistakes in each passage was counted and entered into the analysis. Rasch model analysis was then applied to the passage scores (mistakes). Our findings showed that dictations fit the Rasch model very well and it is possible to measure examinees’ ability on an interval scale using dictations.