مطالب مرتبط با کلیدواژه
۱.
۲.
۳.
۴.
۵.
۶.
۷.
۸.
۹.
۱۰.
۱۱.
۱۲.
۱۳.
۱۴.
۱۵.
۱۶.
۱۷.
۱۸.
۱۹.
۲۰.
Validity
حوزه های تخصصی:
Locus of control is said to affect learners' academic achievement. This effect has scarcely been examined within general English context. This study is concerned with examining the differences in General English (GE) course achievement among university students of humanities, sciences, and engineering. It also explores the effect of locus of control (LOC) in GE course achievement among these three groups of university students. The results of the study indicate that: 1. There is a significantly positive relationship between the university students' LOC and their GE achievement course, 2. There are significant differences in GE course achievement among the three groups of students, and 3. There are significant differences in LOC among the three groups of university students. The results of the participants' interviews were also in agreement with those of the questionnaires. The findings of this study postulate that encouraging students to seek ways to improve their self-efficacy can be really helpful for them to achieve higher scores in GE course.
Differential Item Functioning (DIF) in Terms of Gender in the Reading Comprehension Subtest of a High-Stakes Test(مقاله علمی وزارت علوم)
حوزه های تخصصی:
Validation is an important enterprise especially when a test is a high stakes one. Demographic variables like gender and field of study can affect test results and interpretations. Differential Item Functioning (DIF) is a way to make sure that a test does not favor one group of test takers over the others. This study investigated DIF in terms of gender in the reading comprehension subtest (35 items) of a high stakes test using a three-step logistic regression procedure (Zumbo, 1999). The participants of the study were 3,398 test takers, both males and females, who took the test in question (the UTEPT) as a partial requirement for entering a PhD program at the University of Tehran. To show whether the 35 items of the reading comprehension part exhibited DIF or not, logistic regression using a three step procedure (Zumbo, 1999) was employed. Three sets of criteria of Cohen’s (1988), Zumbo’s (1999), and Jodin and Girel’s (2001) were selected. It was revealed that, though the 35 items show “small” effect sizes according to Cohen’s classification, they do not display DIF based on the other two criteria. Therefore, it can be concluded that the reading comprehension subtest of the UTEPT favors neither males nor females.
The Relationship between Translation Tests and Reading Comprehension: A Case of Iranian University Students(مقاله علمی وزارت علوم)
حوزه های تخصصی:
The present study seeks to investigate the potentiality of the translation task as a testing method for measuring reading comprehension. To achieve this objective, two types of translation tests, open-ended and multiple-choice tests, and two types of reading comprehension tests, multiple-choice reading comprehension and open-ended cloze tests were developed in this study. The reliability of the tests was computed in order to estimate which translation test was more reliable and valid. Correlation coefficients were run in order to investigate whether translation tests worked as reliable and valid measures of reading comprehension, and to examine the relationship between proficiency in reading comprehension and proficiency in translation. The results indicate that the open-ended translation test is more reliable and valid than the multiple-choice one; translation has a high potentiality to work as a reliable and valid tool to assess reading comprehension; and there exists a high positive correlation between the participants’ proficiency in reading comprehension and their proficiency in translation. The findings of this study might have pedagogical implications for instructors. They may be justified to highlight the role of translation tests and benefit from them in their reading comprehension classes.
Development and Validation of Teacher Emotional Support Scale: a structural equation modeling approach(مقاله علمی وزارت علوم)
حوزه های تخصصی:
Reviewing the literature indicated that no validated model was found that examine the extent to which teachers support their students emotionally in EFL classrooms. Therefore the present study elaborated on this issue through developing and validating a teacher emotional support scale in an Iranian English foreign language context. Main components of the scale have been specified based on Hamre and Pianta's (2007)theoretical framework. A large number of items were created primarily based on operational definitions of each component. After reviewing the items by a group of experts, the questionnaire was piloted and tested on a sample of 324 EFL teachers. Finally, the researchers evaluated the validity of the questionnaire through exploratory and confirmatory factor analysis.The results of the reliability of the questionnaire estimated through Cronbach’s alpha were 0.833. 17 items have been removed from analysis resulting in identifying 4 factors in exploratory factor analysis. The model was evaluated using AMOS 22 also indicated that the model was fit the data.the current study contributes to the field of English language education through designing and validating new instrument to assess teacher emotional support in EFL classrooms. Researchers and other practitioners who are involved in teaching English language can assess the extent to which teachers support students emotionally in similar pedagogical EFL context using this instrument. They also need to encourage teachers to improve their emotional skills by participating in teacher training courses.
Investigating the Reliability and Factor Structure of the Self-Regulating Capacity in Vocabulary Learning (SRCvoc) in Iranian EFL Context(مقاله پژوهشی دانشگاه آزاد)
منبع:
The Journal of English Language Pedagogy and Practice, Vol.۱۰, No.۲۰, Spring & Summer ۲۰۱۷
169 - 186
حوزه های تخصصی:
The present study aimed to investigate the reliability and factor structure of the self-regulating capacity in vocabulary learning strategies scale (SRCvoc) in the Iranian EFL context. To this end, the original (SRCvoc) questionnaire (Tseng, Dornyei, & Schmitt, 2006) was translated into Persian, using a translation/back-translation procedure. Then, the Persian version of the SRCVOC was piloted to 43 high school students and showed acceptable internal consistency reliability (α = .81). In the main phase of the study, a sample of 1167 high school students (grades 9-12) from fifteen high schools in three Iranian cities completed the Persian SRCvoc. Based on the results, the Persian version of the scale demonstrated acceptable internal consistency reliability (<em>α </em>= 0.81). The factor structure of the translated version of the measure was investigated through a series of factor analyses. The results showed that the translated SVLSQ is composed of one dimension with five subcomponents, with a different factor structure as compared to the original questionnaire. The findings of the study suggest that the Persian version of the SVLSQ is a reliable and valid instrument for measuring self-regulatory vocabulary learning strategies in Iran.
Investigating validity and reliability and factor analysis of Webster's Wisdom Questionnaire in Iran(مقاله علمی وزارت علوم)
حوزه های تخصصی:
Webster's Wisdom Questionnaire is a well-known self-assessment scale, which can cover a wide range of future wisdom studies. This research was conducted with the aim of factor analysis and examining the reliability and validity of Webster's Wisdom Questionnaire and to evaluate the relationship between wisdom and age and gender. This questionnaire contains 40 questions assessing the people's wisdom. In a cross-sectional study, 395 (293 males and 102 females) of Sanandaj city, selected by randomized cluster sampling, were assessed using Webster's Wisdom Questionnaire. Data were analyzed using correlation coefficient, factor analysis and t-test. Using factor analysis, four factors of the proper use of experiences, emotional regulation, reflection, and humor were extracted. To assess the reliability of this questionnaire, Cronbach's alpha and Pearson correlation were used. The results revealed that this questionnaire had good convergent validity. In addition, the comparison of these factors between males and females indicated that females significantly obtained higher score than males in two factors of using the experiences and emotional regulation. Moreover, the high correlation of factors with the total score of the questionnaire and poor correlation of the factors with each other reflect the adequacy and efficiency of this questionnaire to be used by researchers, experts, and psychologists in Iran.
Quantifying Investment in Language Learning: Model and Questionnaire Development and Validation in the Iranian Context(مقاله علمی وزارت علوم)
حوزه های تخصصی:
The present exploratory study aimed to provide a more tangible and comprehensive picture of the construct of investment in language learning through investigating the issue from a quantitative perspective. To this end, the present researchers followed three main phases. First, a hypothesized model of investment in language learning with six components was developed for the Iranian English as a foreign language (EFL) learners based on the extensive readings of the literature on investment, consultations with a panel of experts, three university professors in the relevant fields, and interviews with 20 language learners. Second, a questionnaire was developed and validated based on the proposed model to represent its components. Finally, the data collected through this questionnaire were fed into the model to see to what extent the model fitted the data. The participants were male and female English language learners belonging to different age groups and English language proficiency levels.The initial results showed poor values; however, the model was trimmed by removing one item from the questionnaire, and final statistical indices showed that the model fitted the data.
Psychometric Properties of Multiple Intelligence Developmental Assessment Scales (MIDAS) for Adults in the Iranian Context(مقاله علمی وزارت علوم)
منبع:
Issues in Language Teaching (ILT), Vol. ۸, No. ۱, June ۲۰۱۹
165 - 194
حوزه های تخصصی:
This study reports psychometric properties and derivation of norms for a Persian version of the Multiple Intelligence Developmental Assessment Scales (MIDAS) for Adults. After examining and confirming equivalency between English and Persian versions, translated and validated by Saeidi, Ostovar, Shearer, and Asghari Jafarabadi (2015), the scale was administered to a sample (N = 2146), including students, undergraduates, graduates, and adults from different provinces in Iran. The participants were at least 19 years old and above (M = 29.40, SD = 2.26). Out of 2146 samples, 1103 females and 1043 were males. To examine the validity and reliability properties of the scale, exploratory and confirmatory factor analyses, Cronbach Alpha (α) reliability correlation coefficients, and corrected item-total correlations were employed. Exploratory factor analysis using varimax rotation identified eight principal components, which accounted for 67.21% of the variance for 115 items. The internal consistency coefficient (α = .92; ranging from 0.89 to 0.93) was also very high. The confirmatory analysis generally replicated the original conceptualization of the MIDAS. According to the results, the Persian-MIDAS-adults questionnaire has good psychometric properties in the research community and can be safely used as a valid tool to assess MI in Iran.
Test-taking Strategies and EFL Learners’ Performance on the Reading Sub-test of Iranian Universities PhD Entrance Exam
منبع:
international Journal of Foreign Language Teaching & Research, Volume ۷, Issue ۲۷, Autumn ۲۰۱۹
71-85
حوزه های تخصصی:
The present study was an attempt to investigate the validity of the English section of Iranian Universities PhD Entrance Exam in TEFL. To this end, 15 EFL learners from university of Isfahan who were in their last semester of that MA education were invited to contribute to the study. A group of 5 university lecturers were also asked to support the study as expert judges. A TOEFL reading paper was used to divide the participants into three ability groups, each consisting of five learners. Think-aloud study was used to find out the strategies each ability group used when completing the test. All the participants completed the reading section of the PhD Entrance Exam while verbalizing their thoughts. The verbal reports were transcribed and coded based on Barati’s (2005) taxonomy of Test-taking strategies. The Chi- square analysis of the think aloud protocols revealed that Monitoring and Evaluation strategies were used significantly more than other strategies by all ability groups. Moreover, the results indicated that the high ability group of test takers were more successful compared with others in maneuvering among different type of strategies. Further, different patterns of strategy use were observed in the three ability groups. The findings of the present study may be of interest to the PhD Entrance Exam developers as well as EFL material designers and classroom instructors.
Validity and Reliability Reports in Applied Linguistics Research Articles: The case of tests and questionnaire
منبع:
international Journal of Foreign Language Teaching & Research, Volume ۷, Issue ۲۸, Winter ۲۰۱۹
121-134
حوزه های تخصصی:
This study intended to determine the way validity and reliability i.e., psychometric properties were reported in the Applied Linguistics research articles. The study also focused on the measurement methods applied to determine the validity and reliability of the scores derived from the tests and questionnaires in the empirical studies. The corpus of the study included 331 empirical studies derived from 733 research articles (RAs) published between 2005 and 2018 in three prominent Applied Linguistics journals – Applied Linguistics, Modern Language Journal, and TESOL Quarterly, The selected papers used test and/or questionnaire for data collection. Our analysis indicated that 77(20.98%) of the studies did not report validity and reliability measures, 82(22.35%) reported only reliability measures, 26(7.08%) reported only validity measures, and 182(49.59%) reported both the validity and reliability measures for the instruments. It was also found that content validity assessed through the pilot study had the highest frequency among validity evidences while internal consistency, mostly identified by Cronbach's alpha, was the most frequent reliability evidence.
Investigating Fairness of Reading Comprehension Section of INUEE: Learner’s Attitudes towards DIF Sources
منبع:
International Journal of Language Testing, Volume ۱۰, Issue ۲, Summer and Autumn ۲۰۲۰
88 - 100
حوزه های تخصصی:
The purpose of the present study was two-fold: (a) First, it examined fairness of Special English Test (SET) of Iranian National University Entrance Exam (INUEE) by analyzing Differential Item Functioning (DIF) with reading comprehension section of this test (b) second, it explored test takers’ attitudes towards possible sources of unfairness and DIF. In the quantitative part of the study the data from 10000 test takers (6820 females and 3180 males) were analyzed for gender DIF using Mantel-Haenszel (MH) technique. It was revealed that only 6 items in the reading comprehension skill showed DIF. Further analysis manifested that the effect size of DIF for all six items were category A or negligible. Moreover, qualitative interview results indicated that learners generally considered the test a fair one while some potential sources of bias such as topic familiarity, multiple-choice format of the test, topic interest, passage length, and complex structure of test items were mentioned.
Translation Quality Assessment Rubric: A Rasch Model-based Validation
منبع:
International Journal of Language Testing, Volume ۱۰, Issue ۲, Summer and Autumn ۲۰۲۰
101 - 128
حوزه های تخصصی:
The present study aimed to examine and validate a rubric for translation quality assessment using Rasch analysis. To this end, the researchers interviewed 20 expert translation instructors to identify the factors they consider important for assessing the quality of students’ translation. Based on the specific commonalities found throughout the interviews, a 23-item assessment rubric was constructed on a four-point Likert scale. More specifically, this study used the Rasch rating scale model for polytomous data to investigate the psychometric properties of the rating scale in terms of dimensionality, reliability, use of response category, and sample appropriateness. Then, a translation exam was administered to 60 translation students at the BA level in Iranian universities. Following this, the rubric was employed to assess the quality of students’ translation. The results revealed that the Rasch model fits the data well. Thus, the findings of the study indicated that the rubric is potentially valid and useful, and can be used as a measure of translation quality assessment in the Iranian context.
Language Learners' Imagined Communities: Model and Questionnaire Development in the Iranian Context(مقاله علمی وزارت علوم)
منبع:
Applied Research on English Language, V. ۹ , N. ۲ , ۲۰۲۰
155 - 182
حوزه های تخصصی:
This study aimed to overcome the researchers' extreme attention to essentially qualitative methods in research on language learners' imagined communities and move towards quantification in order to achieve a more tangible image of this construct. To do so, the present researchers followed three main phases. First, a hypothesized model of language learners' imagined communities with eight components was developed for the Iranian context based on the wide-ranging readings of the literature on imagined communities, consultations with experts and interviews with language learners. Second, a questionnaire was developed and validated based on the model to represent its components. Finally, the data collected through the questionnaire were fed into the model to see to what extent the model fit the data. The initial results showed poor values; however, the model was trimmed by removing one item from the questionnaire, and final statistical indices showed that the model was fit.
The Process of Enhancing Validity, Reliability, and Ethics in Research(مقاله علمی وزارت علوم)
حوزه های تخصصی:
Many types of research are carried out in the field of ELT. Therefore, different types of studies are performed by post-graduate students, teachers, professors, and researchers. However, the main concern of the present article is that whether the post-graduate students, teachers, and professors have the necessary knowledge on three important research points: validity, reliability, and ethics. To this end, this article discusses these three issues and sheds some light on them. In fact, validity is concerned with the correctness of inferences according to the results and instruments. Meanwhile, reliability deals with the quality and consistency of the data collection procedures. In order to calculate the reliability of the data, Cohen Kappa’s inter-rater agreement is presented and explained by means of a vivid example. Finally, ethics is an area of moral philosophy concerning the rules by which behavior needs to be directed. Finally, some means and ways of increasing and enhancing the validity, reliability, and ethics of the research are introduced and elaborated on. By providing comprehensive details and vivid examples, this article can be useful and helpful to post-graduate students, teachers, professors, and researchers in carrying out research and ensuring and quarantining their data, data collection procedures, and instruments.
Constructing and Validating an EFL Hidden Curriculum Scale Using the Rasch Model(مقاله علمی وزارت علوم)
حوزه های تخصصی:
Whether acknowledged or neglected by educators, the hidden curriculum is present in every institute. Therefore, studying the hidden curriculum is essential to understand how it functions within an English language institute’s setting and among those within it. The purpose of this study was to design and validate a scale to measure language teachers’ perspectives on English as a Foreign Language (EFL) hidden curriculum by the application of the Rasch model. The review of the literature indicated the lack of sufficient research on the investigation of EFL hidden curriculum components in the view of EFL teachers. To fill the existing gap in the literature, a 40-item questionnaire was devised and validated, then 164 Iranian EFL teachers, teaching at different language institutes were asked to reply to the questionnaire. In this study, hidden curriculum components were based on Saylor, Alexander, and Lewis’ (1981) perspectives. Accordingly, items were classified into three different constructs, namely the social atmosphere (including 15 items), the organizational structure of the English Language Institute (consisting of 14 items), and the interaction between teachers and learners (including 11 items). The results showed that the questionnaire items fitted the Rasch model after removing six items from the scale. Moreover, it was confirmed that the scale enjoyed suitable reliability. This proposes that the questionnaire is potentially valid and can be used as a measure of EFL hidden curriculum. One of the study implications is that the questionnaire designed and validated in this study can be used as a research tool in future research to assist policymakers and material designers, institutions’ administrators, and language teachers to be considered for future decision making, and designing materials. It also can be used as a research tool to measure the relationship between EFL hidden curriculum and other variables in future research.
Mokken Scale Analysis of the Reading Comprehension Section of the International English Language Testing System (IELTS)
منبع:
International Journal of Language Testing, Volume ۱۱, Issue ۲, Summer and Autumn ۲۰۲۱
91 - 108
حوزه های تخصصی:
Large-scale standardized ESL tests such as the International English Language Testing System (IELTS) are widely used around the world to measure language proficiency of test takers and make different decisions based on their scores. Reading comprehension is an integral part of such tests which requires test takers to read passages and answer a set of questions. Although IELTS is a popular standardized test and is used for making critical decisions about test takers, very few attempts have been made to explore the validity of the exam and especially the reading part of the General Training Module. With this in mind, the purpose of the present study was to use a non-parametric item response theory model, called Mokken Scale Analysis (MSA), to examine the validity of the reading part of the General Training module of IELTS. To this end, item responses of 352 test takers to the reading comprehension test were analyzed. The results of item scalability, total scalability, and item-pair scalability showed that the reading part is a weak unidimensional scale. Using Monotone Homogeneity Model (MHM), monotonicity results also indicated that there are some items which violate the monotonicity assumption, although their values are insignificant. The analysis of unidimensionality using the AISP revealed that there are two scales and four unscalable items in the reading part. Therefore, Mokken scale analysis did not support the unidimensional structure of the reading part of the General Training module of IELTS.
A Survey on Intercultural Contact (IC) among Iranian EFL Students: Validating a Questionnaire(مقاله پژوهشی دانشگاه آزاد)
منبع:
The Journal of English Language Pedagogy and Practice, Vol.۱۴, No.۲۹, Fall & Winter ۲۰۲۱
19 - 40
حوزه های تخصصی:
Intercultural contact (IC) among students has received a great prominence in EFL and ESL contexts in recent years; therefore, this study was an attempt to modify and validate a questionnaire as an instrument to elicit the resources from which Iranian EFL students obtain their IC information. To reach this aim, a modified version of Peng and Wu’s questionnaire with 26 items and five factors was administered among 200 male and female Iranian EFL students from different language institutes in Tabriz, Iran. To determine the reliability and validity of the modified questionnaire, the statistical analyses of the model and fitness of the questionnaire were conducted by SmartPLS3 software. The results of reliability analyses using three measures of Cronbach’s alpha, combined reliability (CR) and average variance extraction (AVE) demonstrated that the questionnaire has a good reliability. Moreover, the results of construct crossvalidated communality (Q²) proved the construct validity of the questionnaire. Additionally, the results of correlation coefficient matrix and p value for all the latent variables demonstrated that all the paths and relationships in the model are significant and the model is a good fit. This study also clarifies the implication of such a questionnaire for ELT and presents some suggestions for future studies.
A Brain-Friendly Teaching Inventory: A Rasch-based Model Validation(مقاله پژوهشی دانشگاه آزاد)
منبع:
The Journal of English Language Pedagogy and Practice, Vol.۱۴, No.۲۹, Fall & Winter ۲۰۲۱
100 - 120
حوزه های تخصصی:
Teachers usually teach according to how brains naturally learn. In this way, not only do their learners learn, retain, and recall quickly, but also the teaching becomes more joyful. Increased attention to the worthwhile role of the mind in learning/teaching in recent times Due to the lack of a valid scale for estimating teachers' awareness of brain-friendly teaching, the current study intended to construct and validate a 54-item brain-friendly teaching inventory by the implementation of the Rasch model. The test was administered to 200 Iranian EFL teachers from different educational contexts. The results revealed that all the 54 items of the scale had a good fit to the Rasch model. Infit and outfit values were within the acceptable range which indicates unidimensionality of the scale. Furthermore, it is asserted that the inventory enjoyed suitable reliability. This demonstrates that the Brain-Friendly Teaching Inventory is valid and can be applied as a scale for assessing the teachers' awareness of brain-friendly teaching.
Preliminary Analysis of Psychometric Properties of Speech Anxiety Thoughts Inventory (SATI)(مقاله علمی وزارت علوم)
حوزه های تخصصی:
This study aimed to evaluate causal explanation of the relationship between emotional expression and marital maladjustment based on the mediating role of empathy among divorce stage couples. This research conducted through a descriptive method and the study design was correlation in the form of path analysis. The statistical population consisted all couples applied for divorce (aged 30-50) who referred to the counseling centers of the Judiciary in Tehran during 2020-2021. The sample size determined 396 cases and selected through convenience sampling method. In order to collect the information, standard questionnaires of marital maladjustment, couple empathy, and emotional expression were used. Data's analyzed in the SPSS 21 and AMOS 24 software's. Data analysis showed the model fit of emotional expression relationship with marital maladjustment by mediated role of couple's empathy. The model explained about 34% of the variance of marital maladjustment in divorce applicants. Based on these findings, it can be said that the relationship between marital maladjustment and emotional expression is not a direct relationship and factors such as marital empathy can strengthen or weaken this relationship, so in trainings related to emotional expression, it is suggested to consider these variables.
Construction and Validation of Dimensions and Components of the Organizational Anomie Scale in Order to Provide a Native Model in Government Hospitals(مقاله علمی وزارت علوم)
حوزه های تخصصی:
Organizational anomie (OA) is defined as the lack of law, as well as violations or weaknesses in the implementation of laws and norms in the organization, which can have detrimental effects on the performance of the organization and its members. The main focus of this study is to establish and validate an organizational anomie scale that can be employed to implement and operate this tool in field studies. The present research is applied-exploratory in terms of purpose and descriptive-survey in terms of method. To conduct this research, issues related to organizational anomie using factor analysis approach and content analysis method of scientific texts as well as from the perspective of qualified and experienced thinkers and experts and a researcher-made questionnaire on organizational anomie in COVID-19 pandemic are analyzed. it placed. Completed by experts and managers. The reliability coefficient of the test was calculated to be 0.85 using Cronbach's alpha test. Exploratory factor analysis of organizational questions revealed that the components of this questionnaire may explain more than 78.512 % of the desired variance. After one rotation of Varimax factors, the correlation between each item with each component was determined in the best situation and accordingly, twelve components were selected and extracted with the most weight: conflicting goals of the individual and organization, weakness in communication, standard selection ,ambiguity in goals, level of trustworthiness, negative attitude of employees towards themselves, feeling useless, understanding justice, weak control, common norms, organizational indifference, lack of socialization. According to the research findings, it can be concluded that organizational anomie is a multidimensional concept with many dimensions and components and cannot be studied with limited dimensions and components.