Construct validity

The present study assessed the construct validity and reliability of a researcher-constructed psycho-motor mechanism scale based on the communicative theory of translation proposed by PACTE (2003). In doing so, the necessary criteria for designing the scale were obtained by a thorough review of related literature on previously constructed scales in error analysis or holistic ones. Moreover, in the first part of the research, a qualitative data analysis according to the translation tasks done by eleven participants and their feedback through a semi-structured translation problems interview was done for finding the descriptors in designing the psycho-motor mechanism scale. Next, by designing the scale, two translation tasks were given to 90 M.A. students majoring in Translation Studies at four different branches of Islamic Azad University. Based on the rating done by two experienced raters, construct validity and reliability of the scale was revealed by the use of factor analysis and correlation statistics. The findings approved by the construct validity and reliability of the researcher-constructed scale could contribute to the field of Translation Studies since having a more objective scale for translation tasks in line with anchored theories of translation quality assessment like those of PACTE (2003) is a felt need.

The field of language assessment, commemorating its 40th anniversary since the launch of language testing, has evolved significantly over the years. This study aimed to investigate the key findings and insights from exploring the role of construct validity in shaping the design of English Language Assessment (ELA) tasks. Additionally, it delved into the challenges encountered in construct validity research studies and the strategies suggested by experts to enhance it. The research team utilized a mixed-method research design for the current study. A total sample size of 37 participants was deployed. Descriptive statistics was used to summarize survey responses using quantitative analysis software (e.g., SPSS). Qualitative data was coded and organized using qualitative analysis software (e.g., NVIVO). Based on the research findings, experts in the current study have proposed strategies, and recommendations for enhancing construct validity. These strategies encompassed the incorporation of contextual factors into assessment design, the promotion of continuous validation research, the diversification of task types, and the active involvement of test-takers in the assessment development process. The findings of this study may render implications for EFL teachers, teacher trainers, and assessment administrators.