Multimodality

The main objective of this study was to investigate how Iranian EFL learners used their literacy practices and multimodal resources to mediate interpretation and representation of an advertisement text and construct their understanding of it. Fifteen female adolescents at an intermediate level of proficiency read the ""مبلمان برلیان"" (“Brelian Furniture”) advertisement text and re-created their understandings in pictures and sentences. The data was analyzed based on Kress and Van Leeuwen’s (1996, 2001) theory of social semiotics. The findings suggest that students situated the meanings of the advertisement texts in specific contexts that reflected their own social and cultural experiences. Furthermore, the students demonstrated that the use of multimodal resources had the potential to enhance language and literacy learning in a way that was transformative and was affected by their identities. In addition, the use of multimodal/multiliteracies pedagogy permitted the students to enter into text composition from different paths. Finally, multimodal/multiliteracies pedagogy could foster critical literacy practices by offering EFL students the opportunities to create new identities and challenge discursive practices that marginalize them. The implications of the findings are also discussed

Multimodal Discourse is a theory of communication in multimedia. The notion of modes refers to semiotic resources which allow the simultaneous realization of discourses and types of (inter)action. Media are the material resources being used for the production such as music, language, and images. This study examined Iranian EFL learners’ perception of multimodal texts. The objective of the study was to examine how Iranian EFL learners utilized their general literacy practices and multimodal repertoires to develop their meaning-making process. The participants were 18 intermediate EFL learners attending Iran Language Institute (ILI), and were exposed to advertisement materials. They were asked to reconstruct their perceptions both visually and verbally. The participants’ responses were analyzed according to the social semiotics model suggested by Kress and van Leeuwen (2001). Results revealed that the participants made contextualized perceptions of the advertisement materials indicating their sociocultural framework. Moreover, applying multimodal knowledge, the students promoted their learning status via transformative self-affected strategies. Multimodal/multiliteracies pedagogy could promote EFL students' critical literacy practices to develop new worldviews and question the imposing discursive moments.

Purpose: The integration of visual and verbal modes in educational materials, particularly in school textbooks, plays a chief role in enhancing the learning experience. Thus, the present study aimed to analyze the intersemiotic complementarity of verbal and visual modes in three English school textbooks from two countries with different policies toward English education at public schools, Iran and Malaysia. Methodology: Employing a qualitative descriptive approach, this study analyzes the intersemiotic complementarity within English school textbooks used in the first grade of high school in Iran and Malaysia, focusing on three selected textbooks: Prospect 1 (Iran), Form 1 (Malaysia), and Pulse 2 (Malaysia). The analysis was guided by Royce's (1998) framework for intersemiotic complementarity, with a particular emphasis on the ideational metafunction. This involved examining the coherence between visual representations (images) and textual content (dialogues) to assess how these elements complement each other in conveying educational content and facilitating learning. Findings: The analysis revealed a marked disparity in the integration of visual and verbal modes between the textbooks from the two countries. Iranian textbooks, specifically Prospect 1, demonstrated a significant disconnect between images and text, often leading to confusion and potentially hindering students' learning. In contrast, the Malaysian textbooks (Form 1 and Pulse 2) exhibited a high level of intersemiotic complementarity, with images effectively supporting and enhancing the textual content, thereby facilitating a more cohesive and comprehensible learning experience for students. Conclusion: The study demonstrates the importance of cohesive integration of visual and verbal elements in textbooks to support effective learning, highlighting the need for strategic multimodal design in educational materials. By ensuring a cohesive integration of visual and verbal elements, textbooks can become more effective tools in enhancing comprehension and improving learning outcomes. This research contributes to the growing discourse on multimodal education, suggesting pathways for future investigations into the optimization of textbook design for enhanced educational impact.

Pedagogic discourse is inherently multimodal, and teaching is a multimodal experience that takes place through the integration of (spoken) language and an array of other communicative modes. Similarly, modern multimedia platforms, such as Instagram, also have the potential to be used as multimodal educational tools that make use of different modalities alongside text. As such, the present study aimed to analyze three prominent Instagram pages, including BBC Learning English, Learning English with Oxford, and Learning English with Cambridge, through the multimodal discourse analysis toolkit proposed by Ledin and Machin (2020). Qualitative data analysis was run to analyze the data. The findings of the study indicated that the English Language Teaching (ELT) pages analyzed employed a diverse array of semiotic resources, spanning from the incorporation of various images to the careful selection of different colors and typography to effectively convey their intended meanings. Additionally, the visual representations employed in the posts were largely consistent with, and in some cases, complementary to the overall content of the posts, and the underlying messages they aimed to convey. Specifically, the visual representations in the ELT pages were purposefully designed to reflect the culture of the English-speaking community as a clear means of reinforcement.

This bibliometric analysis explores the integration of semiotics within educational contexts, highlighting a transformative shift towards multifaceted understandings of knowledge construction through language, multimodality, and educational transformation. Drawing on 1823 publications from the Web of Science database, this study employs both co-citation and co-word analysis to reveal prevalent themes and keywords in the field of semiotics in education. The co-citation analysis highlights the evolution of semiotic theories and their application in educational practices, from foundational concepts introduced by pioneers such as Saussure and Peirce to modern interpretations that consider the impact of digital technologies on semiotic resources. Co-word analysis, on the other hand, uncovers key research topics such as multimodality, multiliteracies, and the role of technology in mediating semiotic learning processes. This investigation is novel in its comprehensive approach to mapping the semiotic landscape in education through bibliometric methods, offering insights into how semiotic theories shape educational practices and outcomes, especially in language teaching and learning. By synthesizing findings from diverse research clusters, this study emphasizes the importance of adopting a multidisciplinary approach to understand the dynamic interaction between semiotics, technology, and learning. It contributes to advancing educational research by highlighting the transformative potential of semiotics in crafting more engaging, inclusive, and effective learning environments in the digital era.