Beyond the Basics: Rethinking Multimedia Learning Principles for Second Language Acquisition

The use of multimedia in online learning environments has become increasingly prominent in education, including for English as a Second Language (ESL) instruction. In multimedia design, Cognitive Theory of Multimedia Learning (CTML) is a widely adopted principle to guide effective multimedia design. However, research shows that not all of these principles, especially redundancy and modality, can be consistently transferred to the second language acquisition (SLA) context (Liu et al., 2018; Ramsin, 2022). ESL learners differ from native speakers because they must navigate both content comprehension and linguistic decoding, a dual cognitive burden that shapes how they process multimedia input. Consequently, traditional CTML assumptions, including recommendations to avoid simultaneous text and narration, often conflict with empirical SLA findings demonstrating that captions, textual repetition, and multimodal redundancy can enhance comprehension, vocabulary development, and long-term retention, particularly for learners with lower proficiency levels (Rodgers and Webb, 2017; Umutlu and Akpinar,2020) This chapter is structured into three sections, each addressing a different aspect of how CTML principles operate in online multimedia ESL instruction. The first section critically examines how researchers have adapted and tested redundancy and modality principles from the CTML principles in online SLA instructions, which highlights the successes and challenges that arise when applying these principles to non-native English speakers. It synthesizes key findings and clarifies when CTML principles support learning and when they may inadvertently hinder ESL learners. The second section of the chapter takes a deeper look at the cognitive processes involved in SLA, particularly how learners encode, store, and retrieve information in long-term memory. This section explores how Cognitive Load Theory (CLT) interacts with second language learning, especially in relation to the cognitive demands placed on ESL learners, such as learning vocabulary and grammar while simultaneously decoding new linguistic input. By linking cognitive science with multimedia learning, this section argues that the redundancy and modality principles, as traditionally defined, may not fully capture the complexities of second language processing and therefore may require reinterpretation or adjustment. Finally, the third section of the chapter proposes a framework and guidelines for designing online multimedia instructions that align with the cognitive needs of ESL learners. It emphasizes reducing unnecessary cognitive load while supporting learners as they engage with both content and language.This framework includes a planning model for instructional designers, outlining how CTML-aligned principles can be adapted for online L2 environments. Recommendations include providing structured text-based scaffolds, using clear visuals, and integrating audio-visual elements that reinforce both language comprehension and conceptual understanding. To enhance clarity and engagement, this chapter also incorporates a multimedia example that illustrates the application of CTML principles in online ESL instruction. As the use of instructional video has increased in recent years (Abubakar & Muhammed, 2023; Noetel et al., 2021; Poquet et al., 2018), this chapter focuses on how ESL instructors can effectively integrate videos as multimedia learning tools for online instruction. We show how strategically combining captions, visuals, and narration can serve as scaffolding rather than redundancy, therefore improving second-language comprehension. These examples function as both illustrations of theoretical principles and practical design guidance for instructors and instructional designers.