1. Home
  2. Vol 5, No 1 (2026)
  3. Nurjamin

Integrating Generative Artificial Intelligence (AI)-Based Multimodal Learning in Education to Enhance Literacy Aligned with Sustainable Development Goals (SDGs)

Asep Nurjamin(1), Lucky Rahayu Nurjamin(2), Yustika Nur Fajriah(3), Aisyah Khoerunnisa Nurjamin(4), Hijrin Ahmad Firdaus(5),


(1) Institut Pendidikan Indonesia Garut
(2) Institut Pendidikan Indonesia Garut
(3) Institut Pendidikan Indonesia Garut
(4) KB Al-Uswah
(5) Institut Pendidikan Indonesia Garut
Corresponding Author

Abstract


This study aimed to investigate the integration of artificial intelligence (AI)-based multimodal learning in education to enhance students’ literacy in alignment with Sustainable Development Goals. A quasi-experimental design was employed with elementary students who participated in lessons supported by teacher modelling and AI scaffolding. The intervention was implemented through literacy tasks focusing on descriptive writing and multimodal expression. The results indicated that students improved in their ability to construct coherent descriptive texts enriched with visual elements, demonstrating progress in vocabulary use and multimodal literacy. These findings are significant because the combination of teacher guidance and AI feedback strengthened the learning process by connecting linguistic concepts with meaningful tasks. The study highlights the impact of aligning educational innovations with Sustainable Development Goals (SDGs), showing that AI-assisted multimodal learning can foster student-centered pedagogy, improve literacy development, and provide sustainable pathways for integrating digital technologies into education.

Keywords


Deep learning; Elementary students; Generative AI; Multimodal learning

References


Abdulmuhsin, I., Bolaji, H.O., Abdulazeez, B.T.A., and Salamia, A.O. Awareness and utilization of artificial intelligence-based intelligent tutoring systems (ITS) in enhancing chemistry education through information and communication technology (ICT). ASEAN Journal of Educational Research and Technology, 4(2), 171-186.

Abdulmumin, I.A., and Abdulrahman, M.R. (2025). Undergraduate perception, attitude, and utilization of artificial intelligence (AI) ChatGPT for learning: An educational technology perspective. Indonesian Journal of Multidiciplinary Research, 5(1), 175-186

Afifah, S., Mudzakir, A., and Nandiyanto, A.B.D. (2022). How to calculate paired sample t-test using SPSS software: From step-by-step processing for users to the practical examples in the analysis of the effect of application anti-fire bamboo teaching materials on student learning outcomes. Indonesian Journal of Teaching in Science, 2(1), 81-92.

Agarry, R.O., Omolafe, E.V., Animashaun, V.O., and Babalola, E.O. (2022). Primary education undergraduates’ competency in the use of artificial intelligence for learning in Kwara State. ASEAN Journal of Educational Research and Technology, 1(2), 111-118.

Agustin, M.I., Muktiarni, M., and Mupita, J. (2022). Implementation of the reading and writing literacy program to elementary school students about the impact of the natural disaster of mount Merapi. Indonesian Journal of Teaching in Science, 2(2), 99-106.

Al Husaeni, D.F., Al Husaeni, D.N., Nandiyanto, A.B.D., Rokhman, M., Chalim, S., Chano, J., Al Obaidi, A.S.M., and Roestamy, M. (2024). How technology can change educational research? Definition, factors for improving quality of education and computational bibliometric analysis. ASEAN Journal of Science and Engineering, 4(2), 127-166.

Al Husaeni, D.F., Haristiani, N., Wahyudin, W., and Rasim, R. (2024). Chatbot artificial intelligence as educational tools in science and engineering education: A literature review and bibliometric mapping analysis with its advantages and disadvantages. ASEAN Journal of Science and Engineering, 4(1), 93-118.

Al Husaeni, D.N., and Haristiani, N. (2025). What evidence supports the advancement of language learning through digital innovation? Toward achieving Sustainable Development Goals (SDGs) in the 21st century completed with bibliometric analysis. ASEAN Journal of Science and Engineering, 5(2), 327-356

Alhammad, A. I. (2025). Implementing a genre-based approach to enhance essay writing skills in Saudi EFL learners. Journal of Language Teaching and Research, 16(1), 295-301.

Alimi, A.E., Buraimoh, O.F., Aladesusi, G.A., and Babalola, E.O. (2021). University students’ awareness of, access to, and use of artificial intelligence for learning in Kwara State. Indonesian Journal of Teaching in Science, 1(2), 91-104.

Al-Khassawneh, Y.A. (2023). A review of artificial intelligence in security and privacy: Research advances, applications, opportunities, and challenges. Indonesian Journal of Science and Technology, 8(1), 79-96.

Andhini, A.B., and Sakti, A.W. (2021). Impact of distance learning on reading and writing ability in elementary school students. Indonesian Journal of Multidiciplinary Research, 1(2), 393-398.

Arifin, K., Sirih, M., Munir, A., Jahidin, and Sabilu, M. (2025). The influence of multimodal learning strategies on prospective biology teachers' literacy-numeracy learning outcomes. EURASIA Journal of Mathematics, Science and Technology Education, 21(1), em2563.

Balasubramanian, K. (2025). The future of teaching: Artificial intelligence (AI) and artificial general intelligence (AGI) for smarter, adaptive, and data-driven educator training. Indonesian Journal of Teaching in Science, 5(1), 49-54.

Chan, A. Y. W., and Sung, C. C. M. (2025). Enhancing students’ digital literacy skills through their technology use in a course-based research project: A Hong Kong case study. Asia Pacific Education Review, 2025, 1-14.

Cheah, Y.H., Jingru, L., and Kim, J. (2025). Integrating generative artificial intelligence in K-12 education: Examining teachers’ preparedness, practices, and barriers. Computers and Education: Artificial Intelligence, 8, 1-12.

Cheung, K. K. C., Pun, J., Kenneth-Li, W., and Mai, J. (2025). Exploring students’ multimodal representations of ideas about epistemic reading of scientific texts in generative AI tools. Journal of Science Education and Technology, 34(2), 284-297.

Damayanti, K.D., and Santosa, M.H. (2024). The effect of prowritingaid writing tool on the writing skills of english as a foreign language (EFL) students: A systematic literature review. Indonesian Journal of Multidiciplinary Research, 4(2), 469-478.

De Oliveira, L. C., and dos Santos, A. E. (2025). Using AI-text generated mentor texts for genre-based pedagogy in second language writing. Journal of Second Language Writing, 67, 101184.

Derewianka, B. (2003). Trends and issues in genre-based approaches. RELC Journal, 34(2), 133-154.

Dimitriadou, E., and Lanitis, A. (2023). A critical evaluation, challenges, and future perspectives of using artificial intelligence and emerging technologies in smart classrooms. Smart Learning Environments, 10(1), 12.

Fedorenko, S.V. (2019). Experience of developing students’ multimodal literacy in the digital learning environment of higher education institutions. Information Technologies and Learning Tools, 69(1), 12-20.

Fiandini, M., Nandiyanto, A.B.D., Al Husaeni, D.F., Al Husaeni, D.N., and Mushiban, M. (2024). How to calculate statistics for significant difference test using SPSS: Understanding students comprehension on the concept of steam engines as power plant. Indonesian Journal of Science and Technology, 9(1), 45-108.

Fiandini, M., Nandiyanto, A.B.D., and Kurniawan, T. (2023). Bibliometric analysis of research trends in conceptual understanding and sustainability awareness through artificial intelligence (AI) and digital learning media. Indonesian Journal of Multidiciplinary Research, 3(2), 477-486.

Fufon, K., Notesiri, U., Lekchaum, K., Chomsuwan, K., Tanitteerapan, T., and Puengsungewan, S. (2025). Smart electric resistance welding based on artificial intelligence (AI) based on real-time adaptive statistical features completed with bibliometric analysis. ASEAN Journal of Science and Engineering, 5(1), 173-198.

Gemil, K.W., Na’ila, D.S., Ardila, N.Z., and Sarahah, Z.U. (2024). The relationship of vocational education skills in agribusiness processing agricultural products in achieving sustainable development goals (SDGs). ASEAN Journal of Science and Engineering Education, 4(2), 181-192.

Guo, X. (2023). Multimodality in language education: Implications of a multimodal affective perspective in foreign language teaching. Frontiers in Psychology, 14, 1283625.

Hamid, S. (2025). Integrating artificial intelligence and multimodality in language education: A systematic review of emerging trends and practices. Journal of Social and Amp; Organizational Matters, 4(2), 400-416.

Ibrahim, A., Bolaji, H.O., and Abdulraheem, A.J. (2025). Accessibility and utilization of artificial intelligence (AI)-based intelligent tutoring systems (ITS) and information and communication technology (ICT) in enhancing biology education. ASEAN Journal for Science Education, 4(2), 93-104.

Jiang, J. (2024). When generative artificial intelligence meets multimodal composition: Rethinking the composition process through an AI-assisted design project. Computers and Composition, 74, 102883.

Keisyafa, A., Sunarya, D.N., Aghniya, S.M., and Maula, S.P. (2024). Analysis of student’s awareness of sustainable diet in reducing carbon footprint to support sustainable development goals (SDGs) 2030. ASEAN Journal of Agricultural and Food Engineering, 3(1), 67-74.

Kelley, M., and Wenzel, S. (2025). Advancing teacher AI literacy: Professional partnerships for effective integration of AI in education. Education Sciences, 15(6), 659.

Khalikova, K.A. (2025). Integrating artificial intelligence into education: Opportunities, challenges, and future prospects. Indonesian Journal of Educational Research and Technology, 5(2), 137-144.

Kosmas, P., Nisiforou, E. A., Kounnapi, E., Sophocleous, S., and Theophanous, G. (2025). Integrating artificial intelligence in literacy lessons for elementary classrooms: A co-design approach. Educational Technology Research and Development, 2025, 1-27.

Lailatussyifa, N.P., Al Baekani, A.K., and Hakim, P.K. (2025). Implementing genre-based approach in teaching reading: a case study at vocational high school students. Journal of Educational Sciences, 9(1), 120-128.

Li, M., and Wilson, J. (2025). AI-Integrated scaffolding to enhance agency and creativity in k-12 English language learners: A systematic review. Information, 16(7), 519.

Lin, C. H., Zhou, K., Li, L., and Sun, L. (2025). Integrating generative AI into digital multimodal composition: A study of multicultural second-language classrooms. Computers and Composition, 75, 102895.

Makinde, S.O., Ajani, Y.A., and Abdulrahman, M.R. (2024). Smart learning as transformative impact of technology: A paradigm for accomplishing sustainable development goals (SDGs) in education. Indonesian Journal of Educational Research and Technology, 4(3), 213-224.

Mamaraimova, D., and Safieva, M. (2025). Navigating the future of artificial intelligence: Innovations, ethical dilemmas, and societal impact. Indonesian Journal of Educational Research and Technology, 5(1), 71-76.

Mittal, U., Sai, S., Chamola, V., and Sangwan, D. (2017). A comprehensive review on generative AI for education. IEEE Access. 12, 142733-142759.

Mohammadi, M. (2025). Artificial intelligence in multimodal learning analytics: A systematic literature review. Computers and Education: Artificial Intelligence, 8, 100426.

Nagaraju, K., and Ramakrishna, S. (2025). Leveraging artificial intelligence (AI) and geospatial technologies for community-centered urban expansion forecasting in Hyderabad. ASEAN Journal of Community Service and Education, 3(2), 135-146

Nandiyanto, A. B. D., and Azizah, N. N. (2022). Analysis of common mistake in writing scientific article in “engineering” undergraduate student. Journal of Engineering Science and Technology, 17(1), 156-170.

Ntelioglou, B. Y., Fannin, J., Montanera, M., and Cummins, J. (2014). A multilingual and multimodal approach to literacy teaching and learning in urban education: A collaborative inquiry project in an inner-city elementary school. Frontiers in Psychology, 5, 533.

Nurhasanah, S., and Nugraha, M.S. (2024). The future of learning: ethical and philosophical implications of artificial intelligence (AI) integration in education. Indonesian Journal of Multidiciplinary Research, 4(2), 341-352.

Nurjamin, A., and Nurjamin, L. R. (2016). The use of genre-based approach to teaching students' writing skill of hortatory exposition text in Bahasa Indonesia. In Ninth International Conference on Applied Linguistics, 9, 221-223.

Nurjamin, A., Nurjamin, L. R., Fajriah, Y. N., Nurjamin, A. K. Nugraha, I. (2025). Developing and evaluating an augmented reality (AR) digital storytelling video to foster multimodal literacy and narrative comprehension. Journal of Engineering Science and Technology, 20(4) 919-956.

Olowoyeye, C.A.C., Deji-Afuye, O.O., and Aladesusi, G.A. (2023). Effect of multimedia instructional approach on English writing performance of pre-service technical teachers in South-Western Nigeria. Indonesian Journal of Multidiciplinary Research, 3(1), 21-30.

Prasetyo, I., Nugroho, A.A., Damayanto, A., and Fathoni, M.I. (2025). Developing an inclusive ICT-based academic information system using REST API to promote Sustainable Development Goals (SDGs) in higher education. ASEAN Journal of Science and Engineering, 5(2), 395-416.

Purba, R., Herman, H., Fatmawati, E., Saputra, N., and Sabata, Y. N. (2023). The multimodal-based learning improves students' reading ability in perspective of systemic functional linguistics. Journal of Education Technology, 7(1), 61-70.

Qazi, S., Kadri, M. B., Naveed, M., Khawaja, B. A., Khan, S. Z., Alam, M. M., and Su'ud, M. M. (2024). AI-Driven learning management systems: Modern developments, challenges and future trends during the age of ChatGPT. Computers, Materials and Continua, 80(2), 3289-3314.

Rahayu, N.I., and Ismail, A. (2023). Trends in the use of artificial intelligence (AI) technology in increasing physical activity. Indonesian Journal of Educational Research and Technology, 3(3), 295-304.

Rahayu, N.I., Muktiarni, M., and Hidayat, Y. (2024). An application of statistical testing: A guide to basic parametric statistics in educational research using SPSS. ASEAN Journal of Science and Engineering, 4(3), 569-582.

Rahmawati, T., and Fajriah, Y.N. (2023). The implementation of building knowledge of the field (Bkof) in teaching narrative text. English Education and Applied Linguistics Journal (EEAL Journal), 6(1), 10-18.

Rahmiyanti, H. (2024). Bibliometric analysis on artificial intelligence research in Indonesia vocational education. ASEAN Journal for Science Education, 3(2), 183-192.

Reddy, A. S. (2024). Multimodal Gen AI: Integrating Text, Image, and Video Analysis for Comprehensive Claims Assessment. ESP International Journal of Advancements in Computational Technology, 2(2), 133-141.

Rochman, S., Rustaman, N., Ramalis, T.R., Amri, K., Zukmadini, A.Y., Ismail, I., and Putra, A.H. (2024). How bibliometric analysis using VOSviewer based on artificial intelligence data (using ResearchRabbit Data): Explore research trends in hydrology content. ASEAN Journal of Science and Engineering, 4(2), 251-294.

Shamim, F., and Riaz, M. N. (2023). Impact of multimodal digital media communication on generation Z’s language use and literacy practices. Academy of Education and Social Sciences Review, 3(4), 398–409.

Smith, B. E., Shimizu, A. Y., Burriss, S. K., Hundley, M., and Pendergrass, E. (2025). Multimodal composing with generative AI: Examining preservice teachers’ processes and perspectives. Computers and Composition, 75, 102896.

Solihat, A.N., Dahlan, D., Kusnendi, K., Susetyo, B., and Al Obaidi, A.S.M. (2024). Artificial intelligence (AI)-based learning media: Definition, bibliometric, classification, and issues for enhancing creative thinking in education. ASEAN Journal of Science and Engineering, 4(3), 349-382.

Susilawati, A., Al-Obaidi, A.S.M., Abduh, A., Irwansyah, F.S., and Nandiyanto, A.B.D. (2025). How to do research methodology: From literature review, bibliometric, step-by-step research stages, to practical examples in science and engineering education. Indonesian Journal of Science and Technology, 10(1), 1-40

Tao, L., Deng, H., and Song, Y. (2025). Generative artificial intelligence in education: A topic-based bibliometric analysis. Educational Technology and Society, 28(2), p327.

Trisanti, N., Sukyadi, D., and Hermawan, B. (2024). University EFL teachers’ stance and engagement in digital multimodal composing as multimodal literacy practices. International Journal of Education, 17(1), 61-70.

Van Leeuwen, T. (2017). Multimodal literacy. Metaphor, 4, 17-23.

Xu, Z. (2024). AI in education: Enhancing learning experiences and student outcomes. Applied and Computational Engineering, 51(1), 104-111.

Zhang, J., and Zhang, Z. (2024). AI in teacher education: Unlocking new dimensions in teaching support, inclusive learning, and digital literacy. Journal of Computer Assisted Learning, 40(4), 1871-1885.

Zhou, X. (2023). Teaching activities for English writing: based on a process genre. English Language Teaching and Linguistics Studies, 5(2), 208-222.

Zhuang, Y., Zhao, R., Xie, Z., and Yu, P. L. H. (2025). Enhancing language learning through generative AI feedback on picture-cued writing tasks. Computers and Education: Artificial Intelligence, 9, 100450.


Full Text: PDF

Article Metrics

Abstract View : 64 times
PDF Download : 77 times

Refbacks

  • There are currently no refbacks.


Copyright (c) 2025 Bumi Publikasi Nusantara

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.