Transforming AI chatbots into metacognitive partners: Culturally grounded mathematics learning in LMS-based environments

##plugins.themes.bootstrap3.article.main##

Alifiani Alifiani
Surya Sari Faradiba
Gusti Firda Khairunnisa

Abstract

The utilization of AI chatbots in mathematics education is on the rise, with these bots often serving as the primary providers of answers, potentially limiting learners’ engagement in reflective and metacognitive reasoning processes. The present study examines how AI chatbots can function as metacognitive partners within a culturally contextualized mathematics learning framework implemented through a learning management system (LMS). Using an embedded multiple-case study design, the data were collected from 33 preservice teachers enrolled in the Department of Mathematics Education during their seventh semester. The data were collected from several sources: chatbot interaction logs, participatory observations, metacognitive reflective journals, and semi-structured interviews. Four participants were purposively selected for in-depth analysis. Thematic analysis revealed two distinct patterns in the interaction of pre-service mathematics teachers with the AI chatbot when completing assignments: an iterative interaction pattern and a linear interaction pattern. The iterative pattern involves repeated exploration, whereas the linear pattern follows a straightforward path with minimal verification. The two patterns yield different metacognitive outcomes, depending on the degree of regulation. When iterative interaction is well regulated, it fosters metacognitive success; however, when it becomes overly regulated, it leads to a metacognitive failure known as mirage, in which learners overanalyze and begin to question correct reasoning. Similarly, when linear interaction is well regulated, it also facilitates metacognitive success. Yet, when it becomes less regulated, it results in a metacognitive failure, blindness, due to the uncritical acceptance. The findings of the present study suggest that AI-supported learning functions as a process of co-regulation rather than passive information delivery, underscoring the importance of regulatory awareness in culturally mathematics learning.

##plugins.themes.bootstrap3.article.details##


Section
Articles

References

Abidin, Z., Aiyub, A., & Jarmita, N. (2025). Correlation of mathematics achievement and metacognitive awareness of Indonesian high school students. Multidisciplinary Reviews, 9(5), 2026221. https://doi.org/10.31893/multirev.2026221

Al Qur’an, M. N. (2025). Conducting case study research in international entrepreneurship: A protocol for qualitative case study. International journal of qualitative methods, 24, 10. https://doi.org/10.1177/16094069251394934

Alifiani, A., & Faradiba, S. S. (2021). Mathematics pre-service teacher's metacognitive failure in mathematics online learning. Jurnal Riset Pendidikan Matematika, 8(2), 179–190. https://doi.org/10.21831/jrpm.v8i2.43366

Annamalah, S., Abdullah, S. A. K., Anthonysamy, L., & Ahmed, S. (2026). Case study research in qualitative inquiry: a structured guide to design, data collection and analysis. Qualitative Research Journal, 1–28. https://doi.org/10.1108/qrj-11-2025-0429

Anupan, A., & Chimmalee, B. (2024). Analysis of undergraduate students’ metacognitive ability in mathematical problem-solving using cloud classroom blended learning. International Journal of Instruction, 9(1), 1–18. https://doi.org/10.29333/aje.2024.911a

Astafieva, M., Bodnenko, D., Lytvyn, O., & Proshkin, V. (2023). Organization of independent work of students in LMS Moodle using a metacognitive approach (on the example of physical and mathematical disciplines). In G. Antoniou, V. Ermolayev, V. Kobets, V. Liubchenko, H. C. Mayr, A. Spivakovsky, V. Yakovyna, & G. Zholtkevych (Eds.), Information and communication technologies in education, research, and industrial applications (pp. 303–312). Springer. https://doi.org/10.1007/978-3-031-48325-7_23

Asyura, I., Pamungkas, A. S., Linda, L., Munawar, B., & Iswara, A. (2026). Hy MAI: An ethno-STEM-based interactive website to improve high school students’ reasoning skills. Infinity Journal, 15(1), 221–240. https://doi.org/10.22460/infinity.v15i1.p221-240

Awi, A., Sutamrin, S., Naufal, M. A., Nasir, N., & Hassan, M. N. (2025). Profile metacognitive scaffolding in developing the concept of determinants to enhance mathematical problem-solving skills of low ability students. Kognitif: Jurnal Riset HOTS Pendidikan Matematika, 5(3), 1330–1344. https://doi.org/10.51574/kognitif.v5i3.3803

Azevedo, R., Bouchet, F., Duffy, M., Harley, J., Taub, M., Trevors, G., Cloude, E., Dever, D., Wiedbusch, M., Wortha, F., & Cerezo, R. (2022). Lessons learned and future directions of MetaTutor: Leveraging multichannel data to scaffold self-regulated learning with an intelligent tutoring system. Frontiers in psychology, 13, 813632. https://doi.org/10.3389/fpsyg.2022.813632

Bahbah, A., Khaldi, M., & Erradi, M. (2023). Mapping of mathematical problem solving processes in middle school students: A methodological and analytical approach. Ra Journal of Applied Research, 9(2), 115–121. https://doi.org/10.47191/rajar/v9i2.10

Chan, C. K. Y., & Hu, W. (2023). Students’ voices on generative AI: perceptions, benefits, and challenges in higher education. International Journal of Educational Technology in Higher Education, 20(1), 43. https://doi.org/10.1186/s41239-023-00411-8

Chen, H., & Anyanwu, C. C. (2025). AI in education: Evaluating the impact of moodle AI-powered chatbots and metacognitive teaching approaches on academic performance of higher institution business education students. Education and Information Technologies, 30(9), 12197–12212. https://doi.org/10.1007/s10639-024-13235-4

Dankunprasert, S., Cojorn, K., Sonsupap, K., Choompunuch, B., Ranmechai, S., Nonsuwan, A., & Tongron, Y. (2025). Bridging knowledge and community: Innovative community-based learning to strengthen mathematic pre-service teachers’ problem-solving competency. Eurasia Journal of Mathematics, Science and Technology Education, 21(10), em2720. https://doi.org/10.29333/ejmste/17179

Duffy, G., Sorby, S., & Bowe, B. (2024). Exploring the role of spatial ability in the mental representation of word problems in mathematics. Frontiers in Education, 9, 1346474. https://doi.org/10.3389/feduc.2024.1346474

Egara, F., & Mosia, M. (2025). Equipping pre-service mathematics teachers for diverse classrooms: Best practices and innovations. In B. E. Olawale (Ed.), Building the foundations: Effective approaches in mathematics teacher preparation (pp. 138–152). ERRCD Forum. https://doi.org/10.38140/obp3-2025-09

El Fathi, T., Saad, A., Larhzil, H., Lamri, D., & Al Ibrahmi, E. M. (2025). Integrating generative AI into STEM education: enhancing conceptual understanding, addressing misconceptions, and assessing student acceptance. Disciplinary and Interdisciplinary Science Education Research, 7, 6. https://doi.org/10.1186/s43031-025-00125-z

Fan, F., Wang, S., Hemuti, M. D. M., Nie, X., & Yang, L. T. (2025). Enhancing students’ metacognition with innovative IA-based metacognitive reflective learning tool. IEEE Transactions on Learning Technologies, 18, 699–715. https://doi.org/10.1109/tlt.2025.3580536

Fererde, A. T., Mihrka, A. A., Ayele, M. A., & Arara, A. A. (2024). Enhancing students’ conceptual understanding and problem-solving skills in learning trigonometry through contextual-based mathematical modeling instruction. International Journal of Secondary Education, 12(4), 108–119.

Fitria, W., Susilana, R., Priatna, N., & Rusman, R. (2025). Investigation of the impact online single and multiple representation scaffolding on mathematical concept mastery and mathematical problem-solving skill. Journal on Mathematics Education, 16(2), 709–728. https://doi.org/10.22342/jme.v16i2.pp709-728

Florean, I., Stragà, M., Mäntylä, T., & Del Missier, F. (2025). Mark it out! Spontaneous cognitive offloading in route planning. Thinking & Reasoning, 31(3), 249–286. https://doi.org/10.1080/13546783.2024.2413151

Gerlich, M. (2025). AI tools in society: Impacts on cognitive offloading and the future of critical thinking. Societies, 15(1), 6. https://doi.org/10.3390/soc15010006

Gonsalves, C. (2024). Generative AI’s impact on critical thinking: Revisiting Bloom’s taxonomy. Journal of Marketing Education, 48(1), 4–19. https://doi.org/10.1177/02734753241305980

Goos, M. (2002). Understanding metacognitive failure. The Journal of Mathematical Behavior, 21(3), 283–302. https://doi.org/10.1016/s0732-3123(02)00130-x

Harahap, R., Simamora, Y., Lubis, N. A., Yustinaningrum, B., & Nasution, A. K. P. (2025). The role of ChatGPT in enhancing mathematics education: A systematic review. Advances in Nonlinear Variational Inequalities, 28(2), 511–524.

Hassen, M. (2025). The impact of AI on students’ reading, critical thinking, and problem-solving skills. American Journal of Education and Information Technology, 9(2), 82–90. https://doi.org/10.11648/j.ajeit.20250902.12

Howlader, M., & Sarkar, P. (2025). Culturally responsive mathematics pedagogy: Insights from NCF-2023 and ethnomathematics. JIPI (Jurnal Ilmiah Penelitian dan Pembelajaran Informatika), 10(3), 2335–2343. https://doi.org/10.29100/jipi.v10i3.8199

Jojo, Z. (2024). Culturally responsive pedagogy for the promotion of understanding Mathematics: The case of rural situated primary schools in Post-apartheid South Africa. Interdisciplinary Journal of Sociality Studies, 4(s1), 1–15. https://doi.org/10.38140/ijss-2024.vol4.s1.06

Katsenou, R., Kotsidis, K., Papadopoulou, A., Anastasiadis, P., & Deliyannis, I. (2025). Beyond assistance: Embracing AI as a collaborative co-agent in education. Education Sciences, 15(8), 1006. https://doi.org/10.3390/educsci15081006

Kholid, M. N., Widyasari, A., Santosa, Y. T., Hidayati, Y. M., Fenyvesi, K., Maharani, S., Ikram, M., Wijaya, A. P., Prabowo, A., & Hendriyanto, A. (2025). Student metacognition levels for solving PISA-like problems: A hierarchy. Infinity Journal, 14(3), 817–838. https://doi.org/10.22460/infinity.v14i3.p817-838

Kim, J., Ham, Y., & Lee, S.-S. (2024). Differences in student-AI interaction process on a drawing task: Focusing on students’ attitude towards AI and the level of drawing skills. Australasian Journal of Educational Technology, 40(1), 19–41. https://doi.org/10.14742/ajet.8859

Kusaeri, A., Putrawangsa, S., Prahmana, R. C. I., Pardi, M. H. H., & Idrus, S. W. A. S. A. (2025). Ethnomathematical insights from the tide-forecasting calendar of an Indonesian coastal community into mathematics classroom. Journal on Mathematics Education, 16(2), 581–602. https://doi.org/10.22342/jme.v16i2.pp581-602

Lee, M. H., Jang, E. E., & Hannah, L. (2025). Automated diagnostic feedback vs. self‐assessment: Rethinking feedback mechanisms on academic writing development. TESOL Quarterly, 59(S1), S280–S317. https://doi.org/10.1002/tesq.70032

Lee, S.-G., Lee, J. H., Lim, D. S., & Park, D. (2024). Teaching mathematics for AI with ChatGPT and GPT-4 Omni. Mathematics Education Research and Practice, 27(4), 449–466. https://doi.org/10.7468/jksmed.2024.27.4.449

León-Domínguez, U. (2024). Potential cognitive risks of generative transformer-based AI chatbots on higher order executive functions. Neuropsychology, 38(4), 293–308. https://doi.org/10.1037/neu0000948

Liljedahl, P., Santos-Trigo, M., Malaspina, U., & Bruder, R. (2016). Problem solving in mathematics education. Springer. https://doi.org/10.1007/978-3-319-40730-2

Lochmiller, C. R. (2021). Conducting thematic analysis with qualitative data. The Qualitative Report, 26(6), 2029–2044. https://doi.org/10.46743/2160-3715/2021.5008

Lucangeli, D., Fastame, M. C., Pedron, M., Porru, A., Duca, V., Hitchcott, P. K., & Penna, M. P. (2019). Metacognition and errors: the impact of self-regulatory trainings in children with specific learning disabilities. ZDM – Mathematics Education, 51(4), 577–585. https://doi.org/10.1007/s11858-019-01044-w

Luzano, J. F. P. (2024). Reshaping mathematics instruction via impact of AI chatbots on secondary education pre-service teachers. International Journal of Studies in Education and Science, 5(3), 233–245.

Magiera, M. T., & Zawojewski, J. S. (2011). Characterizations of social-based and self-based contexts associated with students' awareness, evaluation, and regulation of their thinking during small-group mathematical modeling. Journal for Research in Mathematics Education, 42(5), 486–520. https://doi.org/10.5951/jresematheduc.42.5.0486

Matueny, R. M., & Nyamai, J. J. (2025). Illusion of competence and skill degradation in artificial intelligence dependency among users. International Journal of Research and Scientific Innovation, 12(5), 1725–1738. https://doi.org/10.51244/ijrsi.2025.120500163

Md Nasir, N. A., & Singh, P. (2023). The effect of a problem-solving approach on students’ heuristics knowledge development. International Journal of Academic Research in Accounting, Finance and Management Sciences, 13(2), 827–842. https://doi.org/10.6007/IJARAFMS/v13-i2/18025

Mulholland, K., Gray, W., Counihan, C., & Nichol, D. (2025). Stepping stones: Adopting a fading programme design to promote teachers’ use of metacognitive strategies for mathematical problem solving. Education Sciences, 15(7), 892. https://doi.org/10.3390/educsci15070892

Murti, R. C. (2023). Culturally responsive teaching to support meaningfull learning in mathematics primary school. Jurnal Prima Edukasia, 11(2), 294–302. https://doi.org/10.21831/jpe.v11i2.63239

Naeem, M., Ozuem, W., Howell, K., & Ranfagni, S. (2023). A step-by-step process of thematic analysis to develop a conceptual model in qualitative research. International journal of qualitative methods, 22, 18. https://doi.org/10.1177/16094069231205789

Nindiasari, H., Hendriana, H., Fathurrohman, M., Kurniawati, N. K., Nirmalasari, D., Rofiroh, R., & Ruhimat, A. (2026). Numeracy website of local wisdom in mathematics learning: Metacognitive approach and mathematical reflective thinking ability. Infinity Journal, 15(2), 595–622. https://doi.org/10.22460/infinity.v15i2.p595-622

Nolan, K., & Xenofontos, C. (2023). Mapping teachers’ perspectives on culturally responsive pedagogy in mathematics: from academic achievement to insights and opportunities. Intercultural Education, 34(6), 550–567. https://doi.org/10.1080/14675986.2023.2265855

Panit, N. M. (2025). Can critical thinking and AI work together? Observations of science, Mathematics, and language instructors. Environment and Social Psychology, 9(11), 3141–3157. https://doi.org/10.59429/esp.v9i11.3141

Pari, Y. R. C., Camargo, M. I. P., Huillca, R. N. S., Ramos, C. B., & Puma, L. U. (2025). Ethnomathematics: The mathematical knowledge of the Shintuya native community - Harakbut people of Madre de Dios, 2023. Revista de Gestão Social e Ambiental, 19(2), e011056. https://doi.org/10.24857/rgsa.v19n2-035

Presmeg, N. C. (1998). Ethnomathematics in teacher education. Journal of Mathematics Teacher Education, 1(3), 317–339. https://doi.org/10.1023/a:1009946219294

Říčan, J., Chytrý, V., & Medová, J. (2022). Aspects of self-regulated learning and their influence on the mathematics achievement of fifth graders in the context of four different proclaimed curricula. Frontiers in psychology, 13, 963151. https://doi.org/10.3389/fpsyg.2022.963151

Rizki, L. M., & Kusumah, Y. S. (2025). Unveiling the needs: Developing AI-based chatbots in blended learning to enhance computational thinking and self-regulated learning in mathematics education. In The Eurasia Proceedings of Educational and Social Sciences, (Vol. 41, pp. 11–24).

Rohilla, A. (2025). Impact of excessive AI tool usage on the cognitive abilities of undergraduate students: A mixed method study. Advance Social Science Archive Journal, 4(1), 2131–2143. https://doi.org/10.55966/assaj.2025.4.1.0115

Sheromova, T. S., Khuziakhmetov, A. N., Kazinets, V. A., Sizova, Z. M., Buslaev, S. I., & Borodianskaia, E. A. (2020). Learning styles and development of cognitive skills in mathematics learning. Eurasia Journal of Mathematics, Science and Technology Education, 16(11), em1895. https://doi.org/10.29333/ejmste/8538

Sutrisno AB, J., Pratama, E. Y., Putra R, A., Nasution, S. H., & Lestyanto, L. M. (2025). Students’ mathematical justification abilities in analyzing ChatGPT’s answers. Infinity Journal, 14(2), 445–460. https://doi.org/10.22460/infinity.v14i2.p445-460

Tankelevitch, L., Kewenig, V., Simkute, A., Scott, A. E., Sarkar, A., Sellen, A., & Rintel, S. (2024). The metacognitive demands and opportunities of generative AI. In Proceedings of the CHI Conference on Human Factors in Computing Systems, (pp. 1–24). https://doi.org/10.1145/3613904.3642902

Taranikanti, V., & Davidson, C. J. (2023). Metacognition through an Iterative anatomy AI chatbot: An innovative playing field for educating the future generation of medical students. Anatomia, 2(3), 271–281. https://doi.org/10.3390/anatomia2030025

Tran, L. M., & Schepers, O. C. (2023). Making mathematics meaningful for culturally and linguistically diverse students with a mathematics learning disability: a focus on culturally responsive practices. Frontiers in Education, 8, 1276423. https://doi.org/10.3389/feduc.2023.1276423

Ullah, S., Akhtar, M., & Kaleem, M. F. (2025). Assessing the role of metacognition in mathematics education for female students: Empirical evidence from Pakistan. ACADEMIA International Journal for Social Sciences, 4(1), 927–932. https://doi.org/10.63056/acad.004.01.0143

Urohmah, A., Yuhana, Y., & Novaliyosi, N. (2025). Development of Banten culture-based animated video learning media to enhance mathematical concept understanding. EMTEKA: Jurnal Pendidikan Matematika, 6(2), 849–864. https://doi.org/10.24127/emteka.v6i2.8657

Utami, N. W., & Sagita, L. (2025). From perception to practice: Pre-service teachers' development of ethnomathematics-based learning tools in Indonesia. Edelweiss Applied Science and Technology, 9(8), 1393–1405. https://doi.org/10.55214/2576-8484.v9i8.9615

Utami, N. W., Sayuti, S. A., & Jailani, J. (2019). Math and mate in Javanese primbon: Ethnomathematics study. Journal on Mathematics Education, 10(3), 341–356. https://doi.org/10.22342/jme.10.3.7611.341-356

Wachira, P., & Mburu, J. (2019). Culturally responsive mathematics teaching and constructivism: Preparing teachers for diverse classrooms. Multicultural Learning and Teaching, 14(1), 20160023. https://doi.org/10.1515/mlt-2016-0023

Wang, K. D., Wu, Z., Tufts, L. N., Wieman, C., Salehi, S., & Haber, N. (2025). Scaffold or crutch? Examining college students' use and views of generative AI tools for STEM education. In 2025 IEEE Global Engineering Education Conference (EDUCON), (pp. 1–10). https://doi.org/10.1109/educon62633.2025.11016406

Wang, T., Zheng, J., Tan, C., & Lajoie, S. P. (2023). Computer‐based scaffoldings influence students' metacognitive monitoring and problem‐solving efficiency in an intelligent tutoring system. Journal of Computer Assisted Learning, 39(5), 1652–1665. https://doi.org/10.1111/jcal.12824

Watts, K. J. (2025). Paying the cognitive debt: An experiential learning framework for integrating AI in social work education. Education Sciences, 15(10), 1304. https://doi.org/10.3390/educsci15101304

Wong, S. F., Mahmud, M. M., & Wong, S. S. (2025). Balancing AI and autonomy: The role of AI in enhancing calculus education. In 2025 6th International Conference on Information Technology and Education Technology (ITET), (pp. 16–21). https://doi.org/10.1109/itet65804.2025.11100716

Wu, Y. (2024). Critical thinking pedagogics design in an era of ChatGPT and other AI tools — Shifting from teaching “What” to teaching “Why” and “How”. Journal of Education and Development, 8(1), 1–10. https://doi.org/10.20849/jed.v8i1.1404

Yin, R. K. (2003). Case study research: Design and methods (3rd ed.). Sage.

Yunianto, W., Lavicza, Z., Kastner-Hauler, O., & Houghton, T. (2024). Investigating the use of ChatGPT to solve a GeoGebra based mathematics+computational thinking task in a geometry topic. Journal on Mathematics Education, 15(3), 1027–1052. https://doi.org/10.22342/jme.v15i3.pp1027-1052

Zhai, C., Wibowo, S., & Li, L. D. (2024). The effects of over-reliance on AI dialogue systems on students' cognitive abilities: a systematic review. Smart learning environments, 11(1), 28. https://doi.org/10.1186/s40561-024-00316-7

Zulkarnaen, R., & Aziza, A. K. (2026). Teachers’ roles in designing and implementing numeracy-oriented instruction in junior high school mathematics: A multiple case study. Journal of Mathematics Instruction, Social Research and Opinion, 5(1), 809–824. https://doi.org/10.58421/misro.v5i1.1204