Exploring the impact of artificial intelligence on mathematics learning: A meta-analysis

Main Article Content

Harun Onesimus Laia
https://orcid.org/0009-0006-8785-9214
Martadiputra
https://orcid.org/0000-0002-9668-0164
Mulyaning Asih
Yosy Candraningsih
https://orcid.org/0009-0004-8518-1564

Abstract

Despite the growing integration of artificial intelligence (AI) in education, empirical findings regarding its effectiveness in mathematics learning remain mixed, providing limited insight into the conditions under which AI-based interventions are most effective. This study aims to examine the effectiveness of AI in mathematics learning and investigate whether educational level, intervention duration, type of AI, mathematical competence, and mathematical content area moderate its effectiveness. A meta-analysis was conducted using 37 effect sizes from 16 studies that met the inclusion criteria. The studies were identified through a systematic search of the Scopus database, and the data were analysed using a random-effects model and Hedges' g, with the support of Comprehensive Meta-Analysis (CMA) software. The findings indicate that AI implementation has a statistically significant positive effect on mathematics learning (g = 0.65, p < 0.05). The moderator analysis revealed that mathematical competence and educational level were significant moderators, whereas intervention duration, type of AI, and mathematical content area were not. These findings highlight the importance of aligning AI-based interventions with the targeted mathematical competencies and learners' educational characteristics. This study contributes to the literature by synthesizing empirical evidence on the effectiveness of AI in mathematics learning and identifying key moderating factors that may influence its impact.

Downloads

Download data is not yet available.

Article Details

How to Cite
Onesimus Laia, H., Martadiputra, B. A. P., Mulyaning Asih, E. C., & Candraningsih, Y. (2026). Exploring the impact of artificial intelligence on mathematics learning: A meta-analysis. Kalamatika: Jurnal Pendidikan Matematika, 11(2), 197-215. https://doi.org/10.22236/KALAMATIKA.vol11no2.2026pp197-215
Section
Article

References

Akavova, A., Temirkhanova, Z., & Lorsanova, Z. (2023). Adaptive learning and artificial intelligence in the educational space. E3S Web of Conferences, 451, 06011. https://doi.org/10.1051/e3sconf/202345106011

Al-Nawaiseh, S. J., Tabieh, A. A., Maqableh, W. F., Altawalbeh, M., & Ahmad, F. B. (2024). The effectiveness of using educational robots in enhancing engineering mathematics skills among students in basic school. International Journal of Education and Practice, 12(3), 906-921. https://doi.org/10.18488/61.v12i3.3768

Awang, L. A., Yusop, F. D., & Danaee, M. (2025). Current practices and future direction of artificial intelligence in mathematics education: A systematic review. International Electronic Journal of Mathematics Education, 20(2), em0823. https://doi.org/10.29333/iejme/16006

Baker, R., & Siemens, G. (2014). Educational Data Mining and Learning Analytics. In R. K. Sawyer (Ed.), The Cambridge Handbook of the Learning Sciences (pp. 253–272). chapter, Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9781139519526.016

Baker, T., Smith, L., & Anissa, N. (2019). Educ-AI-tion rebooted? exploring the future of artificial intelligence in schools and colleges. In www.nesta.org.uk. Nesta. https://media.nesta.org.uk/documents/Future_of_AI_and_education_v5_WEB.pdf

Belpaeme, T., Kennedy, J., Ramachandran, A., Scassellati, B., & Tanaka, F. (2018). Social robots for education: A review. Science Robotics, 3(21), 1–10. https://doi.org/10.1126/scirobotics.aat5954

Berida, O., Oguntimilehin, A., Ajisafe, B., Adebusola, T.-O., Babalola, G., Akinduyite, O., Okebule, T., Obamiyi, S., & Sanya, O. (2024, April). SMat-Bot: An interactive chatbot for facilitating students’ comprehension of mathematics. In 2024 International Conference on Science, Engineering and Business for Driving Sustainable Development Goals (SEB4SDG) (pp. 1-8). IEEE. https://doi.org/10.1109/SEB4SDG60871.2024.10630005

Borenstein, M., Hedges, L. V, Higgins, J. P. T., & Rothstein, H. R. (2021). Introduction to Meta-Analysis. Second Edition. Wiley. https://doi.org/10.1002/9780470743386

Chen, L., Chen, P., & Lin, Z. (2020). Artificial intelligence in education: A review. IEEE Access, 8, 75264–75278. https://doi.org/10.1109/ACCESS.2020.2988510

Choi, Y., & McClenen, C. (2020). Development of adaptive formative assessment system using computerized adaptive testing and dynamic bayesian networks. Applied Sciences (Switzerland), 10(22), 1–17. https://doi.org/10.3390/app10228196

D’Mello, S., & Graesser, A. C. (2015). Feeling, thinking, and computing with affect-aware learning technologies. Feeling, thinking, and computing with affect-aware learning technologies. In R. Calvo, S. D’Mello, J. Gratch, & A. Kappas (Eds.), The Oxford handbook of affective computing. Oxford University Press. https://doi.org/10.1093/oxfordhb/9780199942237.013.032

Duval, S., & Tweedie, R. (2000). Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56(2), 455–463. https://doi.org/10.1111/j.0006-341X.2000.00455.x

Ellington, L. M. (2026). Adaptive learning systems: revolutionizing student-centered education. In V. Wang (Ed.), AI, Personalization, Equity, and the Future of Learning (pp. 345-368). IGI Global Scientific Publishing. https://doi.org/10.4018/979-8-3373-5097-4.ch012

Fardian, D., Suryadi, D., Prabawanto, S., & Jupri, A. (2025). Integrating Chat-GPT in the classroom: A study on linear algebra learning in higher education. International Journal of Information and Education Technology, 15(4), 732–751. https://doi.org/10.18178/ijiet.2025.15.4.2279

Garcia, M. B., Acut, D. P., Arif, Y. M., Maher, D., Alex, J. K., Wardat, Y., Chiu, T. K. F., & Damaševičius, R. (2026). Modernizing mathematics education with artificial intelligence: A narrative review of ai-powered tools, thematic trends, and instructional applications. In A. Mazı (Ed.), The Convergence of Mathematics and AI: A New Paradigm in Education (pp. 153-186). IGI Global Scientific Publishing. https://doi.org/10.4018/979-8-3373-1998-8.ch006

Gürefe, N., Sarpkaya Aktaş, G., & Öksüz, H. (2024). Investigating the Impact of the AI-Supported 5E (AI-s5E) Instructional Model on Spatial Ability. Behavioral Sciences, 14, 682. https://doi.org/10.3390/bs14080682

Holmes, W., Bialik, M., & Fadel, C. (2019). Artificial intelligence in education: Promises and implications for teaching and learning. Center for Curriculum Redesign.

Hwang, S. (2022). Examining the effects of artificial intelligence on elementary students’ mathematics achievement: A meta-analysis. Sustainability, 14(20), 13185. https://doi.org/10.3390/su142013185

Khairunnisa, K., Sari, F. F., Anggelena, M., Agustina, D., & Nursa’adah, E. (2022). Penggunaan Effect Size Sebagai Mediasi dalam Koreksi Efek Suatu Penelitian. Jurnal Pendidikan Matematika (Judika Education), 5(2), 138–151. https://doi.org/10.31539/judika.v5i2.4802

Lampropoulos, G., & Papadakis, S. (2024). Maker education and educational robotics in the age of artificial intelligence. In S. Papadakis & G. Lampropoulos (Eds.), Intelligent educational robots: Toward personalized learning environments (pp. 1–8). De Gruyter. https://doi.org/10.1515/9783111352695-001

Létourneau, A., Deslandes Martineau, M., Charland, P., Karran, J. A., Boasen, J., & Léger, P. M. (2025). A systematic review of AI-driven intelligent tutoring systems (ITS) in K-12 education. Npj Science of Learning, 10(1), 29. https://doi.org/10.1038/s41539-025-00320-7

Lu, Y., Pian, Y., Chen, P., Meng, Q., & Cao, Y. (2021). RadarMath: An Intelligent Tutoring System for Math Education. Proceedings of the AAAI Conference on Artificial Intelligence, 35(18), 16087–16090. https://doi.org/10.1609/aaai.v35i18.18020

Memiş, Y. (2025). Examining the potential and pitfalls of AI in problem solving. Journal of Pedagogical Research, 9(2), 177–190. https://doi.org/10.33902/JPR.202532099

Niño, F., Lancheros-Cuesta, D., Jiménez-Valderrama, M., Mestre, G., & Gómez, S. (2023). Systematic Review: Trends in Intelligent Tutoring Systems in Mathematics Teaching and Learning. International Journal of Education in Mathematics, Science and Technology, 12, 203–229. https://doi.org/10.46328/ijemst.3189

Onesimus Laia, H., Martadiputra, B. A. P., & Dahlan, J. A. (2025). The Effect of Logical-Mathematical Intelligence on Mathematics Learning and Moderator Analysis: A Meta- Analysis. Al-Jabar: Jurnal Pendidikan Matematika, 16(1), 129–149. https://doi.org/10.24042/ajpm.v16i1.25539

Opesemowo, O. A. G. (2025). Artificial Intelligence in Mathematics Education: The Pros and Cons. In M. Khosrow-Pour, D.B.A. (Ed.), Encyclopedia of Information Science and Technology, Sixth Edition. Advance online publication. https://doi.org/10.4018/978-1-6684-7366-5.ch084

Ouyang, F., & Xu, W. (2024). The effects of educational robotics in STEM education: A multilevel meta-analysis. International Journal of STEM Education, 11(1). https://doi.org/10.1186/s40594-024-00469-4

Ruppar, T. (2020). Meta-analysis: How to quantify and explain heterogeneity? European Journal of Cardiovascular Nursing, 19(7), 646–652. https://doi.org/10.1177/1474515120944014

Seban, P., & Urban, K. (2024). Examining the Utilisation of Learning Techniques and Strategies Among Pedagogy Students : Implications for Self-Regulated Learning. Journal of Pedagogy, 15, 27–49. https://doi.org/10.2478/jped-2024-0002

Sedgwick, P. (2015). Meta-analyses: What is heterogeneity? BMJ, 350, h1435. https://doi.org/10.1136/bmj.h1435

Sterne, J. A. C., Sutton, A. J., Ioannidis, J. P. A., Terrin, N., Jones, D. R., Lau, J., Carpenter, J., Rücker, G., Harbord, R. M., Schmid, C. H., Tetzlaff, J., Deeks, J. J., Peters, J., Macaskill, P., Schwarzer, G., Duval, S., Altman, D. G., Moher, D., & Higgins, J. P. T. (2011). Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ, 343, d4002. https://doi.org/10.1136/bmj.d4002

Surbakti, R., Umboh, S., Pong, M., & Dara, S. (2024). Cognitive Load Theory: Implications for Instructional Design in Digital Classrooms. International Journal of Educational Narratives, 2, 483–493. https://doi.org/10.70177/ijen.v2i6.1659

Sweller, J. (2011). Cognitive load theory. In J. P. Mestre & B. H. Ross (Eds.), Psychology of learning and motivation (Vol. 55, pp. 37–76). Academic Press. https://doi.org/10.1016/B978-0-12-387691-1.00002-8

Thalheimer, W., & Cook, S. (2002). How to calculate effect sizes from published research. Work-Learning Research, 1(August), 1–9. www.work-learning.com

Wahba, F., Ajlouni, A., & Abumosa, M. (2024). The impact of ChatGPT-based learning statistics on undergraduates’ statistical reasoning and attitudes toward statistics. Eurasia Journal of Mathematics, Science and Technology Education, 20, em2468. https://doi.org/10.29333/ejmste/14726

Wu, X. -Y. (2024). Artificial intelligence in L2 learning: A meta-analysis of contextual, instructional, and social-emotional moderators. System, 126, 103498. https://doi.org/10.1016/j.system.2024.103498

Yi, L., Liu, D., Jiang, T., & Xian, Y. (2025). The effectiveness of AI on K-12 students’ mathematics learning: A systematic review and meta-analysis. International Journal of Science and Mathematics Education, 23(4), 1105–1126. https://doi.org/10.1007/s10763-024-10499-7

Yıldız, S. G., & Körpeoğlu, S. G. (2025). Trends and insights of AI in mathematics education: A bibliometric analysis. International Electronic Journal of Mathematics Education, 20(3), em0837. https://doi.org/10.29333/iejme/16401

Zhang, Y., Zhang, L., Zhang, H., & Wu, X. (2025). Development of a Computerized Adaptive Assessment and Learning System for Mathematical Ability Based on Cognitive Diagnosis. Journal of Intelligence, 13(9), 114. https://doi.org/10.3390/jintelligence13090114

Zimmerman, B. J. (2002). Becoming a self-regulated learner: An overview. Theory Into Practice, 41(2), 64–70. https://doi.org/10.1207/s15430421tip4102_2