Evaluating the Impact of Integrating Intelligent Educational Chatbots in English Conversation-Based Classes on Reducing Speaking Anxiety Among Adult Language Learners
Keywords:
speaking anxiety, chatbots in education, AI - assisted language learning , adult EFL learners, conversational practice, randomized controlled trialAbstract
Purpose: This study aimed to evaluate the effectiveness of integrating intelligent educational chatbots into English conversation-based classrooms in reducing speaking anxiety among adult language learners.
Methods and Materials: A randomized controlled trial was conducted with 30 adult intermediate-level English learners from Tehran, who were randomly assigned to either an experimental group (n = 15) receiving a 10-session chatbot-assisted intervention or a control group (n = 15) participating in traditional conversation classes. Each session lasted 90 minutes and focused on interactive speaking tasks. Speaking anxiety was measured using the Foreign Language Classroom Anxiety Scale (FLCAS) at three time points: pre-test, post-test, and five-month follow-up. Data were analyzed using repeated measures ANOVA and Bonferroni post-hoc tests via SPSS-27.
Findings: The results showed a significant time × group interaction effect on speaking anxiety scores (F(2, 56) = 35.41, p < .001, η² = .57), indicating that the reduction in anxiety was significantly greater in the experimental group than in the control group. Participants in the chatbot-assisted group experienced a significant decline in anxiety from pre-test (M = 126.47) to post-test (M = 97.85), which was sustained at follow-up (M = 99.42). Bonferroni post-hoc comparisons confirmed significant within-group changes for the experimental group (p < .001), while the control group showed no statistically significant differences across time points.
Conclusion: The integration of AI-powered educational chatbots in conversation-focused English classes appears to be an effective and lasting strategy for reducing speaking anxiety among adult learners. These findings suggest that chatbots offer a psychologically safe, interactive, and engaging environment that facilitates oral language development by lowering affective barriers in language learning.
Downloads
References
Al-Madi, N. A., Maria, K. A., Al-Madi, M., & Maria, E. A. (2024). An Inquiry Smart Chatbot System for Al-Zaytoonah University of Jordan. Bulletin of Electrical Engineering and Informatics, 13(4), 2758-2773. https://doi.org/10.11591/eei.v13i4.7645
Ballıdağ, M., & Aydın, S. (2025). A Comparison of the Effects of AI‐based Chatbots and Peer Interactions on Speaking Anxiety Among EFL Learners. Future in Educational Research, 3(2), 224-238. https://doi.org/10.1002/fer3.70005
Bozkurt, B. N., & Aydın, S. (2023). The Impact of Collaborative Learning on Speaking Anxiety Among Foreign Language Learners in Online and Face-to-Face Environments. International Journal of Virtual and Personal Learning Environments, 13(1), 1-16. https://doi.org/10.4018/ijvple.316973
Chen, C., Lam, K. K., Yip, K. M., So, H. K., Lum, T., Wong, I. C. K., Yam, J. C., Chui, C. S. L., & Ip, P. (2025). Comparison of an AI Chatbot With a Nurse Hotline in Reducing Anxiety and Depression Levels in the General Population: Pilot Randomized Controlled Trial. JMIR human factors, 12, e65785-e65785. https://doi.org/10.2196/65785
Dewi, F. R. (2024). Speaking Anxiety Analysis in Public Speaking Class at Hasanuddin Islamic Institute of Pare. English Teaching Journal and Research Journal of English Education Literature and Linguistics, 4(2), 130-144. https://doi.org/10.55148/etjar.v4i2.1436
Duong, T., & Suppasetseree, S. (2024). The Effects of an Artificial Intelligence Voice Chatbot on Improving Vietnamese Undergraduate Students’ English Speaking Skills. International Journal of Learning Teaching and Educational Research, 23(3), 293-321. https://doi.org/10.26803/ijlter.23.3.15
Kim, M., Lee, S., Kim, S., Heo, J.-i., Lee, S., Shin, Y. B., Cho, C. H., & Jung, D. (2025). Therapeutic Potential of Social Chatbots in Alleviating Loneliness and Social Anxiety: Quasi-Experimental Mixed Methods Study. Journal of medical Internet research, 27, e65589. https://doi.org/10.2196/65589
Kızıl, A. Ş., Klímová, B., Pikhart, M., & Parmaxi, A. (2025). A Systematic Review of the Recent Research on the Usefulness of Chatbots for Language Education. Journal of Computer Assisted Learning, 41(2). https://doi.org/10.1111/jcal.70001
Pertiwi, P. C., Segoh, D., & Rohmadhani, A. (2025). Artificial Intelligence in Academic Environments: Reducing or Increasing Foreign Language Anxiety? Inspiring English Education Journal, 8(1), 100-131. https://doi.org/10.35905/inspiring.v8i1.13009
Pham, H. T. U., Dinh, T., & Tran, X. (2025). The Impact of ChatGPT Voice on Non-Majored Students’ Willingness to Communicate in a Vietnamese University. AsiaCALL Online Journal, 16(1), 312-327. https://doi.org/10.54855/acoj.2516116
Poseletska, K., Kyrychenko, S., Vlasenko, O., Koval, I., Потюк, І. Є., & Shpenyk, S. (2023). Scenarios for the Use of Chatbots in Teaching a Foreign Language in the Higher Educational Institution (HEI). Revista Romaneasca pentru Educatie Multidimensionala, 15(3), 347-359. https://doi.org/10.18662/rrem/15.3/770
Sboui, M., Baati, O., & Sfar, N. (2024). Influencing Factors and Consequences of Chatbot Initial Trust in AI Telecommunication Services: A study on Generation Z. The TQM Journal. https://doi.org/10.1108/tqm-02-2024-0085
Setyoningrum, T. Y., Susanto, D. A., & Setiaji, A. (2025). Impacting Artificial Intelligent Chatbot in Flipped Classroom to Enhance Students’ Speaking Competence. Aree, 3(1), 8. https://doi.org/10.26714/aree.3.1.2025.8-25
Sonsaat, S., & Kurt, Ş. (2024). The Impact of Generative AI-powered Chatbots on L2 Comprehensibility. Journal of Second Language Pronunciation, 10(3), 339-374. https://doi.org/10.1075/jslp.24053.son
Sundjaja, A. M., Utomo, P., & Colline, F. (2024). The Determinant Factors of Continuance Use of Customer Service Chatbot in Indonesia E-Commerce: Extended Expectation Confirmation Theory. Journal of Science and Technology Policy Management, 16(1), 182-203. https://doi.org/10.1108/jstpm-04-2024-0137
Taeza, J. (2025). The Role of AI-powered Chatbots in Enhancing Second Language Acquisition: An Empirical Investigation of Conversational AI Assistants. Edelweiss Applied Science and Technology, 9(3), 2616-2629. https://doi.org/10.55214/25768484.v9i3.5853
Tomas, F., & Immerzeel, J. (2025). Chatbots in Eyewitness Interviews: Perceived Usefulness and Ease of Use Drive Intent to Use Conversational Agent. Journal of Criminal Psychology. https://doi.org/10.1108/jcp-11-2024-0110
Tran, H. T. T., Ngoc, L. T. M., & Lam, N. X. (2024). Innovating With Chatbots: A Study of Adoption Factors in the Vietnamese Construction Sector. Vnu University of Economics and Business, 4(6), 52. https://doi.org/10.57110/vnu-jeb.v4i6.353
Tyen, G., Caines, A., & Buttery, P. (2024). LLM Chatbots as a Language Practice Tool: A User Study. 211, 235-247. https://doi.org/10.3384/ecp211018
Xiang, X. (2023). English Speaking Anxiety in Chinese International High School Students. Lecture Notes in Education Psychology and Public Media, 9(1), 1-6. https://doi.org/10.54254/2753-7048/9/20230008
Yao, X. (2025). From Assistants to Digital Beings: Exploring Anthropomorphism, Humanness Perception, and AI Anxiety in Large-Language-Model Chatbots. Social Science Computer Review. https://doi.org/10.1177/08944393251354976
Yu, Y., Xie, C., Xia, Y., Zeng, S., & Qian, Y. (2023). Useless Anxieties: Status and Causes of Educational Anxiety Under the “Double Reduction Policy”. Journal of Humanities Arts and Social Science, 7(9), 1728-1733. https://doi.org/10.26855/jhass.2023.09.004
Zhang, J. (2025). Integrating Chatbot Technology Into English Language Learning to Enhance Student Engagement and Interactive Communication Skills. Journal of Computational Methods in Sciences and Engineering, 25(3), 2288-2299. https://doi.org/10.1177/14727978241312992
Downloads
Published
Submitted
Revised
Accepted
Issue
Section
License
Copyright (c) 2025 Akbar Molaei
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
