Designing an AI-Assisted Speech-Based Interactive System for Home-Based Sentence Practice for Children

• Elizabeth Wiafe Dalhousie University
• Frank Rudzicz Dalhousie University
• Lizbeth Escobedo Dalhousie University

DOI: https://doi.org/10.5753/clihc.2026.21174

Resumo

Expressive sentence construction is foundational to children’s academic development, yet opportunities for structured practice and receiving feedback outside clinical environments remain limited. This work-in-progress paper presents an AI-assisted speech-based interactive prototype designed to support home-based sentence formulation through multimodal prompts and automated feedback. The system integrates visual stimuli, guided target words, local speech recognition, and structured grammar-aware analysis that evaluates sentence completeness, target word use, complexity level, and contextual relevance through a conjunctive decision rule to provide supportive, non-diagnostic feedback. We describe the system architecture and outline a proposed pilot study with children aged 6-12, complemented by expert input from speech-language pathologists, to evaluate feasibility, usability, and perceived educational value.

Referências

Bai, Y., García, C., Hubers, F., Cucchiarini, C., and Strik, H. (2023). An asr-based tutor for learning to read: How to optimize feedback to first graders. ArXiv, abs/2306.04190.

Kamalov, F., Calonge, D. S., and Gurrib, I. (2023). New era of artificial intelligence in education: Towards a sustainable multifaceted revolution. Sustainability.

Kang, B., Jeon, H.-B., and Lee, Y. (2024). Ai-based language tutoring systems with end-to-end automatic speech recognition and proficiency evaluation. ETRI Journal, 46:48 – 58.

Mathew, A., Paulose, J., and Info, A. (2021). Nlp-based personal learning assistant for school education. International Journal of Electrical and Computer Engineering, 11:4522–4530.

Molenaar, B., García, C., Strik, H., and Cucchiarini, C. (2023). Automatic assessment of oral reading accuracy for reading diagnostics. In Interspeech.

Sun, L., Xu, W., and Gao, Z. (2026). A Human-Centered Privacy (HCP) Approach to AI. In Handbook of Human-Centered Artificial Intelligence, pages 1–47. Springer.

Tan, L. Y., Hu, S., Yeo, D. J., and Cheong, K. H. (2025). Artificial Intelligence-Enabled Adaptive Learning Platforms: A Review. Computers and Education: Artificial Intelligence, 9:100429.

Thompson, C. K. and Shapiro, L. P. (2007). Complexity in Treatment of Syntactic Deficits. Complexity.

Usha, G. P. and Alex, J. (2023). Speech assessment tool methods for speech impaired children: A systematic literature review on the state-of-the-art in speech impairment analysis. Multimedia Tools and Applications, pages 1 – 38.