PriMera Scientific Engineering (ISSN: 2834-2550)

Research Article

Volume 6 Issue 4

Empowering Dementia Tele-Neurorehabilitation: AI-Enhanced Gamified Speech Therapy

Pritish Pore, Prutha Rinke, Sharvari Bhagwat, Yash Desai*, Arati Deshpande, Soubhik Das and Pushkraj Marne

March 14, 2025

View PDF

Abstract

Dementia, a neuro-degenerative disorder affecting various cognitive functions, including speech and language, presents significant challenges in rehabilitation. This research paper introduces a comprehensive tele-neurorehabilitation system designed for speech therapy in dementia patients, leveraging cutting-edge technology. The system incorporates nine distinct activities, employing text comparison models. Users engage in interactive exercises, where their spoken words are transcribed to text, fostering language engagement and cognitive stimulation. This application explores the dynamic correlation between dementia and speech therapy, analyzing advancements, challenges, and therapeutic applications. The outcomes of our study aim to deepen comprehension of this intricate relationship, providing a foundation for more precise and impactful speech therapy interventions, ultimately contributing to improved rehabilitation for those affected by dementia.

Keywords: Dementia; Speech Therapy; Tele-Neurorehabilitation; Gamification; Automated Speech and Language Therapy; Text Comparison; Cognitive Stimulation; Interactive Experience

References

  1. Swan K., et al. “Speech-Language Pathologist Interventions for Communication in Moderate-Severe Dementia: A Systematic Review”. Am J Speech Lang Pathol 27.2 (2018): 836-852.
  2. EM Alkabawi, AR Hilal and OA Basir. “Computer-aided classification of multi-types of dementia via convolutional neural networks”.  2017 IEEE International Symposium on Medical Measurements and Applications (MeMeA), Rochester, MN, USA (2017): 45-50.
  3. Gale SA, Acar D and Daffner KR. “Dementia”. Am J Med 131.10 (2018): 1161-1169.
  4. Bahar-Fuchs A, Clare L and Woods B. “Cognitive training and cognitive rehabilitation for persons with mild to moderate dementia of the Alzheimer’s or vascular type: a review”. Alzheimer’s research & therapy 5 (2013): 1-14.
  5. Klimova B and Kuca K. “Speech and language impairments in dementia”. J Appl Biomed 14.2 (2016): 97-103.
  6. Rathnayaka MHKR., et al. “Cognitive rehabilitation based mpersonalized solution for Dementia patients using reinforcement learning”. In 2021 IEEE International Systems Conference (SysCon) (2021): 1-6.
  7. Kabir MS., et al. “The Early Detection of Dementia Disease Using Machine Learning Approach”. In 2023 International Conference on Computer Communication and Informatics (ICCCI) (2023): 1-6.
  8. Wootton Richard. “Recent advances: Telemedicine”. BMJ 323.7312 (2001): 557-560.
  9. Hjelm NM. “Benefits and drawbacks of telemedicine”. Introduction to Telemedicine, second edition (2017): 134-149.
  10. Federico S., et al. “Telerehabilitation for Neurological Motor Impairment: A Systematic Review and Meta-Analysis on Quality of Life, Satisfaction, and Acceptance in Stroke, Multiple Sclerosis, and Parkinson’s Disease”. Journal of Clinical Medicine 13.1 (2024): 299.
  11. MS Kabir., et al. “The Early Detection of Dementia Disease Using Machine Learning Approach”.  2023 International Conference on Computer Communication and Informatics (ICCCI), Coimbatore, India (2023): 1-6.
  12. CA Tommy and J-L Minoi. “Speech therapy mobile application for speech and language impairment children”.  2016 IEEE EMBS Conference on Biomedical Engineering and Sciences (IECBES), Kuala Lumpur, Malaysia (2016): 199-203.
  13. Horner J., et al. “Swallowing in Alzheimer’s disease”. Alzheimer Dis Assoc Disord 8.3 (1994): 177-89.
  14. M Das and A Saha. “An automated speech-language therapy tool with interactive virtual agent and peer-to-peer feedback”.  2017 4th International Conference on Advances in Electrical Engineering (ICAEE), Dhaka (2017): 510-515.
  15. Dodd B and Bradford A. “A comparison of three therapy methods for children with different types of developmental phonological disorder”. Int J Lang Commun Disord 35.2 (2000): 189-209.
  16. Crosbie S, Holm A and Dodd B. “Intervention for children with severe speech disorder: a comparison of two approaches”. Int J Lang Commun Disord 40.4 (2005): 467-91.
  17. RM Rawat., et al. “Dementia Detection Using Machine Learning by Stacking Models”.  2020 5th International Conference on Communication and Electronics Systems (ICCES), Coimbatore, India (2020): 849-854.
  18. C Yamagata., et al. “Mobile app development and usability research to help dementia and Alzheimer patients”.  2013 IEEE Long Island Systems, Applications and Technology Conference (LISAT), Farmingdale, NY, USA (2013): 1-6.
  19. R Maskeliunas., et al. “Serious Game iDO: Towards Better Education in Dementia Care.” Information 10 (2019): 355.
  20. I Paliokas., et al. “Gamification in Social Networking: A Platform for People Living with Dementia and their Caregivers”.  2017 IEEE 17th International Conference on Bioinformatics and Bioengineering (BIBE), Washington, DC, USA (2017): 574-579.
  21. A Vinnarasu and Deepa V Jose. “Speech to text conversion and summarization for effective understanding and documentation.” International Journal of Electrical and Computer Engineering (IJECE) (2019).
  22. Nagdewani Shivangi and Ashika Jain. “A Review on Methods for Speech-To-Text and Text-To-Speech Conversion”. (2020).
  23. Sergio Jimenez, Fabio Gonzalez and Alexander Gelbukh. “Text comparison using soft cardinality”. In Proceedings of the 17th international conference on String processing and information retrieval (SPIRE’10). Springer-Verlag, Berlin, Heidelberg (2010): 297-302.
  24. M Bhattacharjee, SRM Prasanna and P Guha. “Speech/Music Classification Using Features from Spectral Peaks”. in IEEE/ACM Transactions on Audio, Speech, and Language Processing 28 (2020): 1549-1559.
  25. A Gaodida., et al. “Aiding Speech Therapy Using Audio and Video Processing”.  2020 IEEE Asia-Pacific Conference on Computer Science and Data Engineering (CSDE), Gold Coast, Australia (2020).
  26. Badshah AM., et al. “Speech Emotion Recognition from Spectrograms with Deep Convolutional Neural Network”. Journal of Speech Technology (2017).