A Machine Learning Based Multimodal Framework for Continuous Health Monitoring using Wearable and Cough Data

The contemporary digital health environment features an abundance of applications and wearable technologies capable of monitoring a wide array of physiological parameters, including cardiac activity, energy expenditure, sleep architecture, stress levels, and critical vital signs such as ECG, SpO₂, and body temperature. However, specialized instruments, exemplified by LCM for respiratory symptom surveillance like cough, typically function in isolation from broader health tracking ecosystems. This technological proliferation has paradoxically created a significant lacuna in the integration of these disparate data sources into a cohesive, publicly accessible, and user-friendly platform. This paper presents a novel framework designed to address this challenge by employing Generative AI (GenAI) to synchronize data from discrete cough monitoring tools with wearable health device datasets. Through GenAI's capacity for multimodal data analysis, the system can discern intricate patterns and correlations between respiratory symptoms and other physiological metrics, thereby facilitating the early detection of nascent health conditions. The proposed solution is engineered to demystify health data interpretation for non-expert users by generating personalized, localized summaries and actionable insights. This integrated approach not only augments the accuracy of health assessments but also empowers individuals to exercise informed agency over their well-being. The framework holds substantial promises for advancing chronic disease management, expediting illness detection, bolstering preventive care, and informing post-care decisions, fostering a unified, intelligent, adaptive, and accessible paradigm for health monitoring [21]

Cough pattern analysis, Gen-AI Multimodal health data, Smart LCM cough monitoring, Smart health ecosystem, Human-centered health interfaces.

1. Shetty, S., & K, P. (2025). Personalized Predictive Healthcare Using Machine Learning and Generative AI. 2025 International Conference on Artificial Intelligence and Data Engineering (AIDE), 867-872. https://doi.org/10.1109/aide64228.2025.10987453. [Google Scholar] [Crossref]

2. He, R., Sarwal, V., Qiu, X., Zhuang, Y., Zhang, L., Liu, Y., & Chiang, J. (2024). Generative AI Models in Time-Varying Biomedical Data: Scoping Review. Journal of Medical Internet Research, 27. https://doi.org/10.2196/59792. [Google Scholar] [Crossref]

3. Liu, J., Cen, X., Yi, C., Wang, F., Ding, J., Cheng, J., Wu, Q., Gai, B., Zhou, Y., He, R., Gao, F., & Li, Y. (2025). Challenges in AI-driven Biomedical Multimodal Data Fusion and Analysis. Genomics, Proteomics & Bioinformatics, 23. https://doi.org/10.1093/gpbjnl/qzaf011 [Google Scholar] [Crossref]

4. Orlandic, L., Thevenot, J., Teijeiro, T., & Atienza, D. (2023). A Multimodal Dataset for Automatic Edge-AI Cough Detection. 2023 45th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), 1-7. https://doi.org/10.1109/embc40787.2023.10340413 [Google Scholar] [Crossref]

5. Patidar, A., Gore, D., Inje, B., & Alhat, A. (2025). AI-Enhanced Depression Detection System: Integrating Multimodal Analysis for Early Diagnosis. 2025 International Conference on Computational, Communication and Information Technology (ICCCIT), 170-175. https://doi.org/10.1109/icccit62592.2025.10928002 [Google Scholar] [Crossref]

6. Kajornkasirat, S., Sawangwong, C., Puangsuwan, K., Chanapai, N., Phutthamongkhon, W., & Puttinaovarat, S. (2025). Integrating AI-Driven Predictive Analytics in Wearable IoT for Real-Time Health Monitoring in Smart Healthcare Systems. Applied Sciences. https://doi.org/10.3390/app15084400 [Google Scholar] [Crossref]

7. Reddy, S. (2024). Generative AI in healthcare: an implementation science informed translational path on application, integration and governance. Implementation Science: IS, 19. https://doi.org/10.1186/s13012-024-01357-9 [Google Scholar] [Crossref]

8. Mohsen, F., Ali, H., Hajj, N., & Shah, Z. (2022). Artificial intelligence-based methods for fusion of electronic health records and imaging data. Scientific Reports, 12. https://doi.org/10.1038/s41598-022-22514-4 [Google Scholar] [Crossref]

9. Shajari, S., Kuruvinashetti, K., Komeili, A., & Sundararaj, U. (2023). The Emergence of AI-Based Wearable Sensors for Digital Health Technology: A Review. Sensors (Basel, Switzerland), 23. https://doi.org/10.3390/s23239498 [Google Scholar] [Crossref]

10. M, S., & Joshi, P. (2025). Early Prediction of Chronic Diseases Through Multimodal Data Fusion in Machine Learning: A Survey. 2025 7th International Conference on Intelligent Sustainable Systems (ICISS), 1108-1115. https://doi.org/10.1109/iciss63372.2025.11076438 [Google Scholar] [Crossref]

11. Alzghaibi, H. (2025). Adoption barriers and facilitators of wearable health devices with AI integration: a patient-centred perspective. Frontiers in Medicine, 12. https://doi.org/10.3389/fmed.2025.1557054 [Google Scholar] [Crossref]

12. Sirapangi, M., & Gopikrishnan, S. (2024). MAIPFE: An Efficient Multimodal Approach Integrating Pre-Emptive Analysis, Personalized Feature Selection, and Explainable AI. Computers, Materials & Continua. https://doi.org/10.32604/cmc.2024.047438 [Google Scholar] [Crossref]

13. Shim, J., Kim, M., Lee, S., Kim, S., Kwon, J., Song, C., Ahn, K., Kang, S., Park, H., Park, H., Kim, B., & Yang, M. (2023). An artificial intelligence algorithm‐based smartphone application for daily cough monitoring. Allergy, 78. https://doi.org/10.1111/all.15632 [Google Scholar] [Crossref]

14. Chen, Y., & Esmaeilzadeh, P. (2024). Generative AI in Medical Practice: In-Depth Exploration of Privacy and Security Challenges. Journal of Medical Internet Research, 26. https://doi.org/10.2196/53008 [Google Scholar] [Crossref]

15. Acosta, J., Falcone, G., Rajpurkar, P., & Topol, E. (2022). Multimodal biomedical AI. Nature Medicine, 28, 1773 - 1784. https://doi.org/10.1038/s41591-022-01981-2. [Google Scholar] [Crossref]

16. Kargarandehkordi, A., Li, S., Lin, K., Phillips, K., Benzo, R., & Washington, P. (2025) [Google Scholar] [Crossref]

17. Fusing Wearable Biosensors with Artificial Intelligence for Mental Health Monitoring: A Systematic Review. Biosensors, 15. https://doi.org/10.3390/bios15040202 [Google Scholar] [Crossref]

18. Alasmari, S., AlGhamdi, R., Tejani, G., Sharma, S., & Mousavirad, S. (2025). Federated learning-based multimodal approach for early detection and personalized care in cardiac disease. Frontiers in Physiology, 16. https://doi.org/10.3389/fphys.2025.1563185 [Google Scholar] [Crossref]

19. Prashanthi, B., Sharma, A., , M., , K., Riad, R., , A., & Chidambaranathan, S. (2024). AI-Driven Smart Health Monitoring System Using Wearable IoT Devices and Predictive Analytics. 2024 International Conference on IoT, Communication and Automation Technology (ICICAT), 952-956. https://doi.org/10.1109/icicat62666.2024.10923489 [Google Scholar] [Crossref]

20. Ijaz, A., Nabeel, M., Masood, U., Mahmood, T., Hashmi, M., Posokhova, I., Rizwan, A., & Imran, A. (2022). Towards using Cough for Respiratory Disease Diagnosis by leveraging Artificial Intelligence: A Survey. ArXiv, abs/2309.14383 https://doi.org/10.1016/j.imu.2021.100832 [Google Scholar] [Crossref]

21. Chen, X., Xie, H., Tao, X., Wang, F., Leng, M., & Lei, B. (2024). Artificial intelligence and multimodal data fusion for smart healthcare: topic modeling and bibliometrics. Artif. Intell. Rev., 57, 91. https://doi.org/10.1007/s10462-024-10712-7 [Google Scholar] [Crossref]

22. Karthick Rajapandiyan, Sridhar L. 2026. Vol. 6 No. Supplementary 1 (2026): Advancement in Management and Technology (AMT), Book of Abstracts, https://doi.org/10.46977/amt.v06isupp1%20%20 [Google Scholar] [Crossref]