MIND: An Adaptive Multimodal Fusion Framework for Integrated Neurological Diagnosis

Accurate computational mapping and classification of brain activities are essential for diagnosing and monitoring intricate neurological disorders such as epilepsy, Parkinson's disease, and Alzheimer's disease. But traditional methods are limited in their diagnostic accuracy and scalability because they deal with data that is not uniform, has low resolution, and is not very efficient at computing. This paper proposes the Multimodal Integrated Neurological Diagnosis (MIND) Framework, a new framework that aims to get around these problems. MIND combines structural and functional data from MRI, fMRI, PET, and CT scans using adaptive feature extraction, advanced data fusion, and machine learning models that work best. The framework greatly improves the resolution, ease of understanding, and speed of neurological mappings. In comparative simulations, MIND gets 93.7% of the classifications right, cuts processing time down to 12 seconds (an improvement of 22.5% over the baseline), and gets 98.6% of the cross-modality fusions right. It also shows that it can handle a wide range of patient groups better. These results show that MIND is a strong and effective tool for planning treatments and making clinical diagnoses. The framework's ability to process data in real time and with high accuracy opens the door to more advanced uses in personalized medicine, automated diagnostics, and brain-computer interfaces.

Keywords

Brain, Imaging, Neurological, Mapping

Downloads

PDF JATS XML

References

1. D. V. Ojie, M. I. Akazue, E. U. Omede, E. Oboh, and A. Imianvan, "Survival prediction of cervical cancer patients using genetic algorithm-based data value metric and recurrent neural network," International Journal of Soft Computing and Engineering, vol. 13, no. 2, pp. 29–41, 2023. doi: 10.35940/ijsce.B3608.0513223. [Google Scholar] [Crossref]

2. O. Okitikpi, M. I. Akazue, O. Okumoku-Evroro, and C. A. Obidike, "Development of a model for predicting hypertension disorders in pregnancy using machine learning," GAS Journal of Clinical Medicine and Medical Research, vol. 2, no. 9, 2025. doi: 10.5281/zenodo.17237564. [Google Scholar] [Crossref]

3. H. Mahmood, S. M. S. Islam, and A. Iqbal, "Multimodal 3D image registration for mapping brain disorders," bioRxiv, 2024. doi: 10.1101/2024.08.xx.xxxxxx. [Google Scholar] [Crossref]

4. Mhiri, A. B. Khalifa, M. A. Mahjoub, and I. Rekik, "Brain graph super-resolution for boosting neurological disorder diagnosis using unsupervised multi-topology connectional brain template learning," Med. Image Anal., vol. 65, p. 101768, 2020. [Google Scholar] [Crossref]

5. Y. Zhang, S. Wang, K. Xia, Y. Jiang, P. Qian, and Alzheimer’s Disease Neuroimaging Initiative, "Alzheimer’s disease multiclass diagnosis via multimodal neuroimaging embedding feature selection and fusion," Inform. Fus., vol. 66, pp. 170–183, 2021. [Google Scholar] [Crossref]

6. W. Lin, W. Lin, G. Chen, H. Zhang, Q. Gao, Y. Huang, and Alzheimer’s Disease Neuroimaging Initiative, "Bidirectional mapping of brain MRI and PET with 3D reversible GAN for the diagnosis of Alzheimer’s disease," Front. Neurosci., vol. 15, p. 646013, 2021. [Google Scholar] [Crossref]

7. Shoeibi et al., "Diagnosis of brain diseases in fusion of neuroimaging modalities using deep learning: a review," Inform. Fus., vol. 93, pp. 85–117, 2023. [Google Scholar] [Crossref]

8. K. R. Bhatele and S. S. Bhadauria, "Brain structural disorders detection and classification approaches: a review," Artif. Intell. Rev., vol. 53, no. 5, pp. 3349–3401, 2020. [Google Scholar] [Crossref]

9. G. Shou, H. Yuan, and L. Ding, "Mapping brain networks using multimodal data," in Handbook of Neuroengineering, 2023, pp. 2975–3025. [Google Scholar] [Crossref]

10. M. A. Rahaman et al., "Deep multimodal predictome for studying mental disorders," Hum. Brain Mapp., vol. 44, no. 2, pp. 509–522, 2023. [Google Scholar] [Crossref]

11. W. Hu et al., "Interpretable multimodal fusion networks reveal mechanisms of brain cognition," IEEE Trans. Med. Imaging, vol. 40, no. 5, pp. 1474–1483, 2021. [Google Scholar] [Crossref]

12. T. Mahmood, A. Rehman, T. Saba, Y. Wang, and F. S. Alamri, "Alzheimer’s disease unveiled: cutting-edge multi-modal neuroimaging and computational methods for enhanced diagnosis," Biomed. Signal Process. Control, vol. 97, p. 106721, 2024. [Google Scholar] [Crossref]

13. M. Akazue, A. Clive, E. Abel, O. Edith, and E. Ufiofio, "Cybershield: Harnessing ensemble feature selection technique for robust distributed denial of service attacks detection," Kongzhi yu Juece/Control and Decision, vol. 38, no. 3, p. 28, 2023a. [Google Scholar] [Crossref]

14. C. Asuai et al., "3ConFA: A robust feature aggregation framework for high-dimensional data optimization," Asian Journal of Research in Computer Science, vol. 18, no. 6, pp. 243–257, 2025. doi: 10.9734/ajrcos/2025/v18i6695. [Google Scholar] [Crossref]

15. B. Idiodi, M. Akazue, and A. Edje, "A pilot study on an enhanced deep learning framework for automated amyotrophic lateral sclerosis diagnosis," European Journal of Medical and Health Research, vol. 3, no. 5, pp. 194–205, 2025. doi: 10.59324/ejmhr.2025.3(5).27. [Google Scholar] [Crossref]

16. M. P. Hosseini, T. X. Tran, D. Pompili, K. Elisevich, and H. Soltanian-Zadeh, "Multimodal data analysis of epileptic EEG and rs-fMRI via deep learning and edge computing," Artif. Intell. Med., vol. 104, p. 101813, 2020. [Google Scholar] [Crossref]

17. S. Q. Abbas, L. Chi, and Y. P. P. Chen, "Deepmnf: deep multimodal neuroimaging framework for diagnosing autism spectrum disorder," Artif. Intell. Med., vol. 136, p. 102475, 2023. [Google Scholar] [Crossref]

18. L. Zhang, M. Wang, M. Liu, and D. Zhang, "A survey on deep learning for neuroimaging-based brain disorder analysis," Front. Neurosci., vol. 14, p. 779, 2020. [Google Scholar] [Crossref]

19. Y. Bi, A. Abrol, Z. Fu, and V. D. Calhoun, "A multimodal vision transformer for interpretable fusion of functional and structural neuroimaging data," Hum. Brain Mapp., vol. 45, no. 17, p. e26783, 2024. [Google Scholar] [Crossref]

20. Safai et al., "Multimodal brain connectomics-based prediction of Parkinson’s disease using graph attention networks," Front. Neurosci., vol. 15, p. 741489, 2022. [Google Scholar] [Crossref]

21. N. Goenka and S. Tiwari, "AlzVNet: a volumetric convolutional neural network for multiclass classification of Alzheimer’s disease through multiple neuroimaging computational approaches," Biomed. Signal Process. Control, vol. 74, p. 103500, 2022. [Google Scholar] [Crossref]

22. Z. Zhang, G. Li, Y. Xu, and X. Tang, "Application of artificial intelligence in the MRI classification task of human brain neurological and psychiatric diseases: a scoping review," Diagnostics, vol. 11, no. 8, p. 1402, 2021. [Google Scholar] [Crossref]

23. S. Qiu et al., "Development and validation of an interpretable deep learning framework for Alzheimer’s disease classification," Brain, vol. 143, no. 6, pp. 1920–1933, 2020. [Google Scholar] [Crossref]

24. X. Gao, F. Shi, D. Shen, and M. Liu, "Task-induced pyramid and attention GAN for multimodal brain image imputation and classification in Alzheimer’s disease," IEEE J. Biomed. Health Inform., vol. 26, no. 1, pp. 36–43, 2021. [Google Scholar] [Crossref]

25. H. Zhou, L. He, Y. Zhang, L. Shen, and B. Chen, "Interpretable graph convolutional network of multi-modality brain imaging for Alzheimer’s disease diagnosis," in 2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI), 2022, pp. 1–5. [Google Scholar] [Crossref]

26. G. Castellano, A. Esposito, E. Lella, G. Montanaro, and G. Vessio, "Automated detection of Alzheimer’s disease: a multi-modal approach with 3D MRI and amyloid PET," Sci. Rep., vol. 14, no. 1, p. 5210, 2024. [Google Scholar] [Crossref]

27. P. K. Mandal et al., "SWADESH: a multimodal multi-disease brain imaging and neuropsychological database and data analytics platform," Front. Neurol., vol. 14, p. 1258116, 2023. [Google Scholar] [Crossref]

28. Ahilan, M. Anlin Sahaya Tinu, A. Jasmine Gnana Malar, and B. Muthu Kumar, "Stationary wavelet-oriented luminance enhancement approach for brain tumor detection with multi-modality images," in International Conference on Frontiers of Intelligent Computing: Theory and Applications, 2023, pp. 461–473. [Google Scholar] [Crossref]

29. R. Sundarasekar and A. Appathurai, "Automatic brain tumor detection and classification based on IoT and machine learning techniques," Fluctuat. Noise Lett., vol. 21, no. 3, p. 2250030, 2022. [Google Scholar] [Crossref]

30. D. Rajeswari, S. Rajendran, A. Arivarasi, A. Govindasamy, and A. Ahilan, "TOSS: deep learning based track object detection using smart sensor," IEEE Sens. J., vol. 2024, p. 1, 2024. [Google Scholar] [Crossref]

31. D. S. Dakshina, P. Jayapriya, and R. Kala, "Saree texture analysis and classification via deep learning framework," Int. J. Data Sci. Artif. Intell., vol. 1, no. 1, pp. 20–25, 2023. [Google Scholar] [Crossref]

32. E. Fenil, G. Manogaran, G. N. Vivekananda, T. Thanjaivadivel, S. Jeeva, and A. Ahilan, "Real time violence detection framework for football stadium comprising of big data analysis and deep learning through bidirectional LSTM," Comput. Netw., vol. 151, pp. 191–200, 2019. [Google Scholar] [Crossref]

33. P. Whitin et al., "Mask FORD-NET: efficient detection of digital image forgery using hybrid REG-NET based mask-RCNN," Int. J. Electr. Comput. Eng. Syst., vol. 15, no. 10, pp. 829–835, 2024. [Google Scholar] [Crossref]

34. N. G. Rani, N. H. Priya, A. Ahilan, and N. Muthukumaran, "LV-YOLO: logistic vehicle speed detection and counting using deep learning-based YOLO network," SIViP, vol. 18, no. 10, pp. 7419–7429, 2024. [Google Scholar] [Crossref]

35. M. Karthikeyan, T. S. Subashini, R. Srinivasan, C. Santhanakrishnan, and A. Ahilan, "YOLOAPPLE: augment Yolov3 deep learning algorithm for apple fruit quality detection," SIViP, vol. 18, no. 1, pp. 119–128, 2024. [Google Scholar] [Crossref]

36. L. Lazli, M. Boukadoum, and O. A. Mohamed, "A survey on computer-aided diagnosis of brain disorders through MRI based on machine learning and data mining methodologies with an emphasis on Alzheimer disease diagnosis and the contribution of the multimodal fusion," Appl. Sci., vol. 10, no. 5, p. 1894, 2020. [Google Scholar] [Crossref]

37. Y. Wang, S. Tang, R. Ma, I. Zamit, Y. Wei, and Y. Pan, "Multi-modal intermediate integrative methods in neuropsychiatric disorders: a review," Comput. Struct. Biotechnol. J., vol. 20, pp. 6149–6162, 2022. [Google Scholar] [Crossref]

38. A. Lima, M. F. Mridha, S. C. Das, M. M. Kabir, M. R. Islam, and Y. Watanobe, "A comprehensive survey on the detection, classification, and challenges of neurological disorders," Biology, vol. 11, no. 3, p. 469, 2022. [Google Scholar] [Crossref]

39. N. Burgos, S. Bottani, J. Faouzi, E. Thibeau-Sutre, and O. Colliot, "Deep learning for brain disorders: from data processing to disease treatment," Brief. Bioinform., vol. 22, no. 2, pp. 1560–1576, 2021. [Google Scholar] [Crossref]

40. S. S. Menon and K. Krishnamurthy, "Multimodal ensemble deep learning to predict disruptive behavior disorders in children," Front. Neuroinform., vol. 15, p. 742807, 2021. [Google Scholar] [Crossref]

41. U. H. Bushra, F. C. Priya, and M. J. A. Patwary, "Multi-modal feature fusion with fuzziness-based semi-supervised learning for Alzheimer’s disease diagnosis," in 2024 IEEE International Conference on Computing, Applications and Systems (COMPAS), 2024, pp. 1–6. [Google Scholar] [Crossref]

42. J. Liu, H. Du, J. Mao, J. Zhu, and X. Tian, "A novel dual interactive network for Parkinson’s disease diagnosis based on multi-modality magnetic resonance imaging," in International Symposium on Bioinformatics Research and Applications, Singapore: Springer, 2024, pp. 434–444. [Google Scholar] [Crossref]

43. D. A. Arafa, H. E. D. Moustafa, H. A. Ali, A. M. Ali-Eldin, and S. F. Saraya, "A deep learning framework for early diagnosis of Alzheimer’s disease on MRI images," Multimed. Tools Appl., vol. 83, no. 2, pp. 3767–3799, 2024. [Google Scholar] [Crossref]

44. S. Desai, H. Chhinkaniwala, S. Shah, and P. Gajjar, "Enhancing Parkinson’s disease diagnosis through deep learning-based classification of 3D MRI images," Proc. Comput. Sci., vol. 235, pp. 201–213, 2024. [Google Scholar] [Crossref]

45. L. Yang et al., "Automated detection of MRI-negative temporal lobe epilepsy with ROI-based morphometric features and machine learning," Front. Neurol., vol. 15, p. 1323623, 2024. [Google Scholar] [Crossref]

MIND: An Adaptive Multimodal Fusion Framework for Integrated Neurological Diagnosis

Authors

Article Information

Publication Timeline

Abstract

Keywords

Downloads

References

Metrics

Views & Downloads

Similar Articles