Vocal-Emotion Visualizer: Voice-Based Emotion Detection & Image Generation

Human feelings are essential in how people communicate and engage with computer systems. Spotting feelings from the manner human beings communicate has become a key area of study in synthetic intelligence. This Study introduces a machine named Vocal Emotion Visualizer, which identifies human emotions from speech, the usage of deep mastering and turns them into clean, visible paperwork. The gadget uses the Librosa library and Mel-Frequency Cepstral Coefficients (MFCC) to extract sound capabilities from recorded audio, and Wav2Vec 2.0 is used for live speech to obtain specified speech facts. These capabilities are then handled through a long short-term memory (LSTM) network to categorise feelings. The emotions discovered are changed into descriptive words to create a visible picture based on emotions, the usage of AI that generates snapshots. This machine facilitates people to apprehend emotions better in voice-based generation and makes interacting with computers greater herbal. Testing suggests that the device can correctly discover numerous feelings like happy, unhappy, angry, calm, and neutral.

Speech Emotion Recognition, Long Short-Term Memory (LSTM), Wav2Vec 2.0, MFCC, Audio Signal Processing, Emotion Classification, Real-Time Emotion Detection.

1. X. Li, J. Tao, M. Yang, and Y. Chen, "Speech Emotion Recognition Based on Deep Learning: A Survey," Neurocomputing, vol. 409, pp. 189–211, 2020. [Google Scholar] [Crossref]

2. T.V. Madhusudhana Rao, Suresh Kurumalla, Bethapudi Prakash, “Matrix Factorization Based Recommendation System using Hybrid Optimization Technique”, EAI Endorsed Transactions on Energy Web, Volume:5, issue:35,2021. [Google Scholar] [Crossref]

3. M. Schmitt, F. Ringeval, and B. Schuller, "At the Border of Acoustic and Linguistic Features: Feature Selection for Speech Emotion Recognition," Computer Speech & Language, vol. 59, pp. 1–20, 2020. [Google Scholar] [Crossref]

4. T.V. Madhusudhana Rao,P.S. Latha Kalyampudi, “Iridology based Vital Organs Malfunctioning identification using Machine learning Techniques”, International Journal of Advanced Science and Technology, Volume: 29, No. 5, PP: 5544 – 5554,2020. [Google Scholar] [Crossref]

5. Z. Zhao, X. Zhang, W. Wu, and B. Schuller, "Attention-Enhanced CNN-LSTM for Speech Emotion Recognition," IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 28, pp. 1717–1729, 2020. [Google Scholar] [Crossref]

6. S.Vidya sagar Appaji, P. V. Lakshmi, “Maximizing Joint Probability in Visual Question Answering Models”, International Journal of Advanced Science and Technology Vol. 29, No. 3, pp. 3914 – 3923,2020. [Google Scholar] [Crossref]

7. A. Baevski, H. Zhou, A. Mohamed, and M. Auli, "wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations," in Proc. Advances in Neural Information Processing Systems (NeurIPS), vol. 33, pp. 12449–12460, 2020. [Google Scholar] [Crossref]

8. Vidya sagar Appaji setti, P. V. Lakshmi, “A Novel Scheme for Red Eye Removal with Image Matching”, Journal of Advanced Research in Dynamical & Control Systems, Vol. 10, 13-Special Issue, 2018. [Google Scholar] [Crossref]

9. A. Tzirakis, G. Trigeorgis, M. Nicolaou, B. Schuller, and S. Zafeiriou, "End-to-End Multimodal Emotion Recognition Using Deep Neural Networks," IEEE Journal of Selected Topics in Signal Processing, vol. 14, no. 2, pp. 130–145, 2019. [Google Scholar] [Crossref]

10. Madhusudhana Rao, T.V. Srinivas, Y, "A Secure Framework for Cloud Using Map Reduce", Journal of Advanced Research in Dynamical and Control Systems (IJARDCS), Volume:9, Sp-14, Pp:1850-1861, ISSN:1943-023x, Dec, 2017. [Google Scholar] [Crossref]

11. S. Zhang, S. Zhang, T. Huang, and W. Gao, "Speech Emotion Recognition Using Deep Learning: A Review," Frontiers of Computer Science, vol. 15, no. 2, pp. 1–14, 2021. [Google Scholar] [Crossref]

12. Lolla Kiran Kumar, S Sreenivasa Rao,” A Framework for Early Recognition of Alzheimer’s Using Machine Learning Approaches”, Intelligent System Design: Proceedings of INDIA 2022, Springer Nature Singapore, PP: 1-13,28/10/2022. [Google Scholar] [Crossref]

13. S. Latif, R. Rana, S. Younis, J. Qadir, and J. Epps, "Transfer Learning for Improving Speech Emotion Classification Accuracy," IEEE Access, vol. 7, pp. 18134–18150, 2019. [Google Scholar] [Crossref]

14. Bharathi Uppalapati, S Srinivasa Rao,” Application of ANN Combined with Machine Learning for Early Recognition of Parkinson’s Disease”, Intelligent System Design: Proceedings of INDIA 2022, Springer Nature Singapore, PP: 39-49, 28/10/2022. [Google Scholar] [Crossref]

15. R. Lotfian and C. Busso, "Building Naturalistic Emotionally Balanced Speech Corpus by Retrieving Emotional Speech from Existing Speech Corpora," IEEE Transactions on Affective Computing, vol. 10, no. 4, pp. 471–483, 2019. [Google Scholar] [Crossref]

16. H. Gideon, S. Khorram, Z. Aldeneh, D. Dimitriadis, and E. M. Provost, "Progressive Neural Networks for Transfer Learning in Emotion Recognition," IEEE Journal of Selected Topics in Signal Processing, vol. 14, no. 2, pp. 235–245, 2020. [Google Scholar] [Crossref]

17. Palli, P., Mishra, S.,” Inferring Compound Similarity: A Clustering Approach in Drug Discovery” 2024 1st International Conference on Cognitive, Green and Ubiquitous Computing, IC-CGU 2024. [Google Scholar] [Crossref]

18. S. Tripathi, S. Acharya, and S. Sharma, "Using Deep and Convolutional Neural Networks for Accurate Emotion Classification on Speech Data," Applied Sciences, vol. 10, no. 6, pp. 1–15, 2020. [Google Scholar] [Crossref]

19. Krishna Prasad, M.H.M., Thammi Reddy, K, “A Efficient Data Integration Framework in Hadoop Using MapReduce” Published in Computational Intelligence Techniques for Comparative Genomics, Springer Briefs in Applied Sciences and Technology, ISSN:2191-530X, PP 129-137, October 2014. [Google Scholar] [Crossref]

20. N. Sharma and P. Goyal, "Real-Time Speech Emotion Recognition System Using Deep Learning Techniques," Procedia Computer Science, vol. 218, pp. 123–130, 2023. [Google Scholar] [Crossref]

21. Nagesh Vadaparhi, Srinivas Yarramalle, “A Novel clustering approach using Hadoop Distributed Environment”, Springer, (Applied Science and Technology), ISSN:2191-530X, Volume:9, pp:113-119, October 2014. [Google Scholar] [Crossref]

22. H. Wu, Y. Sun, and L. Wang, "Speech Emotion Recognition Using Deep Neural Networks and Feature Fusion," Sensors, vol. 21, no. 4, pp. 1–18, 2021. [Google Scholar] [Crossref]

23. Suribabu Naick B,Prakash Bethapudi “Malware Detection in Android Mobile Devices by Applying Swarm Intelligence Optimization and Machine Learning for API Calls”, International Journal of Intelligent Systems and Applications (IJISAE), Volume:10, issue:3s, 27 Dec2022. [Google Scholar] [Crossref]

24. P. Verma and P. K. Singh, "Emotion Recognition Using Deep Learning Approaches from Audio Signals: A Review," Multimedia Tools and Applications, vol. 80, pp. 1–24, 2021. [Google Scholar] [Crossref]

25. K. Malik, A. Kumar, and R. Kumar, "Speech Emotion Recognition Using Hybrid Deep Learning Models," IEEE Access, vol. 10, pp. 45678–45689, 2022. [Google Scholar] [Crossref]

26. S. Patel, R. Mehta, and K. Shah, "Emotion Detection from Speech Using LSTM Networks and Feature Extraction Techniques," International Journal of Advanced Computer Science and Applications, vol. 14, no. 2, pp. 210–218, 2023. [Google Scholar] [Crossref]

27. Balajee Maram, Guru Kesava Dasu Gopisetty, “A Framework for Data Security using Cryptography and Image Steganography”,International Journal of Innovative Technology and Exploring Engineering (IJITEE) ISSN: 2278-3075, Volume-8 Issue-11, September,2019. [Google Scholar] [Crossref]

28. Y. Pepino, P. Riera, and L. Ferrer, "Emotion Recognition from Speech Using Wav2Vec 2.0 Embeddings," in Proc. Interspeech, pp. 3400–3404, 2021. [Google Scholar] [Crossref]

29. D. Singh and A. Verma, "Speech Emotion Recognition Using Wav2Vec and Deep Learning Models," IEEE Access, vol. 12, pp. 34567–34578, 2024. [Google Scholar] [Crossref]

30. A. Satt, S. Rozenberg, and R. Hoory, "Efficient Emotion Recognition from Speech Using Deep Learning on Spectrograms," in Proc. Interspeech, pp. 1089–1093, 2019. [Google Scholar] [Crossref]

31. J. Deng, Z. Zhang, E. Marchi, and B. Schuller, "Sparse Autoencoder-Based Feature Transfer Learning for Speech Emotion Recognition," IEEE Access, vol. 7, pp. 39035–39044, 2019. [Google Scholar] [Crossref]

• The Role of Artificial Intelligence in Revolutionizing Library Services in Nairobi: Ethical Implications and Future Trends in User Interaction
• ESPYREAL: A Mobile Based Multi-Currency Identifier for Visually Impaired Individuals Using Convolutional Neural Network
• Comparative Analysis of AI-Driven IoT-Based Smart Agriculture Platforms with Blockchain-Enabled Marketplaces
• AI-Based Dish Recommender System for Reducing Fruit Waste through Spoilage Detection and Ripeness Assessment
• SEA-TALK: An AI-Powered Voice Translator and Southeast Asian Dialects Recognition