Contextualizing Internet Memes Using Knowledge Graphs: An Analytical Study

This research introduces an analytical methodology for contextualizing internet memes through knowledge graphs to improve their semantic clarity. A dataset of 1,500 memes was amassed from Instagram, Twitter/X, and YouTube, thereafter undergoing preprocessing, OCR-based text extraction, and the production of multimodal embeddings via CLIP. Entities, relationships, and emotions were extracted to create a Meme Knowledge Graph (MKG) in Neo4j, facilitating structured semantic representation and contextual analysis. The MKG attained a mean Semantic Richness Score (SRS) of 0.64, indicating substantial enhancement in meme comprehension, especially with political and situational humor. Graph-based contextualization enhanced downstream analytical tasks, resulting in increases of 15%, 19%, and 21% in classification accuracy, sentiment interpretation, and misinformation detection, respectively, compared to baseline models. The findings validate that knowledge graphs offer a strong and comprehensible method for modelling the socio-cultural and affective aspects of online memes.

Internet Memes, Social Media, Knowledge Graphs, Analytical Study, Contextualizing.

1. Davison, P. (2022). The language of internet memes. The social media reader, 120, 134. [Google Scholar] [Crossref]

2. Bauckhage, C. (2021). Insights into internet memes. In Proceedings of the International AAAI Conference on Web and Social Media (Vol. 5, No. 1, pp. 42-49). [Google Scholar] [Crossref]

3. Bennett, W. L. (2021). The internet and global activism. Contesting media power: Alternative media in a networked world. Oxford: Rowman & Littlefield, 17-37. [Google Scholar] [Crossref]

4. Zannettou, S., Bradlyn, B., De Cristofaro, E., Kwak, H., Sirivianos, M., Stringini, G., & Blackburn, J. (2018, April). What is gab: A bastion of free speech or an alt-right echo chamber. In Companion Proceedings of the The Web Conference 2018 (pp. 1007-1014). [Google Scholar] [Crossref]

5. Kiela, D., Firooz, H., Mohan, A., Goswami, V., Singh, A., Ringshia, P., & Testuggine, D. (2020). The hateful memes challenge: Detecting hate speech in multimodal memes. Advances in neural information processing systems, 33, 2611-2624. [Google Scholar] [Crossref]

6. Fersini, E., Nozza, D., & Rosso, P. (2020). AMI@ EVALITA2020: Automatic misogyny identification. In Proceedings of the 7th evaluation campaign of Natural Language Processing and Speech tools for Italian (EVALITA 2020). (seleziona...). [Google Scholar] [Crossref]

7. Thakur, A. K., Ilievski, F., Sandlin, H. Â., Sourati, Z., Luceri, L., Tommasini, R., & Mermoud, A. (2022). Multimodal and explainable internet meme classification. arXiv preprint arXiv:2212.05612. [Google Scholar] [Crossref]

8. Tommasini, R., Ilievski, F., & Wijesiriwardene, T. (2023, May). IMKG: The internet meme knowledge graph. In European Semantic Web Conference (pp. 354-371). Cham: Springer Nature Switzerland. [Google Scholar] [Crossref]

9. Joshi, S., Ilievski, F., & Luceri, L. (2024, May). Contextualizing internet memes across social media platforms. In Companion Proceedings of the ACM Web Conference 2024 (pp. 1831-1840). [Google Scholar] [Crossref]

10. Pierri, F., DeVerna, M. R., Yang, K. C., Axelrod, D., Bryden, J., & Menczer, F. (2023). One year of COVID-19 vaccine misinformation on Twitter: longitudinal study. Journal of Medical Internet Research, 25, e42227. [Google Scholar] [Crossref]

11. Baruah, A., Das, K., Barbhuiya, F., & Dey, K. (2020, December). Iiitg-adbu at semeval-2020 task 8: A multimodal approach to detect offensive, sarcastic and humorous memes. In Proceedings of the Fourteenth Workshop on Semantic Evaluation (pp. 885-890). [Google Scholar] [Crossref]

12. Sharma, S., Ramaneswaran, S., Arora, U., Akhtar, M. S., & Chakraborty, T. (2023, July). MEMEX: Detecting explanatory evidence for memes via knowledge-enriched contextualization. In Proceedings of the 61st annual meeting of the association for computational linguistics (volume 1: long papers) (pp. 5272-5290). [Google Scholar] [Crossref]

13. Xu, B., Li, T., Zheng, J., Naseriparsa, M., Zhao, Z., Lin, H., & Xia, F. (2019, July). Met-meme: A multimodal meme dataset rich in metaphors. In Proceedings of the 45th international ACM SIGIR conference on research and development in information retrieval (pp. 2887-2899). [Google Scholar] [Crossref]

14. Lee, J., Wang, Y., Li, J., & Zhang, M. (2024). Multimodal reasoning with multimodal knowledge graph. arXiv preprint arXiv:2406.02030. [Google Scholar] [Crossref]

• The Dynamic of Religious Pluralism and Cultural Identity in Rongmei Naga (Kabui) Society
• Effects of Social-Economic Empowerment of Teenage Mothers and Nurture Care. A Case of Kimbilio Hope Centre, Machakos, Kenya
• Gendering Caste and Casteing Gender: A Study of Social Sickness in Uma Chakravarti’s Gendering Caste: Through a Feminist Lens
• Counselling as Social Work for Women Empowerment in Akwa Ibom State: A Case Study of Ibiono Ibom Local Government Area. Implications for Counsellors
• Motherhood: Inclusion and Containment, A Case Study