Leveraging AI to Capture Textual and Visual Elements: Insights for HRM Research and Practice

This paper advances Human Resource Management (HRM) scholarship by introducing an accessible method to analyse of both visual and textual social media content in combination. Although HRM studies increasingly mobilise social media data, most approaches remain text-centric, overlooking the HR-relevant cues, embedded in images, that can inform micro, meso and macro level interpretations. We propose a method that classifies latent features from images and texts by leveraging the potential of a Large Language Model, namely GPT-4o-mini. We illustrate the method with an example that reports a promising performance of the GPT-4o-mini model. We highlight the conceptual potential of our method for theory development through multimodal data, enabling multi-level analysis of HRM phenomena, and we discuss practical applications for HR practitioners in recruitment and selection, gauging employee engagement, and assessing organisational image, alongside limitations and considerations for responsible use.