Meta-patients: Using Mixed Reality Patients and an AI Framework for Simulating Life-Like Clinical Examinations.

This chapter addresses an augmented learning experience created for the Griffith University School of Nursing and Midwifery in 2022. An interdisciplinary research team from Griffith University (Australia) deployed the first iteration of an application for students in response to the difficulties imposed through the previous two years. The impacts of the COVID pandemic bought challenges to the Bachelor of Nursing program, particularly in relation to student competency in the physical assessment of patients, through objective structured clinical examinations. This pilot study introduced life-like, simulated patients, designed and rendered within Unreal Engine to the students. The patients were accessible through cross platform applications, including mixed reality devices. Students were also able to interact with patient information communicated using the AI framework afforded by Microsoft PowerApps all packaged in a bespoke SharePoint site. Student participants were interviewed as part of the development process and approved of Augmented and Mixed Reality as successful platforms for the deployment of the simulated patient scenarios within Microsoft Teams and available through a mobile application and mixed reality device.