Contactless Human Physical Signal Measurement for Collaborative Robotic Using Visible-IR Dual Cameras

Collaborative robotic configurations for monitoring and tracking human beings for safety and efficiency have attracted interest in industrial revolution. The fusion of different types of sensors embedded in collaborative robotic systems significantly improve robotic perception. However, current methods have not deeply explored the capabilities of multi-sensory configurations including visible and thermal sensors. In this paper, we propose a contactless multi-sensor fusion including visible and thermal dual camera for collaborative robots to improve the robotic perception for human safety. Remote photoplethysmography detection and infrared thermal camera were used to measure the heart rate and body temperature.