TY - GEN
T1 - A Mixed Reality Human Robot Interaction Interface Using Hand Tracking and Stereo Vision for Construction Applications
AU - Tennakoon, Damith
AU - Jadidi, Mojgan
AU - Razavialavi, Seyedreza
PY - 2024/7/17
Y1 - 2024/7/17
N2 - The modern day construction site is able to complete complex tasks using highly skilled on-site workers and robust machinery. On-site workers face severe physical injuries from unforeseen accidents due to construction site dynamics. This project proposes and implements a mixed reality human robot interaction system, utilizing stereo vision systems and hand tracking algorithms, to teleoperate a robot arm within a simulation. Results demonstrate enhanced depth and situational awareness in the robot workspace versus traditional teleoperation. This research allows operators to safely perform complex construction tasks remotely with a robot arm using a head-mounted display.
AB - The modern day construction site is able to complete complex tasks using highly skilled on-site workers and robust machinery. On-site workers face severe physical injuries from unforeseen accidents due to construction site dynamics. This project proposes and implements a mixed reality human robot interaction system, utilizing stereo vision systems and hand tracking algorithms, to teleoperate a robot arm within a simulation. Results demonstrate enhanced depth and situational awareness in the robot workspace versus traditional teleoperation. This research allows operators to safely perform complex construction tasks remotely with a robot arm using a head-mounted display.
UR - http://www.scopus.com/inward/record.url?scp=85203445934&partnerID=8YFLogxK
U2 - 10.35490/EC3.2024.275
DO - 10.35490/EC3.2024.275
M3 - Conference contribution
AN - SCOPUS:85203445934
SN - 9789083451305
T3 - Proceedings of the European Conference on Computing in Construction
SP - 1015
EP - 1022
BT - Proceedings of the 2024 European Conference on Computing in Construction
A2 - Srećković, Marijana
A2 - Kassem, Mohamad
A2 - Soman, Ranjith
A2 - Chassiakos, Athanasios
PB - European Council on Computing in Construction (EC3)
T2 - European Conference on Computing in Construction, EC3 2024
Y2 - 14 July 2024 through 17 July 2024
ER -