Noncontact Human-machine Interaction for Air-writing Based on Piezoelectric Micromachined Ultrasonic Transducers

Dongze Lv, Mengjiao Qu, Linjin Shi, Kaifan Wu, Jie Zhou, Yongqing Fu, Jin Xie*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

6 Downloads (Pure)

Abstract

With rapid development of internet of things and virtual reality (VR), sensors based on human-machine interaction (HMI) are crucially required to have attributes of natural and intuitive operation experience using various adaptable and hygienic noncontact techniques. In this study, we develop a real-time noncontact HMI system for air-writing based on piezoelectric micromachined ultrasonic transducers (pMUTs), which have great advantages including easy integration, miniaturization, low power consumption, and less influences by environmental factors such as light or sound. These pMUTs often have problems of weak signals and limited measurement range for complex gesture recognitions. To address these issues, we propose a machine learning algorithm which effectively fuses multiple features of time-of-flight, voltage amplitudes, and echo energies, and significantly increases the detection range and accuracy of pMUTs for arbitrary gesture recognition. We demonstrate a real-time computer control to search and browse websites simply using only one finger air-writing with a recognition accuracy of 96.62% for 16 gestures of characters (including numbers, letters, and symbols) within a distance range of 15 cm. We believe our method revolutionizes functionalities and adaptabilities of noncontact HMI in VR, smart home/vehicle, smart cities, and healthcare.
Original languageEnglish
Pages (from-to)1-12
Number of pages12
JournalIEEE Transactions on Instrumentation and Measurement
Volume74
Early online date2 Dec 2024
DOIs
Publication statusPublished - 1 Jan 2025

Keywords

  • Piezoelectric micromachined ultrasonic transducers (PMUT)
  • human-machine interaction (HMI)
  • air-writing
  • multi-feature fusion algorithm
  • gesture recognition

Cite this