SkyNet: Multi-Drone Cooperation for Real-Time Person Identification and Localization

Junkun Peng, Qing Li, Yuanzheng Tan, Dan Zhao, Zhenhui Yuan, Jinhua Chen, Hanling Wang, Yong Jiang

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

5 Citations (Scopus)

Abstract

Aerial images from drones have been used to detect and track suspects in the crowd for the public safety purpose. However, using a single drone for human identification and localization faces many challenges including low accuracy and long latency, due to poor visibility, varying field of views (FoVs), and limited on-board computing resources. In this paper, we propose SkyNet, a multi-drone cooperative system for accurate and real-time human identification and localization. SkyNet computes the 3D position of a person by cross searching from multiple views. To achieve high accuracy in identification, SkyNet fuses aerial images of multiple drones according to their legibility. Moreover, by predicting the estimated finishing time of tasks, SkyNet schedules and balances workloads among edge devices and the cloud server to minimize processing latency. We implement and deploy SkyNet in real life, and evaluate the performance of identification and localization with 20 human participants. The results show that SkyNet can locate people with an average error within 0.18m on a square of 554m 2 . The identification accuracy is 91.36%. The localization and identification process is completed within 0.84s.
Original languageEnglish
Title of host publicationIEEE INFOCOM 2023 - IEEE Conference on Computer Communications
PublisherIEEE
Pages1-10
Number of pages10
ISBN (Electronic)9798350334142
ISBN (Print)9798350334159
DOIs
Publication statusPublished - 17 May 2023

Keywords

  • information fusion
  • localization
  • multi-drone
  • person identification
  • task distribution

Cite this