Unifying Person and Vehicle Re-Identification

Daniel Organisciak, Dimitrios Sakkos, Edmond S.L. Ho, Nauman Aslam, Hubert P.H. Shum*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)
5 Downloads (Pure)

Abstract

Person and vehicle re-identification (re-ID) are important challenges for the analysis of the burgeoning collection of urban surveillance videos. To efficiently evaluate such videos, which are populated with both vehicles and pedestrians, it would be preferable to have one unified framework with effective performance across both domains. Unfortunately, due to the contrasting composition of humans and vehicles, no architecture has yet been established that can adequately perform both tasks. We release a Person and Vehicle Unified Data Set (PVUD) comprising of both pedestrians and vehicles from popular existing re-ID data sets, in order to better model the data that we would expect to find in the real world. We exploit the generalisation ability of metric learning to propose a re-ID framework that can learn to re-identify humans and vehicles simultaneously. We design our network, MidTriNet, to harness the power of mid-level features to develop better representations for the re-ID tasks. We help the system to handle mixed data by appending unification terms with additional hard negative and hard positive mining to MidTriNet. We attain comparable accuracy training on PVUD to training on the comprising data sets separately, supporting the system's generalisation power. To further demonstrate the effectiveness of our framework, we also obtain results better than, or competitive with, the state-of-the-art on each of the Market-1501, CUHK03, VehicleID and VeRi data sets.

Original languageEnglish
Pages (from-to)115673-115684
Number of pages12
JournalIEEE Access
Volume8
Early online date22 Jun 2020
DOIs
Publication statusPublished - 2020

Fingerprint Dive into the research topics of 'Unifying Person and Vehicle Re-Identification'. Together they form a unique fingerprint.

Cite this