TY - JOUR
T1 - A machine learning-based approach for picture acquisition timeslot prediction using defective pixels
AU - Ahmed, Farah Nafees
AU - Khelifi, Fouad
AU - Lawgaly, Ashref
AU - Bouridane, Ahmed
N1 - Funding information: This work was partially supported by NPRP grant # NPRP12S-0312-190332 from the Qatar National Research Fund (a member of the Qatar Foundation).
PY - 2021/12/1
Y1 - 2021/12/1
N2 - Estimating the acquisition time of digital photographs is a challenging task in temporal image forensics, but the application is highly demanded for establishing temporal order among individual pieces of evidence and deduce the causal relationship of events in a court case. The forensic investigator needs to identify the timeline of events and look for some patterns to gain a clear overview of activities associated with a crime. This paper aims to explore the presence of defective pixels over time for estimating the acquisition date of digital pictures. We propose a technique to predict the acquisition timeslots of digital pictures using a set of candidate defective pixels in non-overlapping image blocks. First, potential candidate defective pixels are determined through related pixel neighbourhood and two proposed features, called the local variation features to best fit in a machine learning model. The machine learning approach is used to model the temporal behaviour of camera sensor defects in each block using the scores obtained from individually trained pixel defect locations and fused in a majority voting method. Interestingly, timeslot estimation using individual blocks has been shown to be more accurate when virtual sub-classes corresponding to halved timeslots are first considered prior to the reconstruction step. Finally, the last stage of the system consists of the combination of block scores in a second majority voting operation to further enhance performance. Assessed on the NTIF image dataset, the proposed system has been shown to reach very promising results with an estimated accuracy between 88% and 93% and clear superiority over a related state-of-the-art system.
AB - Estimating the acquisition time of digital photographs is a challenging task in temporal image forensics, but the application is highly demanded for establishing temporal order among individual pieces of evidence and deduce the causal relationship of events in a court case. The forensic investigator needs to identify the timeline of events and look for some patterns to gain a clear overview of activities associated with a crime. This paper aims to explore the presence of defective pixels over time for estimating the acquisition date of digital pictures. We propose a technique to predict the acquisition timeslots of digital pictures using a set of candidate defective pixels in non-overlapping image blocks. First, potential candidate defective pixels are determined through related pixel neighbourhood and two proposed features, called the local variation features to best fit in a machine learning model. The machine learning approach is used to model the temporal behaviour of camera sensor defects in each block using the scores obtained from individually trained pixel defect locations and fused in a majority voting method. Interestingly, timeslot estimation using individual blocks has been shown to be more accurate when virtual sub-classes corresponding to halved timeslots are first considered prior to the reconstruction step. Finally, the last stage of the system consists of the combination of block scores in a second majority voting operation to further enhance performance. Assessed on the NTIF image dataset, the proposed system has been shown to reach very promising results with an estimated accuracy between 88% and 93% and clear superiority over a related state-of-the-art system.
KW - Defective pixel detection
KW - pixel classification
KW - picture acquisition timeslot,
KW - temporal image forensics
KW - defective pixel location
KW - machine learning
KW - Temporal image forensics
KW - Digital evidence
KW - Picture acquisition timeslot
KW - Machine learning
KW - Defective pixel location
KW - Pixel classification
UR - http://www.scopus.com/inward/record.url?scp=85122625012&partnerID=8YFLogxK
U2 - 10.1016/j.fsidi.2021.301311
DO - 10.1016/j.fsidi.2021.301311
M3 - Article
SN - 2666-2817
VL - 39
JO - Forensic Science International: Digital Investigation
JF - Forensic Science International: Digital Investigation
M1 - 301311
ER -