Abstract
We compare the outputs of several widely-utilized image quality metrics (such as the PSNR, SSIM, MS-SSIM, FSIMc & IMMSE) in the context of AI-mediated image super-resolution (SR) microscopy derived from a GAN. Although these metrics are often employed in the image analytics space for assaying image quality, the findings of our study indicate that such metrics may not be quite suitable for determining the quality of a GAN-generated image in the context of image SR microscopy, namely in the preservation of fine details and structures which are crucial aspects of high-resolution images (as determined visually). For instance, in some of the assayed images, we observed that these metrics returned a relatively favorable score, while on closer visual inspection, the generated image was observed to be prone to reconstruction artifacts, bearing little similarity to the Expected (ground truth) image. In this respect, we have sought to develop a custom image quality metric capable of assessing image similarity on a pixel-wise scale irrespective of the bit-depth of the image. Our proposed metric [termed the image comparative index (ICI)] has proven to be a viable determinant of similarity between 2 images, closely corroborating with a pixel-wise map of the differences between the assayed images, thereby allowing for more detailed analysis and identification of specific areas of improvement. We postulate that these results represent an important consideration for researchers seeking to utilize deep convolutional neural networks (DCNNs) for image SR (particularly when assessing the similarity between a DCNN-generated and the ground truth images during model training) with potential extrapolations of the proposed ICI metric in image classification & object detection use-cases as well.
Original language | English |
---|---|
Title of host publication | TENCON 2024 - 2024 IEEE Region 10 Conference (TENCON) |
Place of Publication | Piscataway, US |
Publisher | IEEE |
Pages | 1239-1243 |
Number of pages | 5 |
ISBN (Electronic) | 9798350350821 |
ISBN (Print) | 9798350350838 |
DOIs | |
Publication status | Published - 1 Dec 2024 |
Event | IEEE Region 10 Conference 2024 (TENCON 2024) - Sands Expo & Convention Centre, Singapore, Singapore Duration: 1 Dec 2024 → 4 Dec 2024 https://tencon2024.org/ |
Publication series
Name | IEEE Region 10 Conference (TENCON) |
---|---|
Publisher | IEEE |
ISSN (Print) | 2159-3442 |
ISSN (Electronic) | 2159-3450 |
Conference
Conference | IEEE Region 10 Conference 2024 (TENCON 2024) |
---|---|
Abbreviated title | TENCON 2024 |
Country/Territory | Singapore |
City | Singapore |
Period | 1/12/24 → 4/12/24 |
Internet address |