Facial Feature Extraction Using a Symmetric Inline Ma-trix-LBP Variant for Emotion Recognition

Eaby Kollonoor Babu, Kamlesh Mistry*, Naveed Anwar, Li Zhang

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

4 Citations (Scopus)
19 Downloads (Pure)


With a large number of Local Binary Patterns (LBP) variants being currently used today, the sig-nificant and importance of visual descriptors in computer vision applications are prominent. This paper presents a novel visual descriptor, i.e., SIM-LBP. It employs a new matrix technique called the Symmetric Inline Matrix generator method, which acts as a new variant of LBP. The key feature that separates our variant from existing counterparts is that our variant is very efficient in extracting facial expression features like eyes, eye brows, nose and mouth in a wide range of lighting con-ditions. For testing our model, we applied SIM-LBP on the JAFFE dataset to convert all the images to its corresponding SIM-LBP transformed variant. These transformed images are then used to train a Convolution Neural Network (CNN) based deep learning model for facial expressions recog-nition (FER). Several performance evaluation metrics, i.e., recognition accuracy rate, precision, recall, and F1-score, were used to test mode efficiency in comparison with those using the tradi-tional LBP descriptor and other LBP variants. Our model outperformed in all four matrices with the proposed SIM-LBP transformation on the input images against those of baseline methods. In comparison analysis with the other state-of-the-art methods, it shows the usefulness of the pro-posed SIM-LBP model. Our proposed SIM-LBP variant transformation can also be applied on facial images to identify a person’s mental states and predict mood variations.
Original languageEnglish
Article number8635
Number of pages14
Issue number22
Publication statusPublished - 9 Nov 2022


Dive into the research topics of 'Facial Feature Extraction Using a Symmetric Inline Ma-trix-LBP Variant for Emotion Recognition'. Together they form a unique fingerprint.

Cite this