A Novel Monogenic Sobel Directional Pattern (MSDP) and Enhanced Bat Algorithm-Based Optimization (BAO) with Pearson Mutation (PM) for Facial Emotion Recognition

A. Sherly Alphonse; S. Abinaya; K. S. Arikumar

doi:10.3390/electronics12040836

journal article Open Access Feb 07, 2023

A Novel Monogenic Sobel Directional Pattern (MSDP) and Enhanced Bat Algorithm-Based Optimization (BAO) with Pearson Mutation (PM) for Facial Emotion Recognition

A. Sherly Alphonse

S. Abinaya

K. S. Arikumar

Electronics Vol. 12 No. 4 pp. 836 · MDPI AG

View at Publisher Save 10.3390/electronics12040836

Abstract

In this paper, a novel Monogenic Sobel Directional Pattern (MSDP) using fractional order masks is proposed for extracting features. The MSDP uses fractional-order Sobel masks to identify thin edges along with color and texture-based information thereby increasing performance. Other edge-detection methods can identify only thick edges. There are three modules namely feature extraction, dimension reduction via a novel discriminant analysis method, and classification using a Convolutional Neural Network (CNN). The proposed MSDP is insensitive to the rotation and scaling changes existing in the images. The Bat Algorithm-based Optimization (BAO) is used for the selection of the best parameters of MSDP. The best value is modified by the Pearson Mutation (PM) operator in an effort to aid the algorithm in avoiding local optima and achieving a balance between global and local searches. The proposed work uses CNN for classification and achieves higher classification accuracy for six datasets.

Topics

No keywords indexed for this article. Browse by subject →

References

59

[1]

Mehta, D., Siddiqui, M.F.H., and Javaid, A.Y. (2018). Facial Emotion Recognition: A Survey and Real-World User Experiences in Mixed Reality. Sensors, 18. 10.3390/s18020416

[2]

Wang, G., and Gong, J. (2019, January 3–5). Facial expression recognition based on improved LeNet-5 CNN. Proceedings of the 2019 Chinese Control and Decision Conference (CCDC), Nanchang, China. 10.1109/ccdc.2019.8832535

[3]

Alphonse "Novel directional patterns and a Generalized Supervised Dimension Reduction System (GSDRS) for facial emotion recognition" Multimed. Tools Appl. (2018) 10.1007/s11042-017-5141-8

[4]

Garcia Freitas, P., Da Eira, L.P., Santos, S.S., and Farias, M.C. (2018). On the application LBP texture descriptors and its variants for no-reference image quality assessment. J. Imaging, 4. 10.3390/jimaging4100114

[5]

Chikkerur "Fingerprint enhancement using STFT analysis" Pattern Recognit. (2007) 10.1016/j.patcog.2006.05.036

[6]

Huang "Spatiotemporal local monogenic binary patterns for facial expression recognition" IEEE Signal Process Lett. (2012) 10.1109/lsp.2012.2188890

[7]

Chen "Combining fractional-order edge detection and chaos synchronisation classifier for fingerprint identification" IET Image Process (2014) 10.1049/iet-ipr.2012.0660

[8]

Chi "Palm Print Edge Extraction Using Fractional Differential Algorithm" J. Appl. Math. (2014) 10.1155/2014/896938

[9]

Dong "A Fractional-order derivative based variational framework for image denoising" Inverse Probl. Imaging (2016) 10.3934/ipi.2016.10.27

[10]

Ismail, S.M., Said, L.A., Madian, A.H., and Radwan, A.G. (2021). Fractional-order edge detection masks for diabetic retinopathy diagnosis as a case study. Computers, 10. 10.3390/computers10030030

[11]

Cajo "A survey on fractional order control techniques for unmanned aerial and ground vehicles" IEEE Access (2019) 10.1109/access.2019.2918578

[12]

Ojansivu, V., Rahtu, E., and Heikkila, J. (2008, January 8–11). Rotation invariant local phase quantization for blur insensitive texture analysis. Proceedings of the 2008 19th International Conference on Pattern Recognition, Tampa, FL, USA. 10.1109/icpr.2008.4761377

[13]

Hamester, D., Barros, P., and Wermter, S. (2015). Neural Networks (IJCNN), Proceedings of the 2015 International Joint Conference on Killarney, Ireland, 12–17 July 2015, IEEE.

[14]

Huang "Extreme learning machine for regression and multiclass classification" Part B IEEE Trans. Syst. Man Cybern. (2012) 10.1109/tsmcb.2011.2168604

[15]

Huang "Extreme learning machine: A new learning scheme of feedforward neural networks" Neural Netw. (2004)

[16]

Reddy "Hybrid firefly-bat optimized fuzzy artificial neural network-based classifier for diabetes diagnosis" Int. J. Intell. Eng. Syst. (2017)

[17]

Vincent, O.R., and Folorunso, O. (2009, January 12–15). A descriptive algorithm for sobel image edge detection. Proceedings of the Informing Science & IT Education Conference (InSITE), Macon, GA, USA. 10.28945/3351

[18]

Reddy "An efficient system for heart disease prediction using hybrid OFBAT with rule-based fuzzy logic model" J. Circuits Syst. Comput. (2017) 10.1142/s021812661750061x

[19]

Asthana, A., Zafeiriou, S., Cheng, S., and Pantic, M. (2014, January 23–28). Incremental face alignment in the wild. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Washington, DC, USA. 10.1109/cvpr.2014.240

[20]

Yang "Bat algorithm: Literature review and applications" Int. J. BioInspired Comput. (2013) 10.1504/ijbic.2013.055093

[21]

Melssen "Facilitating the application of Support Vector Regression by using a universal Pearson VII function based Kernel" Chemom. Intell. Lab. Syst. (2006) 10.1016/j.chemolab.2005.09.003

[22]

Jia "Dimension reduction in radio maps based on the supervised kernel principal component analysis" Soft Comput. (2018) 10.1007/s00500-018-3228-4

[23]

Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., Ambadar, Z., and Matthews, I. (2010, January 13–18). The extended cohn-kanade dataset (ck+): A complete dataset for action unit and emotion-specified expression. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), San Francisco, CA, USA. 10.1109/cvprw.2010.5543262

[24]

Lyons, M., Akamatsu, S., Kamachi, M., and Gyoba, J. (1998, January 14–16). Coding facial expressions with gabor wavelets. Proceedings of the Third IEEE International Conference on Automatic Face and Gesture Recognition, Nara, Japan.

[25]

Zhao "Facial expression recognition from near-infrared videos" Image Vis. Comput. (2010) 10.1016/j.imavis.2011.07.002

[26]

Multiresolution gray-scale and rotation invariant texture classification with local binary patterns

T. Ojala, M. Pietikainen, T. Mäenpää

IEEE Transactions on Pattern Analysis and Machine... 2002 10.1109/tpami.2002.1017623

[27]

Pantic, M., Valstar, M., Rademaker, R., and Maat, L. (2005, January 6). Web-based database for facial expression analysis. Proceedings of the Multimedia and Expo, IEEE International Conference, Amsterdam, The Netherlands.

[28]

Valstar, M., and Pantic, M. (2010, January 23). Induced disgust, happiness and surprise:an addition to the MMI facial expression database. Proceedings of the 3rd International Workshop on EMOTION (Satellite of LREC): Corpora for Research on Emotion and Affect, London, UK.

[29]

Pu "Fractional differential analysis for texture of digital image" J. Algorithms Comput. Technol. (2007) 10.1260/174830107782424075

[30]

Aifanti, N., Papachristou, C., and Delopoulos, A. (2010, January 12–14). The MUG facial expression database. Proceedings of the 11th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS), Desenzano, Italy.

[31]

Dhall, A., Goecke, R., Joshi, J., Sikka, K., and Gedeon, T. (2014, January 12–16). Emotion recognition in the wild challenge 2014: Baseline, data and protocol, ACM ICMI. Proceedings of the 16th International Conference on Multimodal Interaction, Istanbul, Turkey. 10.1145/2663204.2666275

[32]

Dhall "Collecting Large, Richly Annotated Facial Expression Databases from Movies" IEEE MultiMedia (2012) 10.1109/mmul.2012.26

[33]

Jabid, T., Kabir, M.H., and Chae, O. (2010, January 9–13). Local directional pattern (LDP) for face recognition. Proceedings of the 2010 Digest of Technical Papers International Conference on Consumer Electronics (ICCE), Las Vegas, NV, USA. 10.1109/icce.2010.5418801

[34]

Alphonse "A novel Monogenic Directional Pattern (MDP) and pseudo-Voigt kernel for facilitating the identification of facial emotions" J. Vis. Commun. Image Represent. (2017) 10.1016/j.jvcir.2017.10.008

[35]

Fogel "Gabor filters as texture discriminator" Biol. Cybern. (1989) 10.1007/bf00204594

[36]

Arya, R., and Vimina, E.R. (2021). Local triangular coded pattern: A texture descriptor for image classification. IETE J. Res., 1–2. 10.1080/03772063.2021.1919222

[37]

Qazi, H.A., Jahangir, U., Yousuf, B.M., and Noor, A. (2017, January 30–31). Human action recognition using SIFT and HOG method. Proceedings of the 2017 International Conference on Information and Communication Technologies (ICICT), Karachi, Pakistan. 10.1109/icict.2017.8320156

[38]

Ahonen, T., Rahtu, E., Ojansivu, V., and Heikkila, J. (2008, January 8–11). Recognition of blurred faces using local phase quantization. Proceedings of the 2008 19th International Conference on Pattern Recognition, Tampa, FL, USA. 10.1109/icpr.2008.4761847

[39]

Zhang "Histogram of gabor phase patterns (hgpp): A novel object representation approach for face recognition" IEEE Trans. Image Process (2006) 10.1109/tip.2006.884956

[40]

Zhang, W., Shan, S., Gao, W., Chen, X., and Zhang, H. (2005, January 17–21). Local gabor binary pattern histogram sequence (lgbphs): A novel non-statistical model for face representation and recognition. Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV’05) Volume 1, Beijing, China.

[41]

Pictorial Structures for Object Recognition

Pedro F. Felzenszwalb, Daniel P. Huttenlocher

International Journal of Computer Vision 2005 10.1023/b:visi.0000042934.15159.49

[42]

Lu "Neighborhood repulsed metric learning for kinship verification" IEEE Trans. Pattern Anal. Mach. Intell. (2013)

[43]

Hu, J., Lu, J., Liu, L., and Zhou, J. (2019, January 22–25). Multi-view geometric mean metric learning for kinship verification. Proceedings of the 2019 IEEE International Conference on Image Processing (ICIP), Taipei, Taiwan. 10.1109/icip.2019.8803754

[44]

Guillaumin, M., Mensink, T., Verbeek, J., and Schmid, C. (October, January 29). Tagprop: Discriminative metric learning in nearest neighbor models for image auto-annotation. Proceedings of the 2009 IEEE 12th International Conference on Computer Vision, Kyoto, Japan. 10.1109/iccv.2009.5459266

[45]

Huang "Class-prototype discriminative network for generalized zero-shot learning" IEEE Signal Process Lett. (2020) 10.1109/lsp.2020.2968213

[46]

Mahpod "Kinship verification using multiview hybrid distance learning" Comput. Vis. Image Underst. (2018) 10.1016/j.cviu.2017.12.003

[47]

Matsukawa, T., and Suzuki, E. (2019, January 27–31). Kernelized cross-view quadratic discriminant analysis for person re-identification. Proceedings of the 2019 16th International Conference on Machine Vision Applications (MVA), Tokyo, Japan. 10.23919/mva.2019.8757990

[48]

Bessaoudi "Multilinear side-information based discriminant analysis for face and kinship verification in the wild" Neurocomputing (2019) 10.1016/j.neucom.2018.09.051

[49]

Shankar, P.B., and Vani, Y.D. (2021, January 19–20). Conceptual Glance of Genetic Algorithms in the Detection of Heart Diseases. Proceedings of the 2021 International Conference on Advances in Electrical, Computing, Communication and Sustainable Technologies (ICAECT), Bhilai, India. 10.1109/icaect49130.2021.9392604

[50]

Liu, P., Han, S., Meng, Z., and Tong, Y. (2014, January 23–28). Facial expression recognition via a boosted deep belief network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA. 10.1109/cvpr.2014.233

Showing 50 of 59 references

Metrics

12

Citations

59

References

Details

Published: Feb 07, 2023
Vol/Issue: 12(4)
Pages: 836
License: View

Authors

A

A. Sherly Alphonse

School of Computer Science and Engineering, Vellore Institute of Technology, Chennai 600127, India

S

S. Abinaya

School of Computer Science and Engineering, Vellore Institute of Technology, Chennai 600127, India

K

K. S. Arikumar

School of Computer Science and Engineering, VIT-AP University, Vijayawada 522237, India

Cite This Article

A. Sherly Alphonse, S. Abinaya, K. S. Arikumar (2023). A Novel Monogenic Sobel Directional Pattern (MSDP) and Enhanced Bat Algorithm-Based Optimization (BAO) with Pearson Mutation (PM) for Facial Emotion Recognition. Electronics, 12(4), 836. https://doi.org/10.3390/electronics12040836

A Novel Monogenic Sobel Directional Pattern (MSDP) and Enhanced Bat Algorithm-Based Optimization (BAO) with Pearson Mutation (PM) for Facial Emotion Recognition

You May Also Like