Learning cognitive manifolds of faces

Li, Liyuan; Mandal, Bappaditya; Tan, Cheston; Lim, Joo-Hwee

Abstract

Inspired by the studies in psychology and neuroscience, we propose a computational model of cognitive face representation that mimics the mechanism of human face perception. We propose to learn two separate manifolds for facial identity and facial expression. A new t-SNE algorithm is designed to find a way to achieve the learning purpose and a spectral regression algorithm is implemented accordingly to learn the cognitive manifolds of neutral and smiling faces from real face images. The association between the two manifolds is established by a weighted k-NN fusion algorithm. An iterative linear algorithm is derived to refine the association between the two manifolds. We evaluate our model on two large datasets containing real-world images of neutral and wide smiling faces. The experimental results show both the accuracy of the cognitive manifold representation and the superiority over Eigenfaces and Fisherfaces on the tough task of matching a wide smiling face to a neutral face of an individual.

Citation

Li, L., Mandal, B., Tan, C., & Lim, J. (2017). Learning cognitive manifolds of faces. . https://doi.org/10.1109/siprocess.2017.8124584

• Conference Name: 2017 IEEE 2nd International Conference on Signal and Image Processing (ICSIP)
• Conference Location: Singapore
• Start Date: Aug 4, 2017
• End Date: Aug 6, 2017
• Publication Date: 2017-08
• Deposit Date: Nov 17, 2023
• Publisher: Institute of Electrical and Electronics Engineers (IEEE)
• DOI: https://doi.org/10.1109/siprocess.2017.8124584
• Publisher URL: https://ieeexplore.ieee.org/document/8124584