Robust RGB-D face recognition using Kinect sensor
MetadataShow full item record
In this paper we propose a robust face recognition algorithm for low resolution RGB-D Kinect data. Many techniques are proposed for image preprocessing due to the noisy depth data. First, facial symmetry is exploited based on the 3D point cloud to obtain a canonical frontal view image irrespective of the initial pose and then depth data is converted to XYZ normal maps. Secondly, multi-channel Discriminant Transforms are then used to project RGB to DCS (Discriminant Color Space) and normal maps to DNM (Discriminant Normal Maps). Finally, a Multi-channel Robust Sparse Coding method is proposed that codes the multiple channels (DCS or DNM) of a test image as a sparse combination of training samples with different pixel weighting. Weights are calculated dynamically in an iterative process to achieve robustness against variations in pose, illumination, facial expressions and disguise. In contrast to existing techniques, our multi-channel approach is more robust to variations. Reconstruction errors of the test image (DCS and DNM) are normalized and fused to decide its identity. The proposed algorithm is evaluated on four public databases. It achieves 98.4% identification rate on CurtinFaces, a Kinect database with 4784 RGB-D images of 52 subjects. Using a first versus all protocol on the Bosphorus, CASIA and FRGC v2 databases, the proposed algorithm achieves 97.6%, 95.6% and 95.2% identification rates respectively. To the best of our knowledge, these are the highest identification rates reported so far for the first three databases.
Showing items related by title, author, creator and subject.
Hong, D.; Liu, Wan-Quan; Wu, X.; Pan, Z.; Su, J. (2016)Palmprint is usually captured with a touchless device. Due to the changes of angle and position of the palm in a capturing process, as well as the defocus of device, it is inevitable to have some distortions in translation, ...
Lim, Hann; Ang, L.; Seng, K. (2008)This paper presents a robust face segmentation method dealing with the illumination problem effectively on color images. In color images, skin color is an important cue for face segmentation. Two sets of skin color data ...
Hong, D.; Liu, Wan-Quan; Su, J.; Pan, Z.; Wu, X. (2014)In this paper, we propose a new palmprint recognition system by using the fast Vese-Osher decomposition model to process the blurred palmprint images. First, a Gaussian defocus degradation model (GDDM) is proposed to ...