Single/Multi-View 3-D Face Reconstruction for Pose-Robust Face Recognition

Simple item page
dc.contributor.advisorKakadiaris, Ioannis A.
dc.contributor.committeeMemberShah, Shishir Kirit
dc.contributor.committeeMemberChen, Guoning
dc.contributor.committeeMemberGlennie, Craig L.
dc.creatorDou, Pengfei 1987-
dc.creator.orcid0000-0003-2928-2999
dc.date.accessioned2018-03-12T18:42:20Z
dc.date.available2018-03-12T18:42:20Z
dc.date.createdDecember 2017
dc.date.issued2017-12
dc.date.submittedDecember 2017
dc.date.updated2018-03-12T18:42:20Z
dc.description.abstractOne challenge in automated face recognition is matching facial images acquired from different views. The pose variation causes not only misalignment between images but also inconsistency in facial appearance. With extensive study on these two issues, several contributions in single/multi-view 3D face reconstruction for facial pose normalization and pose-robust facial signature generation for pose invariant face matching have been made in this dissertation. The first contribution is a method for single-view 3D face reconstruction. An algorithm based on subspace learning and partial least-squares regression is proposed for reconstructing a sparse 3D facial shape from 2D facial landmarks and a 3D super-resolution algorithm is proposed for recovering a dense 3D facial shape from the estimated sparse shape. The second contribution is an end-to-end method for single-view 3D face reconstruction based on deep neural networks. A 3D facial shape subspace model is utilized for parametric 3D face representation and a deep neural network model is proposed for model parameter estimation from a 2D image. The third contribution is a method for extracting and matching pose-robust facial signatures for pose invariant face recognition. Discriminative feature learning and part-based face representation are combined to enhance the extracted facial features with estimated self-occlusion encodings and create pose-aware facial signatures. The fourth contribution is a method for multi-view 3D face reconstruction based on recurrent neural networks. A neural network model with two long short-term memory (LSTM) layers is proposed for aggregating the contextual identity signal from a facial image set and estimating the parameters for 3D face reconstruction. The fifth contribution is an study on the impact of single/multi-view 3D face reconstruction on the performance of 3D-aided face recognition. With extensive experiments, the performances of the proposed single/multi-view 3D face reconstruction methods are demonstrated to have outperformed the state-of-the-art. In average, the reconstruction error of the proposed methods is 2.6%-31.5% lower than existing methods on three public benchmarks. For 3D-aided face recognition, the proposed facial signature achieves significant improvement over the state-of-the-art facial matchers. In average, the face identification Rank-1 rates are improved by 2 to 19.5 percentage points on two challenging public benchmarks.
dc.description.departmentComputer Science, Department of
dc.format.digitalOriginborn digital
dc.format.mimetypeapplication/pdf
dc.identifier.urihttp://hdl.handle.net/10657/2875
dc.language.isoeng
dc.rightsThe author of this work is the copyright owner. UH Libraries and the Texas Digital Library have their permission to store and provide access to this work. Further transmission, reproduction, or presentation of this work is prohibited except with permission of the author(s).
dc.subject3D face modeling
dc.subject3D face reconstruction
dc.subjectFace recognition
dc.subjectDeep neural networks
dc.titleSingle/Multi-View 3-D Face Reconstruction for Pose-Robust Face Recognition
dc.type.dcmiText
dc.type.genreThesis
local.embargo.lift2018-12-01
local.embargo.terms2018-12-01
thesis.degree.collegeCollege of Natural Sciences and Mathematics
thesis.degree.departmentComputer Science, Department of
thesis.degree.disciplineComputer Science
thesis.degree.grantorUniversity of Houston
thesis.degree.levelDoctoral
thesis.degree.nameDoctor of Philosophy

Files

Original bundle

Now showing 1 - 1 of 1
No Thumbnail Available
Name:
DOU-DISSERTATION-2017.pdf
Size:
71.4 MB
Format:
Adobe Portable Document Format
Download

License bundle

Now showing 1 - 2 of 2
No Thumbnail Available
Name:
PROQUEST_LICENSE.txt
Size:
4.43 KB
Format:
Plain Text
Description:
Download
No Thumbnail Available
Name:
LICENSE.txt
Size:
1.81 KB
Format:
Plain Text
Description:
Download

Collections

Published ETD Collection