Real-Time 3D Head Pose Tracking Through 2.5D Constrained Local Models with Local Neural Fields.

Saved in:

Bibliographic Details
Title:	Real-Time 3D Head Pose Tracking Through 2.5D Constrained Local Models with Local Neural Fields.
Authors:	Ackland, Stephen¹ (AUTHOR) stephenmackland@gmail.com, Chiclana, Francisco¹ (AUTHOR) chiclana@dmu.ac.uk, Istance, Howell² (AUTHOR) howell.istance@staff.uta.fi, Coupland, Simon¹ (AUTHOR) simonc@dmu.ac.uk
Source:	International Journal of Computer Vision. Jun2019, Vol. 127 Issue 6/7, p579-598. 20p. 6 Color Photographs, 3 Black and White Photographs, 5 Charts.
Subjects:	Pose estimation (Computer vision), Real-time rendering (Computer graphics), Facial expression, Algorithms, Three-dimensional imaging, Computer vision
Abstract:	Tracking the head in a video stream is a common thread seen within computer vision literature, supplying the research community with a large number of challenging and interesting problems. Head pose estimation from monocular cameras is often considered an extended application after the face tracking task has already been performed. This often involves passing the resultant 2D data through a simpler algorithm that best fits the data to a static 3D model to determine the 3D pose estimate. This work describes the 2.5D constrained local model, combining a deformable 3D shape point model with 2D texture information to provide direct estimation of the pose parameters, avoiding the need for additional optimization strategies. It achieves this through an analytical derivation of a Jacobian matrix describing how changes in the parameters of the model create changes in the shape within the image through a full-perspective camera model. In addition, the model has very low computational complexity and can run in real-time on modern mobile devices such as tablets and laptops. The point distribution model of the face is built in a unique way, so as to minimize the effect of changes in facial expressions on the estimated head pose and hence make the solution more robust. Finally, the texture information is trained via local neural fields—a deep learning approach that utilizes small discriminative patches to exploit spatial relationships between the pixels and provide strong peaks at the optimal locations. [ABSTRACT FROM AUTHOR]
	Copyright of International Journal of Computer Vision is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database:	Engineering Source

Description
Abstract:	Tracking the head in a video stream is a common thread seen within computer vision literature, supplying the research community with a large number of challenging and interesting problems. Head pose estimation from monocular cameras is often considered an extended application after the face tracking task has already been performed. This often involves passing the resultant 2D data through a simpler algorithm that best fits the data to a static 3D model to determine the 3D pose estimate. This work describes the 2.5D constrained local model, combining a deformable 3D shape point model with 2D texture information to provide direct estimation of the pose parameters, avoiding the need for additional optimization strategies. It achieves this through an analytical derivation of a Jacobian matrix describing how changes in the parameters of the model create changes in the shape within the image through a full-perspective camera model. In addition, the model has very low computational complexity and can run in real-time on modern mobile devices such as tablets and laptops. The point distribution model of the face is built in a unique way, so as to minimize the effect of changes in facial expressions on the estimated head pose and hence make the solution more robust. Finally, the texture information is trained via local neural fields—a deep learning approach that utilizes small discriminative patches to exploit spatial relationships between the pixels and provide strong peaks at the optimal locations. [ABSTRACT FROM AUTHOR]
ISSN:	09205691
DOI:	10.1007/s11263-019-01152-w