Enhancing a sequence of facial images by combining multiple undersampled and compressed images

Scarmana, Gabriel and Fryer, John (2006) Enhancing a sequence of facial images by combining multiple undersampled and compressed images. Photogrammetric Record, 21 (114). pp. 161-175. ISSN 0031-868X


The enhancement of a sequence of low-resolution images of a human face into a single higher resolution composite poses a real problem in the fields of forensics and security. This is due to the substantial variations in appearance that faces undergo with changing illumination, orientation, scale, facial expressions and occlusions. In addition, faces often appear small in surveillance imagery because of the wide fields of view that are typically used and the relatively large distance between the cameras and the scene. A device-independent algorithm for the estimation of an enhanced resolution image from multiple low-resolution and non-coplanar compressed images having arbitrary motion is proposed in this paper. The basic algorithm has previously been described but its application to enhancing images of objects, in this case a human face, with a range of scales and orientations is the extension detailed here.

The task of obtaining a super-resolved image from a dynamic, under-sampled and degraded image sequence can take advantage of the additional spatio-temporal data
available in the image sequence. In particular, camera and scene motion lead to frames containing similar, but not identical information. While the images may look similar to the human eye, the grey-scale values of the individual pixels are sufficiently different to allow reconstruction of a super-resolved image with wider bandwidth than that of any of the individual low-resolution frames. The arbitrarily distorted images must be warped, firstly,
to a common orientation so that a rigorous least squares area-based matching technique can then compute the registration parameters needed for their accurate combination. The warping is an iterative process relying on manual intervention. Once all the low-resolution images are brought into registration and comply with pre-established image correlation criteria, they are combined using the algorithm to recover the desired high-resolution
composite. In addition to improving the spatial resolution of the under-sampled sequence, the method may also attenuate compression artefacts.

Statistics for USQ ePrint 26351
Statistics for this ePrint Item
Item Type: Article (Commonwealth Reporting Category C)
Refereed: Yes
Item Status: Live Archive
Additional Information: Permanent restricted access to Published version due to publisher copyright policy.
Faculty / Department / School: Historic - Faculty of Engineering and Surveying - Department of Agricultural, Civil and Environmental Engineering
Date Deposited: 17 Feb 2015 05:13
Last Modified: 29 Sep 2016 02:57
Uncontrolled Keywords: digital photogrammetry, image sequence, image warping, resolution enhancement
Fields of Research : 09 Engineering > 0906 Electrical and Electronic Engineering > 090609 Signal Processing
09 Engineering > 0909 Geomatic Engineering > 090903 Geospatial Information Systems
Socio-Economic Objective: E Expanding Knowledge > 97 Expanding Knowledge > 970109 Expanding Knowledge in Engineering
URI: http://eprints.usq.edu.au/id/eprint/26351

Actions (login required)

View Item Archive Repository Staff Only