Image Formation from a Large Sequence of RAW Images : performance and accuracy

Thibaud Briand 1, 2
2 IMAGINE [Marne-la-Vallée]
LIGM - Laboratoire d'Informatique Gaspard-Monge, ENPC - École des Ponts ParisTech
Abstract : The aim of this thesis is to build a high-quality color image, containing a low level of noise and aliasing, from a large sequence (e.g. hundreds or thousands) of RAW images taken with a consumer camera. This is a challenging issue requiring to perform on the fly demosaicking, denoising and super-resolution. Existing algorithms produce high-quality images but the number of input images is limited by severe computational and memory costs. In this thesis we propose an image fusion algorithm that processes the images sequentially so that the memory cost only depends on the size of the output image. After a preprocessing step, the mosaicked (or CFA) images are aligned in a common system of coordinates using a two-step registration method that we introduce. Then, a color image is computed by accumulation of the irregularly sampled data using classical kernel regression. Finally, the blur introduced is removed by applying the inverse of the corresponding asymptotic equivalent filter (that we introduce).We evaluate the performance and the accuracy of each step of our algorithm on synthetic and real data. We find that for a large sequence of RAW images, our method successfully performs super-resolution and the residual noise decreases as expected. We obtained results similar to those obtained by slower and memory greedy methods. As generating synthetic data requires an interpolation method, we also study in detail the trigonometric polynomial and B-spline interpolation methods. We derive from this study new fine-tuned interpolation methods
Document type :
Complete list of metadatas

Cited literature [118 references]  Display  Hide  Download
Contributor : Abes Star <>
Submitted on : Monday, January 14, 2019 - 2:34:17 PM
Last modification on : Tuesday, March 19, 2019 - 11:43:24 PM


Version validated by the jury (STAR)


  • HAL Id : tel-01980492, version 1



Thibaud Briand. Image Formation from a Large Sequence of RAW Images : performance and accuracy. Image Processing [eess.IV]. Université Paris-Est, 2018. English. ⟨NNT : 2018PESC1017⟩. ⟨tel-01980492⟩



Record views


Files downloads