Etudes de méthodes et outils pour la cohérence visuelle en réalité mixte appliquée au patrimoine

Abstract : The work described in this report has as a target the mixed reality device ray-on, developed by the on-situ company. This device, dedicated to cultural heritage and specifically architectural heritage, is meant to be installed on-site and shows the user an uchronic view of its surroundings. As the chosen stance is to display photo-realistic images, two trails were followed: the improvement of the real-virtual merging by reproducing accurately the real lighting on the virtual objects, and the development of a real-time segmentation method which is resilient to lighting changes.Regarding lighting reproduction, an image-based rendering method is used in addition to a high dynamic range capture of the lighting environment. The emphasis is put on the photometric and colorimetric correctness of these two steps. To measure the quality of the lighting reproduction chain, a test scene is set up with a calibrated color checker, captured by a camera while another camera is grabbing the lighting environment. The image of the real scene is then compared to the simulation of the same scene, enlightened by the light probe.Segmentation resilient to lighting changes is developed from a set of global image segmentation methods, which consider an image as a graph where a cut of minimal energy has to be found between the foreground and the background. These methods being semi-automatic, the manual part is replaced by a low resolution pre-segmentation based on the depthmap of the scene which is used as a seed for the final segmentation.
Document type :
Theses
Complete list of metadatas

Cited literature [96 references]  Display  Hide  Download

https://pastel.archives-ouvertes.fr/pastel-00996513
Contributor : Abes Star <>
Submitted on : Monday, May 26, 2014 - 3:37:24 PM
Last modification on : Wednesday, September 12, 2018 - 1:28:01 AM
Long-term archiving on : Tuesday, August 26, 2014 - 12:02:11 PM

File

DURAND.pdf
Version validated by the jury (STAR)

Identifiers

  • HAL Id : pastel-00996513, version 1

Citation

Emmanuel Durand. Etudes de méthodes et outils pour la cohérence visuelle en réalité mixte appliquée au patrimoine. Traitement du signal et de l'image [eess.SP]. Ecole nationale supérieure d'arts et métiers - ENSAM, 2013. Français. ⟨NNT : 2013ENAM0043⟩. ⟨pastel-00996513⟩

Share

Metrics

Record views

1292

Files downloads

3234