Skip to Main content Skip to Navigation

Etudes de méthodes et outils pour la cohérence visuelle en réalité mixte appliquée au patrimoine

Abstract : The work described in this report has as a target the mixed reality device ray-on, developed by the on-situ company. This device, dedicated to cultural heritage and specifically architectural heritage, is meant to be installed on-site and shows the user an uchronic view of its surroundings. As the chosen stance is to display photo-realistic images, two trails were followed: the improvement of the real-virtual merging by reproducing accurately the real lighting on the virtual objects, and the development of a real-time segmentation method which is resilient to lighting changes.Regarding lighting reproduction, an image-based rendering method is used in addition to a high dynamic range capture of the lighting environment. The emphasis is put on the photometric and colorimetric correctness of these two steps. To measure the quality of the lighting reproduction chain, a test scene is set up with a calibrated color checker, captured by a camera while another camera is grabbing the lighting environment. The image of the real scene is then compared to the simulation of the same scene, enlightened by the light probe.Segmentation resilient to lighting changes is developed from a set of global image segmentation methods, which consider an image as a graph where a cut of minimal energy has to be found between the foreground and the background. These methods being semi-automatic, the manual part is replaced by a low resolution pre-segmentation based on the depthmap of the scene which is used as a seed for the final segmentation.
Document type :
Complete list of metadata

Cited literature [96 references]  Display  Hide  Download
Contributor : ABES STAR :  Contact
Submitted on : Monday, May 26, 2014 - 3:37:24 PM
Last modification on : Friday, August 5, 2022 - 2:54:00 PM
Long-term archiving on: : Tuesday, August 26, 2014 - 12:02:11 PM


Version validated by the jury (STAR)


  • HAL Id : pastel-00996513, version 1


Emmanuel Durand. Etudes de méthodes et outils pour la cohérence visuelle en réalité mixte appliquée au patrimoine. Traitement du signal et de l'image [eess.SP]. Ecole nationale supérieure d'arts et métiers - ENSAM, 2013. Français. ⟨NNT : 2013ENAM0043⟩. ⟨pastel-00996513⟩



Record views


Files downloads