Towards scalable, multi-view urban modeling using structure priors

Abstract : In this thesis, we address the problem of 3D reconstruction from a sequence of calibrated street-level photographs with a simultaneous focus on scalability and the use of structure priors in Multi-View Stereo (MVS).While both aspects have been studied broadly, existing scalable MVS approaches do not handle well the ubiquitous structural regularities, yet simple, of man-made environments. On the other hand, structure-aware 3D reconstruction methods are slow and scale poorly with the size of the input sequences and/or may even require additional restrictive information. The goal of this thesis is to reconcile scalability and structure awareness within common MVS grounds using soft, generic priors which encourage : (i) piecewise planarity, (ii) alignment of objects boundaries with image gradients and (iii) with vanishing directions (VDs), and (iv) objects co-planarity. To do so, we present the novel “Patchwork Stereo” framework which integrates photometric stereo from a handful of wide-baseline views and a sparse 3D point cloud combining robust 3D plane extraction and top-down image partitioning from a unified 2D-3D analysis in a principled Markov Random Field energy minimization. We evaluate our contributions quantitatively and qualitatively on challenging urban datasets and illustrate results which are at least on par with state-of-the-art methods in terms of geometric structure, but achieved in several orders of magnitude faster paving the way for photo-realistic city-scale modeling
Document type :
Theses
Complete list of metadatas

Cited literature [110 references]  Display  Hide  Download

https://pastel.archives-ouvertes.fr/tel-01786911
Contributor : Abes Star <>
Submitted on : Monday, May 7, 2018 - 9:40:34 AM
Last modification on : Thursday, May 16, 2019 - 5:46:00 PM
Long-term archiving on : Tuesday, September 25, 2018 - 1:00:32 PM

File

TH2017PESC1062.pdf
Version validated by the jury (STAR)

Identifiers

  • HAL Id : tel-01786911, version 1

Citation

Amine Bourki. Towards scalable, multi-view urban modeling using structure priors. Modeling and Simulation. Université Paris-Est, 2017. English. ⟨NNT : 2017PESC1062⟩. ⟨tel-01786911⟩

Share

Metrics

Record views

246

Files downloads

78