Inverse lighting and photorealistic rendering for augmented reality

Miika Aittala

Research output: Contribution to journalArticleScientificpeer-review

27 Citations (Scopus)

Abstract

We present a practical and robust photorealistic rendering pipeline for augmented reality. We solve the real world lighting conditions from observations of a diffuse sphere or a rotated marker. The solution method is based on l1-regularized least squares minimization, yielding a sparse set of light sources readily usable with most rendering methods. The framework also supports the use of more complex light source representations. Once the lighting conditions are solved, we render the image using modern real-time rendering methods such as shadow maps with variable softness, ambient occlusion, advanced BRDF’s and approximate reflections and refractions. Finally, we perform post-processing on the resulting images in order to match the various aberrations and defects typically found in the underlying real-world video.
Original languageEnglish
Pages (from-to)669-678
JournalVisual Computer
Volume26
Issue number6-8
DOIs
Publication statusPublished - 2010
MoE publication typeA1 Journal article-refereed
EventComputer Graphics International, CGI'2010 - Singapore, Singapore
Duration: 8 Jun 201011 Jun 2010

    Fingerprint

Keywords

  • Image processing
  • Inverse rendering
  • l1-regularization
  • Real-time rendering
  • Sparsity

Cite this