Inverse lighting and photorealistic rendering for augmented reality

Miika Aittala

Research output: Contribution to journalArticleScientificpeer-review

26 Citations (Scopus)

Abstract

We present a practical and robust photorealistic rendering pipeline for augmented reality. We solve the real world lighting conditions from observations of a diffuse sphere or a rotated marker. The solution method is based on l1-regularized least squares minimization, yielding a sparse set of light sources readily usable with most rendering methods. The framework also supports the use of more complex light source representations. Once the lighting conditions are solved, we render the image using modern real-time rendering methods such as shadow maps with variable softness, ambient occlusion, advanced BRDF’s and approximate reflections and refractions. Finally, we perform post-processing on the resulting images in order to match the various aberrations and defects typically found in the underlying real-world video.
Original languageEnglish
Pages (from-to)669-678
JournalVisual Computer
Volume26
Issue number6-8
DOIs
Publication statusPublished - 2010
MoE publication typeA1 Journal article-refereed
EventComputer Graphics International, CGI'2010 - Singapore, Singapore
Duration: 8 Jun 201011 Jun 2010

Fingerprint

Augmented reality
Light sources
Lighting
Refraction
Aberrations
Pipelines
Defects
Processing
Rendering (computer graphics)

Keywords

  • Image processing
  • Inverse rendering
  • l1-regularization
  • Real-time rendering
  • Sparsity

Cite this

Aittala, Miika. / Inverse lighting and photorealistic rendering for augmented reality. In: Visual Computer. 2010 ; Vol. 26, No. 6-8. pp. 669-678.
@article{0f7564698cb34de8b579af257ff3fa05,
title = "Inverse lighting and photorealistic rendering for augmented reality",
abstract = "We present a practical and robust photorealistic rendering pipeline for augmented reality. We solve the real world lighting conditions from observations of a diffuse sphere or a rotated marker. The solution method is based on l1-regularized least squares minimization, yielding a sparse set of light sources readily usable with most rendering methods. The framework also supports the use of more complex light source representations. Once the lighting conditions are solved, we render the image using modern real-time rendering methods such as shadow maps with variable softness, ambient occlusion, advanced BRDF’s and approximate reflections and refractions. Finally, we perform post-processing on the resulting images in order to match the various aberrations and defects typically found in the underlying real-world video.",
keywords = "Image processing, Inverse rendering, l1-regularization, Real-time rendering, Sparsity",
author = "Miika Aittala",
year = "2010",
doi = "10.1007/s00371-010-0501-7",
language = "English",
volume = "26",
pages = "669--678",
journal = "Visual Computer",
issn = "0178-2789",
publisher = "Springer",
number = "6-8",

}

Inverse lighting and photorealistic rendering for augmented reality. / Aittala, Miika.

In: Visual Computer, Vol. 26, No. 6-8, 2010, p. 669-678.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - Inverse lighting and photorealistic rendering for augmented reality

AU - Aittala, Miika

PY - 2010

Y1 - 2010

N2 - We present a practical and robust photorealistic rendering pipeline for augmented reality. We solve the real world lighting conditions from observations of a diffuse sphere or a rotated marker. The solution method is based on l1-regularized least squares minimization, yielding a sparse set of light sources readily usable with most rendering methods. The framework also supports the use of more complex light source representations. Once the lighting conditions are solved, we render the image using modern real-time rendering methods such as shadow maps with variable softness, ambient occlusion, advanced BRDF’s and approximate reflections and refractions. Finally, we perform post-processing on the resulting images in order to match the various aberrations and defects typically found in the underlying real-world video.

AB - We present a practical and robust photorealistic rendering pipeline for augmented reality. We solve the real world lighting conditions from observations of a diffuse sphere or a rotated marker. The solution method is based on l1-regularized least squares minimization, yielding a sparse set of light sources readily usable with most rendering methods. The framework also supports the use of more complex light source representations. Once the lighting conditions are solved, we render the image using modern real-time rendering methods such as shadow maps with variable softness, ambient occlusion, advanced BRDF’s and approximate reflections and refractions. Finally, we perform post-processing on the resulting images in order to match the various aberrations and defects typically found in the underlying real-world video.

KW - Image processing

KW - Inverse rendering

KW - l1-regularization

KW - Real-time rendering

KW - Sparsity

U2 - 10.1007/s00371-010-0501-7

DO - 10.1007/s00371-010-0501-7

M3 - Article

VL - 26

SP - 669

EP - 678

JO - Visual Computer

JF - Visual Computer

SN - 0178-2789

IS - 6-8

ER -