4D imaging through spray-on optics

No Thumbnail Available
Files
There are no files associated with this item.
Date
2017
Authors
Iseringhausen, Julian
Pesheva, Nina
Iliev, Stanimir
Wender, Alexander
Fuchs, Martin
Hullin, Matthias B.
Editors
Contact
Journal ISSN
Electronic ISSN
ISBN
Bibliographical data
Publisher
Series
URI (citable link)
DOI (citable link)
ArXiv-ID
International patent number
Link to the license
oops
EU project number
336978
Project
LIA - Light Field Imaging and Analysis
Open Access publication
Restricted until
Title in another language
Research Projects
Organizational Units
Journal Issue
Publication type
Journal article
Publication status
Published
Published in
ACM Transactions on Graphics ; 36 (2017), 4. - 35. - ISSN 0730-0301. - eISSN 1557-7368
Abstract
Light fields are a powerful concept in computational imaging and a mainstay in image-based rendering; however, so far their acquisition required either carefully designed and calibrated optical systems (micro-lens arrays), or multi-camera/multi-shot settings. Here, we show that fully calibrated light field data can be obtained from a single ordinary photograph taken through a partially wetted window. Each drop of water produces a distorted view on the scene, and the challenge of recovering the unknown mapping from pixel coordinates to refracted rays in space is a severely underconstrained problem. The key idea behind our solution is to combine ray tracing and low-level image analysis techniques (extraction of 2D drop contours and locations of scene features seen through drops) with state-of-the-art drop shape simulation and an iterative refinement scheme to enforce photo-consistency across features that are seen in multiple views. This novel approach not only recovers a dense pixel-to-ray mapping, but also the refractive geometry through which the scene is observed, to high accuracy. We therefore anticipate that our inherently self-calibrating scheme might also find applications in other fields, for instance in materials science where the wetting properties of liquids on surfaces are investigated.
Summary in another language
Subject (DDC)
004 Computer Science
Keywords
Conference
Review
undefined / . - undefined, undefined. - (undefined; undefined)
Cite This
ISO 690ISERINGHAUSEN, Julian, Bastian GOLDLÜCKE, Nina PESHEVA, Stanimir ILIEV, Alexander WENDER, Martin FUCHS, Matthias B. HULLIN, 2017. 4D imaging through spray-on optics. In: ACM Transactions on Graphics. 36(4), 35. ISSN 0730-0301. eISSN 1557-7368. Available under: doi: 10.1145/3072959.3073589
BibTex
@article{Iseringhausen2017-07-20imagi-39834,
  year={2017},
  doi={10.1145/3072959.3073589},
  title={4D imaging through spray-on optics},
  number={4},
  volume={36},
  issn={0730-0301},
  journal={ACM Transactions on Graphics},
  author={Iseringhausen, Julian and Goldlücke, Bastian and Pesheva, Nina and Iliev, Stanimir and Wender, Alexander and Fuchs, Martin and Hullin, Matthias B.},
  note={Article Number: 35}
}
RDF
<rdf:RDF
    xmlns:dcterms="http://purl.org/dc/terms/"
    xmlns:dc="http://purl.org/dc/elements/1.1/"
    xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
    xmlns:bibo="http://purl.org/ontology/bibo/"
    xmlns:dspace="http://digital-repositories.org/ontologies/dspace/0.1.0#"
    xmlns:foaf="http://xmlns.com/foaf/0.1/"
    xmlns:void="http://rdfs.org/ns/void#"
    xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > 
  <rdf:Description rdf:about="https://kops.uni-konstanz.de/server/rdf/resource/123456789/39834">
    <dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/36"/>
    <dc:creator>Wender, Alexander</dc:creator>
    <dc:contributor>Pesheva, Nina</dc:contributor>
    <dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/36"/>
    <dc:contributor>Iseringhausen, Julian</dc:contributor>
    <dc:creator>Fuchs, Martin</dc:creator>
    <dc:language>eng</dc:language>
    <dc:contributor>Iliev, Stanimir</dc:contributor>
    <dc:creator>Iseringhausen, Julian</dc:creator>
    <dc:date rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2017-08-10T12:19:48Z</dc:date>
    <dc:contributor>Fuchs, Martin</dc:contributor>
    <dc:creator>Pesheva, Nina</dc:creator>
    <void:sparqlEndpoint rdf:resource="http://localhost/fuseki/dspace/sparql"/>
    <dc:contributor>Goldlücke, Bastian</dc:contributor>
    <dc:creator>Goldlücke, Bastian</dc:creator>
    <dc:creator>Iliev, Stanimir</dc:creator>
    <dc:contributor>Hullin, Matthias B.</dc:contributor>
    <bibo:uri rdf:resource="https://kops.uni-konstanz.de/handle/123456789/39834"/>
    <dcterms:abstract xml:lang="eng">Light fields are a powerful concept in computational imaging and a mainstay in image-based rendering; however, so far their acquisition required either carefully designed and calibrated optical systems (micro-lens arrays), or multi-camera/multi-shot settings. Here, we show that fully calibrated light field data can be obtained from a single ordinary photograph taken through a partially wetted window. Each drop of water produces a distorted view on the scene, and the challenge of recovering the unknown mapping from pixel coordinates to refracted rays in space is a severely underconstrained problem. The key idea behind our solution is to combine ray tracing and low-level image analysis techniques (extraction of 2D drop contours and locations of scene features seen through drops) with state-of-the-art drop shape simulation and an iterative refinement scheme to enforce photo-consistency across features that are seen in multiple views. This novel approach not only recovers a dense pixel-to-ray mapping, but also the refractive geometry through which the scene is observed, to high accuracy. We therefore anticipate that our inherently self-calibrating scheme might also find applications in other fields, for instance in materials science where the wetting properties of liquids on surfaces are investigated.</dcterms:abstract>
    <dcterms:title>4D imaging through spray-on optics</dcterms:title>
    <foaf:homepage rdf:resource="http://localhost:8080/"/>
    <dc:contributor>Wender, Alexander</dc:contributor>
    <dc:creator>Hullin, Matthias B.</dc:creator>
    <dcterms:issued>2017-07-20</dcterms:issued>
    <dcterms:available rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2017-08-10T12:19:48Z</dcterms:available>
  </rdf:Description>
</rdf:RDF>
Internal note
xmlui.Submission.submit.DescribeStep.inputForms.label.kops_note_fromSubmitter
Contact
URL of original publication
Test date of URL
Examination date of dissertation
Method of financing
Comment on publication
Alliance license
Corresponding Authors der Uni Konstanz vorhanden
International Co-Authors
Bibliography of Konstanz
Yes
Refereed