4D imaging through spray-on optics
Dateien
Datum
Autor:innen
Herausgeber:innen
ISSN der Zeitschrift
Electronic ISSN
ISBN
Bibliografische Daten
Verlag
Schriftenreihe
Auflagebezeichnung
DOI (zitierfähiger Link)
Internationale Patentnummer
Angaben zur Forschungsförderung
Projekt
Open Access-Veröffentlichung
Sammlungen
Core Facility der Universität Konstanz
Titel in einer weiteren Sprache
Publikationstyp
Publikationsstatus
Erschienen in
Zusammenfassung
Light fields are a powerful concept in computational imaging and a mainstay in image-based rendering; however, so far their acquisition required either carefully designed and calibrated optical systems (micro-lens arrays), or multi-camera/multi-shot settings. Here, we show that fully calibrated light field data can be obtained from a single ordinary photograph taken through a partially wetted window. Each drop of water produces a distorted view on the scene, and the challenge of recovering the unknown mapping from pixel coordinates to refracted rays in space is a severely underconstrained problem. The key idea behind our solution is to combine ray tracing and low-level image analysis techniques (extraction of 2D drop contours and locations of scene features seen through drops) with state-of-the-art drop shape simulation and an iterative refinement scheme to enforce photo-consistency across features that are seen in multiple views. This novel approach not only recovers a dense pixel-to-ray mapping, but also the refractive geometry through which the scene is observed, to high accuracy. We therefore anticipate that our inherently self-calibrating scheme might also find applications in other fields, for instance in materials science where the wetting properties of liquids on surfaces are investigated.
Zusammenfassung in einer weiteren Sprache
Fachgebiet (DDC)
Schlagwörter
Konferenz
Rezension
Zitieren
ISO 690
ISERINGHAUSEN, Julian, Bastian GOLDLÜCKE, Nina PESHEVA, Stanimir ILIEV, Alexander WENDER, Martin FUCHS, Matthias B. HULLIN, 2017. 4D imaging through spray-on optics. In: ACM Transactions on Graphics. 2017, 36(4), 35. ISSN 0730-0301. eISSN 1557-7368. Available under: doi: 10.1145/3072959.3073589BibTex
@article{Iseringhausen2017-07-20imagi-39834,
year={2017},
doi={10.1145/3072959.3073589},
title={4D imaging through spray-on optics},
number={4},
volume={36},
issn={0730-0301},
journal={ACM Transactions on Graphics},
author={Iseringhausen, Julian and Goldlücke, Bastian and Pesheva, Nina and Iliev, Stanimir and Wender, Alexander and Fuchs, Martin and Hullin, Matthias B.},
note={Article Number: 35}
}RDF
<rdf:RDF
xmlns:dcterms="http://purl.org/dc/terms/"
xmlns:dc="http://purl.org/dc/elements/1.1/"
xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
xmlns:bibo="http://purl.org/ontology/bibo/"
xmlns:dspace="http://digital-repositories.org/ontologies/dspace/0.1.0#"
xmlns:foaf="http://xmlns.com/foaf/0.1/"
xmlns:void="http://rdfs.org/ns/void#"
xmlns:xsd="http://www.w3.org/2001/XMLSchema#" >
<rdf:Description rdf:about="https://kops.uni-konstanz.de/server/rdf/resource/123456789/39834">
<dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/36"/>
<dc:creator>Wender, Alexander</dc:creator>
<dc:contributor>Pesheva, Nina</dc:contributor>
<dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/36"/>
<dc:contributor>Iseringhausen, Julian</dc:contributor>
<dc:creator>Fuchs, Martin</dc:creator>
<dc:language>eng</dc:language>
<dc:contributor>Iliev, Stanimir</dc:contributor>
<dc:creator>Iseringhausen, Julian</dc:creator>
<dc:date rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2017-08-10T12:19:48Z</dc:date>
<dc:contributor>Fuchs, Martin</dc:contributor>
<dc:creator>Pesheva, Nina</dc:creator>
<void:sparqlEndpoint rdf:resource="http://localhost/fuseki/dspace/sparql"/>
<dc:contributor>Goldlücke, Bastian</dc:contributor>
<dc:creator>Goldlücke, Bastian</dc:creator>
<dc:creator>Iliev, Stanimir</dc:creator>
<dc:contributor>Hullin, Matthias B.</dc:contributor>
<bibo:uri rdf:resource="https://kops.uni-konstanz.de/handle/123456789/39834"/>
<dcterms:abstract xml:lang="eng">Light fields are a powerful concept in computational imaging and a mainstay in image-based rendering; however, so far their acquisition required either carefully designed and calibrated optical systems (micro-lens arrays), or multi-camera/multi-shot settings. Here, we show that fully calibrated light field data can be obtained from a single ordinary photograph taken through a partially wetted window. Each drop of water produces a distorted view on the scene, and the challenge of recovering the unknown mapping from pixel coordinates to refracted rays in space is a severely underconstrained problem. The key idea behind our solution is to combine ray tracing and low-level image analysis techniques (extraction of 2D drop contours and locations of scene features seen through drops) with state-of-the-art drop shape simulation and an iterative refinement scheme to enforce photo-consistency across features that are seen in multiple views. This novel approach not only recovers a dense pixel-to-ray mapping, but also the refractive geometry through which the scene is observed, to high accuracy. We therefore anticipate that our inherently self-calibrating scheme might also find applications in other fields, for instance in materials science where the wetting properties of liquids on surfaces are investigated.</dcterms:abstract>
<dcterms:title>4D imaging through spray-on optics</dcterms:title>
<foaf:homepage rdf:resource="http://localhost:8080/"/>
<dc:contributor>Wender, Alexander</dc:contributor>
<dc:creator>Hullin, Matthias B.</dc:creator>
<dcterms:issued>2017-07-20</dcterms:issued>
<dcterms:available rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2017-08-10T12:19:48Z</dcterms:available>
</rdf:Description>
</rdf:RDF>
