Reflection Separation in Light Fields based on Sparse Coding and Specular Flow

No Thumbnail Available
Files
There are no files associated with this item.
Date
2016
Editors
Contact
Journal ISSN
Electronic ISSN
ISBN
Bibliographical data
Publisher
Series
URI (citable link)
DOI (citable link)
ArXiv-ID
International patent number
Link to the license
oops
EU project number
336978
Project
LIA - Light Field Imaging and Analysis
Open Access publication
Restricted until
Title in another language
Research Projects
Organizational Units
Journal Issue
Publication type
Contribution to a conference collection
Publication status
Published
Published in
Vision, Modeling & Visualization / Hullin, Matthias; Stamminger, Marc; Weinkauf, Tino (ed.). - Geneva : The Eurographics Association, 2016. - ISBN 978-3-03868-025-3
Abstract
We present a method to separate a dichromatic reflection component from diffuse object colors for the set of rays in a 4D light field such that the separation is consistent across all subaperture views. The separation model is based on explaining the observed light field as a sparse linear combination of a constant-color specular term and a small finite set of albedos. Consistency across the light field is achieved by embedding the ray-wise separation into a global optimization framework. On each individual epipolar plane image (EPI), the diffuse coefficients need to be constant along lines which are the projections of the same scene point, while the specular coefficient needs to be constant along the direction of the specular flow within the epipolar volume. We handle both constraints with depth-dependent anisotropic regularizers, and demonstrate promising performance on a number of real-world light fields captured with a Lytro Illum plenoptic camera.
Summary in another language
Subject (DDC)
004 Computer Science
Keywords
Conference
VMV 2016 : 21th International Symposium on Vision, Modeling and Visualization, Oct 10, 2016 - Oct 12, 2016, Bayreuth
Review
undefined / . - undefined, undefined. - (undefined; undefined)
Cite This
ISO 690SULC, Antonin, Anna ALPEROVICH, Nico MARNIOK, Bastian GOLDLÜCKE, 2016. Reflection Separation in Light Fields based on Sparse Coding and Specular Flow. VMV 2016 : 21th International Symposium on Vision, Modeling and Visualization. Bayreuth, Oct 10, 2016 - Oct 12, 2016. In: HULLIN, Matthias, ed., Marc STAMMINGER, ed., Tino WEINKAUF, ed.. Vision, Modeling & Visualization. Geneva:The Eurographics Association. ISBN 978-3-03868-025-3. Available under: doi: 10.2312/vmv.20161352
BibTex
@inproceedings{Sulc2016Refle-38171,
  year={2016},
  doi={10.2312/vmv.20161352},
  title={Reflection Separation in Light Fields based on Sparse Coding and Specular Flow},
  isbn={978-3-03868-025-3},
  publisher={The Eurographics Association},
  address={Geneva},
  booktitle={Vision, Modeling & Visualization},
  editor={Hullin, Matthias and Stamminger, Marc and Weinkauf, Tino},
  author={Sulc, Antonin and Alperovich, Anna and Marniok, Nico and Goldlücke, Bastian}
}
RDF
<rdf:RDF
    xmlns:dcterms="http://purl.org/dc/terms/"
    xmlns:dc="http://purl.org/dc/elements/1.1/"
    xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
    xmlns:bibo="http://purl.org/ontology/bibo/"
    xmlns:dspace="http://digital-repositories.org/ontologies/dspace/0.1.0#"
    xmlns:foaf="http://xmlns.com/foaf/0.1/"
    xmlns:void="http://rdfs.org/ns/void#"
    xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > 
  <rdf:Description rdf:about="https://kops.uni-konstanz.de/server/rdf/resource/123456789/38171">
    <dc:creator>Marniok, Nico</dc:creator>
    <dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/36"/>
    <dc:date rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2017-03-28T12:40:10Z</dc:date>
    <dc:language>eng</dc:language>
    <dcterms:abstract xml:lang="eng">We present a method to separate a dichromatic reflection component from diffuse object colors for the set of rays in a 4D light field such that the separation is consistent across all subaperture views. The separation model is based on explaining the observed light field as a sparse linear combination of a constant-color specular term and a small finite set of albedos. Consistency across the light field is achieved by embedding the ray-wise separation into a global optimization framework. On each individual epipolar plane image (EPI), the diffuse coefficients need to be constant along lines which are the projections of the same scene point, while the specular coefficient needs to be constant along the direction of the specular flow within the epipolar volume. We handle both constraints with depth-dependent anisotropic regularizers, and demonstrate promising performance on a number of real-world light fields captured with a Lytro Illum plenoptic camera.</dcterms:abstract>
    <dcterms:available rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2017-03-28T12:40:10Z</dcterms:available>
    <void:sparqlEndpoint rdf:resource="http://localhost/fuseki/dspace/sparql"/>
    <dcterms:issued>2016</dcterms:issued>
    <dc:contributor>Goldlücke, Bastian</dc:contributor>
    <dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/36"/>
    <dc:contributor>Marniok, Nico</dc:contributor>
    <dc:contributor>Sulc, Antonin</dc:contributor>
    <dc:contributor>Alperovich, Anna</dc:contributor>
    <dcterms:title>Reflection Separation in Light Fields based on Sparse Coding and Specular Flow</dcterms:title>
    <dc:creator>Goldlücke, Bastian</dc:creator>
    <bibo:uri rdf:resource="https://kops.uni-konstanz.de/handle/123456789/38171"/>
    <foaf:homepage rdf:resource="http://localhost:8080/"/>
    <dc:creator>Alperovich, Anna</dc:creator>
    <dc:creator>Sulc, Antonin</dc:creator>
  </rdf:Description>
</rdf:RDF>
Internal note
xmlui.Submission.submit.DescribeStep.inputForms.label.kops_note_fromSubmitter
Contact
URL of original publication
Test date of URL
Examination date of dissertation
Method of financing
Comment on publication
Alliance license
Corresponding Authors der Uni Konstanz vorhanden
International Co-Authors
Bibliography of Konstanz
Yes
Refereed