Visual Quality Assessment for Motion Compensated Frame Interpolation

IEEE COMPUTER SOCIETY, /, ed.. 2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX) : June 5-7, 2019, Berlin, Germany. Piscataway: IEEE, 2019, pp. 197-203. ISBN 978-1-5386-8212-8. Available under: doi: 10.1109/QoMEX.2019.8743221

Zusammenfassung

Current benchmarks for optical flow algorithms evaluate the estimation quality by comparing their predicted flow field with the ground truth, and additionally may compare interpolated frames, based on these predictions, with the correct frames from the actual image sequences. For the latter comparisons, objective measures such as mean square errors are applied. However, for applications like image interpolation, the expected user's quality of experience cannot be fully deduced from such simple quality measures. Therefore, we conducted a subjective quality assessment study by crowdsourcing for the interpolated images provided in one of the optical flow benchmarks, the Middlebury benchmark. We used paired comparisons with forced choice and reconstructed absolute quality scale values according to Thurstone's model using the classical least squares method. The results give rise to a re-ranking of 141 participating algorithms w.r.t. visual quality of interpolated frames mostly based on optical flow estimation. Our re-ranking result shows the necessity of visual quality assessment as another evaluation metric for optical flow and frame interpolation benchmarks.

Fachgebiet (DDC)

004 Informatik

Schlagwörter

visual quality assessment, optical flow, frame interpolation

Konferenz

2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX), 5. Juni 2019 - 7. Juni 2019, Berlin

Zitieren

ISO 690

MEN, Hui, Hanhe LIN, Vlad HOSU, Daniel MAURER, Andres BRUHN, Dietmar SAUPE, 2019. Visual Quality Assessment for Motion Compensated Frame Interpolation. 2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX). Berlin, 5. Juni 2019 - 7. Juni 2019. In: IEEE COMPUTER SOCIETY, /, ed.. 2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX) : June 5-7, 2019, Berlin, Germany. Piscataway: IEEE, 2019, pp. 197-203. ISBN 978-1-5386-8212-8. Available under: doi: 10.1109/QoMEX.2019.8743221

BibTex

@inproceedings{Men2019Visua-49117,
  year={2019},
  doi={10.1109/QoMEX.2019.8743221},
  title={Visual Quality Assessment for Motion Compensated Frame Interpolation},
  isbn={978-1-5386-8212-8},
  publisher={IEEE},
  address={Piscataway},
  booktitle={2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX) : June 5-7, 2019, Berlin, Germany},
  pages={197--203},
  editor={IEEE Computer Society, /},
  author={Men, Hui and Lin, Hanhe and Hosu, Vlad and Maurer, Daniel and Bruhn, Andres and Saupe, Dietmar}
}

RDF

<rdf:RDF
    xmlns:dcterms="http://purl.org/dc/terms/"
    xmlns:dc="http://purl.org/dc/elements/1.1/"
    xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
    xmlns:bibo="http://purl.org/ontology/bibo/"
    xmlns:dspace="http://digital-repositories.org/ontologies/dspace/0.1.0#"
    xmlns:foaf="http://xmlns.com/foaf/0.1/"
    xmlns:void="http://rdfs.org/ns/void#"
    xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > 
  <rdf:Description rdf:about="https://kops.uni-konstanz.de/server/rdf/resource/123456789/49117">
    <dcterms:available rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2020-03-23T09:00:48Z</dcterms:available>
    <dc:creator>Bruhn, Andres</dc:creator>
    <dcterms:issued>2019</dcterms:issued>
    <dc:contributor>Saupe, Dietmar</dc:contributor>
    <dc:creator>Maurer, Daniel</dc:creator>
    <void:sparqlEndpoint rdf:resource="http://localhost/fuseki/dspace/sparql"/>
    <dc:language>eng</dc:language>
    <dc:contributor>Bruhn, Andres</dc:contributor>
    <dc:contributor>Lin, Hanhe</dc:contributor>
    <foaf:homepage rdf:resource="http://localhost:8080/"/>
    <dcterms:title>Visual Quality Assessment for Motion Compensated Frame Interpolation</dcterms:title>
    <dc:creator>Hosu, Vlad</dc:creator>
    <dc:creator>Saupe, Dietmar</dc:creator>
    <dc:contributor>Men, Hui</dc:contributor>
    <bibo:uri rdf:resource="https://kops.uni-konstanz.de/handle/123456789/49117"/>
    <dc:date rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2020-03-23T09:00:48Z</dc:date>
    <dc:creator>Lin, Hanhe</dc:creator>
    <dc:contributor>Hosu, Vlad</dc:contributor>
    <dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/36"/>
    <dc:creator>Men, Hui</dc:creator>
    <dcterms:abstract xml:lang="eng">Current benchmarks for optical flow algorithms evaluate the estimation quality by comparing their predicted flow field with the ground truth, and additionally may compare interpolated frames, based on these predictions, with the correct frames from the actual image sequences. For the latter comparisons, objective measures such as mean square errors are applied. However, for applications like image interpolation, the expected user's quality of experience cannot be fully deduced from such simple quality measures. Therefore, we conducted a subjective quality assessment study by crowdsourcing for the interpolated images provided in one of the optical flow benchmarks, the Middlebury benchmark. We used paired comparisons with forced choice and reconstructed absolute quality scale values according to Thurstone's model using the classical least squares method. The results give rise to a re-ranking of 141 participating algorithms w.r.t. visual quality of interpolated frames mostly based on optical flow estimation. Our re-ranking result shows the necessity of visual quality assessment as another evaluation metric for optical flow and frame interpolation benchmarks.</dcterms:abstract>
    <dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/36"/>
    <dc:contributor>Maurer, Daniel</dc:contributor>
  </rdf:Description>
</rdf:RDF>

Universitätsbibliographie

Ja