KOPS - The Institutional Repository of the University of Konstanz

Crowd workers proven useful : a comparative study of subjective video quality assessment

Crowd workers proven useful : a comparative study of subjective video quality assessment

Cite This

Files in this item

Checksum: MD5:cbbf61c9a13923495bdd6dfb77f215b1

SAUPE, Dietmar, Franz HAHN, Vlad HOSU, Igor ZINGMAN, Masud RANA, Shujun LI, 2016. Crowd workers proven useful : a comparative study of subjective video quality assessment. QoMEX 2016 : 8th International Conference on Quality of Multimedia Experience. Lisbon, Portugal, Jun 6, 2016 - Jun 8, 2016. In: QoMEX 2016 : 8th International Conference on Quality of Multimedia Experience

@inproceedings{Saupe2016Crowd-35942, title={Crowd workers proven useful : a comparative study of subjective video quality assessment}, year={2016}, booktitle={QoMEX 2016 : 8th International Conference on Quality of Multimedia Experience}, author={Saupe, Dietmar and Hahn, Franz and Hosu, Vlad and Zingman, Igor and Rana, Masud and Li, Shujun} }

<rdf:RDF xmlns:dcterms="http://purl.org/dc/terms/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:bibo="http://purl.org/ontology/bibo/" xmlns:dspace="http://digital-repositories.org/ontologies/dspace/0.1.0#" xmlns:foaf="http://xmlns.com/foaf/0.1/" xmlns:void="http://rdfs.org/ns/void#" xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > <rdf:Description rdf:about="https://kops.uni-konstanz.de/rdf/resource/123456789/35942"> <void:sparqlEndpoint rdf:resource="http://localhost/fuseki/dspace/sparql"/> <dspace:hasBitstream rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/35942/3/Saupe_0-371921.pdf"/> <dcterms:issued>2016</dcterms:issued> <dc:contributor>Hosu, Vlad</dc:contributor> <dc:date rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2016-11-16T16:29:04Z</dc:date> <dc:creator>Hosu, Vlad</dc:creator> <dc:rights>terms-of-use</dc:rights> <dc:contributor>Rana, Masud</dc:contributor> <dc:contributor>Li, Shujun</dc:contributor> <dcterms:abstract xml:lang="eng">We carried out crowdsourced video quality as- sessments using paired comparisons and converting the results to differential mean opinion scores (DMOS). A previous lab- based study had provided corresponding MOS-values for absolute category ratings. Using a simple linear transformation to fit the crowdsourcing-based DMOS values to the lab-based MOS values, we compared the results in terms of correlation coefficients and visually checked the relationship on scatter plots. The comparison result is surprisingly good with correlation coefficients more than 0.96, although (1) the original video sequences had to be cropped and downscaled in the crowdsourcing-based experiments, (2) the control of the experimental setup for the crowdsourcing case was much less and (3) it was widely believed that data from crowdsourcing workers are less reliable. Our result suggests crowdsourcing workers can actually be used to collect reliable VQA data in some applications.</dcterms:abstract> <dc:creator>Li, Shujun</dc:creator> <dc:contributor>Zingman, Igor</dc:contributor> <dc:creator>Saupe, Dietmar</dc:creator> <dc:creator>Zingman, Igor</dc:creator> <dc:contributor>Hahn, Franz</dc:contributor> <bibo:uri rdf:resource="https://kops.uni-konstanz.de/handle/123456789/35942"/> <dc:contributor>Saupe, Dietmar</dc:contributor> <dc:language>eng</dc:language> <dcterms:title>Crowd workers proven useful : a comparative study of subjective video quality assessment</dcterms:title> <dc:creator>Rana, Masud</dc:creator> <dcterms:rights rdf:resource="https://kops.uni-konstanz.de/page/termsofuse"/> <dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/rdf/resource/123456789/36"/> <foaf:homepage rdf:resource="http://localhost:8080/jspui"/> <dcterms:available rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2016-11-16T16:29:04Z</dcterms:available> <dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/rdf/resource/123456789/36"/> <dcterms:hasPart rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/35942/3/Saupe_0-371921.pdf"/> <dc:creator>Hahn, Franz</dc:creator> </rdf:Description> </rdf:RDF>

Downloads since Nov 16, 2016 (Information about access statistics)

Saupe_0-371921.pdf 112

This item appears in the following Collection(s)

Search KOPS


Browse

My Account