Publikation: Crowd workers proven useful : a comparative study of subjective video quality assessment
Lade...
Dateien
Datum
2016
Herausgeber:innen
ISSN der Zeitschrift
Electronic ISSN
ISBN
Bibliografische Daten
Verlag
Schriftenreihe
Auflagebezeichnung
URI (zitierfähiger Link)
Internationale Patentnummer
Link zur Lizenz
Angaben zur Forschungsförderung
Projekt
Open Access-Veröffentlichung
Open Access Green
Core Facility der Universität Konstanz
Titel in einer weiteren Sprache
Publikationstyp
Beitrag zu einem Konferenzband
Publikationsstatus
Published
Erschienen in
QoMEX 2016 : 8th International Conference on Quality of Multimedia Experience. 2016
Zusammenfassung
We carried out crowdsourced video quality as- sessments using paired comparisons and converting the results to differential mean opinion scores (DMOS). A previous lab- based study had provided corresponding MOS-values for absolute category ratings. Using a simple linear transformation to fit the crowdsourcing-based DMOS values to the lab-based MOS values, we compared the results in terms of correlation coefficients and visually checked the relationship on scatter plots. The comparison result is surprisingly good with correlation coefficients more than 0.96, although (1) the original video sequences had to be cropped and downscaled in the crowdsourcing-based experiments, (2) the control of the experimental setup for the crowdsourcing case was much less and (3) it was widely believed that data from crowdsourcing workers are less reliable. Our result suggests crowdsourcing workers can actually be used to collect reliable VQA data in some applications.
Zusammenfassung in einer weiteren Sprache
Fachgebiet (DDC)
004 Informatik
Schlagwörter
Konferenz
QoMEX 2016 : 8th International Conference on Quality of Multimedia Experience, 6. Juni 2016 - 8. Juni 2016, Lisbon, Portugal
Rezension
undefined / . - undefined, undefined
Zitieren
ISO 690
SAUPE, Dietmar, Franz HAHN, Vlad HOSU, Igor ZINGMAN, Masud RANA, Shujun LI, 2016. Crowd workers proven useful : a comparative study of subjective video quality assessment. QoMEX 2016 : 8th International Conference on Quality of Multimedia Experience. Lisbon, Portugal, 6. Juni 2016 - 8. Juni 2016. In: QoMEX 2016 : 8th International Conference on Quality of Multimedia Experience. 2016BibTex
@inproceedings{Saupe2016Crowd-35942,
year={2016},
title={Crowd workers proven useful : a comparative study of subjective video quality assessment},
booktitle={QoMEX 2016 : 8th International Conference on Quality of Multimedia Experience},
author={Saupe, Dietmar and Hahn, Franz and Hosu, Vlad and Zingman, Igor and Rana, Masud and Li, Shujun}
}RDF
<rdf:RDF
xmlns:dcterms="http://purl.org/dc/terms/"
xmlns:dc="http://purl.org/dc/elements/1.1/"
xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
xmlns:bibo="http://purl.org/ontology/bibo/"
xmlns:dspace="http://digital-repositories.org/ontologies/dspace/0.1.0#"
xmlns:foaf="http://xmlns.com/foaf/0.1/"
xmlns:void="http://rdfs.org/ns/void#"
xmlns:xsd="http://www.w3.org/2001/XMLSchema#" >
<rdf:Description rdf:about="https://kops.uni-konstanz.de/server/rdf/resource/123456789/35942">
<dc:creator>Hosu, Vlad</dc:creator>
<dc:creator>Rana, Masud</dc:creator>
<dcterms:rights rdf:resource="https://rightsstatements.org/page/InC/1.0/"/>
<dc:contributor>Hosu, Vlad</dc:contributor>
<dc:contributor>Rana, Masud</dc:contributor>
<dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/36"/>
<dcterms:issued>2016</dcterms:issued>
<dc:creator>Li, Shujun</dc:creator>
<dc:contributor>Saupe, Dietmar</dc:contributor>
<dspace:hasBitstream rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/35942/3/Saupe_0-371921.pdf"/>
<bibo:uri rdf:resource="https://kops.uni-konstanz.de/handle/123456789/35942"/>
<dc:creator>Hahn, Franz</dc:creator>
<foaf:homepage rdf:resource="http://localhost:8080/"/>
<dc:language>eng</dc:language>
<dc:contributor>Li, Shujun</dc:contributor>
<dcterms:title>Crowd workers proven useful : a comparative study of subjective video quality assessment</dcterms:title>
<dc:contributor>Hahn, Franz</dc:contributor>
<void:sparqlEndpoint rdf:resource="http://localhost/fuseki/dspace/sparql"/>
<dc:creator>Zingman, Igor</dc:creator>
<dcterms:abstract xml:lang="eng">We carried out crowdsourced video quality as- sessments using paired comparisons and converting the results to differential mean opinion scores (DMOS). A previous lab- based study had provided corresponding MOS-values for absolute category ratings. Using a simple linear transformation to fit the crowdsourcing-based DMOS values to the lab-based MOS values, we compared the results in terms of correlation coefficients and visually checked the relationship on scatter plots. The comparison result is surprisingly good with correlation coefficients more than 0.96, although (1) the original video sequences had to be cropped and downscaled in the crowdsourcing-based experiments, (2) the control of the experimental setup for the crowdsourcing case was much less and (3) it was widely believed that data from crowdsourcing workers are less reliable. Our result suggests crowdsourcing workers can actually be used to collect reliable VQA data in some applications.</dcterms:abstract>
<dc:creator>Saupe, Dietmar</dc:creator>
<dcterms:hasPart rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/35942/3/Saupe_0-371921.pdf"/>
<dc:contributor>Zingman, Igor</dc:contributor>
<dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/36"/>
<dc:date rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2016-11-16T16:29:04Z</dc:date>
<dc:rights>terms-of-use</dc:rights>
<dcterms:available rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2016-11-16T16:29:04Z</dcterms:available>
</rdf:Description>
</rdf:RDF>Interner Vermerk
xmlui.Submission.submit.DescribeStep.inputForms.label.kops_note_fromSubmitter
Prüfungsdatum der Dissertation
Finanzierungsart
Kommentar zur Publikation
Allianzlizenz
Corresponding Authors der Uni Konstanz vorhanden
Internationale Co-Autor:innen
Universitätsbibliographie
Ja
