Publikation: Foveated Video Coding for Real-Time Streaming Applications
Dateien
Datum
Herausgeber:innen
ISSN der Zeitschrift
Electronic ISSN
ISBN
Bibliografische Daten
Verlag
Schriftenreihe
Auflagebezeichnung
URI (zitierfähiger Link)
DOI (zitierfähiger Link)
Internationale Patentnummer
Link zur Lizenz
Angaben zur Forschungsförderung
Projekt
Open Access-Veröffentlichung
Core Facility der Universität Konstanz
Titel in einer weiteren Sprache
Publikationstyp
Publikationsstatus
Erschienen in
Zusammenfassung
Video streaming under real-time constraints is an increasingly widespread application. Many recent video encoders are unsuitable for this scenario due to theoretical limitations or run time requirements. In this paper, we present a framework for the perceptual evaluation of foveated video coding schemes. Foveation describes the process of adapting a visual stimulus according to the acuity of the human eye. In contrast to traditional region-of-interest coding, where certain areas are statically encoded at a higher quality, we utilize feedback from an eye-tracker to spatially steer the bit allocation scheme in real-time. We evaluate the performance of an H.264 based foveated coding scheme in a lab environment by comparing the bitrates at the point of just noticeable distortion (JND). Furthermore, we identify perceptually optimal codec parameterizations. In our trials, we achieve an average bitrate savings of 63.24% at the JND in comparison to the unfoveated baseline.
Zusammenfassung in einer weiteren Sprache
Fachgebiet (DDC)
Schlagwörter
Konferenz
Rezension
Zitieren
ISO 690
WIEDEMANN, Oliver, Vlad HOSU, Hanhe LIN, Dietmar SAUPE, 2020. Foveated Video Coding for Real-Time Streaming Applications. 2020 Twelth International Conference on Quality of Multimedia Experience (QoMEX). Athlone, Ireland, 26. Mai 2020 - 28. Mai 2020. In: 2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX). Piscataway, NJ: IEEE, 2020. ISSN 2372-7179. eISSN 2472-7814. ISBN 978-1-72815-965-2. Available under: doi: 10.1109/QoMEX48832.2020.9123080BibTex
@inproceedings{Wiedemann2020Fovea-52102, year={2020}, doi={10.1109/QoMEX48832.2020.9123080}, title={Foveated Video Coding for Real-Time Streaming Applications}, isbn={978-1-72815-965-2}, issn={2372-7179}, publisher={IEEE}, address={Piscataway, NJ}, booktitle={2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX)}, author={Wiedemann, Oliver and Hosu, Vlad and Lin, Hanhe and Saupe, Dietmar} }
RDF
<rdf:RDF xmlns:dcterms="http://purl.org/dc/terms/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:bibo="http://purl.org/ontology/bibo/" xmlns:dspace="http://digital-repositories.org/ontologies/dspace/0.1.0#" xmlns:foaf="http://xmlns.com/foaf/0.1/" xmlns:void="http://rdfs.org/ns/void#" xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > <rdf:Description rdf:about="https://kops.uni-konstanz.de/server/rdf/resource/123456789/52102"> <dc:contributor>Wiedemann, Oliver</dc:contributor> <dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/36"/> <dc:contributor>Lin, Hanhe</dc:contributor> <dc:date rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2020-12-14T08:20:51Z</dc:date> <dcterms:abstract xml:lang="eng">Video streaming under real-time constraints is an increasingly widespread application. Many recent video encoders are unsuitable for this scenario due to theoretical limitations or run time requirements. In this paper, we present a framework for the perceptual evaluation of foveated video coding schemes. Foveation describes the process of adapting a visual stimulus according to the acuity of the human eye. In contrast to traditional region-of-interest coding, where certain areas are statically encoded at a higher quality, we utilize feedback from an eye-tracker to spatially steer the bit allocation scheme in real-time. We evaluate the performance of an H.264 based foveated coding scheme in a lab environment by comparing the bitrates at the point of just noticeable distortion (JND). Furthermore, we identify perceptually optimal codec parameterizations. In our trials, we achieve an average bitrate savings of 63.24% at the JND in comparison to the unfoveated baseline.</dcterms:abstract> <dcterms:rights rdf:resource="https://rightsstatements.org/page/InC/1.0/"/> <dcterms:issued>2020</dcterms:issued> <dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/36"/> <dc:rights>terms-of-use</dc:rights> <dc:creator>Lin, Hanhe</dc:creator> <void:sparqlEndpoint rdf:resource="http://localhost/fuseki/dspace/sparql"/> <dc:language>eng</dc:language> <dc:contributor>Hosu, Vlad</dc:contributor> <bibo:uri rdf:resource="https://kops.uni-konstanz.de/handle/123456789/52102"/> <dc:creator>Wiedemann, Oliver</dc:creator> <foaf:homepage rdf:resource="http://localhost:8080/"/> <dcterms:available rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2020-12-14T08:20:51Z</dcterms:available> <dc:creator>Saupe, Dietmar</dc:creator> <dc:creator>Hosu, Vlad</dc:creator> <dc:contributor>Saupe, Dietmar</dc:contributor> <dspace:hasBitstream rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/52102/3/Wiedemann_2-1i76kviy2m8ls7.pdf"/> <dcterms:hasPart rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/52102/3/Wiedemann_2-1i76kviy2m8ls7.pdf"/> <dcterms:title>Foveated Video Coding for Real-Time Streaming Applications</dcterms:title> </rdf:Description> </rdf:RDF>