Foveated Video Coding for Real-Time Streaming Applications

Lade...
Vorschaubild
Dateien
Wiedemann_2-1i76kviy2m8ls7.pdf
Wiedemann_2-1i76kviy2m8ls7.pdfGröße: 1.43 MBDownloads: 303
Datum
2020
Herausgeber:innen
Kontakt
ISSN der Zeitschrift
Electronic ISSN
ISBN
Bibliografische Daten
Verlag
Schriftenreihe
Auflagebezeichnung
ArXiv-ID
Internationale Patentnummer
EU-Projektnummer
DFG-Projektnummer
Forschungsförderung
Projekt
Open Access-Veröffentlichung
Gesperrt bis
Titel in einer weiteren Sprache
Forschungsvorhaben
Organisationseinheiten
Zeitschriftenheft
Publikationstyp
Beitrag zu einem Konferenzband
Publikationsstatus
Published
Erschienen in
2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX). Piscataway, NJ: IEEE, 2020. ISSN 2372-7179. eISSN 2472-7814. ISBN 978-1-72815-965-2. Available under: doi: 10.1109/QoMEX48832.2020.9123080
Zusammenfassung

Video streaming under real-time constraints is an increasingly widespread application. Many recent video encoders are unsuitable for this scenario due to theoretical limitations or run time requirements. In this paper, we present a framework for the perceptual evaluation of foveated video coding schemes. Foveation describes the process of adapting a visual stimulus according to the acuity of the human eye. In contrast to traditional region-of-interest coding, where certain areas are statically encoded at a higher quality, we utilize feedback from an eye-tracker to spatially steer the bit allocation scheme in real-time. We evaluate the performance of an H.264 based foveated coding scheme in a lab environment by comparing the bitrates at the point of just noticeable distortion (JND). Furthermore, we identify perceptually optimal codec parameterizations. In our trials, we achieve an average bitrate savings of 63.24% at the JND in comparison to the unfoveated baseline.

Zusammenfassung in einer weiteren Sprache
Fachgebiet (DDC)
004 Informatik
Schlagwörter
Konferenz
2020 Twelth International Conference on Quality of Multimedia Experience (QoMEX), 26. Mai 2020 - 28. Mai 2020, Athlone, Ireland
Rezension
undefined / . - undefined, undefined
Zitieren
ISO 690WIEDEMANN, Oliver, Vlad HOSU, Hanhe LIN, Dietmar SAUPE, 2020. Foveated Video Coding for Real-Time Streaming Applications. 2020 Twelth International Conference on Quality of Multimedia Experience (QoMEX). Athlone, Ireland, 26. Mai 2020 - 28. Mai 2020. In: 2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX). Piscataway, NJ: IEEE, 2020. ISSN 2372-7179. eISSN 2472-7814. ISBN 978-1-72815-965-2. Available under: doi: 10.1109/QoMEX48832.2020.9123080
BibTex
@inproceedings{Wiedemann2020Fovea-52102,
  year={2020},
  doi={10.1109/QoMEX48832.2020.9123080},
  title={Foveated Video Coding for Real-Time Streaming Applications},
  isbn={978-1-72815-965-2},
  issn={2372-7179},
  publisher={IEEE},
  address={Piscataway, NJ},
  booktitle={2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX)},
  author={Wiedemann, Oliver and Hosu, Vlad and Lin, Hanhe and Saupe, Dietmar}
}
RDF
<rdf:RDF
    xmlns:dcterms="http://purl.org/dc/terms/"
    xmlns:dc="http://purl.org/dc/elements/1.1/"
    xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
    xmlns:bibo="http://purl.org/ontology/bibo/"
    xmlns:dspace="http://digital-repositories.org/ontologies/dspace/0.1.0#"
    xmlns:foaf="http://xmlns.com/foaf/0.1/"
    xmlns:void="http://rdfs.org/ns/void#"
    xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > 
  <rdf:Description rdf:about="https://kops.uni-konstanz.de/server/rdf/resource/123456789/52102">
    <dc:contributor>Wiedemann, Oliver</dc:contributor>
    <dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/36"/>
    <dc:contributor>Lin, Hanhe</dc:contributor>
    <dc:date rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2020-12-14T08:20:51Z</dc:date>
    <dcterms:abstract xml:lang="eng">Video streaming under real-time constraints is an increasingly widespread application. Many recent video encoders are unsuitable for this scenario due to theoretical limitations or run time requirements. In this paper, we present a framework for the perceptual evaluation of foveated video coding schemes. Foveation describes the process of adapting a visual stimulus according to the acuity of the human eye. In contrast to traditional region-of-interest coding, where certain areas are statically encoded at a higher quality, we utilize feedback from an eye-tracker to spatially steer the bit allocation scheme in real-time. We evaluate the performance of an H.264 based foveated coding scheme in a lab environment by comparing the bitrates at the point of just noticeable distortion (JND). Furthermore, we identify perceptually optimal codec parameterizations. In our trials, we achieve an average bitrate savings of 63.24% at the JND in comparison to the unfoveated baseline.</dcterms:abstract>
    <dcterms:rights rdf:resource="https://rightsstatements.org/page/InC/1.0/"/>
    <dcterms:issued>2020</dcterms:issued>
    <dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/36"/>
    <dc:rights>terms-of-use</dc:rights>
    <dc:creator>Lin, Hanhe</dc:creator>
    <void:sparqlEndpoint rdf:resource="http://localhost/fuseki/dspace/sparql"/>
    <dc:language>eng</dc:language>
    <dc:contributor>Hosu, Vlad</dc:contributor>
    <bibo:uri rdf:resource="https://kops.uni-konstanz.de/handle/123456789/52102"/>
    <dc:creator>Wiedemann, Oliver</dc:creator>
    <foaf:homepage rdf:resource="http://localhost:8080/"/>
    <dcterms:available rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2020-12-14T08:20:51Z</dcterms:available>
    <dc:creator>Saupe, Dietmar</dc:creator>
    <dc:creator>Hosu, Vlad</dc:creator>
    <dc:contributor>Saupe, Dietmar</dc:contributor>
    <dspace:hasBitstream rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/52102/3/Wiedemann_2-1i76kviy2m8ls7.pdf"/>
    <dcterms:hasPart rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/52102/3/Wiedemann_2-1i76kviy2m8ls7.pdf"/>
    <dcterms:title>Foveated Video Coding for Real-Time Streaming Applications</dcterms:title>
  </rdf:Description>
</rdf:RDF>
Interner Vermerk
xmlui.Submission.submit.DescribeStep.inputForms.label.kops_note_fromSubmitter
Kontakt
URL der Originalveröffentl.
Prüfdatum der URL
Prüfungsdatum der Dissertation
Finanzierungsart
Kommentar zur Publikation
Allianzlizenz
Corresponding Authors der Uni Konstanz vorhanden
Internationale Co-Autor:innen
Universitätsbibliographie
Ja
Begutachtet