Do You Think It's Biased? : How To Ask For The Perception Of Media Bias

Spinde, Timo; Kreuter, Christina; Gaissmaier, Wolfgang; Hamborg, Felix; Gipp, Bela; Giese, Helge

Do You Think It's Biased? : How To Ask For The Perception Of Media Bias

Dateien

Zu diesem Dokument gibt es keine Dateien.

Datum

2021

Publikationstyp

Beitrag zu einem Konferenzband

Publikationsstatus

Published

Erschienen in

DOWNIE, J. Stephen, ed. and others. 2021 ACM/IEEE Joint Conference on Digital Libraries, JCDL 2021, Virtual Conference, Hosted by the University of Illinois at Urbana-Champaign, USA, 27-30 September 2021 ; Proceeding. Piscataway, NJ: IEEE, 2021, pp. 61-69. ISBN 978-1-66541-770-9. Available under: doi: 10.1109/JCDL52503.2021.00018

Zusammenfassung

Media coverage possesses a substantial effect on the public perception of events. The way media frames events can significantly alter the beliefs and perceptions of our society. Nevertheless, nearly all media outlets are known to report news in a biased way. While such bias can be introduced by altering the word choice or omitting information, the perception of bias also varies largely depending on a reader's personal background. Therefore, media bias is a very complex construct to identify and analyze. Even though media bias has been the subject of many studies, previous assessment strategies are oversimplified, lack overlap and empirical evaluation. Thus, this study aims to develop a scale that can be used as a reliable standard to evaluate article bias. To name an example: Intending to measure bias in a news article, should we ask, “How biased is the article?” or should we instead ask, “How did the article treat the American president?”. We conducted a literature search to find 824 relevant questions about text perception in previous research on the topic. In a multi-iterative process, we summarized and condensed these questions semantically to conclude a complete and representative set of possible question types about bias. The final set consisted of 25 questions with varying answering formats, 17 questions using semantic differentials, and six ratings of feelings. We tested each of the questions on 190 articles with overall 663 participants to identify how well the questions measure an article's perceived bias. Our results show that 21 final items are suitable and reliable for measuring the perception of media bias. We publish the final set of questions on http://bias-guestion-tree.gipplab.org/.

Fachgebiet (DDC)

004 Informatik

Konferenz

Joint Conference on Digital Libraries, JCDL 2021, 27. Sep. 2021 - 30. Sep. 2021, Virtual Conference

Zitieren

ISO 690

SPINDE, Timo, Christina KREUTER, Wolfgang GAISSMAIER, Felix HAMBORG, Bela GIPP, Helge GIESE, 2021. Do You Think It's Biased? : How To Ask For The Perception Of Media Bias. Joint Conference on Digital Libraries, JCDL 2021. Virtual Conference, 27. Sep. 2021 - 30. Sep. 2021. In: DOWNIE, J. Stephen, ed. and others. 2021 ACM/IEEE Joint Conference on Digital Libraries, JCDL 2021, Virtual Conference, Hosted by the University of Illinois at Urbana-Champaign, USA, 27-30 September 2021 ; Proceeding. Piscataway, NJ: IEEE, 2021, pp. 61-69. ISBN 978-1-66541-770-9. Available under: doi: 10.1109/JCDL52503.2021.00018

BibTex

@inproceedings{Spinde2021Think-57009,
  year={2021},
  doi={10.1109/JCDL52503.2021.00018},
  title={Do You Think It's Biased? : How To Ask For The Perception Of Media Bias},
  isbn={978-1-66541-770-9},
  publisher={IEEE},
  address={Piscataway, NJ},
  booktitle={2021 ACM/IEEE Joint Conference on Digital Libraries, JCDL 2021, Virtual Conference, Hosted by the University of Illinois at Urbana-Champaign, USA, 27-30 September 2021 ; Proceeding},
  pages={61--69},
  editor={Downie, J. Stephen},
  author={Spinde, Timo and Kreuter, Christina and Gaissmaier, Wolfgang and Hamborg, Felix and Gipp, Bela and Giese, Helge}
}

RDF

<rdf:RDF
    xmlns:dcterms="http://purl.org/dc/terms/"
    xmlns:dc="http://purl.org/dc/elements/1.1/"
    xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
    xmlns:bibo="http://purl.org/ontology/bibo/"
    xmlns:dspace="http://digital-repositories.org/ontologies/dspace/0.1.0#"
    xmlns:foaf="http://xmlns.com/foaf/0.1/"
    xmlns:void="http://rdfs.org/ns/void#"
    xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > 
  <rdf:Description rdf:about="https://kops.uni-konstanz.de/server/rdf/resource/123456789/57009">
    <dc:creator>Hamborg, Felix</dc:creator>
    <void:sparqlEndpoint rdf:resource="http://localhost/fuseki/dspace/sparql"/>
    <dcterms:issued>2021</dcterms:issued>
    <dc:creator>Giese, Helge</dc:creator>
    <dc:creator>Kreuter, Christina</dc:creator>
    <bibo:uri rdf:resource="https://kops.uni-konstanz.de/handle/123456789/57009"/>
    <dcterms:available rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2022-03-25T12:42:55Z</dcterms:available>
    <dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/36"/>
    <dc:contributor>Hamborg, Felix</dc:contributor>
    <dcterms:title>Do You Think It's Biased? : How To Ask For The Perception Of Media Bias</dcterms:title>
    <dc:contributor>Giese, Helge</dc:contributor>
    <foaf:homepage rdf:resource="http://localhost:8080/"/>
    <dc:date rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2022-03-25T12:42:55Z</dc:date>
    <dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/43"/>
    <dc:language>eng</dc:language>
    <dc:contributor>Kreuter, Christina</dc:contributor>
    <dc:creator>Gipp, Bela</dc:creator>
    <dc:creator>Gaissmaier, Wolfgang</dc:creator>
    <dc:contributor>Gipp, Bela</dc:contributor>
    <dc:creator>Spinde, Timo</dc:creator>
    <dcterms:abstract xml:lang="eng">Media coverage possesses a substantial effect on the public perception of events. The way media frames events can significantly alter the beliefs and perceptions of our society. Nevertheless, nearly all media outlets are known to report news in a biased way. While such bias can be introduced by altering the word choice or omitting information, the perception of bias also varies largely depending on a reader's personal background. Therefore, media bias is a very complex construct to identify and analyze. Even though media bias has been the subject of many studies, previous assessment strategies are oversimplified, lack overlap and empirical evaluation. Thus, this study aims to develop a scale that can be used as a reliable standard to evaluate article bias. To name an example: Intending to measure bias in a news article, should we ask, “How biased is the article?” or should we instead ask, “How did the article treat the American president?”. We conducted a literature search to find 824 relevant questions about text perception in previous research on the topic. In a multi-iterative process, we summarized and condensed these questions semantically to conclude a complete and representative set of possible question types about bias. The final set consisted of 25 questions with varying answering formats, 17 questions using semantic differentials, and six ratings of feelings. We tested each of the questions on 190 articles with overall 663 participants to identify how well the questions measure an article's perceived bias. Our results show that 21 final items are suitable and reliable for measuring the perception of media bias. We publish the final set of questions on http://bias-guestion-tree.gipplab.org/.</dcterms:abstract>
    <dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/36"/>
    <dc:contributor>Gaissmaier, Wolfgang</dc:contributor>
    <dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/43"/>
    <dc:contributor>Spinde, Timo</dc:contributor>
  </rdf:Description>
</rdf:RDF>

Universitätsbibliographie

Ja