KOPS - The Institutional Repository of the University of Konstanz

Automated identification of bias inducing words in news articles using linguistic and context-oriented features

Automated identification of bias inducing words in news articles using linguistic and context-oriented features

Cite This

Files in this item

Checksum: MD5:1acf03652a139d5a300e1baf80dab123

SPINDE, Timo, Lada RUDNITCKAIA, Jelena MITROVIĆ, Felix HAMBORG, Michael GRANITZER, Bela GIPP, Karsten DONNAY, 2021. Automated identification of bias inducing words in news articles using linguistic and context-oriented features. In: Information Processing & Management. Elsevier. 58(3), 102505. ISSN 0306-4573. eISSN 1873-5371. Available under: doi: 10.1016/j.ipm.2021.102505

@article{Spinde2021-05Autom-52980, title={Automated identification of bias inducing words in news articles using linguistic and context-oriented features}, year={2021}, doi={10.1016/j.ipm.2021.102505}, number={3}, volume={58}, issn={0306-4573}, journal={Information Processing & Management}, author={Spinde, Timo and Rudnitckaia, Lada and Mitrović, Jelena and Hamborg, Felix and Granitzer, Michael and Gipp, Bela and Donnay, Karsten}, note={Article Number: 102505} }

Spinde, Timo Rudnitckaia, Lada eng Granitzer, Michael Granitzer, Michael Rudnitckaia, Lada Donnay, Karsten Gipp, Bela Donnay, Karsten 2021-05 Hamborg, Felix Spinde, Timo 2021-02-24T13:40:37Z Gipp, Bela 2021-02-24T13:40:37Z Media has a substantial impact on public perception of events, and, accordingly, the way media presents events can potentially alter the beliefs and views of the public. One of the ways in which bias in news articles can be introduced is by altering word choice. Such a form of bias is very challenging to identify automatically due to the high context-dependence and the lack of a large-scale gold-standard data set. In this paper, we present a prototypical yet robust and diverse data set for media bias research. It consists of 1,700 statements representing various media bias instances and contains labels for media bias identification on the word and sentence level. In contrast to existing research, our data incorporate background information on the participants’ demographics, political ideology, and their opinion about media in general. Based on our data, we also present a way to detect bias-inducing words in news articles automatically. Our approach is feature-oriented, which provides a strong descriptive and explanatory power compared to deep learning techniques. We identify and engineer various linguistic, lexical, and syntactic features that can potentially be media bias indicators. Our resource collection is the most complete within the media bias research area to the best of our knowledge. We evaluate all of our features in various combinations and retrieve their possible importance both for future research and for the task in general. We also evaluate various possible Machine Learning approaches with all of our features. XGBoost, a decision tree implementation, yields the best results. Our approach achieves an F<sub>1</sub>-score of 0.43, a precision of 0.29, a recall of 0.77, and a ROC AUC of 0.79, which outperforms current media bias detection methods based on features. We propose future improvements, discuss the perspectives of the feature-based approach and a combination of neural networks and deep learning with our current system. Attribution-NonCommercial-NoDerivatives 4.0 International Hamborg, Felix Mitrović, Jelena Automated identification of bias inducing words in news articles using linguistic and context-oriented features Mitrović, Jelena

Downloads since Feb 24, 2021 (Information about access statistics)

Spinde_2-5futcux6vkvc4.pdf 71

This item appears in the following Collection(s)

Attribution-NonCommercial-NoDerivatives 4.0 International Except where otherwise noted, this item's license is described as Attribution-NonCommercial-NoDerivatives 4.0 International

Search KOPS


Browse

My Account