Do Falsifiers Leave Traces? : Finding Recognizable Response Patterns in Interviewer Falsifications

Loading...
Thumbnail Image
Date
2021
Editors
Contact
Journal ISSN
Electronic ISSN
ISBN
Bibliographical data
Publisher
Series
DOI (citable link)
ArXiv-ID
International patent number
Link to the license
EU project number
Project
Open Access publication
Collections
Restricted until
Title in another language
Research Projects
Organizational Units
Journal Issue
Publication type
Journal article
Publication status
Published
Published in
methods, data, analyses ; 15 (2021), 2. - pp. 125-160. - GESIS - Leibniz Institute for the Social Sciences. - ISSN 1864-6956
Abstract
Fraud by interviewers is a ubiquitous threat to data quality in survey practice, whenever face-to-face surveys are conducted. Particularly if interviewers use stereotypes about re- spondents to fill in questionnaires, falsifications can limit the variety of possible answers, lead erroneously to significant correlations and distort survey results. In addition to external control mechanisms to detect fraud (such as postcards or time stamps) more recent research has started to also consider internal indicators (such as the number of missing values or open answers) as a monitoring strategy. This latter approach relies on ex-post statistical analyses and implicitly assumes that falsifiers apply rational behavioral strategies which result in detectable response patterns. This study examines to what extent fieldwork monitoring can benefit from such approaches, by empirically assess- ing how effective different indicators are at detecting known cases of fabrication. In contrast to most previous research, which often relies on laboratory fabrications, this study uses authentic cases of detected interviewer fraud from a survey on the fairness of earnings conducted in Germany. The main goal of this study is to examine to what extent the falsifiers’ attempts to produce unsuspicious data led to recognizable response patterns. For this purpose, we test a wide range of indicators that could potentially identify falsifica- tions: avoidance of extreme categories and open text-based answers, low rates of item-non- response, strategic use of filter questions to shorten the questionnaire and non-compliance of responses to numeric questions with Benford‘s Law. Furthermore, we compare authentic and fabricated interviews according to their values on a social desirability scale and report results from an innovative trick question that was especially designed to detect falsifiers.
Summary in another language
Subject (DDC)
300 Social Sciences, Sociology
Keywords
interviewer falsification, interviewer fraud, interviewer effects, response pat- terns, statistical methods, data quality
Conference
Review
undefined / . - undefined, undefined. - (undefined; undefined)
Cite This
ISO 690WALZENBACH, Sandra, 2021. Do Falsifiers Leave Traces? : Finding Recognizable Response Patterns in Interviewer Falsifications. In: methods, data, analyses. GESIS - Leibniz Institute for the Social Sciences. 15(2), pp. 125-160. ISSN 1864-6956. Available under: doi: 10.12758/mda.2021.02
BibTex
@article{Walzenbach2021Falsi-57631,
  year={2021},
  doi={10.12758/mda.2021.02},
  title={Do Falsifiers Leave Traces? : Finding Recognizable Response Patterns in Interviewer Falsifications},
  number={2},
  volume={15},
  issn={1864-6956},
  journal={methods, data, analyses},
  pages={125--160},
  author={Walzenbach, Sandra}
}
RDF
<rdf:RDF
    xmlns:dcterms="http://purl.org/dc/terms/"
    xmlns:dc="http://purl.org/dc/elements/1.1/"
    xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
    xmlns:bibo="http://purl.org/ontology/bibo/"
    xmlns:dspace="http://digital-repositories.org/ontologies/dspace/0.1.0#"
    xmlns:foaf="http://xmlns.com/foaf/0.1/"
    xmlns:void="http://rdfs.org/ns/void#"
    xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > 
  <rdf:Description rdf:about="https://kops.uni-konstanz.de/server/rdf/resource/123456789/57631">
    <dcterms:rights rdf:resource="https://rightsstatements.org/page/InC/1.0/"/>
    <dcterms:hasPart rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/57631/3/Walzenbach_2-es797vtcmc7e3.pdf"/>
    <dc:contributor>Walzenbach, Sandra</dc:contributor>
    <foaf:homepage rdf:resource="http://localhost:8080/"/>
    <dcterms:issued>2021</dcterms:issued>
    <dc:rights>terms-of-use</dc:rights>
    <dcterms:title>Do Falsifiers Leave Traces? : Finding Recognizable Response Patterns in Interviewer Falsifications</dcterms:title>
    <dc:language>eng</dc:language>
    <bibo:uri rdf:resource="https://kops.uni-konstanz.de/handle/123456789/57631"/>
    <dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/34"/>
    <dc:date rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2022-05-24T07:53:25Z</dc:date>
    <dc:creator>Walzenbach, Sandra</dc:creator>
    <dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/34"/>
    <dcterms:available rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2022-05-24T07:53:25Z</dcterms:available>
    <dcterms:abstract xml:lang="eng">Fraud by interviewers is a ubiquitous threat to data quality in survey practice, whenever face-to-face surveys are conducted. Particularly if interviewers use stereotypes about re- spondents to fill in questionnaires, falsifications can limit the variety of possible answers, lead erroneously to significant correlations and distort survey results. In addition to external control mechanisms to detect fraud (such as postcards or time stamps) more recent research has started to also consider internal indicators (such as the number of missing values or open answers) as a monitoring strategy. This latter approach relies on ex-post statistical analyses and implicitly assumes that falsifiers apply rational behavioral strategies which result in detectable response patterns. This study examines to what extent fieldwork monitoring can benefit from such approaches, by empirically assess- ing how effective different indicators are at detecting known cases of fabrication. In contrast to most previous research, which often relies on laboratory fabrications, this study uses authentic cases of detected interviewer fraud from a survey on the fairness of earnings conducted in Germany. The main goal of this study is to examine to what extent the falsifiers’ attempts to produce unsuspicious data led to recognizable response patterns. For this purpose, we test a wide range of indicators that could potentially identify falsifica- tions: avoidance of extreme categories and open text-based answers, low rates of item-non- response, strategic use of filter questions to shorten the questionnaire and non-compliance of responses to numeric questions with Benford‘s Law. Furthermore, we compare authentic and fabricated interviews according to their values on a social desirability scale and report results from an innovative trick question that was especially designed to detect falsifiers.</dcterms:abstract>
    <dspace:hasBitstream rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/57631/3/Walzenbach_2-es797vtcmc7e3.pdf"/>
    <void:sparqlEndpoint rdf:resource="http://localhost/fuseki/dspace/sparql"/>
  </rdf:Description>
</rdf:RDF>
Internal note
xmlui.Submission.submit.DescribeStep.inputForms.label.kops_note_fromSubmitter
Contact
URL of original publication
Test date of URL
Examination date of dissertation
Method of financing
Comment on publication
Alliance license
Corresponding Authors der Uni Konstanz vorhanden
International Co-Authors
Bibliography of Konstanz
Refereed
Yes