Method Effects in Factorial Surveys : An Analysis of Respondents' Comments, Interviewers' Assessments, and Response Behavior

Thumbnail Image
Date
2014
Authors
Sauer, Carsten
Liebig, Stefan
Schupp, Jürgen
Editors
Contact
Journal ISSN
Electronic ISSN
ISBN
Bibliographical data
Publisher
Series
SOEPpaper; 629
URI (citable link)
DOI (citable link)
ArXiv-ID
International patent number
Link to the license
EU project number
Project
Open Access publication
Collections
Restricted until
Title in another language
Research Projects
Organizational Units
Journal Issue
Publication type
Working Paper/Technical Report
Publication status
Published in
Abstract
This paper describes the implementation of a factorial survey within the SOEP-Pretest of 2008 and investigates (1) respondents' comments about the vignettes, (2) interviewers' assessments of respondents comprehension and willingness to answer, and (3) response behavior regarding response time, use of the answering scale, and consistency of evaluations by different age groups and educational background. The respondents evaluated 24 vignettes consisting of ten dimensions that described full-time employees and their gross earnings. The evaluation task was to assess whether the given earnings were just or unjust, and if they were rated as unjust, respondents had to specify the amount of injustice on an 100-point rating scale. In regard to respondents' comments, the critique mentioned most frequently by respondents referred to the content (unrealistic descriptions) and the number of the vignettes. The analysis of the interviewers' assessments of respondents' comprehension and willingness to answer revealed less comprehension and willingness to answer for older and less well educated respondents, although these differences were similar to those found for the complete questionnaire. The analysis of the response behavior revealed no differences of response time between the groups. Analyses of response consistency show that one should consider hints for simplifying heuristics: such heuristics can lead to an artificially high response consistency. The implications of the findings are discussed.
Summary in another language
Subject (DDC)
300 Social Sciences, Sociology
Keywords
Conference
Review
undefined / . - undefined, undefined. - (undefined; undefined)
Cite This
ISO 690SAUER, Carsten, Katrin AUSPURG, Thomas HINZ, Stefan LIEBIG, Jürgen SCHUPP, 2014. Method Effects in Factorial Surveys : An Analysis of Respondents' Comments, Interviewers' Assessments, and Response Behavior
BibTex
@techreport{Sauer2014Metho-31125,
  year={2014},
  series={SOEPpaper},
  title={Method Effects in Factorial Surveys : An Analysis of Respondents' Comments, Interviewers' Assessments, and Response Behavior},
  number={629},
  url={http://papers.ssrn.com/sol3/papers.cfm?abstract_id=2399404},
  author={Sauer, Carsten and Auspurg, Katrin and Hinz, Thomas and Liebig, Stefan and Schupp, Jürgen}
}
RDF
<rdf:RDF
    xmlns:dcterms="http://purl.org/dc/terms/"
    xmlns:dc="http://purl.org/dc/elements/1.1/"
    xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
    xmlns:bibo="http://purl.org/ontology/bibo/"
    xmlns:dspace="http://digital-repositories.org/ontologies/dspace/0.1.0#"
    xmlns:foaf="http://xmlns.com/foaf/0.1/"
    xmlns:void="http://rdfs.org/ns/void#"
    xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > 
  <rdf:Description rdf:about="https://kops.uni-konstanz.de/server/rdf/resource/123456789/31125">
    <dc:date rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2015-06-10T08:01:06Z</dc:date>
    <dc:contributor>Sauer, Carsten</dc:contributor>
    <dcterms:rights rdf:resource="https://rightsstatements.org/page/InC/1.0/"/>
    <dspace:hasBitstream rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/31125/3/Sauer_0-292336.pdf"/>
    <dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/34"/>
    <dc:creator>Sauer, Carsten</dc:creator>
    <bibo:uri rdf:resource="http://kops.uni-konstanz.de/handle/123456789/31125"/>
    <dc:language>eng</dc:language>
    <dcterms:hasPart rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/31125/3/Sauer_0-292336.pdf"/>
    <dc:contributor>Liebig, Stefan</dc:contributor>
    <dcterms:abstract xml:lang="eng">This paper describes the implementation of a factorial survey within the SOEP-Pretest of 2008 and investigates (1) respondents' comments about the vignettes, (2) interviewers' assessments of respondents comprehension and willingness to answer, and (3) response behavior regarding response time, use of the answering scale, and consistency of evaluations by different age groups and educational background. The respondents evaluated 24 vignettes consisting of ten dimensions that described full-time employees and their gross earnings. The evaluation task was to assess whether the given earnings were just or unjust, and if they were rated as unjust, respondents had to specify the amount of injustice on an 100-point rating scale. In regard to respondents' comments, the critique mentioned most frequently by respondents referred to the content (unrealistic descriptions) and the number of the vignettes. The analysis of the interviewers' assessments of respondents' comprehension and willingness to answer revealed less comprehension and willingness to answer for older and less well educated respondents, although these differences were similar to those found for the complete questionnaire. The analysis of the response behavior revealed no differences of response time between the groups. Analyses of response consistency show that one should consider hints for simplifying heuristics: such heuristics can lead to an artificially high response consistency. The implications of the findings are discussed.</dcterms:abstract>
    <void:sparqlEndpoint rdf:resource="http://localhost/fuseki/dspace/sparql"/>
    <dc:creator>Schupp, Jürgen</dc:creator>
    <dc:contributor>Schupp, Jürgen</dc:contributor>
    <dc:contributor>Auspurg, Katrin</dc:contributor>
    <dcterms:issued>2014</dcterms:issued>
    <dc:contributor>Hinz, Thomas</dc:contributor>
    <dcterms:available rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2015-06-10T08:01:06Z</dcterms:available>
    <dc:creator>Liebig, Stefan</dc:creator>
    <dc:rights>terms-of-use</dc:rights>
    <foaf:homepage rdf:resource="http://localhost:8080/"/>
    <dc:creator>Auspurg, Katrin</dc:creator>
    <dcterms:title>Method Effects in Factorial Surveys : An Analysis of Respondents' Comments, Interviewers' Assessments, and Response Behavior</dcterms:title>
    <dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/34"/>
    <dc:creator>Hinz, Thomas</dc:creator>
  </rdf:Description>
</rdf:RDF>
Internal note
xmlui.Submission.submit.DescribeStep.inputForms.label.kops_note_fromSubmitter
Contact
Test date of URL
2015-06-10
Examination date of dissertation
Method of financing
Comment on publication
Alliance license
Corresponding Authors der Uni Konstanz vorhanden
International Co-Authors
Bibliography of Konstanz
Yes
Refereed