The application of factorial surveys in general population samples : the effects of respondent age and education on response times and response consistency

No Thumbnail Available
Files
There are no files associated with this item.
Date
2011
Authors
Sauer, Carsten
Liebig, Stefan
Editors
Contact
Journal ISSN
Electronic ISSN
ISBN
Bibliographical data
Publisher
Series
URI (citable link)
DOI (citable link)
ArXiv-ID
International patent number
Link to the license
EU project number
Project
Open Access publication
Collections
Restricted until
Title in another language
Research Projects
Organizational Units
Journal Issue
Publication type
Journal article
Publication status
Published in
Survey Research Methods ; 5 (2011), 3. - pp. 89-102
Abstract
Over the last decade, there has been a marked increase in the number of studies on attitude and decision research which use the factorial survey (FS) design. The FS integrates experimental set-ups into a survey: respondents react to hypothetical descriptions (vignettes) while the values of each attribute (dimension) of these descriptions systematically vary in order to estimate their impact on respondent judgments. As the vignettes are based on a number of dimensions and as respondents evaluate several vignettes, FSs are demanding in terms of individual cognitive and information-processing abilities. So far, there is little empirical knowledge of whether and to what extent this complexity is feasible in general population samples with heterogeneous respondents. Using data from a study on the fairness of earnings (with a mixed mode sample consisting a computer assisted personal interview [CAPI], computer assisted self interview [CASI], and paper and pencil [PAPI] mode), the complexity of FSs is analyzed in terms of: 1) design dimensions, such as the number of vignette dimensions (five, eight, or 12) and the number of vignettes for single respondents (10, 20, or 30), which were varied in a 3x3 experimental design; and 2) respondent characteristics that are associated with cognitive abilities (age and education). Two different indicators for cognitive load as well as learning and fatigue effects are analyzed: 1) latency time and 2) response consistency. The results show that raw reaction times but not latency times are longer for older respondents, suggesting that the cognitive effort needed for the evaluation of vignettes is not particularly high. Consistency measures reveal that respondents with a lower educational level show greater inconsistency in their evaluations when the number of vignettes is high. The number of dimensions has an effect on consistency only when respondents have to rate a large number of vignettes. In short, the results demonstrate that FSs are applicable in general population samples but should be used with a limited number of vignettes and dimensions per respondent.
Summary in another language
Subject (DDC)
300 Social Sciences, Sociology
Keywords
Conference
Review
undefined / . - undefined, undefined. - (undefined; undefined)
Cite This
ISO 690SAUER, Carsten, Katrin AUSPURG, Thomas HINZ, Stefan LIEBIG, 2011. The application of factorial surveys in general population samples : the effects of respondent age and education on response times and response consistency. In: Survey Research Methods. 5(3), pp. 89-102. Available under: doi: 10.18148/srm/2011.v5i3.4625
BibTex
@article{Sauer2011appli-17787,
  year={2011},
  doi={10.18148/srm/2011.v5i3.4625},
  title={The application of factorial surveys in general population samples : the effects of respondent age and education on response times and response consistency},
  number={3},
  volume={5},
  journal={Survey Research Methods},
  pages={89--102},
  author={Sauer, Carsten and Auspurg, Katrin and Hinz, Thomas and Liebig, Stefan}
}
RDF
<rdf:RDF
    xmlns:dcterms="http://purl.org/dc/terms/"
    xmlns:dc="http://purl.org/dc/elements/1.1/"
    xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
    xmlns:bibo="http://purl.org/ontology/bibo/"
    xmlns:dspace="http://digital-repositories.org/ontologies/dspace/0.1.0#"
    xmlns:foaf="http://xmlns.com/foaf/0.1/"
    xmlns:void="http://rdfs.org/ns/void#"
    xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > 
  <rdf:Description rdf:about="https://kops.uni-konstanz.de/server/rdf/resource/123456789/17787">
    <dcterms:issued>2011</dcterms:issued>
    <dc:language>eng</dc:language>
    <dc:contributor>Liebig, Stefan</dc:contributor>
    <dc:rights>terms-of-use</dc:rights>
    <dc:contributor>Sauer, Carsten</dc:contributor>
    <dc:creator>Liebig, Stefan</dc:creator>
    <dcterms:abstract xml:lang="eng">Over the last decade, there has been a marked increase in the number of studies on attitude and decision research which use the factorial survey (FS) design. The FS integrates experimental set-ups into a survey: respondents react to hypothetical descriptions (vignettes) while the values of each attribute (dimension) of these descriptions systematically vary in order to estimate their impact on respondent judgments. As the vignettes are based on a number of dimensions and as respondents evaluate several vignettes, FSs are demanding in terms of individual cognitive and information-processing abilities. So far, there is little empirical knowledge of whether and to what extent this complexity is feasible in general population samples with heterogeneous respondents. Using data from a study on the fairness of earnings (with a mixed mode sample consisting a computer assisted personal interview [CAPI], computer assisted self interview [CASI], and paper and pencil [PAPI] mode), the complexity of FSs is analyzed in terms of: 1) design dimensions, such as the number of vignette dimensions (five, eight, or 12) and the number of vignettes for single respondents (10, 20, or 30), which were varied in a 3x3 experimental design; and 2) respondent characteristics that are associated with cognitive abilities (age and education). Two different indicators for cognitive load as well as learning and fatigue effects are analyzed: 1) latency time and 2) response consistency. The results show that raw reaction times but not latency times are longer for older respondents, suggesting that the cognitive effort needed for the evaluation of vignettes is not particularly high. Consistency measures reveal that respondents with a lower educational level show greater inconsistency in their evaluations when the number of vignettes is high. The number of dimensions has an effect on consistency only when respondents have to rate a large number of vignettes. In short, the results demonstrate that FSs are applicable in general population samples but should be used with a limited number of vignettes and dimensions per respondent.</dcterms:abstract>
    <dcterms:available rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2012-02-03T08:47:11Z</dcterms:available>
    <dcterms:bibliographicCitation>Publ. in: Survey Research Methods; 5 (2011), 3. - S. 89-102</dcterms:bibliographicCitation>
    <dc:contributor>Hinz, Thomas</dc:contributor>
    <dcterms:rights rdf:resource="https://rightsstatements.org/page/InC/1.0/"/>
    <dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/34"/>
    <dcterms:title>The application of factorial surveys in general population samples : the effects of respondent age and education on response times and response consistency</dcterms:title>
    <foaf:homepage rdf:resource="http://localhost:8080/"/>
    <dc:contributor>Auspurg, Katrin</dc:contributor>
    <bibo:uri rdf:resource="http://kops.uni-konstanz.de/handle/123456789/17787"/>
    <dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/34"/>
    <dc:date rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2012-02-03T08:47:11Z</dc:date>
    <dc:creator>Sauer, Carsten</dc:creator>
    <dc:creator>Hinz, Thomas</dc:creator>
    <dc:creator>Auspurg, Katrin</dc:creator>
    <void:sparqlEndpoint rdf:resource="http://localhost/fuseki/dspace/sparql"/>
  </rdf:Description>
</rdf:RDF>
Internal note
xmlui.Submission.submit.DescribeStep.inputForms.label.kops_note_fromSubmitter
Contact
URL of original publication
Test date of URL
Examination date of dissertation
Method of financing
Comment on publication
Alliance license
Corresponding Authors der Uni Konstanz vorhanden
International Co-Authors
Bibliography of Konstanz
Yes
Refereed