Type of Publication: | Journal article |
Publication status: | Published |
URI (citable link): | http://nbn-resolving.de/urn:nbn:de:bsz:352-2-phws5ww8mf0q0 |
Author: | Sauer, Carsten; Auspurg, Katrin; Hinz, Thomas |
Year of publication: | 2020 |
Published in: | Methods, Data, Analyses : mda ; 14 (2020), 2. - pp. 195-214. - Gesis. - ISSN 1864-6956. - eISSN 2190-4936 |
DOI (citable link): | https://dx.doi.org/10.12758/mda.2020.06 |
Summary: |
Multi-factorial survey experiments have become a well-established tool in social sciences as they combine experimental designs with advantages of heterogeneous respondent samples. This paper investigates three under-researched design features: how to present vignettes (running text vs. table), how to measure responses (rating vs. open scale), and how to sort vignettes (random vs. extreme-cases-first, to prevent censored responses). Experiments were conducted in a 2 x 2 x 2 between-subject design with 408 university students rating decks à 20 vignettes. Analyses of 7,895 ratings showed no differences of whether vignettes were presented as running texts or tables. Open scales revealed more measurement problems, e.g., missing values, than rating scales. Finally, vignettes presented randomly sorted produced similar results compared to sorting extreme vignette cases first. Recommendations based on the findings are to use random orders of vignettes and rating scales. Table vignettes provide an alternative to text vignettes but should be further evaluated with heterogeneous samples.
|
Subject (DDC): | 300 Social Sciences, Sociology |
Keywords: | Multi-factorial survey, vignette presentation, response scale, vignette order, ceiling effects |
Link to License: | In Copyright |
Bibliography of Konstanz: | Yes |
Refereed: | Unknown |
SAUER, Carsten, Katrin AUSPURG, Thomas HINZ, 2020. Designing Multi-Factorial Survey Experiments : Effects of Presentation Style (Text or Table), Answering Scales, and Vignette Order. In: Methods, Data, Analyses : mda. Gesis. 14(2), pp. 195-214. ISSN 1864-6956. eISSN 2190-4936. Available under: doi: 10.12758/mda.2020.06
@article{Sauer2020Desig-50333, title={Designing Multi-Factorial Survey Experiments : Effects of Presentation Style (Text or Table), Answering Scales, and Vignette Order}, year={2020}, doi={10.12758/mda.2020.06}, number={2}, volume={14}, issn={1864-6956}, journal={Methods, Data, Analyses : mda}, pages={195--214}, author={Sauer, Carsten and Auspurg, Katrin and Hinz, Thomas} }
<rdf:RDF xmlns:dcterms="http://purl.org/dc/terms/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:bibo="http://purl.org/ontology/bibo/" xmlns:dspace="http://digital-repositories.org/ontologies/dspace/0.1.0#" xmlns:foaf="http://xmlns.com/foaf/0.1/" xmlns:void="http://rdfs.org/ns/void#" xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > <rdf:Description rdf:about="https://kops.uni-konstanz.de/rdf/resource/123456789/50333"> <dcterms:hasPart rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/50333/1/Sauer_2-phws5ww8mf0q0.pdf"/> <dcterms:title>Designing Multi-Factorial Survey Experiments : Effects of Presentation Style (Text or Table), Answering Scales, and Vignette Order</dcterms:title> <dcterms:abstract xml:lang="eng">Multi-factorial survey experiments have become a well-established tool in social sciences as they combine experimental designs with advantages of heterogeneous respondent samples. This paper investigates three under-researched design features: how to present vignettes (running text vs. table), how to measure responses (rating vs. open scale), and how to sort vignettes (random vs. extreme-cases-first, to prevent censored responses). Experiments were conducted in a 2 x 2 x 2 between-subject design with 408 university students rating decks à 20 vignettes. Analyses of 7,895 ratings showed no differences of whether vignettes were presented as running texts or tables. Open scales revealed more measurement problems, e.g., missing values, than rating scales. Finally, vignettes presented randomly sorted produced similar results compared to sorting extreme vignette cases first. Recommendations based on the findings are to use random orders of vignettes and rating scales. Table vignettes provide an alternative to text vignettes but should be further evaluated with heterogeneous samples.</dcterms:abstract> <dc:date rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2020-07-21T11:20:22Z</dc:date> <void:sparqlEndpoint rdf:resource="http://localhost/fuseki/dspace/sparql"/> <dcterms:rights rdf:resource="https://rightsstatements.org/page/InC/1.0/"/> <dcterms:available rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2020-07-21T11:20:22Z</dcterms:available> <dc:creator>Sauer, Carsten</dc:creator> <dc:contributor>Auspurg, Katrin</dc:contributor> <dc:creator>Hinz, Thomas</dc:creator> <dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/rdf/resource/123456789/34"/> <dc:rights>terms-of-use</dc:rights> <dspace:hasBitstream rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/50333/1/Sauer_2-phws5ww8mf0q0.pdf"/> <bibo:uri rdf:resource="https://kops.uni-konstanz.de/handle/123456789/50333"/> <foaf:homepage rdf:resource="http://localhost:8080/jspui"/> <dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/rdf/resource/123456789/34"/> <dc:contributor>Hinz, Thomas</dc:contributor> <dc:creator>Auspurg, Katrin</dc:creator> <dc:language>eng</dc:language> <dc:contributor>Sauer, Carsten</dc:contributor> <dcterms:issued>2020</dcterms:issued> </rdf:Description> </rdf:RDF>
Sauer_2-phws5ww8mf0q0.pdf | 239 |