The Success of Linear Bootstrapping Models : Decision Domain-, Expertise-, and Criterion-Specific Meta-Analysis
The Success of Linear Bootstrapping Models : Decision Domain-, Expertise-, and Criterion-Specific Meta-Analysis
Date
2016
Authors
Wittmann, Werner W.
Editors
Journal ISSN
Electronic ISSN
ISBN
Bibliographical data
Publisher
Series
URI (citable link)
DOI (citable link)
International patent number
Link to the license
EU project number
Project
Open Access publication
Collections
Title in another language
Publication type
Journal article
Publication status
Published
Published in
PloS one ; 11 (2016), 6. - e0157914. - Public Library of Science (PLoS). - eISSN 1932-6203
Abstract
The success of bootstrapping or replacing a human judge with a model (e.g., an equation) has been demonstrated in Paul Meehl's (1954) seminal work and bolstered by the results of several meta-analyses. To date, however, analyses considering different types of meta-analyses as well as the potential dependence of bootstrapping success on the decision domain, the level of expertise of the human judge, and the criterion for what constitutes an accurate decision have been missing from the literature. In this study, we addressed these research gaps by conducting a meta-analysis of lens model studies. We compared the results of a traditional (bare-bones) meta-analysis with findings of a meta-analysis of the success of bootstrap models corrected for various methodological artifacts. In line with previous studies, we found that bootstrapping was more successful than human judgment. Furthermore, bootstrapping was more successful in studies with an objective decision criterion than in studies with subjective or test score criteria. We did not find clear evidence that the success of bootstrapping depended on the decision domain (e.g., education or medicine) or on the judge's level of expertise (novice or expert). Correction of methodological artifacts increased the estimated success of bootstrapping, suggesting that previous analyses without artifact correction (i.e., traditional meta-analyses) may have underestimated the value of bootstrapping models.
Summary in another language
Subject (DDC)
150 Psychology
Keywords
Conference
Review
undefined / . - undefined, undefined. - (undefined; undefined)
Cite This
ISO 690
KAUFMANN, Esther, Werner W. WITTMANN, 2016. The Success of Linear Bootstrapping Models : Decision Domain-, Expertise-, and Criterion-Specific Meta-Analysis. In: PloS one. Public Library of Science (PLoS). 11(6), e0157914. eISSN 1932-6203. Available under: doi: 10.1371/journal.pone.0157914BibTex
@article{Kaufmann2016Succe-55554, year={2016}, doi={10.1371/journal.pone.0157914}, title={The Success of Linear Bootstrapping Models : Decision Domain-, Expertise-, and Criterion-Specific Meta-Analysis}, number={6}, volume={11}, journal={PloS one}, author={Kaufmann, Esther and Wittmann, Werner W.}, note={Article Number: e0157914} }
RDF
<rdf:RDF xmlns:dcterms="http://purl.org/dc/terms/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:bibo="http://purl.org/ontology/bibo/" xmlns:dspace="http://digital-repositories.org/ontologies/dspace/0.1.0#" xmlns:foaf="http://xmlns.com/foaf/0.1/" xmlns:void="http://rdfs.org/ns/void#" xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > <rdf:Description rdf:about="https://kops.uni-konstanz.de/server/rdf/resource/123456789/55554"> <dc:rights>Attribution 4.0 International</dc:rights> <bibo:uri rdf:resource="https://kops.uni-konstanz.de/handle/123456789/55554"/> <dc:language>eng</dc:language> <dc:creator>Wittmann, Werner W.</dc:creator> <dc:creator>Kaufmann, Esther</dc:creator> <dcterms:rights rdf:resource="http://creativecommons.org/licenses/by/4.0/"/> <dc:contributor>Wittmann, Werner W.</dc:contributor> <dcterms:issued>2016</dcterms:issued> <dcterms:hasPart rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/55554/4/Kaufmann_2-b3n18fpkdo883.pdf"/> <dcterms:available rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2021-11-16T10:27:48Z</dcterms:available> <foaf:homepage rdf:resource="http://localhost:8080/"/> <dcterms:title>The Success of Linear Bootstrapping Models : Decision Domain-, Expertise-, and Criterion-Specific Meta-Analysis</dcterms:title> <dspace:hasBitstream rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/55554/4/Kaufmann_2-b3n18fpkdo883.pdf"/> <dc:date rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2021-11-16T10:27:48Z</dc:date> <dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/43"/> <dc:contributor>Kaufmann, Esther</dc:contributor> <dcterms:abstract xml:lang="eng">The success of bootstrapping or replacing a human judge with a model (e.g., an equation) has been demonstrated in Paul Meehl's (1954) seminal work and bolstered by the results of several meta-analyses. To date, however, analyses considering different types of meta-analyses as well as the potential dependence of bootstrapping success on the decision domain, the level of expertise of the human judge, and the criterion for what constitutes an accurate decision have been missing from the literature. In this study, we addressed these research gaps by conducting a meta-analysis of lens model studies. We compared the results of a traditional (bare-bones) meta-analysis with findings of a meta-analysis of the success of bootstrap models corrected for various methodological artifacts. In line with previous studies, we found that bootstrapping was more successful than human judgment. Furthermore, bootstrapping was more successful in studies with an objective decision criterion than in studies with subjective or test score criteria. We did not find clear evidence that the success of bootstrapping depended on the decision domain (e.g., education or medicine) or on the judge's level of expertise (novice or expert). Correction of methodological artifacts increased the estimated success of bootstrapping, suggesting that previous analyses without artifact correction (i.e., traditional meta-analyses) may have underestimated the value of bootstrapping models.</dcterms:abstract> <dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/43"/> <void:sparqlEndpoint rdf:resource="http://localhost/fuseki/dspace/sparql"/> </rdf:Description> </rdf:RDF>
Internal note
xmlui.Submission.submit.DescribeStep.inputForms.label.kops_note_fromSubmitter
Examination date of dissertation
Method of financing
Comment on publication
Alliance license
Corresponding Authors der Uni Konstanz vorhanden
International Co-Authors
Bibliography of Konstanz
No
Refereed
Yes