Avoiding Methodological Biases in Meta-Analysis : Use of Online Versus Offline Individual Participant Data (IPD) in Educational Psychology

Loading...
Thumbnail Image
Date
2016
Authors
Editors
Contact
Journal ISSN
Electronic ISSN
ISBN
Bibliographical data
Publisher
Series
DOI (citable link)
ArXiv-ID
International patent number
Link to the license
EU project number
Project
Open Access publication
Restricted until
Title in another language
Research Projects
Organizational Units
Journal Issue
Publication type
Journal article
Publication status
Published
Published in
Zeitschrift für Psychologie ; 224 (2016), 3. - pp. 157-167. - ISSN 2190-8370. - eISSN 2151-2604
Abstract
Individual participant data (IPD) meta-analysis is the gold standard of meta-analyses. This paper points out several advantages of IPD meta-analysis over classical meta-analysis, such as avoiding aggregation bias (e.g., ecological fallacy or Simpson’s paradox) and shows how its two main disadvantages (time and cost) can be overcome through Internet-based research. Ideally, we recommend carrying out IPD meta-analyses that consider online versus offline data gathering processes and examine data quality. Through a comprehensive literature search, we investigated whether IPD meta-analyses published in the field of educational psychology already follow these recommendations; this was not the case. For this reason, the paper demonstrates characteristics of ideal meta-analysis on teachers’ judgment accuracy and links it to recent meta-analyses on that topic. The recommendations are important for meta-analysis researchers and for readers and reviewers of meta-analyses. Our paper is also relevant to current discussions within the psychological community on study replication.
Summary in another language
Subject (DDC)
150 Psychology
Keywords
meta-analysis, ecological fallacy, online versus offline, Simpson’s paradox, replication
Conference
Review
undefined / . - undefined, undefined. - (undefined; undefined)
Cite This
ISO 690KAUFMANN, Esther, Ulf-Dietrich REIPS, Katharina MAAG MERKI, 2016. Avoiding Methodological Biases in Meta-Analysis : Use of Online Versus Offline Individual Participant Data (IPD) in Educational Psychology. In: Zeitschrift für Psychologie. 224(3), pp. 157-167. ISSN 2190-8370. eISSN 2151-2604. Available under: doi: 10.1027/2151-2604/a000251
BibTex
@article{Kaufmann2016Avoid-37665,
  year={2016},
  doi={10.1027/2151-2604/a000251},
  title={Avoiding Methodological Biases in Meta-Analysis : Use of Online Versus Offline Individual Participant Data (IPD) in Educational Psychology},
  number={3},
  volume={224},
  issn={2190-8370},
  journal={Zeitschrift für Psychologie},
  pages={157--167},
  author={Kaufmann, Esther and Reips, Ulf-Dietrich and Maag Merki, Katharina}
}
RDF
<rdf:RDF
    xmlns:dcterms="http://purl.org/dc/terms/"
    xmlns:dc="http://purl.org/dc/elements/1.1/"
    xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
    xmlns:bibo="http://purl.org/ontology/bibo/"
    xmlns:dspace="http://digital-repositories.org/ontologies/dspace/0.1.0#"
    xmlns:foaf="http://xmlns.com/foaf/0.1/"
    xmlns:void="http://rdfs.org/ns/void#"
    xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > 
  <rdf:Description rdf:about="https://kops.uni-konstanz.de/server/rdf/resource/123456789/37665">
    <void:sparqlEndpoint rdf:resource="http://localhost/fuseki/dspace/sparql"/>
    <foaf:homepage rdf:resource="http://localhost:8080/"/>
    <dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/46"/>
    <dc:date rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2017-02-22T10:02:30Z</dc:date>
    <dc:creator>Kaufmann, Esther</dc:creator>
    <dc:creator>Reips, Ulf-Dietrich</dc:creator>
    <dc:contributor>Reips, Ulf-Dietrich</dc:contributor>
    <dc:contributor>Maag Merki, Katharina</dc:contributor>
    <dc:contributor>Kaufmann, Esther</dc:contributor>
    <dcterms:available rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2017-02-22T10:02:30Z</dcterms:available>
    <dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/43"/>
    <dcterms:title>Avoiding Methodological Biases in Meta-Analysis : Use of Online Versus Offline Individual Participant Data (IPD) in Educational Psychology</dcterms:title>
    <dc:language>eng</dc:language>
    <dc:rights>terms-of-use</dc:rights>
    <dcterms:hasPart rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/37665/1/Kaufmann_2-c5qggipnml9p2.pdf"/>
    <dcterms:abstract xml:lang="eng">Individual participant data (IPD) meta-analysis is the gold standard of meta-analyses. This paper points out several advantages of IPD meta-analysis over classical meta-analysis, such as avoiding aggregation bias (e.g., ecological fallacy or Simpson’s paradox) and shows how its two main disadvantages (time and cost) can be overcome through Internet-based research. Ideally, we recommend carrying out IPD meta-analyses that consider online versus offline data gathering processes and examine data quality. Through a comprehensive literature search, we investigated whether IPD meta-analyses published in the field of educational psychology already follow these recommendations; this was not the case. For this reason, the paper demonstrates characteristics of ideal meta-analysis on teachers’ judgment accuracy and links it to recent meta-analyses on that topic. The recommendations are important for meta-analysis researchers and for readers and reviewers of meta-analyses. Our paper is also relevant to current discussions within the psychological community on study replication.</dcterms:abstract>
    <bibo:uri rdf:resource="https://kops.uni-konstanz.de/handle/123456789/37665"/>
    <dc:creator>Maag Merki, Katharina</dc:creator>
    <dspace:hasBitstream rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/37665/1/Kaufmann_2-c5qggipnml9p2.pdf"/>
    <dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/43"/>
    <dcterms:rights rdf:resource="https://rightsstatements.org/page/InC/1.0/"/>
    <dcterms:issued>2016</dcterms:issued>
    <dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/46"/>
  </rdf:Description>
</rdf:RDF>
Internal note
xmlui.Submission.submit.DescribeStep.inputForms.label.kops_note_fromSubmitter
Contact
URL of original publication
Test date of URL
Examination date of dissertation
Method of financing
Comment on publication
Alliance license
Corresponding Authors der Uni Konstanz vorhanden
International Co-Authors
Bibliography of Konstanz
Yes
Refereed