KOPS - Das Institutionelle Repositorium der Universität Konstanz

How to assess and compare inter-rater reliability, agreement and correlation of ratings : an exemplary analysis of mother-father and parent-teacher expressive vocabulary rating pairs

How to assess and compare inter-rater reliability, agreement and correlation of ratings : an exemplary analysis of mother-father and parent-teacher expressive vocabulary rating pairs

Zitieren

Dateien zu dieser Ressource

Prüfsumme: MD5:21f316216d5c2d5bb538700ffd773986

STOLAROVA, Margarita, Corinna WOLF, Tanja RINKER, Aenne BRIELMANN, 2014. How to assess and compare inter-rater reliability, agreement and correlation of ratings : an exemplary analysis of mother-father and parent-teacher expressive vocabulary rating pairs. In: Frontiers in Psychology. 5, 509. eISSN 1664-1078

@article{Stolarova2014asses-28067, title={How to assess and compare inter-rater reliability, agreement and correlation of ratings : an exemplary analysis of mother-father and parent-teacher expressive vocabulary rating pairs}, year={2014}, doi={10.3389/fpsyg.2014.00509}, volume={5}, journal={Frontiers in Psychology}, author={Stolarova, Margarita and Wolf, Corinna and Rinker, Tanja and Brielmann, Aenne}, note={Article Number: 509} }

<rdf:RDF xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:bibo="http://purl.org/ontology/bibo/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:dcterms="http://purl.org/dc/terms/" xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > <rdf:Description rdf:about="https://kops.uni-konstanz.de/rdf/resource/123456789/28067"> <dcterms:issued>2014</dcterms:issued> <dcterms:rights rdf:resource="http://nbn-resolving.org/urn:nbn:de:bsz:352-20140905103605204-4002607-1"/> <dc:creator>Brielmann, Aenne</dc:creator> <dcterms:bibliographicCitation>Frontiers in quantitative psychology and measurement ; 5 (2014). - 509</dcterms:bibliographicCitation> <dc:contributor>Wolf, Corinna</dc:contributor> <dc:creator>Rinker, Tanja</dc:creator> <dc:contributor>Brielmann, Aenne</dc:contributor> <dcterms:available rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2014-06-13T06:48:48Z</dcterms:available> <dc:rights>deposit-license</dc:rights> <dc:language>eng</dc:language> <dc:creator>Wolf, Corinna</dc:creator> <dc:contributor>Stolarova, Margarita</dc:contributor> <dc:creator>Stolarova, Margarita</dc:creator> <dc:contributor>Rinker, Tanja</dc:contributor> <dcterms:title>How to assess and compare inter-rater reliability, agreement and correlation of ratings : an exemplary analysis of mother-father and parent-teacher expressive vocabulary rating pairs</dcterms:title> <bibo:uri rdf:resource="http://kops.uni-konstanz.de/handle/123456789/28067"/> <dcterms:abstract xml:lang="eng">This report has two main purposes. First, we combine well-known analytical approaches to conduct a comprehensive assessment of agreement and correlation of rating-pairs and to dis-entangle these often confused concepts, providing a best-practice example on concrete data and a tutorial for future reference. Second, we explore whether a screening questionnaire developed for use with parents can be reliably employed with daycare teachers when assessing early expressive vocabulary. A total of 53 vocabulary rating pairs (34 parent–teacher and 19 mother–father pairs) collected for two-year-old children (12 bilingual) are evaluated. First, inter-rater reliability both within and across subgroups is assessed using the intra-class correlation coefficient (ICC). Next, based on this analysis of reliability and on the test-retest reliability of the employed tool, inter-rater agreement is analyzed, magnitude and direction of rating differences are considered. Finally, Pearson correlation coefficients of standardized vocabulary scores are calculated and compared across subgroups. The results underline the necessity to distinguish between reliability measures, agreement and correlation. They also demonstrate the impact of the employed reliability on agreement evaluations. This study provides evidence that parent–teacher ratings of children's early vocabulary can achieve agreement and correlation comparable to those of mother–father ratings on the assessed vocabulary scale. Bilingualism of the evaluated child decreased the likelihood of raters' agreement. We conclude that future reports of agreement, correlation and reliability of ratings will benefit from better definition of terms and stricter methodological approaches. The methodological tutorial provided here holds the potential to increase comparability across empirical reports and can help improve research practices and knowledge transfer to educational and therapeutic settings.</dcterms:abstract> <dc:date rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2014-06-13T06:48:48Z</dc:date> </rdf:Description> </rdf:RDF>

Dateiabrufe seit 01.10.2014 (Informationen über die Zugriffsstatistik)

Stolarova_280676.pdf 285

Das Dokument erscheint in:

KOPS Suche


Stöbern

Mein Benutzerkonto