Stakes in the eye of the beholder : an international study of learners' perceptions within programmatic assessment

dc.contributor.authorSchut, Suzanne
dc.contributor.authorDriessen, Erik
dc.contributor.authorvan Tartwijk, Jan
dc.contributor.authorvan der Vleuten, Cees
dc.contributor.authorHeeneman, Sylvia
dc.date.accessioned2019-01-08T12:28:03Z
dc.date.available2019-01-08T12:28:03Z
dc.date.issued2018eng
dc.description.abstractObjectives

Within programmatic assessment, the ambition is to simultaneously optimise the feedback and the decision‐making function of assessment. In this approach, individual assessments are intended to be low stakes. In practice, however, learners often perceive assessments designed to be low stakes as high stakes. In this study, we explored how learners perceive assessment stakes within programmatic assessment and which factors influence these perceptions.

Methods

Twenty‐six learners were interviewed from three different countries and five different programmes, ranging from undergraduate to postgraduate medical education. The interviews explored learners’ experience with and perception of assessment stakes. An open and qualitative approach to data gathering and analyses inspired by the constructivist grounded theory approach was used to analyse the data and reveal underlying mechanisms influencing learners’ perceptions.

Results

Learners’ sense of control emerged from the analysis as key for understanding learners’ perception of assessment stakes. Several design factors of the assessment programme provided or hindered learners’ opportunities to exercise control over the assessment experience, mainly the opportunities to influence assessment outcomes, to collect evidence and to improve. Teacher–learner relationships that were characterised by learners’ autonomy and in which learners feel safe were important for learners’ believed ability to exercise control and to use assessment to support their learning.

Conclusions

Knowledge of the factors that influence the perception of assessment stakes can help design effective assessment programmes in which assessment supports learning. Learners’ opportunities for agency, a supportive programme structure and the role of the teacher are particularly powerful mechanisms to stimulate the learning value of programmatic assessment.
eng
dc.description.versionpublishedeng
dc.identifier.doi10.1111/medu.13532eng
dc.identifier.pmid29572920eng
dc.identifier.urihttps://kops.uni-konstanz.de/handle/123456789/44445
dc.language.isoengeng
dc.rightsAttribution-NonCommercial 4.0 International
dc.rights.urihttp://creativecommons.org/licenses/by-nc/4.0/
dc.subject.ddc370eng
dc.titleStakes in the eye of the beholder : an international study of learners' perceptions within programmatic assessmenteng
dc.typeJOURNAL_ARTICLEeng
dspace.entity.typePublication
kops.citation.bibtex
@article{Schut2018Stake-44445,
  year={2018},
  doi={10.1111/medu.13532},
  title={Stakes in the eye of the beholder : an international study of learners' perceptions within programmatic assessment},
  number={6},
  volume={52},
  issn={0308-0110},
  journal={Medical education},
  pages={654--663},
  author={Schut, Suzanne and Driessen, Erik and van Tartwijk, Jan and van der Vleuten, Cees and Heeneman, Sylvia}
}
kops.citation.iso690SCHUT, Suzanne, Erik DRIESSEN, Jan VAN TARTWIJK, Cees VAN DER VLEUTEN, Sylvia HEENEMAN, 2018. Stakes in the eye of the beholder : an international study of learners' perceptions within programmatic assessment. In: Medical education. 2018, 52(6), pp. 654-663. ISSN 0308-0110. eISSN 1365-2923. Available under: doi: 10.1111/medu.13532deu
kops.citation.iso690SCHUT, Suzanne, Erik DRIESSEN, Jan VAN TARTWIJK, Cees VAN DER VLEUTEN, Sylvia HEENEMAN, 2018. Stakes in the eye of the beholder : an international study of learners' perceptions within programmatic assessment. In: Medical education. 2018, 52(6), pp. 654-663. ISSN 0308-0110. eISSN 1365-2923. Available under: doi: 10.1111/medu.13532eng
kops.citation.rdf
<rdf:RDF
    xmlns:dcterms="http://purl.org/dc/terms/"
    xmlns:dc="http://purl.org/dc/elements/1.1/"
    xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
    xmlns:bibo="http://purl.org/ontology/bibo/"
    xmlns:dspace="http://digital-repositories.org/ontologies/dspace/0.1.0#"
    xmlns:foaf="http://xmlns.com/foaf/0.1/"
    xmlns:void="http://rdfs.org/ns/void#"
    xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > 
  <rdf:Description rdf:about="https://kops.uni-konstanz.de/server/rdf/resource/123456789/44445">
    <dcterms:rights rdf:resource="http://creativecommons.org/licenses/by-nc/4.0/"/>
    <dc:contributor>van der Vleuten, Cees</dc:contributor>
    <dc:creator>Schut, Suzanne</dc:creator>
    <dc:creator>Driessen, Erik</dc:creator>
    <dcterms:abstract xml:lang="eng">Objectives&lt;br /&gt;&lt;br /&gt;Within programmatic assessment, the ambition is to simultaneously optimise the feedback and the decision‐making function of assessment. In this approach, individual assessments are intended to be low stakes. In practice, however, learners often perceive assessments designed to be low stakes as high stakes. In this study, we explored how learners perceive assessment stakes within programmatic assessment and which factors influence these perceptions.&lt;br /&gt;&lt;br /&gt;Methods&lt;br /&gt;&lt;br /&gt;Twenty‐six learners were interviewed from three different countries and five different programmes, ranging from undergraduate to postgraduate medical education. The interviews explored learners’ experience with and perception of assessment stakes. An open and qualitative approach to data gathering and analyses inspired by the constructivist grounded theory approach was used to analyse the data and reveal underlying mechanisms influencing learners’ perceptions.&lt;br /&gt;&lt;br /&gt;Results&lt;br /&gt;&lt;br /&gt;Learners’ sense of control emerged from the analysis as key for understanding learners’ perception of assessment stakes. Several design factors of the assessment programme provided or hindered learners’ opportunities to exercise control over the assessment experience, mainly the opportunities to influence assessment outcomes, to collect evidence and to improve. Teacher–learner relationships that were characterised by learners’ autonomy and in which learners feel safe were important for learners’ believed ability to exercise control and to use assessment to support their learning.&lt;br /&gt;&lt;br /&gt;Conclusions&lt;br /&gt;&lt;br /&gt;Knowledge of the factors that influence the perception of assessment stakes can help design effective assessment programmes in which assessment supports learning. Learners’ opportunities for agency, a supportive programme structure and the role of the teacher are particularly powerful mechanisms to stimulate the learning value of programmatic assessment.</dcterms:abstract>
    <dc:contributor>Schut, Suzanne</dc:contributor>
    <dcterms:issued>2018</dcterms:issued>
    <void:sparqlEndpoint rdf:resource="http://localhost/fuseki/dspace/sparql"/>
    <foaf:homepage rdf:resource="http://localhost:8080/"/>
    <dc:date rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2019-01-08T12:28:03Z</dc:date>
    <dc:creator>Heeneman, Sylvia</dc:creator>
    <dc:rights>Attribution-NonCommercial 4.0 International</dc:rights>
    <bibo:uri rdf:resource="https://kops.uni-konstanz.de/handle/123456789/44445"/>
    <dc:contributor>Driessen, Erik</dc:contributor>
    <dc:creator>van Tartwijk, Jan</dc:creator>
    <dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/31"/>
    <dc:contributor>Heeneman, Sylvia</dc:contributor>
    <dcterms:available rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2019-01-08T12:28:03Z</dcterms:available>
    <dcterms:title>Stakes in the eye of the beholder : an international study of learners' perceptions within programmatic assessment</dcterms:title>
    <dc:contributor>van Tartwijk, Jan</dc:contributor>
    <dc:language>eng</dc:language>
    <dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/31"/>
    <dc:creator>van der Vleuten, Cees</dc:creator>
  </rdf:Description>
</rdf:RDF>
kops.description.openAccessopenaccesshybrideng
kops.flag.isPeerReviewedtrueeng
kops.sourcefieldMedical education. 2018, <b>52</b>(6), pp. 654-663. ISSN 0308-0110. eISSN 1365-2923. Available under: doi: 10.1111/medu.13532deu
kops.sourcefield.plainMedical education. 2018, 52(6), pp. 654-663. ISSN 0308-0110. eISSN 1365-2923. Available under: doi: 10.1111/medu.13532deu
kops.sourcefield.plainMedical education. 2018, 52(6), pp. 654-663. ISSN 0308-0110. eISSN 1365-2923. Available under: doi: 10.1111/medu.13532eng
relation.isAuthorOfPublicationa8592209-5ea6-4f02-8e3f-84865e3d3fc1
relation.isAuthorOfPublication.latestForDiscoverya8592209-5ea6-4f02-8e3f-84865e3d3fc1
source.bibliographicInfo.fromPage654eng
source.bibliographicInfo.issue6eng
source.bibliographicInfo.toPage663eng
source.bibliographicInfo.volume52eng
source.identifier.eissn1365-2923eng
source.identifier.issn0308-0110eng
source.periodicalTitleMedical educationeng

Dateien