KonTra at CMCL 2021 Shared Task : Predicting Eye Movements by Combining BERT with Surface, Linguistic and Behavioral Information

Yu, Qi; Kalouli, Aikaterini-Lida; Frassinelli, Diego

KonTra at CMCL 2021 Shared Task : Predicting Eye Movements by Combining BERT with Surface, Linguistic and Behavioral Information

Dateien

Zu diesem Dokument gibt es keine Dateien.

Datum

2021

Publikationstyp

Beitrag zu einem Konferenzband

Publikationsstatus

Published

Erschienen in

CHERSONI, Emmanuele, ed., Nora HOLLENSTEIN, ed., Cassandra JACOBS, ed. and others. Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics. Stroudsburg, PA: ACL, 2021, pp. 120-124. ISBN 978-1-954085-35-0. Available under: doi: 10.18653/v1/2021.cmcl-1.15

Zusammenfassung

This paper describes the submission of the team KonTra to the CMCL 2021 Shared Task on eye-tracking prediction. Our system combines the embeddings extracted from a fine-tuned BERT model with surface, linguistic and behavioral features, resulting in an average mean absolute error of 4.22 across all 5 eye-tracking measures. We show that word length and features representing the expectedness of a word are consistently the strongest predictors across all 5 eye-tracking measures.

Fachgebiet (DDC)

400 Sprachwissenschaft, Linguistik

Konferenz

Workshop on Cognitive Modeling and Computational Linguistics (Online), 10. Juni 2021

Zitieren

ISO 690

YU, Qi, Aikaterini-Lida KALOULI, Diego FRASSINELLI, 2021. KonTra at CMCL 2021 Shared Task : Predicting Eye Movements by Combining BERT with Surface, Linguistic and Behavioral Information. Workshop on Cognitive Modeling and Computational Linguistics (Online), 10. Juni 2021. In: CHERSONI, Emmanuele, ed., Nora HOLLENSTEIN, ed., Cassandra JACOBS, ed. and others. Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics. Stroudsburg, PA: ACL, 2021, pp. 120-124. ISBN 978-1-954085-35-0. Available under: doi: 10.18653/v1/2021.cmcl-1.15

BibTex

@inproceedings{Yu2021KonTr-54528,
  year={2021},
  doi={10.18653/v1/2021.cmcl-1.15},
  title={KonTra at CMCL 2021 Shared Task : Predicting Eye Movements by Combining BERT with Surface, Linguistic and Behavioral Information},
  isbn={978-1-954085-35-0},
  publisher={ACL},
  address={Stroudsburg, PA},
  booktitle={Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics},
  pages={120--124},
  editor={Chersoni, Emmanuele and Hollenstein, Nora and Jacobs, Cassandra},
  author={Yu, Qi and Kalouli, Aikaterini-Lida and Frassinelli, Diego}
}

RDF

<rdf:RDF
    xmlns:dcterms="http://purl.org/dc/terms/"
    xmlns:dc="http://purl.org/dc/elements/1.1/"
    xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
    xmlns:bibo="http://purl.org/ontology/bibo/"
    xmlns:dspace="http://digital-repositories.org/ontologies/dspace/0.1.0#"
    xmlns:foaf="http://xmlns.com/foaf/0.1/"
    xmlns:void="http://rdfs.org/ns/void#"
    xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > 
  <rdf:Description rdf:about="https://kops.uni-konstanz.de/server/rdf/resource/123456789/54528">
    <dc:creator>Kalouli, Aikaterini-Lida</dc:creator>
    <dc:contributor>Kalouli, Aikaterini-Lida</dc:contributor>
    <dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/45"/>
    <dc:contributor>Frassinelli, Diego</dc:contributor>
    <dc:rights>terms-of-use</dc:rights>
    <dcterms:available rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2021-08-10T11:55:43Z</dcterms:available>
    <dcterms:issued>2021</dcterms:issued>
    <dc:creator>Frassinelli, Diego</dc:creator>
    <dcterms:title>KonTra at CMCL 2021 Shared Task : Predicting Eye Movements by Combining BERT with Surface, Linguistic and Behavioral Information</dcterms:title>
    <dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/45"/>
    <dc:language>eng</dc:language>
    <dc:date rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2021-08-10T11:55:43Z</dc:date>
    <foaf:homepage rdf:resource="http://localhost:8080/"/>
    <void:sparqlEndpoint rdf:resource="http://localhost/fuseki/dspace/sparql"/>
    <dcterms:abstract xml:lang="eng">This paper describes the submission of the team KonTra to the CMCL 2021 Shared Task on eye-tracking prediction. Our system combines the embeddings extracted from a fine-tuned BERT model with surface, linguistic and behavioral features, resulting in an average mean absolute error of 4.22 across all 5 eye-tracking measures. We show that word length and features representing the expectedness of a word are consistently the strongest predictors across all 5 eye-tracking measures.</dcterms:abstract>
    <dc:creator>Yu, Qi</dc:creator>
    <dc:contributor>Yu, Qi</dc:contributor>
    <bibo:uri rdf:resource="https://kops.uni-konstanz.de/handle/123456789/54528"/>
    <dcterms:rights rdf:resource="https://rightsstatements.org/page/InC/1.0/"/>
  </rdf:Description>
</rdf:RDF>

Universitätsbibliographie

Ja