SpeechEval – Evaluating Spoken Dialog Systems by User Simulation

Scheffler, Tatjana; Roller, Roland; Reithinger, Norbert

SpeechEval – Evaluating Spoken Dialog Systems by User Simulation

Dateien

Zu diesem Dokument gibt es keine Dateien.

Datum

2009

Autor:innen

Scheffler, Tatjana

Roller, Roland

Reithinger, Norbert

URI (zitierfähiger Link)

http://nbn-resolving.de/urn:nbn:de:bsz:352-290357

Sammlungen

Linguistik

Publikationstyp

Beitrag zu einem Konferenzband

Publikationsstatus

Published

Erschienen in

JÖNSSON, Arne, ed. and others. Twenty-first Innovative Applications of Artificial Intelligence Conference (IAAI) : July 14 - 16, 2009, Pasadena, California, USA ; 6th IJCAI Workshop on Knowledge and Reasoning in Practical Dialog. 2009, pp. 93-98

Zusammenfassung

In this paper, we introduce the SpeechEval system, a platform for the automatic evaluation of spoken dialog systems on the basis of learned user strategies. The increasing number of spoken dialog systems calls for efficient approaches for their development and testing. The goal of SpeechEval is the minimization of hand-crafted resources to maximize the portability of this evaluation environment across spoken dialog systems and domains. In this paper we discuss the architecture of SpeechEval, as well as the user simulation technique which allows us to learn general user strategies from a new corpus. We present this corpus, the VOICE Awards human-machine dialog corpus, and show how this corpus is used to semi-automatically extract the resources and knowledge bases on which SpeechEval is based.

Fachgebiet (DDC)

400 Sprachwissenschaft, Linguistik

Konferenz

6th IJCAI Workshop on Knowledge and Reasoning in Practical Dialog, 14. Juli 2009 - 16. Juli 2009, Pasadena, California, USA

Zitieren

ISO 690

SCHEFFLER, Tatjana, Roland ROLLER, Norbert REITHINGER, 2009. SpeechEval – Evaluating Spoken Dialog Systems by User Simulation. 6th IJCAI Workshop on Knowledge and Reasoning in Practical Dialog. Pasadena, California, USA, 14. Juli 2009 - 16. Juli 2009. In: JÖNSSON, Arne, ed. and others. Twenty-first Innovative Applications of Artificial Intelligence Conference (IAAI) : July 14 - 16, 2009, Pasadena, California, USA ; 6th IJCAI Workshop on Knowledge and Reasoning in Practical Dialog. 2009, pp. 93-98

BibTex

@inproceedings{Scheffler2009Speec-29035,
  year={2009},
  title={SpeechEval – Evaluating Spoken Dialog Systems by User Simulation},
  booktitle={Twenty-first Innovative Applications of Artificial Intelligence Conference (IAAI) : July 14 - 16, 2009, Pasadena, California, USA ; 6th IJCAI Workshop on Knowledge and Reasoning in Practical Dialog},
  pages={93--98},
  editor={Jönsson, Arne},
  author={Scheffler, Tatjana and Roller, Roland and Reithinger, Norbert},
  note={Link zur Originalveröffentlichung: <br /> http://www.ida.liu.se/~arnjo/Ijcai09ws/proceedings.pdf}
}

RDF

<rdf:RDF
    xmlns:dcterms="http://purl.org/dc/terms/"
    xmlns:dc="http://purl.org/dc/elements/1.1/"
    xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
    xmlns:bibo="http://purl.org/ontology/bibo/"
    xmlns:dspace="http://digital-repositories.org/ontologies/dspace/0.1.0#"
    xmlns:foaf="http://xmlns.com/foaf/0.1/"
    xmlns:void="http://rdfs.org/ns/void#"
    xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > 
  <rdf:Description rdf:about="https://kops.uni-konstanz.de/server/rdf/resource/123456789/29035">
    <foaf:homepage rdf:resource="http://localhost:8080/"/>
    <dc:creator>Reithinger, Norbert</dc:creator>
    <dc:contributor>Roller, Roland</dc:contributor>
    <dc:contributor>Reithinger, Norbert</dc:contributor>
    <dcterms:available rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2014-09-30T14:05:27Z</dcterms:available>
    <bibo:uri rdf:resource="http://kops.uni-konstanz.de/handle/123456789/29035"/>
    <dc:creator>Scheffler, Tatjana</dc:creator>
    <dc:creator>Roller, Roland</dc:creator>
    <dcterms:issued>2009</dcterms:issued>
    <dcterms:bibliographicCitation>Twenty-first Innovative Applications of Artificial Intelligence Conference (IAAI) : July 14-16, 2009, Pasadena, California, USA ; 6th IJCAI Workshop on Knowledge and Reasoning in Practical Dialog / ed. by Arne Jönsson ... - S. 93-98</dcterms:bibliographicCitation>
    <dc:rights>terms-of-use</dc:rights>
    <dc:contributor>Scheffler, Tatjana</dc:contributor>
    <dc:language>eng</dc:language>
    <dc:date rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2014-09-30T14:05:27Z</dc:date>
    <dcterms:abstract xml:lang="eng">In this paper, we introduce the SpeechEval system, a platform for the automatic evaluation of spoken dialog systems on the basis of learned user strategies. The increasing number of spoken dialog systems calls for efficient approaches for their development and testing. The goal of SpeechEval is the minimization of hand-crafted resources to maximize the portability of this evaluation environment across spoken dialog systems and domains. In this paper we discuss the architecture of SpeechEval, as well as the user simulation technique which allows us to learn general user strategies from a new corpus. We present this corpus, the VOICE Awards human-machine dialog corpus, and show how this corpus is used to semi-automatically extract the resources and knowledge bases on which SpeechEval is based.</dcterms:abstract>
    <dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/45"/>
    <dcterms:rights rdf:resource="https://rightsstatements.org/page/InC/1.0/"/>
    <dcterms:title>SpeechEval – Evaluating Spoken Dialog Systems by User Simulation</dcterms:title>
    <void:sparqlEndpoint rdf:resource="http://localhost/fuseki/dspace/sparql"/>
    <dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/45"/>
  </rdf:Description>
</rdf:RDF>

Kommentar zur Publikation

Link zur Originalveröffentlichung:
http://www.ida.liu.se/~arnjo/Ijcai09ws/proceedings.pdf

Universitätsbibliographie

Nein