SpeechEval – Evaluating Spoken Dialog Systems by User Simulation

No Thumbnail Available
Files
There are no files associated with this item.
Date
2009
Authors
Roller, Roland
Reithinger, Norbert
Editors
Contact
Journal ISSN
Electronic ISSN
ISBN
Bibliographical data
Publisher
Series
URI (citable link)
DOI (citable link)
ArXiv-ID
International patent number
Link to the license
EU project number
Project
Open Access publication
Collections
Restricted until
Title in another language
Research Projects
Organizational Units
Journal Issue
Publication type
Contribution to a conference collection
Publication status
Published in
Twenty-first Innovative Applications of Artificial Intelligence Conference (IAAI) : July 14 - 16, 2009, Pasadena, California, USA ; 6th IJCAI Workshop on Knowledge and Reasoning in Practical Dialog / Jönsson, Arne et al. (ed.). - pp. 93-98
Abstract
In this paper, we introduce the SpeechEval system, a platform for the automatic evaluation of spoken dialog systems on the basis of learned user strategies. The increasing number of spoken dialog systems calls for efficient approaches for their development and testing. The goal of SpeechEval is the minimization of hand-crafted resources to maximize the portability of this evaluation environment across spoken dialog systems and domains. In this paper we discuss the architecture of SpeechEval, as well as the user simulation technique which allows us to learn general user strategies from a new corpus. We present this corpus, the VOICE Awards human-machine dialog corpus, and show how this corpus is used to semi-automatically extract the resources and knowledge bases on which SpeechEval is based.
Summary in another language
Subject (DDC)
400 Philology, Linguistics
Keywords
Conference
6th IJCAI Workshop on Knowledge and Reasoning in Practical Dialog, Jul 14, 2009 - Jul 16, 2009, Pasadena, California, USA
Review
undefined / . - undefined, undefined. - (undefined; undefined)
Cite This
ISO 690SCHEFFLER, Tatjana, Roland ROLLER, Norbert REITHINGER, 2009. SpeechEval – Evaluating Spoken Dialog Systems by User Simulation. 6th IJCAI Workshop on Knowledge and Reasoning in Practical Dialog. Pasadena, California, USA, Jul 14, 2009 - Jul 16, 2009. In: JÖNSSON, Arne, ed. and others. Twenty-first Innovative Applications of Artificial Intelligence Conference (IAAI) : July 14 - 16, 2009, Pasadena, California, USA ; 6th IJCAI Workshop on Knowledge and Reasoning in Practical Dialog, pp. 93-98
BibTex
@inproceedings{Scheffler2009Speec-29035,
  year={2009},
  title={SpeechEval – Evaluating Spoken Dialog Systems by User Simulation},
  booktitle={Twenty-first Innovative Applications of Artificial Intelligence Conference (IAAI) : July 14 - 16, 2009, Pasadena, California, USA ; 6th IJCAI Workshop on Knowledge and Reasoning in Practical Dialog},
  pages={93--98},
  editor={Jönsson, Arne},
  author={Scheffler, Tatjana and Roller, Roland and Reithinger, Norbert},
  note={Link zur Originalveröffentlichung: <br /> http://www.ida.liu.se/~arnjo/Ijcai09ws/proceedings.pdf}
}
RDF
<rdf:RDF
    xmlns:dcterms="http://purl.org/dc/terms/"
    xmlns:dc="http://purl.org/dc/elements/1.1/"
    xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
    xmlns:bibo="http://purl.org/ontology/bibo/"
    xmlns:dspace="http://digital-repositories.org/ontologies/dspace/0.1.0#"
    xmlns:foaf="http://xmlns.com/foaf/0.1/"
    xmlns:void="http://rdfs.org/ns/void#"
    xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > 
  <rdf:Description rdf:about="https://kops.uni-konstanz.de/server/rdf/resource/123456789/29035">
    <foaf:homepage rdf:resource="http://localhost:8080/"/>
    <dc:creator>Reithinger, Norbert</dc:creator>
    <dc:contributor>Roller, Roland</dc:contributor>
    <dc:contributor>Reithinger, Norbert</dc:contributor>
    <dcterms:available rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2014-09-30T14:05:27Z</dcterms:available>
    <bibo:uri rdf:resource="http://kops.uni-konstanz.de/handle/123456789/29035"/>
    <dc:creator>Scheffler, Tatjana</dc:creator>
    <dc:creator>Roller, Roland</dc:creator>
    <dcterms:issued>2009</dcterms:issued>
    <dcterms:bibliographicCitation>Twenty-first Innovative Applications of Artificial Intelligence Conference (IAAI) : July 14-16, 2009, Pasadena, California, USA ; 6th IJCAI Workshop on Knowledge and Reasoning in Practical Dialog / ed. by Arne Jönsson ... - S. 93-98</dcterms:bibliographicCitation>
    <dc:rights>terms-of-use</dc:rights>
    <dc:contributor>Scheffler, Tatjana</dc:contributor>
    <dc:language>eng</dc:language>
    <dc:date rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2014-09-30T14:05:27Z</dc:date>
    <dcterms:abstract xml:lang="eng">In this paper, we introduce the SpeechEval system, a platform for the automatic evaluation of spoken dialog systems on the basis of learned user strategies. The increasing number of spoken dialog systems calls for efficient approaches for their development and testing. The goal of SpeechEval is the minimization of hand-crafted resources to maximize the portability of this evaluation environment across spoken dialog systems and domains. In this paper we discuss the architecture of SpeechEval, as well as the user simulation technique which allows us to learn general user strategies from a new corpus. We present this corpus, the VOICE Awards human-machine dialog corpus, and show how this corpus is used to semi-automatically extract the resources and knowledge bases on which SpeechEval is based.</dcterms:abstract>
    <dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/45"/>
    <dcterms:rights rdf:resource="https://rightsstatements.org/page/InC/1.0/"/>
    <dcterms:title>SpeechEval – Evaluating Spoken Dialog Systems by User Simulation</dcterms:title>
    <void:sparqlEndpoint rdf:resource="http://localhost/fuseki/dspace/sparql"/>
    <dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/45"/>
  </rdf:Description>
</rdf:RDF>
Internal note
xmlui.Submission.submit.DescribeStep.inputForms.label.kops_note_fromSubmitter
Contact
URL of original publication
Test date of URL
Examination date of dissertation
Method of financing
Comment on publication
Link zur Originalveröffentlichung:
http://www.ida.liu.se/~arnjo/Ijcai09ws/proceedings.pdf
Alliance license
Corresponding Authors der Uni Konstanz vorhanden
International Co-Authors
Bibliography of Konstanz
No
Refereed