Publikation:

SpeechEval : A Domain-Independent User Simulation Platform for Spoken Dialog System Evaluation

Vorschaubild

Dateien

Zu diesem Dokument gibt es keine Dateien.

Datum

2011

Autor:innen

Roller, Roland
Reithinger, Norbert

Herausgeber:innen

Kontakt

ISSN der Zeitschrift

Electronic ISSN

ISBN

Bibliografische Daten

Verlag

Schriftenreihe

Auflagebezeichnung

URI (zitierfähiger Link)
http://nbn-resolving.de/urn:nbn:de:bsz:352-290246
DOI (zitierfähiger Link)
https://doi.org/10.1007/978-1-4614-1335-6_29
ArXiv-ID

Internationale Patentnummer

Angaben zur Forschungsförderung

Projekt

Open Access-Veröffentlichung

Sammlungen

Linguistik: Publikationen
Core Facility der Universität Konstanz

Gesperrt bis

Titel in einer weiteren Sprache

Publikationstyp
Beitrag zu einem Konferenzband
Publikationsstatus
Published

Erschienen in

DELGADO, Ramón López-Cózar, ed., Tetsunori KOBAYASHI, ed.. Proceedings of the Paralinguistic Information and its Integration in Spoken Dialogue Systems Workshop. New York, NY: Springer New York, 2011, pp. 295-300. ISBN 978-1-4614-1334-9. Available under: doi: 10.1007/978-1-4614-1335-6_29

Zusammenfassung

In this paper, we present the SpeechEval user simulation platform for spoken dialog system (SDS) evaluation. Our user simulation realizes a complete end-to-end user test system with spoken input and output that calls speech-based dialog systems via telephone, and is intended to be used in the development and evaluation of real-life SDSs. We give an overview of the system architecture and present the results of applying our approach to two different kinds of systems in two domains.

User simulations for SDS are developed for many different purposes, often to test or train specific system components, like dialog manager, language model or the speech recognition itself. Many user simulations are developed in the context of research systems, which differ from commercially used systems in many aspects. In contrast, our user simulation uses a speech interface, can be carried over to new domains easily by learning characteristics of user behavior from a corpus, and treats the evaluated SDS as a black box.

Zusammenfassung in einer weiteren Sprache

Fachgebiet (DDC)
400 Sprachwissenschaft, Linguistik

Schlagwörter

Konferenz

Rezension
undefined / . - undefined, undefined

Forschungsvorhaben

Organisationseinheiten

Zeitschriftenheft

Zugehörige Datensätze in KOPS

Zitieren

ISO 690SCHEFFLER, Tatjana, Roland ROLLER, Norbert REITHINGER, 2011. SpeechEval : A Domain-Independent User Simulation Platform for Spoken Dialog System Evaluation. In: DELGADO, Ramón López-Cózar, ed., Tetsunori KOBAYASHI, ed.. Proceedings of the Paralinguistic Information and its Integration in Spoken Dialogue Systems Workshop. New York, NY: Springer New York, 2011, pp. 295-300. ISBN 978-1-4614-1334-9. Available under: doi: 10.1007/978-1-4614-1335-6_29
BibTex
@inproceedings{Scheffler2011-08-12Speec-29024,
  year={2011},
  doi={10.1007/978-1-4614-1335-6_29},
  title={SpeechEval : A Domain-Independent User Simulation Platform for Spoken Dialog System Evaluation},
  isbn={978-1-4614-1334-9},
  publisher={Springer New York},
  address={New York, NY},
  booktitle={Proceedings of the Paralinguistic Information and its Integration in Spoken Dialogue Systems Workshop},
  pages={295--300},
  editor={Delgado, Ramón López-Cózar and Kobayashi, Tetsunori},
  author={Scheffler, Tatjana and Roller, Roland and Reithinger, Norbert}
}
RDF
<rdf:RDF
    xmlns:dcterms="http://purl.org/dc/terms/"
    xmlns:dc="http://purl.org/dc/elements/1.1/"
    xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
    xmlns:bibo="http://purl.org/ontology/bibo/"
    xmlns:dspace="http://digital-repositories.org/ontologies/dspace/0.1.0#"
    xmlns:foaf="http://xmlns.com/foaf/0.1/"
    xmlns:void="http://rdfs.org/ns/void#"
    xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > 
  <rdf:Description rdf:about="https://kops.uni-konstanz.de/server/rdf/resource/123456789/29024">
    <dcterms:bibliographicCitation>Proceedings of the Paralinguistic Information and its Integration in Spoken Dialogue Systems Workshop / ed. by Ramón López-Cózar Delgado ... - New York, NY : Springer, 2011. - S. 295-300. - ISBN 978-1-4614-1334-9</dcterms:bibliographicCitation>
    <dc:contributor>Roller, Roland</dc:contributor>
    <dc:language>eng</dc:language>
    <dc:creator>Scheffler, Tatjana</dc:creator>
    <dc:creator>Reithinger, Norbert</dc:creator>
    <dc:contributor>Scheffler, Tatjana</dc:contributor>
    <dc:contributor>Reithinger, Norbert</dc:contributor>
    <dc:creator>Roller, Roland</dc:creator>
    <dc:rights>terms-of-use</dc:rights>
    <bibo:uri rdf:resource="http://kops.uni-konstanz.de/handle/123456789/29024"/>
    <dcterms:available rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2014-09-30T13:33:45Z</dcterms:available>
    <foaf:homepage rdf:resource="http://localhost:8080/"/>
    <void:sparqlEndpoint rdf:resource="http://localhost/fuseki/dspace/sparql"/>
    <dcterms:title>SpeechEval : A Domain-Independent User Simulation Platform for Spoken Dialog System Evaluation</dcterms:title>
    <dc:date rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2014-09-30T13:33:45Z</dc:date>
    <dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/45"/>
    <dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/45"/>
    <dcterms:abstract xml:lang="eng">In this paper, we present the SpeechEval user simulation platform for spoken dialog system (SDS) evaluation. Our user simulation realizes a complete end-to-end user test system with spoken input and output that calls speech-based dialog systems via telephone, and is intended to be used in the development and evaluation of real-life SDSs. We give an overview of the system architecture and present the results of applying our approach to two different kinds of systems in two domains.&lt;br /&gt;&lt;br /&gt;User simulations for SDS are developed for many different purposes, often to test or train specific system components, like dialog manager, language model or the speech recognition itself. Many user simulations are developed in the context of research systems, which differ from commercially used systems in many aspects. In contrast, our user simulation uses a speech interface, can be carried over to new domains easily by learning characteristics of user behavior from a corpus, and treats the evaluated SDS as a black box.</dcterms:abstract>
    <dcterms:rights rdf:resource="https://rightsstatements.org/page/InC/1.0/"/>
    <dcterms:issued>2011-08-12</dcterms:issued>
  </rdf:Description>
</rdf:RDF>

Interner Vermerk

xmlui.Submission.submit.DescribeStep.inputForms.label.kops_note_fromSubmitter

Kontakt
URL der Originalveröffentl.

Prüfdatum der URL

Prüfungsdatum der Dissertation

Finanzierungsart

Kommentar zur Publikation

Allianzlizenz
Corresponding Authors der Uni Konstanz vorhanden
Internationale Co-Autor:innen
Universitätsbibliographie
Nein
Begutachtet
Diese Publikation teilen