Neue Suche
Journalartikel - Wissenschaftlicher Artikel | | aktuell nicht Peer reviewed

Conversational Agents: A Framework for Evaluation (CAFE) (Dagstuhl Perspectives Workshop 24352)

Autor*innen
Bauer, Christine ; Chen, Li ; Ferro, Nicola ; Fuhr, Norbert ; Anand, Avishek ; Breuer, Timo ; Faggioli, Guglielmo ; Frieder, Ophir ; Joho, Hideo ; Karlgren, Jussi ; Kiesel, Johannes ; Knijnenburg, Bart P. ; Lipani, Aldo ; Michiels, Lien ; Papenmeier, Andrea ; Pera, Maria Soledad ; Sanderson, Mark ; Sanner, Scott ; Stein, Benno ; Trippas, Johanne R. ; Verspoor, Karin ; Willemsen, Martijn C.
Zeitschrift
Dagstuhl Manifestos 
DOI
10.4230/DagMan.11.1.19

Weitere Details

Sprache
englisch
Darstellungsform
Text
Band
11
Ausgabe
1
Seitenbereich
19 - 67
Schlüsselwörter
Computing methodologies → Natural language processing , Conversational Agents , Evaluation , Information Access , Information systems → Information retrieval , Information systems → Recommender systems

During the workshop, we deeply discussed what CONversational Information ACcess (CONIAC) is and its unique features, proposing a world model abstracting it, and defined the Conversational Agents Framework for Evaluation (CAFE) for the evaluation of CONIAC systems, consisting of six major components: 1) goals of the system’s stakeholders, 2) user tasks to be studied in the evaluation, 3) aspects of the users carrying out the tasks, 4) evaluation criteria to be considered, 5) evaluation methodology to be applied, and 6) measures for the quantitative criteria chosen.

Zitierstile

Download
 RDF/XML-Format
 JSON-LD-Format
 Turtle-Format
 N3-Format