Art

J-GLOBAL ID：201702255391434001   Reference number：17A0009607

Evaluating Helpdesk Dialogues: Initial Considerations from An Information Access Perspective

ヘルプデスク会話の評価:情報アクセス視点からの初期考察

Author (4)： SAKAI Tetsuya (Waseda Univ., JPN) ,  ZENG Zhaohao (Waseda Univ., JPN) ,  LUO Cheng (Tsinghua Univ., P.R.C.) ,  LUO Cheng (Waseda Univ., JPN)
Material： 情報処理学会研究報告(Web)  (IPSJ Technical Report (Web))
Volume： 2016  Issue： NL-228  Page： Vol.2016-NL-228,No.1,1-10 (WEB ONLY)  Publication year： Sep. 22, 2016 
JST Material Number： U0451A  Document type： Proceedings
Article type： 原著論文  Country of issue： Japan (JPN)  Language： ENGLISH (EN)

Thesaurus term： *claim management ,  *conversation ,  *automatic language processing ,  information collection ,  subjective evaluation ,  *Web(information system) ,  character processing ,  pilot test ,  measure ,  annotation ,  customer satisfaction
Semi thesaurus term： help desk ,  access to information ,  chat ,  character information

JST classification (1)： Natural language processing  (JE06000L)

Reference (27)：

• Black, A. W. and Eskenazi, M.: The Spoken Dialogue Challenge, Proceedings of SIGDIAL 2009, pp. 337-340 (2009).
• DeVault, D., Leuski, A. and Sagae, K.: Toward Learning and Evaluation of Dialogue Policies with Text Examples, Proceedings of SIGDIAL 2011, pp. 39-48 (2011).
• Fleiss, J. L.: Measuring Nominal Scale Agreement among Many Raters, Psychological Bulletin, Vol. 76, No. 5, pp. 378-382 (1971).
• Galley, M., Brockett, C., Sordoni, A., Ji, Y., Auli, M., Quirk, C., Mitchell, M., Gao, J. and Dolan, B.: ?BLEU: A Discriminative Metric for Generation Tasks with Intrinsically Diverse Targets, Proceedings of ACL 2015, pp. 445-450 (2015).
• Hartikainen, M., Salonen, E.-P. and Turunen, M.: Subjective Evaluation of Spoken Dialogue Systems Using SERVQUAL Method, Proceedings of INTERSPEECH 2004-ICSLP (2004).

Terms in the title (6)： ヘルプデスク ,  会話 ,  評価 ,  情報アクセス ,  視点 ,  初期