Date
2020Subject
004 Data processing and computer science HochschuleLehreEvaluationComputerlinguistikDialogsystemMensch-Maschine-KommunikationMetadata
Show full item record
Konferenzveröffentlichung![](/themes/Mirage2/images/Open_Access_logo_PLoS_transparent.svg)
A Conversational Agent to Improve Response Quality in Course Evaluations
Abstract
Recent advances in Natural Language Processing (NLP) bear the opportunity to design new forms of human-computer interaction with conversational interfaces. We hypothesize that these interfaces can interactively engage students to increase response quality of course evaluations in education compared to the common standard of web surveys. Past research indicates that web surveys come with disadvantages, such as poor response quality caused by inattention, survey fatigue or satisficing behavior. To test if conversational interfaces have a positive impact on the level of enjoyment and the response quality, we design an NLP-based conversational agent and deploy it in a field experiment with 127 students in our lecture and compare it with a web survey as a baseline. Our findings indicate that using conversational agents for evaluations are resulting in higher levels of response quality and level of enjoyment, and are therefore, a promising approach to increase the effectiveness of surveys in general.
Citation
In: ACM (Hrsg.): Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems - CHI EA '20. Association for Computing Machinery: New York, NY 2020, S. ; ISBN 978-1-4503-6819-3Citation
@inproceedings{doi:10.17170/kobra-202104013623,
author={Wambsganss, Thiemo and Winkler, Rainer and Söllner, Matthias and Leimeister, Jan Marco},
title={A Conversational Agent to Improve Response Quality in Course Evaluations},
booktitle={Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems - CHI EA '20},
year={2020}
}
0500 Oax 0501 Text $btxt$2rdacontent 0502 Computermedien $bc$2rdacarrier 1100 2020$n2020 1500 1/eng 2050 ##0##http://hdl.handle.net/123456789/12757 3000 Wambsganss, Thiemo 3010 Winkler, Rainer 3010 Söllner, Matthias 3010 Leimeister, Jan Marco 4000 A Conversational Agent to Improve Response Quality in Course Evaluations / Wambsganss, Thiemo 4030 4060 Online-Ressource 4085 ##0##=u http://nbn-resolving.de/http://hdl.handle.net/123456789/12757=x R 4204 \$dKonferenzveröffentlichung 4170 5550 {{Hochschule}} 5550 {{Lehre}} 5550 {{Evaluation}} 5550 {{Computerlinguistik}} 5550 {{Dialogsystem}} 5550 {{Mensch-Maschine-Kommunikation}} 7136 ##0##http://hdl.handle.net/123456789/12757
2021-04-29T12:36:31Z 2021-04-29T12:36:31Z 2020 doi:10.17170/kobra-202104013623 http://hdl.handle.net/123456789/12757 eng Association for Computing Machinery Namensnennung-Nicht-kommerziell 4.0 International http://creativecommons.org/licenses/by-nc/4.0/ conversational agents online course evaluations field experiment 004 A Conversational Agent to Improve Response Quality in Course Evaluations Konferenzveröffentlichung Recent advances in Natural Language Processing (NLP) bear the opportunity to design new forms of human-computer interaction with conversational interfaces. We hypothesize that these interfaces can interactively engage students to increase response quality of course evaluations in education compared to the common standard of web surveys. Past research indicates that web surveys come with disadvantages, such as poor response quality caused by inattention, survey fatigue or satisficing behavior. To test if conversational interfaces have a positive impact on the level of enjoyment and the response quality, we design an NLP-based conversational agent and deploy it in a field experiment with 127 students in our lecture and compare it with a web survey as a baseline. Our findings indicate that using conversational agents for evaluations are resulting in higher levels of response quality and level of enjoyment, and are therefore, a promising approach to increase the effectiveness of surveys in general. open access Wambsganss, Thiemo Winkler, Rainer Söllner, Matthias Leimeister, Jan Marco New York, NY doi:10.1145/3334480.3382805 Hochschule Lehre Evaluation Computerlinguistik Dialogsystem Mensch-Maschine-Kommunikation publishedVersion 2020-04 Honolulu, HI, USA Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems - CHI EA '20 ACM ISBN 978-1-4503-6819-3 false CHI '20: CHI Conference on Human Factors in Computing Systems LBM349
The following license files are associated with this item: