Datum
2020Schlagwort
004 Informatik ComputerlinguistikComputerunterstütztes LernenOnline-BefragungBenutzeroberflächeMensch-Maschine-KommunikationHochschuleLehreEvaluationMetadata
Zur Langanzeige
Konferenzveröffentlichung
Unleashing the Potential of Conversational Agents for Course Evaluations: Empirical Insights from a Comparison with Web Surveys
Zusammenfassung
Recent advances in Natural Language Processing (NLP) bear the opportunity to design new forms of human-computer interaction with conversational interfaces. However, little is known about how these interfaces change the way users respond in online course evaluations. We aim to explore the effects of conversational agents (CAs) on the response quality of online course evaluations in education compared to the common standard of web surveys. Past research indicates that web surveys come with disadvantages, such as poor response quality caused by inattention, survey fatigue or satisficing behavior. We propose that a conversational interface will have a positive effect on the response quality through the different way of interaction. To test our hypotheses, we design an NLP-based CA and deploy it in a field experiment with 176 students in three different course formats and compare it with a web survey as a baseline. The results indicate that participants using the CA showed higher levels of response quality and social presence compared to the web survey. These findings along with technology acceptance measurements suggest that using CAs for evaluation are a promising approach to increase the effectiveness of surveys in general.
Zitierform
In: European Conference on Information Systems (Hrsg.): Proceedings of the 28th European Conference on Information Systems (ECIS). Association for Information Systems: 2020, S. ; ISBN 978-1-7336325-1-5Zitieren
@inproceedings{doi:10.17170/kobra-202104153670,
author={Wambsganss, Thiemo and Winkler, Rainer and Schmid, Pascale and Söllner, Matthias},
title={Unleashing the Potential of Conversational Agents for Course Evaluations: Empirical Insights from a Comparison with Web Surveys},
booktitle={Proceedings of the 28th European Conference on Information Systems (ECIS)},
year={2020}
}
0500 Oax 0501 Text $btxt$2rdacontent 0502 Computermedien $bc$2rdacarrier 1100 2020$n2020 1500 1/eng 2050 ##0##http://hdl.handle.net/123456789/12751 3000 Wambsganss, Thiemo 3010 Winkler, Rainer 3010 Schmid, Pascale 3010 Söllner, Matthias 4000 Unleashing the Potential of Conversational Agents for Course Evaluations: Empirical Insights from a Comparison with Web Surveys / Wambsganss, Thiemo 4030 4060 Online-Ressource 4085 ##0##=u http://nbn-resolving.de/http://hdl.handle.net/123456789/12751=x R 4204 \$dKonferenzveröffentlichung 4170 5550 {{Computerlinguistik}} 5550 {{Computerunterstütztes Lernen}} 5550 {{Online-Befragung}} 5550 {{Benutzeroberfläche}} 5550 {{Mensch-Maschine-Kommunikation}} 5550 {{Hochschule}} 5550 {{Lehre}} 5550 {{Evaluation}} 7136 ##0##http://hdl.handle.net/123456789/12751
2021-04-28T10:25:12Z 2021-04-28T10:25:12Z 2020 doi:10.17170/kobra-202104153670 http://hdl.handle.net/123456789/12751 eng Association for Information Systems Urheberrechtlich geschützt https://rightsstatements.org/page/InC/1.0/ human-computer interaction conversational agents course evaluation pedagogical conversational agents social presence social response theory 004 Unleashing the Potential of Conversational Agents for Course Evaluations: Empirical Insights from a Comparison with Web Surveys Konferenzveröffentlichung Recent advances in Natural Language Processing (NLP) bear the opportunity to design new forms of human-computer interaction with conversational interfaces. However, little is known about how these interfaces change the way users respond in online course evaluations. We aim to explore the effects of conversational agents (CAs) on the response quality of online course evaluations in education compared to the common standard of web surveys. Past research indicates that web surveys come with disadvantages, such as poor response quality caused by inattention, survey fatigue or satisficing behavior. We propose that a conversational interface will have a positive effect on the response quality through the different way of interaction. To test our hypotheses, we design an NLP-based CA and deploy it in a field experiment with 176 students in three different course formats and compare it with a web survey as a baseline. The results indicate that participants using the CA showed higher levels of response quality and social presence compared to the web survey. These findings along with technology acceptance measurements suggest that using CAs for evaluation are a promising approach to increase the effectiveness of surveys in general. open access Wambsganss, Thiemo Winkler, Rainer Schmid, Pascale Söllner, Matthias Computerlinguistik Computerunterstütztes Lernen Online-Befragung Benutzeroberfläche Mensch-Maschine-Kommunikation Hochschule Lehre Evaluation publishedVersion 2020-06 Marrakesh, Marokko Proceedings of the 28th European Conference on Information Systems (ECIS) European Conference on Information Systems ISBN 978-1-7336325-1-5 false Liberty, Equality, and Fraternity in a Digitizing World, 28th European Conference on Information Systems (ECIS) Research Paper 50
Die folgenden Lizenzbestimmungen sind mit dieser Ressource verbunden:
:Urheberrechtlich geschützt