Aufsatz![](/themes/Mirage2/images/Open_Access_logo_PLoS_transparent.svg)
Using Monte Carlo Simulation to Forecast the Scientific Utility of Psychological App Studies: A Tutorial
Zusammenfassung
Mobile applications offer a wide range of opportunities for psychological data collection, such as increased ecological validity and greater acceptance by participants compared to traditional laboratory studies. However, app-based psychological data also pose data-analytic challenges because of the complexities introduced by missingness and interdependence of observations. Consequently, researchers must weigh the advantages and disadvantages of app-based data collection to decide on the scientific utility of their proposed app study. For instance, some studies might only be worthwhile if they provide adequate statistical power. However, the complexity of app data forestalls the use of simple analytic formulas to estimate properties such as power. In this paper, we demonstrate how Monte Carlo simulations can be used to investigate the impact of app usage behavior on the utility of app-based psychological data. We introduce a set of questions to guide simulation implementation and showcase how we answered them for the simulation in the context of the guessing game app Who Knows. Finally, we give a brief overview of the simulation results and the conclusions we have drawn from them for real-world data generation. Our results can serve as an example of how to use a simulation approach for planning real-world app-based data collection.
Zitierform
In: Multivariate Behavioral Research Volume 59 / Issue 4 (2024-07-11) , S. 879-893 ; eissn:1532-7906Förderhinweis
Gefördert im Rahmen des Projekts DEALZitieren
@article{doi:10.17170/kobra-2024091110809,
author={Kueppers, Sebastian and Rau, Richard and Scharf, Florian},
title={Using Monte Carlo Simulation to Forecast the Scientific Utility of Psychological App Studies: A Tutorial},
journal={Multivariate Behavioral Research},
year={2024}
}
0500 Oax 0501 Text $btxt$2rdacontent 0502 Computermedien $bc$2rdacarrier 1100 2024$n2024 1500 1/eng 2050 ##0##http://hdl.handle.net/123456789/16033 3000 Kueppers, Sebastian 3010 Rau, Richard 3010 Scharf, Florian 4000 Using Monte Carlo Simulation to Forecast the Scientific Utility of Psychological App Studies: A Tutorial / Kueppers, Sebastian 4030 4060 Online-Ressource 4085 ##0##=u http://nbn-resolving.de/http://hdl.handle.net/123456789/16033=x R 4204 \$dAufsatz 4170 5550 {{Monte-Carlo-Simulation}} 5550 {{App <Programm>}} 5550 {{Datenerhebung}} 7136 ##0##http://hdl.handle.net/123456789/16033
2024-09-11T08:53:08Z 2024-09-11T08:53:08Z 2024-07-11 doi:10.17170/kobra-2024091110809 http://hdl.handle.net/123456789/16033 Gefördert im Rahmen des Projekts DEAL eng Attribution-NonCommercial-NoDerivatives 4.0 International http://creativecommons.org/licenses/by-nc-nd/4.0/ App-based data collection Monte Carlo simulations dropout longitudinal data planned missingness 150 Using Monte Carlo Simulation to Forecast the Scientific Utility of Psychological App Studies: A Tutorial Aufsatz Mobile applications offer a wide range of opportunities for psychological data collection, such as increased ecological validity and greater acceptance by participants compared to traditional laboratory studies. However, app-based psychological data also pose data-analytic challenges because of the complexities introduced by missingness and interdependence of observations. Consequently, researchers must weigh the advantages and disadvantages of app-based data collection to decide on the scientific utility of their proposed app study. For instance, some studies might only be worthwhile if they provide adequate statistical power. However, the complexity of app data forestalls the use of simple analytic formulas to estimate properties such as power. In this paper, we demonstrate how Monte Carlo simulations can be used to investigate the impact of app usage behavior on the utility of app-based psychological data. We introduce a set of questions to guide simulation implementation and showcase how we answered them for the simulation in the context of the guessing game app Who Knows. Finally, we give a brief overview of the simulation results and the conclusions we have drawn from them for real-world data generation. Our results can serve as an example of how to use a simulation approach for planning real-world app-based data collection. open access Kueppers, Sebastian Rau, Richard Scharf, Florian doi:10.1080/00273171.2024.2335411 Monte-Carlo-Simulation App <Programm> Datenerhebung publishedVersion eissn:1532-7906 Issue 4 Multivariate Behavioral Research 879-893 Volume 59 false
Die folgenden Lizenzbestimmungen sind mit dieser Ressource verbunden: