Supplementary materials for: Mouse Chase: Detecting Careless and Unmotivated Responders Using Cursor Movements in Web-Based Surveys.
Author(s) / Creator(s)
Żółtak, Tomasz
Pokropek, Artur
Muszyński, Marek
Abstract / Description
Supplementary materials for: Pokropek, A., Żółtak, T., & Muszyński, M. (2023). Mouse chase: Detecting careless and unmotivated responders using cursor movements in web-based surveys. European Journal of Psychological Assessment. Advance online publication. https://doi.org/10.1027/1015-5759/a000758
Supplementary materials include results of additional analyses and more detailed description of the procedure, that could not be included into the paper because of the text length limit (for more information see "Table of contents" metadata field").
Web surveys offer new research possibilities, but they also have specific problems. One of them is a higher risk of careless, inattentive, or otherwise invalid responses. Using paradata, which are data collected apart from reactionary data, is one of the potential tools that can help to screen for problematic responses in web-based surveys. One of the most promising forms of paradata is the movement, or trajectory, of the cursor in making a response. This study constructed indicators of such data presented correlations between them and provided an interpretation and validation of these components by correlating them with previously known indices of careless responding. Finally, it tested cursor movement indices during different motivational states induced by experimental instructions. Cursor movement indices proved to be moderately related to classical careless responding indices but some of them (horizontal distance traveled as well speed and acceleration on vertical dimension) were as responsive to manipulation conditions as classical indices. The potential role of cursor movement indices in survey practice and future studies in this area are discussed.
Keyword(s)
paradata web survey survey methodology cursor movement careless/insufficient effort responding (C/IER)Persistent Identifier
Date of first publication
2022-11-07
Publisher
PsychArchives
Is referenced by
Citation
-
Mouse-Chase-Online-Suplement.pdfAdobe PDF - 499.91KBMD5: 127bafc754d50d295cd5ee731b354deaDescription: Supplementary materials for Pokropek, Muszyński and Żółtak's Mouse Chase paper
-
22022-11-07Bootstrap test statistics and p-values were corrected to be the same as produced by the code enabling to reproduce the analysis in this supplementary materials and in related paper (by using the same seed of a random number generator).
-
Author(s) / Creator(s)Żółtak, Tomasz
-
Author(s) / Creator(s)Pokropek, Artur
-
Author(s) / Creator(s)Muszyński, Marek
-
Temporal coverage2022-12
-
PsychArchives acquisition timestamp2022-11-07T08:54:07Z
-
Made available on2022-10-25T12:05:51Z
-
Made available on2022-11-07T08:54:07Z
-
Date of first publication2022-11-07
-
Abstract / DescriptionSupplementary materials for: Pokropek, A., Żółtak, T., & Muszyński, M. (2023). Mouse chase: Detecting careless and unmotivated responders using cursor movements in web-based surveys. European Journal of Psychological Assessment. Advance online publication. https://doi.org/10.1027/1015-5759/a000758 Supplementary materials include results of additional analyses and more detailed description of the procedure, that could not be included into the paper because of the text length limit (for more information see "Table of contents" metadata field").en_US
-
Abstract / DescriptionWeb surveys offer new research possibilities, but they also have specific problems. One of them is a higher risk of careless, inattentive, or otherwise invalid responses. Using paradata, which are data collected apart from reactionary data, is one of the potential tools that can help to screen for problematic responses in web-based surveys. One of the most promising forms of paradata is the movement, or trajectory, of the cursor in making a response. This study constructed indicators of such data presented correlations between them and provided an interpretation and validation of these components by correlating them with previously known indices of careless responding. Finally, it tested cursor movement indices during different motivational states induced by experimental instructions. Cursor movement indices proved to be moderately related to classical careless responding indices but some of them (horizontal distance traveled as well speed and acceleration on vertical dimension) were as responsive to manipulation conditions as classical indices. The potential role of cursor movement indices in survey practice and future studies in this area are discussed.en
-
Publication statuspublishedVersion
-
Review statuspeerReviewed
-
Table of contentsExperimental procedure 2 Consequences of sample exclusions 2 Manipulation check 3 Wording of scale items and response categories 4 Supplementary results 7 Additional figures 11 Reanalysis using views on vaccines scale 12en
-
Persistent Identifierhttps://hdl.handle.net/20.500.12034/7562.2
-
Persistent Identifierhttps://doi.org/10.23668/psycharchives.8393
-
Language of contentengen_US
-
PublisherPsychArchivesen_US
-
Is referenced byhttps://doi.org/10.1027/1015-5759/a000758
-
Is related tohttps://doi.org/10.23668/psycharchives.8394
-
Is related tohttps://doi.org/10.23668/psycharchives.8397
-
Is related tohttps://doi.org/10.1027/1015-5759/a000758
-
Keyword(s)paradataen_US
-
Keyword(s)web surveyen_US
-
Keyword(s)survey methodologyen_US
-
Keyword(s)cursor movementen_US
-
Keyword(s)careless/insufficient effort responding (C/IER)en_US
-
Dewey Decimal Classification number(s)150
-
TitleSupplementary materials for: Mouse Chase: Detecting Careless and Unmotivated Responders Using Cursor Movements in Web-Based Surveys.en_US
-
DRO typeotheren_US
-
Leibniz subject classificationSozialwissenschaftende_DE