Other

Supplementary materials for: Mouse Chase: Detecting Careless and Unmotivated Responders Using Cursor Movements in Web-Based Surveys.

Author(s) / Creator(s)

Żółtak, Tomasz
Pokropek, Artur
Muszyński, Marek

Abstract / Description

Supplementary materials for: Pokropek, A., Żółtak, T., & Muszyński, M. (2023). Mouse chase: Detecting careless and unmotivated responders using cursor movements in web-based surveys. European Journal of Psychological Assessment. Advance online publication. https://doi.org/10.1027/1015-5759/a000758 Supplementary materials include results of additional analyses and more detailed description of the procedure, that could not be included into the paper because of the text length limit (for more information see "Table of contents" metadata field").
Web surveys offer new research possibilities, but they also have specific problems. One of them is a higher risk of careless, inattentive, or otherwise invalid responses. Using paradata, which are data collected apart from reactionary data, is one of the potential tools that can help to screen for problematic responses in web-based surveys. One of the most promising forms of paradata is the movement, or trajectory, of the cursor in making a response. This study constructed indicators of such data presented correlations between them and provided an interpretation and validation of these components by correlating them with previously known indices of careless responding. Finally, it tested cursor movement indices during different motivational states induced by experimental instructions. Cursor movement indices proved to be moderately related to classical careless responding indices but some of them (horizontal distance traveled as well speed and acceleration on vertical dimension) were as responsive to manipulation conditions as classical indices. The potential role of cursor movement indices in survey practice and future studies in this area are discussed.

Keyword(s)

paradata web survey survey methodology cursor movement careless/insufficient effort responding (C/IER)

Persistent Identifier

Date of first publication

2022-11-07

Publisher

PsychArchives

Is referenced by

Citation

  • 2
    2022-11-07
    Bootstrap test statistics and p-values were corrected to be the same as produced by the code enabling to reproduce the analysis in this supplementary materials and in related paper (by using the same seed of a random number generator).
  • 1
    2022-10-25
  • Author(s) / Creator(s)
    Żółtak, Tomasz
  • Author(s) / Creator(s)
    Pokropek, Artur
  • Author(s) / Creator(s)
    Muszyński, Marek
  • Temporal coverage
    2022-12
  • PsychArchives acquisition timestamp
    2022-11-07T08:54:07Z
  • Made available on
    2022-10-25T12:05:51Z
  • Made available on
    2022-11-07T08:54:07Z
  • Date of first publication
    2022-11-07
  • Abstract / Description
    Supplementary materials for: Pokropek, A., Żółtak, T., & Muszyński, M. (2023). Mouse chase: Detecting careless and unmotivated responders using cursor movements in web-based surveys. European Journal of Psychological Assessment. Advance online publication. https://doi.org/10.1027/1015-5759/a000758 Supplementary materials include results of additional analyses and more detailed description of the procedure, that could not be included into the paper because of the text length limit (for more information see "Table of contents" metadata field").
    en_US
  • Abstract / Description
    Web surveys offer new research possibilities, but they also have specific problems. One of them is a higher risk of careless, inattentive, or otherwise invalid responses. Using paradata, which are data collected apart from reactionary data, is one of the potential tools that can help to screen for problematic responses in web-based surveys. One of the most promising forms of paradata is the movement, or trajectory, of the cursor in making a response. This study constructed indicators of such data presented correlations between them and provided an interpretation and validation of these components by correlating them with previously known indices of careless responding. Finally, it tested cursor movement indices during different motivational states induced by experimental instructions. Cursor movement indices proved to be moderately related to classical careless responding indices but some of them (horizontal distance traveled as well speed and acceleration on vertical dimension) were as responsive to manipulation conditions as classical indices. The potential role of cursor movement indices in survey practice and future studies in this area are discussed.
    en
  • Publication status
    publishedVersion
  • Review status
    peerReviewed
  • Table of contents
    Experimental procedure 2 Consequences of sample exclusions 2 Manipulation check 3 Wording of scale items and response categories 4 Supplementary results 7 Additional figures 11 Reanalysis using views on vaccines scale 12
    en
  • Persistent Identifier
    https://hdl.handle.net/20.500.12034/7562.2
  • Persistent Identifier
    https://doi.org/10.23668/psycharchives.8393
  • Language of content
    eng
    en_US
  • Publisher
    PsychArchives
    en_US
  • Is referenced by
    https://doi.org/10.1027/1015-5759/a000758
  • Is related to
    https://doi.org/10.23668/psycharchives.8394
  • Is related to
    https://doi.org/10.23668/psycharchives.8397
  • Is related to
    https://doi.org/10.1027/1015-5759/a000758
  • Keyword(s)
    paradata
    en_US
  • Keyword(s)
    web survey
    en_US
  • Keyword(s)
    survey methodology
    en_US
  • Keyword(s)
    cursor movement
    en_US
  • Keyword(s)
    careless/insufficient effort responding (C/IER)
    en_US
  • Dewey Decimal Classification number(s)
    150
  • Title
    Supplementary materials for: Mouse Chase: Detecting Careless and Unmotivated Responders Using Cursor Movements in Web-Based Surveys.
    en_US
  • DRO type
    other
    en_US
  • Leibniz subject classification
    Sozialwissenschaften
    de_DE