Conference Object

What happens at night stays in the dark – Estimating autoregressive effects in three-level experience sampling data

Author(s) / Creator(s)

Neubauer, Andreas B.
Scott, Stacey B.
Sliwinski, Martin J.
Smyth, Joshua M.

Abstract / Description

Background: Unequally spaced inter-measurement intervals are common in intensive longitudinal data which can lead to blurred estimates of autoregressive effects. Dynamic structural equation models (DSEM) have been discussed as an approach to accommodate this issue. One core feature of DSEM is that they assume a continuous decay of the autoregressive effect with increasing time between adjacent measurements. However, intervals of the same length can have psychologically different meanings. Specifically, an eight-hour interval from the evening to the next morning may be psychologically distinct from an eight-hour interval during waking hours. This may complicate the interpretation of autoregressive effects estimated by DSEM in three-level experience sampling data. Objective and Research Questions: The central objective of this work is to present conceptual ideas on potential shortcomings of models that assume continuous processes when these processes are in fact interrupted. Simulated data will be presented that might, for instance, represent affective experiences of individuals reported several times per day over multiple days. The implications of different modeling approaches will be illustrated using an empirical example. Method: In the simulated data, different population models were assumed: (a) a continuous autoregressive process that continues overnight or (b) an interrupted overnight autoregressive process (either weaker or stronger autoregressive effect overnight than during the day). These simulated data were re-estimated using different versions of two-level DSEM in Mplus. Further, the implications of assuming continuous autoregressive effects are illustrated in an exemplary experience sampling data set. In this study, 242 participants (age range: 25-65 years) completed five momentary assessments of their current affective well-being per day for 14 consecutive days. Results: Findings from the simulation study show that falsely assuming a continuous process can severely bias the observed autocorrelation within days and across nights. Specifically, a continuous time DSEM approach leads to an underestimation of the across-night autoregressive effect and an overestimation of the within-day autoregressive effect if the true overnight autoregressive effect is larger than a within-day autoregressive effect between two temporally equally distant measurements. In contrast, the across-night autoregressive effect is overestimated and the within-day autoregressive effect is underestimated if the autoregressive effect is terminated across night. Results from the empirical example illustrate that the estimated within-day autoregressive effect (for both positive and negative affect) becomes larger if it is estimated separately from the overnight autoregressive effect. This suggests that the overnight autoregressive effect is interrupted. Overnight autoregressive effects were estimated as ρ = .191 (positive affect) and ρ =.193 (negative affect) and within-day effects were estimated as ρ = .437 (positive affect) and ρ =.379 (negative affect). A DSEM with a continuous autoregression function overestimated within-day autoregressive effects and underestimated the overnight autoregressive effect. Conclusions and implications: Results suggest that the application of DSEM to three-level experience sampling data should be considered carefully. Conventional DSEM analyses assume a continuous process across the whole observation period which may not be appropriate for some applications to experience sampling data. Alternative approaches with separate estimates of within-day and overnight autoregressive effects will be discussed.

Persistent Identifier

Date of first publication

2021-05-19

Is part of

Research Synthesis & Big Data, 2021, online

Publisher

ZPID (Leibniz Institute for Psychology)

Citation

Neubauer, A. B., Scott, S. B., Sliwinski, M. J., & Smyth, J. M. (2021). What happens at night stays in the dark – Estimating autoregressive effects in three-level experience sampling data. ZPID (Leibniz Institute for Psychology). https://doi.org/10.23668/PSYCHARCHIVES.4816
  • Author(s) / Creator(s)
    Neubauer, Andreas B.
  • Author(s) / Creator(s)
    Scott, Stacey B.
  • Author(s) / Creator(s)
    Sliwinski, Martin J.
  • Author(s) / Creator(s)
    Smyth, Joshua M.
  • PsychArchives acquisition timestamp
    2021-05-11T11:42:33Z
  • Made available on
    2021-05-11T11:42:33Z
  • Date of first publication
    2021-05-19
  • Abstract / Description
    Background: Unequally spaced inter-measurement intervals are common in intensive longitudinal data which can lead to blurred estimates of autoregressive effects. Dynamic structural equation models (DSEM) have been discussed as an approach to accommodate this issue. One core feature of DSEM is that they assume a continuous decay of the autoregressive effect with increasing time between adjacent measurements. However, intervals of the same length can have psychologically different meanings. Specifically, an eight-hour interval from the evening to the next morning may be psychologically distinct from an eight-hour interval during waking hours. This may complicate the interpretation of autoregressive effects estimated by DSEM in three-level experience sampling data. Objective and Research Questions: The central objective of this work is to present conceptual ideas on potential shortcomings of models that assume continuous processes when these processes are in fact interrupted. Simulated data will be presented that might, for instance, represent affective experiences of individuals reported several times per day over multiple days. The implications of different modeling approaches will be illustrated using an empirical example. Method: In the simulated data, different population models were assumed: (a) a continuous autoregressive process that continues overnight or (b) an interrupted overnight autoregressive process (either weaker or stronger autoregressive effect overnight than during the day). These simulated data were re-estimated using different versions of two-level DSEM in Mplus. Further, the implications of assuming continuous autoregressive effects are illustrated in an exemplary experience sampling data set. In this study, 242 participants (age range: 25-65 years) completed five momentary assessments of their current affective well-being per day for 14 consecutive days. Results: Findings from the simulation study show that falsely assuming a continuous process can severely bias the observed autocorrelation within days and across nights. Specifically, a continuous time DSEM approach leads to an underestimation of the across-night autoregressive effect and an overestimation of the within-day autoregressive effect if the true overnight autoregressive effect is larger than a within-day autoregressive effect between two temporally equally distant measurements. In contrast, the across-night autoregressive effect is overestimated and the within-day autoregressive effect is underestimated if the autoregressive effect is terminated across night. Results from the empirical example illustrate that the estimated within-day autoregressive effect (for both positive and negative affect) becomes larger if it is estimated separately from the overnight autoregressive effect. This suggests that the overnight autoregressive effect is interrupted. Overnight autoregressive effects were estimated as ρ = .191 (positive affect) and ρ =.193 (negative affect) and within-day effects were estimated as ρ = .437 (positive affect) and ρ =.379 (negative affect). A DSEM with a continuous autoregression function overestimated within-day autoregressive effects and underestimated the overnight autoregressive effect. Conclusions and implications: Results suggest that the application of DSEM to three-level experience sampling data should be considered carefully. Conventional DSEM analyses assume a continuous process across the whole observation period which may not be appropriate for some applications to experience sampling data. Alternative approaches with separate estimates of within-day and overnight autoregressive effects will be discussed.
    en
  • Publication status
    unknown
    en
  • Review status
    unknown
    en
  • Citation
    Neubauer, A. B., Scott, S. B., Sliwinski, M. J., & Smyth, J. M. (2021). What happens at night stays in the dark – Estimating autoregressive effects in three-level experience sampling data. ZPID (Leibniz Institute for Psychology). https://doi.org/10.23668/PSYCHARCHIVES.4816
    en
  • Persistent Identifier
    https://hdl.handle.net/20.500.12034/4253
  • Persistent Identifier
    https://doi.org/10.23668/psycharchives.4816
  • Language of content
    eng
  • Publisher
    ZPID (Leibniz Institute for Psychology)
    en
  • Is part of
    Research Synthesis & Big Data, 2021, online
    en
  • Dewey Decimal Classification number(s)
    150
  • Title
    What happens at night stays in the dark – Estimating autoregressive effects in three-level experience sampling data
    en
  • DRO type
    conferenceObject
    en_US
  • Visible tag(s)
    ZPID Conferences and Workshops