Skip to main content

Research Repository

Advanced Search

A spurious correlation between difference scores in evidence-accumulation model parameters

Grange, James A.; Schuch, Stefanie

Authors

Stefanie Schuch



Abstract

Evidence-accumulation models are a useful tool for investigating the cognitive processes that give rise to behavioural data patterns in reaction times (RTs) and error rates. In their simplest form, evidence-accumulation models include three parameters: The average rate of evidence accumulation over time (drift rate) and the amount of evidence that needs to be accumulated before a response becomes selected (boundary) both characterise the response-selection process; a third parameter summarises all processes before and after the response-selection process (non-decision time). Researchers often compute experimental effects as simple difference scores between two within-subject conditions and such difference scores can also be computed on model parameters. In the present paper, we report spurious correlations between such model parameter difference scores, both in empirical data and in computer simulations. The most pronounced spurious effect is a negative correlation between boundary difference and non-decision difference, which amounts to r = – .70 or larger. In the simulations, we only observed this spurious negative correlation when either (a) there was no true difference in model parameters between simulated experimental conditions, or (b) only drift rate was manipulated between simulated experimental conditions; when a true difference existed in boundary separation, non-decision time, or all three main parameters, the correlation disappeared. We suggest that care should be taken when using evidence-accumulation model difference scores for correlational approaches because the parameter difference scores can correlate in the absence of any true inter-individual differences at the population level.

Citation

Grange, J. A., & Schuch, S. (in press). A spurious correlation between difference scores in evidence-accumulation model parameters. Behavior Research Methods, https://doi.org/10.3758/s13428-022-01956-8

Journal Article Type Article
Acceptance Date Aug 9, 2022
Online Publication Date Sep 22, 2022
Deposit Date May 30, 2023
Journal Behavior Research Methods
Print ISSN 1554-351X
Publisher Springer Verlag
Peer Reviewed Peer Reviewed
DOI https://doi.org/10.3758/s13428-022-01956-8
Keywords General Psychology; Psychology (miscellaneous); Arts and Humanities (miscellaneous); Developmental and Educational Psychology; Experimental and Cognitive Psychology
Additional Information Accepted: 9 August 2022; First Online: 22 September 2022