Edinburgh Research Explorer

Interaction effects on common measures of sensitivity: Choice of measure, type I error, and power

Research output: Contribution to journalArticle

Related Edinburgh Organisations

Open Access permissions

Open

Documents

  • Download as Adobe PDF

    Rights statement: The final publication is available at Springer via: https://link.springer.com/article/10.3758%2Fs13428-018-1081-0

    Accepted author manuscript, 474 KB, PDF-document

Original languageEnglish
Pages (from-to)1-19
JournalBehavior Research Methods
Early online date18 Jul 2018
DOIs
Publication statusE-pub ahead of print - 18 Jul 2018

Abstract

Here we use simulation to assess previously unaddressed problems in the assessment of statistical interactions in detection and recognition tasks. The proportion of hits and false-alarms made by an observer on such tasks is affected by both their sensitivity and bias, and numerous measures have been developed to separate out these two factors.Each of these measures makes different assumptions regarding the underlying process and different predictions as to how false-alarm and hit rates should covary. Previous simulations have shown that choice of an inappropriate measure can lead to inflated type I error rates, or reduced power, for main effects, provided there are differences in response bias between the conditions being compared. Interaction effects pose a particular problem in this context. We show that spurious interaction effects in analysis of variance can be produced, or true interactions missed, even in the absence of variation in bias. Additional simulations show that variation in bias complicates patterns of type I error and power further. This under-appreciated fact has the potential to greatly distort the assessment of interactions in detection and recognition experiments. We discuss steps researchers can take to mitigate their chances of making an error.

    Research areas

  • recognition, detection, interactions, type I error, type II error, power, sensitivity, bias

ID: 65005612