Cluster-based computational methods for mass univariate analyses of event-related brain potentials/fields: A simulation study

C R Pernet*, M Latinus, T E Nichols, G A Rousselet

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

BACKGROUND: In recent years, analyses of event related potentials/fields have moved from the selection of a few components and peaks to a mass-univariate approach in which the whole data space is analyzed. Such extensive testing increases the number of false positives and correction for multiple comparisons is needed.

METHOD: Here we review all cluster-based correction for multiple comparison methods (cluster-height, cluster-size, cluster-mass, and threshold free cluster enhancement - TFCE), in conjunction with two computational approaches (permutation and bootstrap).

RESULTS: Data driven Monte-Carlo simulations comparing two conditions within subjects (two sample Student's t-test) showed that, on average, all cluster-based methods using permutation or bootstrap alike control well the family-wise error rate (FWER), with a few caveats.

CONCLUSIONS: (i) A minimum of 800 iterations are necessary to obtain stable results; (ii) below 50 trials, bootstrap methods are too conservative; (iii) for low critical family-wise error rates (e.g. p=1%), permutations can be too liberal; (iv) TFCE controls best the type 1 error rate with an attenuated extent parameter (i.e. power<1).

Original languageEnglish
Pages (from-to)85–93
JournalJournal of Neuroscience Methods
Volume250
Early online date13 Aug 2014
DOIs
Publication statusPublished - 30 Jul 2015

Keywords

  • Cluster-based statistics
  • ERP
  • Family-wise error rate
  • Monte-Carlo simulations
  • Multiple comparison correction
  • Threshold free cluster enhancement

Fingerprint

Dive into the research topics of 'Cluster-based computational methods for mass univariate analyses of event-related brain potentials/fields: A simulation study'. Together they form a unique fingerprint.

Cite this