Power analysis software for educational researchers

Chao-Ying Joanne Peng, Haiying Long, S. Abaci

Research output: Contribution to journalArticlepeer-review

Abstract

Given the importance of statistical power analysis in quantitative research and the repeated emphasis on it by American Educational Research Association/American Psychological Association journals, the authors examined the reporting practice of power analysis by the quantitative studies published in 12 education/psychology journals between 2005 and 2010. It was surprising to uncover that less than 2% of the studies conducted prospective power analysis. Another 3.5% computed observed power, a practice not endorsed by the literature on power analysis. In this article, the authors clarify these 2 types of power analysis and discuss functionalities of 8 programs/packages (G*Power 3.1.3, PASS 11, SAS/STAT 9.3, Stata 12, SPSS 19, SPSS/Sample Power 3.0.1, Optimal Design Software 2.01, and MLPowSim 1.0 BETA) to encourage proper and planned power analysis. On the basis of their review, the authors recommend 2 programs (SPSS/Sample Power and G*Power) for general purpose univariate/multivariate analyses, and 1 (Optimal Design Software) for hierarchical/multilevel modeling and meta-analysis. Recommendations are also made for reporting power analysis results and exploring additional software. The article concludes with an examination of the role of statistical power in research and viable alternatives to hypothesis testing.
Original languageEnglish
Pages (from-to)113-136
Number of pages24
JournalJournal of Experimental Education
Volume80
Issue number2
Early online date10 Feb 2012
DOIs
Publication statusPublished - 2012

Keywords

  • G*Power
  • Observed power
  • sample power
  • prospective power

Fingerprint

Dive into the research topics of 'Power analysis software for educational researchers'. Together they form a unique fingerprint.

Cite this