Practical variable selection for generalized additive models

Giampiero Marra*, Simon N. Wood

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

The problem of variable selection within the class of generalized additive models, when there are many covariates to choose from but the number of predictors is still somewhat smaller than the number of observations, is considered. Two very simple but effective shrinkage methods and an extension of the nonnegative garrote estimator are introduced. The proposals avoid having to use nonparametric testing methods for which there is no general reliable distributional theory. Moreover, component selection is carried out in one single step as opposed to many selection procedures which involve an exhaustive search of all possible models. The empirical performance of the proposed methods is compared to that of some available techniques via an extensive simulation study. The results show under which conditions one method can be preferred over another, hence providing applied researchers with some practical guidelines. The procedures are also illustrated analysing data on plasma beta-carotene levels from a cross-sectional study conducted in the United States.

Original languageEnglish
Pages (from-to)2372-2387
Number of pages16
JournalComputational Statistics and Data Analysis
Volume55
Issue number7
Early online date10 Feb 2011
DOIs
Publication statusPublished - 1 Jul 2011

Keywords / Materials (for Non-textual outputs)

  • Generalized additive model
  • Nonnegative garrote estimator
  • Penalized thin plate regression spline
  • Practical variable selection
  • Shrinkage smoother

Fingerprint

Dive into the research topics of 'Practical variable selection for generalized additive models'. Together they form a unique fingerprint.

Cite this