Fast stable direct fitting and smoothness selection for generalized additive models

Research output: Contribution to journalArticlepeer-review

Abstract / Description of output

Existing computationally efficient methods for penalized likelihood generalized additive model fitting employ iterative smoothness selection on working linear models (or working mixed models). Such schemes fail to converge for a non-negligible proportion of models, with failure being particularly frequent in the presence of concurvity. If smoothness selection is performed by optimizing 'whole model' criteria these problems disappear, but until now attempts to do this have employed finite-difference-based optimization schemes which are computationally inefficient and can suffer from false convergence. The paper develops the first computationally efficient method for direct generalized additive model smoothness selection. It is highly stable, but by careful structuring achieves a computational efficiency that leads, in simulations, to lower mean computation times than the schemes that are based on working model smoothness selection. The method also offers a reliable way of fitting generalized additive mixed models.

Original languageEnglish
Pages (from-to)495-518
Number of pages24
JournalJournal of the Royal Statistical Society: Statistical Methodology Series B
Issue number3
Early online date10 Apr 2008
Publication statusPublished - 31 Jul 2008

Keywords / Materials (for Non-textual outputs)

  • Akaike's information criterion
  • Generalized additive mixed models
  • Generalized additive models
  • Generalized approximate cross-validation
  • Generalized cross-validation
  • Penalized likelihood
  • Penalized regression splines
  • Stable computation


Dive into the research topics of 'Fast stable direct fitting and smoothness selection for generalized additive models'. Together they form a unique fingerprint.

Cite this