Optimal cut-off for rare events and unbalanced misclassification costs

Research output: Contribution to journalArticlepeer-review

Abstract

This paper develops a method for handling two-class classification problems with highly unbalanced class sizes and misclassification costs. When the class sizes are highly unbalanced and the minority class represents a rare event, conventional classification methods tend to strongly favour the majority class, resulting in very low detection of the minority class. A method is proposed to determine the optimal cut-off for asymmetric misclassification costs and for unbalanced class sizes. Monte Carlo simulations show that this proposal performs better than the method based on the notion of classification accuracy. Finally, the proposed method is applied to empirical data on Italian small and medium enterprises to classify them into default and non-default groups.
Original languageEnglish
Pages (from-to)1678-1693
JournalJournal of Applied Statistics
Volume41
Issue number8
DOIs
Publication statusPublished - 10 Feb 2014

Fingerprint Dive into the research topics of 'Optimal cut-off for rare events and unbalanced misclassification costs'. Together they form a unique fingerprint.

Cite this