Journal of Risk Model Validation

Risk.net

Discriminatory power: an obsolete validation criterion?

Manuel Lingo, Gerhard Winkler

ABSTRACT

In this paper we analyze two common measures of discriminatory power, the accuracy ratio and the area under the receiver operator characteristic, in a probabilistic framework. Under the assumption of a random default event, we verify that the measures will be portfolio dependent, as discovered by Hamerle et al (2003), and furthermore stochastic, as indicated by Blochwitz et al (2005). As an extension we first study how the structure of a portfolio influences the measures. Furthermore we demonstrate that the measures contain information about a rating system’s calibration quality. To this end a testing procedure is developed that also allows for a comparison of the measures across different portfolios. Our analysis leads to the final conclusion that high granularity and good calibration quality are sufficient to maximize attainable discriminatory power and are thus the sole criteria to be considered in any validation exercise.

Sorry, our subscription options are not loading right now

Please try again later. Get in touch with our customer services team if this issue persists.

New to Risk.net? View our subscription options

If you already have an account, please sign in here.

You need to sign in to use this feature. If you don’t have a Risk.net account, please register for a trial.

Sign in
You are currently on corporate access.

To use this feature you will need an individual account. If you have one already please sign in.

Sign in.

Alternatively you can request an individual account here: