Journal of Risk Model Validation

Validation of credit default probabilities using multiple-testing procedures

Sebastian Döhler


We consider the problem of identifying inaccurate default probability estimates in credit rating systems. Since the validation of these estimates usually entails performing multiple tests, there is an increased risk of erroneously dismissing correctly calibrated default probabilities. We use multiple-testing procedures to control this risk of committing type-I errors as measured by the family-wise error rate (FWER) and the false discovery rate for finite sample sizes. For the FWER, we also consider procedures that take possible discreteness of the data (and the test statistics) into account. The performance of these methods is illustrated in a simulation setting and for empirical default data. The results show that both types of multiple-testing procedure can serve as helpful tools for identifying inaccurate estimates while maintaining a predefined level of type-I error.

Sorry, our subscription options are not loading right now

Please try again later. Get in touch with our customer services team if this issue persists.

New to View our subscription options

You need to sign in to use this feature. If you don’t have a account, please register for a trial.

Sign in
You are currently on corporate access.

To use this feature you will need an individual account. If you have one already please sign in.

Sign in.

Alternatively you can request an individual account here