メインコンテンツに移動

Journal of Operational Risk

Risk.net

Model validation of a generative-artificial-intelligence-based avatar for customer support in banking

Jochen Gerhard, Martin Gombert, Björn Henrich and James Smith

  • Model risk management is key for ensuring trustworthiness in AI-based virtual assistants. It plays a strategic role by engaging in independent validation and managing risks specific to AI applications.
  • Traditional model validation approaches fall short for generative AI. We introduce a systematic framework with guardrails focusing on human oversight, fairness, transparency, and reliability, tailored the challenges of GenAI.
  • Our framework aligns the theoretical dimension with practical processes like rigorous testing, continuous monitoring, lifecycle management, and risk scenario assessment.
  • Vendor-provided GenAI systems inherently carry higher residual risks due to opacity, probabilistic outputs, and complexity.

This study presents an innovative validation approach for a generative-artificial-intelligence-based avatar named Ava, designed to handle customer inquiries in the banking sector. Classical model validation frameworks fall short when applied to generative artificial intelligence models due to the opaque, black-box nature of such models. This paper introduces a systematic framework of guardrails that emphasize trustworthiness, including rigorous testing, real-time monitoring, scenario assessment and effective governance. Our validation approach ensures Ava adheres to principles of human oversight, fairness, transparency and reliability, which are vital for safe use in financial services. Using Commerzbank’s Ava as a case study, the framework provides insights into achieving trustworthy artificial intelligence in highly regulated sectors, balancing innovation and compliance.

Sorry, our subscription options are not loading right now

Please try again later. Get in touch with our customer services team if this issue persists.

New to Risk.net? View our subscription options

無料メンバーシップの内容をお知りになりたいですか?ここをクリック

パスワードを表示
パスワードを非表示にする

You need to sign in to use this feature. If you don’t have a Risk.net account, please register for a trial.

ログイン
You are currently on corporate access.

To use this feature you will need an individual account. If you have one already please sign in.

Sign in.

Alternatively you can request an individual account here