メインコンテンツに移動

Introduction

Miquel Noguer i Alonso, Daniel Bloch and David Pacheco Aznar

Volume 1 of Artificial Intelligence in Finance offered a rich, detailed exploration of how artificial intelligence (AI) technologies intersect with the financial industry, while this volume provides more technical information on machine learning, as well as applications. In this chapter we describe the format of this volume.

1.1 MARKOV DECISION PROBLEMS

Chapter 2, on Markov decision problems (MDPs), delves into the mathematical framework used to model decision-making in reinforcement learning and other AI contexts. We begin by defining MDPs and exploring their key components, including states, actions, transition probabilities and rewards. We discuss how MDPs represent sequential decision-making problems where the outcomes are partly random and partly under the control of a decision maker. The stochastic nature of MDPs is explained, emphasising how decisions made in one state affect the trajectory of the system over time.

We outline different types of MDPs, including those with discrete and continuous time, and we examine the role of the Bellman equations in solving MDPs. This chapter provides a comprehensive overview of the credit assignment problem, a critical aspect of

Sorry, our subscription options are not loading right now

Please try again later. Get in touch with our customer services team if this issue persists.

New to Risk.net? View our subscription options

無料メンバーシップの内容をお知りになりたいですか?ここをクリック

パスワードを表示
パスワードを非表示にする

You need to sign in to use this feature. If you don’t have a Risk.net account, please register for a trial.

ログイン
You are currently on corporate access.

To use this feature you will need an individual account. If you have one already please sign in.

Sign in.

Alternatively you can request an individual account here