expectedRewardsBeforeHittingA: Expected first passage Rewards for a set of states in a...

In markovchain: Easy Handling Discrete Time Markov Chains

Expected first passage Rewards for a set of states in a markovchain

Description

Given a markovchain object and reward values for every state, function calculates expected reward value for a set A of states after n steps.

Usage

expectedRewardsBeforeHittingA(markovchain, A, state, rewards, n)

Arguments

markovchain	the markovchain-class object
A	set of states for first passage expected reward
state	initial state
rewards	vector depicting rewards coressponding to states
n	no of steps of the process

Details

The function returns the value of expected first passage rewards given rewards coressponding to every state, an initial state and number of steps.

Value

returns a expected reward (numerical value) as described above

Author(s)

Sai Bhargav Yalamanchi, Vandit Jain

markovchain documentation built on Sept. 24, 2023, 5:06 p.m.