Man pages for MDP2
Markov Decision Processes (MDPs)

actionIdxDfInfo about the actions in the HMDP model under consideration.
actionIdxMatInfo about the actions in the HMDP model under consideration.
actionInfoInfo about the actions in the HMDP model under consideration.
actionWeightMatInfo about the weights of the actions in the HMDP model under...
binaryActionWriterFunction for writing actions of a HMDP model to binary files....
binaryMDPWriterFunction for writing an HMDP model to binary files. The...
checkWDurIdxInternal function. Check if the indexes given are okay....
checkWIdxInternal function. Check if the index of the weight is okay....
convertBinary2HMPConvert a HMDP model stored in binary format to a 'hmp' (XML)...
convertHMP2BinaryConvert a HMDP model stored in a hmp (xml) file to binary...
getBinInfoActionsInfo about the actions in the HMDP model under consideration.
getBinInfoStatesInfo about the states in the binary files of the HMDP model...
getHypergraphReturn the (parts of) state-expanded hypergraph
getInfoInformation about the MDP
getPolicyGet parts of the optimal policy.
getRPOCalculate the retention pay-off (RPO) or opportunity cost for...
getSteadyStatePrCalculate the steady state transition probabilities for the...
getWIdxReturn the index of a weight in the model. Note that index...
hmpMDPWriterFunction for writing an HMDP model to a hmp file (XML). The...
loadMDPLoad the HMDP model defined in the binary files. The model...
MDP2-packageMDP2: Markov Decision Processes (MDPs)
memoryMDPWriterFunction for building an HMDP model directly in memory.
plot.HMDPPlot the state-expanded hypergraph of the MDP.
plotHypergraphPlot parts of the state expanded hypergraph.
randomHMDPGenerate a "random" HMDP stored in a set of binary files.
runCalcWeightsCalculate weights based on current policy. Normally run after...
runPolicyIteAvePerform policy iteration using the average expected-weight...
runPolicyIteDiscountPerform policy iteration using the discounted expected-weight...
runValueItePerform value iteration on the MDP.
saveMDPSave the MDP to binary files
setPolicyModify the current policy by setting policy action of states.
stateIdxDfInfo about the states in the HMDP model under consideration.
stateIdxMatInfo about the states in the HMDP model under consideration.
transProbMatInfo about the transition probabilities in the HMDP model...
weightNamesNames of weights used in actions.
MDP2 documentation built on June 13, 2026, 1:08 a.m.