MDP2: Markov Decision Processes (MDPs)

Create and optimize (semi) MDPs with discrete time steps and state space. Both hierarchical and ordinary-traditional MDPs can be modeled.

Package details

AuthorLars Relund Nielsen [aut, cre] (ORCID: <https://orcid.org/0000-0002-4802-3071>)
MaintainerLars Relund Nielsen <lars@relund.dk>
LicenseGPL (>= 3)
Version2.2.2.0
URL https://relund.github.io/mdp/ https://github.com/relund/mdp/ http://relund.github.io/mdp/
Package repositoryView on CRAN
Installation Install the latest version of this package by entering the following in R:
install.packages("MDP2")

Try the MDP2 package in your browser

Any scripts or data that you put into this service are public.

MDP2 documentation built on June 13, 2026, 1:08 a.m.