| accessors | Access to Parts of the Model Description |
| actions | Available Actions |
| add_policy | Add a Policy to a POMDP Problem Description |
| Cliff_walking | Cliff Walking Gridworld MDP |
| colors | Default Colors for Visualization in Package pomdp |
| DynaMaze | The Dyna Maze |
| estimate_belief_for_nodes | Estimate the Belief for Policy Graph Nodes |
| gridworld | Helper Functions for Gridworld MDPs |
| Maze | Steward Russell's 4x3 Maze Gridworld MDP |
| MDP | Define an MDP Problem |
| MDP2POMDP | Convert between MDPs and POMDPs |
| MDP_policy_functions | Functions for MDP Policies |
| optimal_action | Optimal action for a belief |
| plot_belief_space | Plot a 2D or 3D Projection of the Belief Space |
| plot_policy_graph | POMDP Plot Policy Graphs |
| policy | Extract the Policy from a POMDP/MDP |
| policy_graph | POMDP Policy Graphs |
| POMDP | Define a POMDP Problem |
| POMDP_example_files | POMDP Example Files |
| pomdp-package | pomdp: Infrastructure for Partially Observable Markov... |
| projection | Defining a Belief Space Projection |
| reachable_and_absorbing | Reachable and Absorbing States |
| regret | Calculate the Regret of a Policy |
| reward | Calculate the Reward for a POMDP Solution |
| round_stochastic | Round a stochastic vector or a row-stochastic matrix |
| RussianTiger | Russian Tiger Problem POMDP Specification |
| sample_belief_space | Sample from the Belief Space |
| simulate_MDP | Simulate Trajectories in a MDP |
| simulate_POMDP | Simulate Trajectories Through a POMDP |
| solve_MDP | Solve an MDP Problem |
| solve_POMDP | Solve a POMDP Problem using pomdp-solver |
| solve_SARSOP | Solve a POMDP Problem using SARSOP |
| Tiger | Tiger Problem POMDP Specification |
| transition_graph | Transition Graph |
| update_belief | Belief Update |
| value_function | Value Function |
| Windy_gridworld | Windy Gridworld MDP |
| write_POMDP | Read and write a POMDP Model to a File in POMDP Format |
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.