| accessors | Access to Parts of the Model Description | 
| actions | Available Actions | 
| add_policy | Add a Policy to a POMDP Problem Description | 
| Cliff_walking | Cliff Walking Gridworld MDP | 
| colors | Default Colors for Visualization in Package pomdp | 
| DynaMaze | The Dyna Maze | 
| estimate_belief_for_nodes | Estimate the Belief for Policy Graph Nodes | 
| gridworld | Helper Functions for Gridworld MDPs | 
| Maze | Steward Russell's 4x3 Maze Gridworld MDP | 
| MDP | Define an MDP Problem | 
| MDP2POMDP | Convert between MDPs and POMDPs | 
| MDP_policy_functions | Functions for MDP Policies | 
| optimal_action | Optimal action for a belief | 
| plot_belief_space | Plot a 2D or 3D Projection of the Belief Space | 
| plot_policy_graph | POMDP Plot Policy Graphs | 
| policy | Extract the Policy from a POMDP/MDP | 
| policy_graph | POMDP Policy Graphs | 
| POMDP | Define a POMDP Problem | 
| POMDP_example_files | POMDP Example Files | 
| pomdp-package | pomdp: Infrastructure for Partially Observable Markov... | 
| projection | Defining a Belief Space Projection | 
| reachable_and_absorbing | Reachable and Absorbing States | 
| regret | Calculate the Regret of a Policy | 
| reward | Calculate the Reward for a POMDP Solution | 
| round_stochastic | Round a stochastic vector or a row-stochastic matrix | 
| RussianTiger | Russian Tiger Problem POMDP Specification | 
| sample_belief_space | Sample from the Belief Space | 
| simulate_MDP | Simulate Trajectories in a MDP | 
| simulate_POMDP | Simulate Trajectories Through a POMDP | 
| solve_MDP | Solve an MDP Problem | 
| solve_POMDP | Solve a POMDP Problem using pomdp-solver | 
| solve_SARSOP | Solve a POMDP Problem using SARSOP | 
| Tiger | Tiger Problem POMDP Specification | 
| transition_graph | Transition Graph | 
| update_belief | Belief Update | 
| value_function | Value Function | 
| Windy_gridworld | Windy Gridworld MDP | 
| write_POMDP | Read and write a POMDP Model to a File in POMDP Format | 
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.