pomdp-package

pomdp: Infrastructure for Partially Observable Markov Decision Processes (POMDP)

Provides the infrastructure to define and analyze the solutions of Partially Observable Markov Decision Process (POMDP) models. Interfaces for various exact and approximate solution algorithms are available including value iteration, point-based value iteration and SARSOP. Smallwood and Sondik (1973) tools:::Rd_expr_doi("10.1287/opre.21.5.1071") . package

Key functions

• Problem specification: POMDP , MDP
• Solvers: solve_POMDP(), solve_MDP(), solve_SARSOP()

See Also

Useful links:

• https://github.com/mhahsler/pomdp
• Report bugs at https://github.com/mhahsler/pomdp/issues

Author(s)

Maintainer : Michael Hahsler mhahsler@lyle.smu.edu (ORCID) [copyright holder]

Other contributors:

• Hossein Kamalzadeh [contributor]