What do we mean by "controllable actions" in a POMDP?

Viewed 367

I have some questions related to POMDPs.

  1. What do we mean by controllable actions in a partially observable Markov decision process? Or no controllable actions in hidden Markov states?

  2. When computing policies through value or policy iteration, could we say that the POMDP is an expert system (because we model the environment)? While, when using Q-learning, it is a more flexible system in terms of intelligence or adaptability to a changing environment?

1 Answers
Related