Decision theory and artificial intelligence II: The hungry monkey

This paper describes a problem-solving framework In which aspects of mathematical decision theory are incorporated into symbolic problem-solving techniques currently predominant in artificial intelligence. The utility function of decision theory IS used to reveal tradeoffs among competing strategies for achieving various goals, taking into account such factors as reliability, the complexity of steps in the strategy, and the value of the goal. The utility function on strategies can therefore be used as a guide when searching for good strategies. It is also used to formulate solutions to the problems of how to acquire a world model, how much planning effort is worthwhile, and whether verification tests should be performed. These techniques are illustrated by application to the classic monkey and bananas problem.