Uncertainty, credal sets and second order probability

The last 20 years or so has seen an intense search carried out within Dempster–Shafer theory, with the aim of finding a generalization of the Shannon entropy for belief functions. In that time, there has also been much progress made in credal set theory—another generalization of the traditional Bayesian epistemic representation—albeit not in this particular area. In credal set theory, sets of probability functions are utilized to represent the epistemic state of rational agents instead of the single probability function of traditional Bayesian theory. The Shannon entropy has been shown to uniquely capture certain highly intuitive properties of uncertainty, and can thus be considered a measure of that quantity. This article presents two measures developed with the purpose of generalizing the Shannon entropy for (1) unordered convex credal sets and (2) possibly non-convex credal sets ordered by second order probability, thereby providing uncertainty measures for such epistemic representations. There is also a comparison with the results of the measure AU developed within Dempster–Shafer theory in a few instances where unordered convex credal set theory and Dempster–Shafer theory overlap.