What are the minimal requirements of rational choice? Arguments from the sequential-decision setting

There are at least two plausible generalisations of subjective expected utility (SEU) theory: cumulative prospect theory (which relaxes the independence axiom) and Levi’s decision theory (which relaxes at least ordering). These theories call for a re-assessment of the minimal requirements of rational choice. Here, I consider how an analysis of sequential decision making contributes to this assessment. I criticise Hammond’s (Economica 44(176):337–350, 1977; Econ Philos 4:292–297, 1988a; Risk, decision and rationality, 1988b; Theory Decis 25:25–78, 1988c) ‘consequentialist’ argument for the SEU preference axioms, but go on to formulate a related diachronic-Dutch-book-style’ argument that better achieves Hammond’s aims. Some deny the importance of Dutch-book sure losses, however, in which case, Seidenfeld’s (Econ Philos 4:267–290, 1988a) argument that distinguishes between theories that relax independence and those that relax ordering is relevant. I unravel Seidenfeld’s argument in light of the various criticisms of it and show that the crux of the argument is somewhat different and much more persuasive than what others have taken it to be; the critical issue is the modelling of future choices between ‘indifferent’ decision-tree branches in the sequential setting. Finally, I consider how Seidenfeld’s conclusions might nonetheless be resisted.     

Elementary proof that mean–variance implies quadratic utility

An extensive literature overlapping economics, statistical decision theory and finance, contrasts expected utility [EU] with the more recent framework of mean–variance (MV). A basic proposition is that MV follows from EU under the assumption of quadratic utility. A less recognized proposition, first raised by Markowitz, is that MV is fully justified under EU, if and only if utility is quadratic. The existing proof of this proposition relies on an assumption from EU, described here as “Buridan’s axiom” after the French philosopher’s fable of the ass that starved out of indifference between two bales of hay. To satisfy this axiom, MV must represent not only “pure” strategies, but also their probability mixtures, as points in the (σ, μ) plane. Markowitz and others have argued that probability mixtures are represented sufficiently by (σ, μ) only under quadratic utility, and hence that MV, interpreted as a mathematical re-expression of EU, implies quadratic utility. We prove a stronger form of this theorem, not involving or contradicting Buridan’s axiom, nor any more fundamental axiom of utility theory.     

Valuing Others’ Information under Imperfect Expectations

Sometimes we believe that others receive harmful information. However, Marschak’s value of information framework always assigns non-negative value under expected utility: it starts from the decision maker’s beliefs – and one can never anticipate information’s harmfulness for oneself. The impact of decision makers’ capabilities to process information and of their expectations remains hidden behind the individual and subjective perspective Marschak’s framework assumes. By introducing a second decision maker as a point of reference, this paper introduces a way for evaluating others’ information from a cross-individual, imperfect expectations perspective for agents maximising expected utility. We define the cross-value of information that can become negative – then the information is “harmful” from a cross-individual perspective – and we define (mutual) cost of limited information processing capabilities and imperfect expectations as an opportunity cost from this same point of reference. The simple relationship between these two expected utility-based concepts and Marschak’s framework is shown, and we discuss evaluating short-term reactions of stock market prices to new information as an important domain of valuing others’ information.      

Statistical decisions under ambiguity

This article provides unified axiomatic foundations for the most common optimality criteria in statistical decision theory. It considers a decision maker who faces a number of possible models of the world (possibly corresponding to true parameter values). Every model generates objective probabilities, and von Neumann–Morgenstern expected utility applies where these obtain, but no probabilities of models are given. This is the classic problem captured by Wald’s (Statistical decision functions, 1950) device of risk functions. In an Anscombe–Aumann environment, I characterize Bayesianism (as a backdrop), the statistical minimax principle, the Hurwicz criterion, minimax regret, and the “Pareto” preference ordering that rationalizes admissibility. Two interesting findings are that c-independence is not crucial in characterizing the minimax principle and that the axiom which picks minimax regret over maximin utility is von Neumann–Morgenstern independence.     

The Likelihood Method for Decision under Uncertainty

This paper introduces the likelihood method for decision under uncertainty. The method allows the quantitative determination of subjective beliefs or decision weights without invoking additional separability conditions, and generalizes the Savage–de Finetti betting method. It is applied to a number of popular models for decision under uncertainty. In each case, preference foundations result from the requirement that no inconsistencies are to be revealed by the version of the likelihood method appropriate for the model considered. A unified treatment of subjective decision weights results for most of the decision models popular today. Savage’s derivation of subjective expected utility can now be generalized and simplified. In addition to the intuitive and empirical contributions of the likelihood method, we provide a number of technical contributions: We generalize Savage’s nonatomiticy condition (“P6”) and his assumption of (sigma) algebras of events, while fully maintaining his flexibility regarding the outcome set. Derivations of Choquet expected utility and probabilistic sophistication are generalized and simplified similarly. The likelihood method also reveals a common intuition underlying many other conditions for uncertainty, such as definitions of ambiguity aversion and pessimism.     

A Method for Eliciting Utilities and its Application to Collective Choice

Designing a mechanism that provides a direct incentive for an individual to report her utility function over several alternatives is a difficult task. A framework for such mechanism design is the following: an individual (a decision maker) is faced with an optimization problem (e.g., maximization of expected utility), and a mechanism designer observes the decision maker’s action. The mechanism does reveal the individual’s utility truthfully if the mechanism designer, having observed the decision maker’s action, infers the decision maker’s utilities over several alternatives. This paper studies an example of such a mechanism and discusses its application to the problem of optimal social choice. Under certain simplifying assumptions about individuals’ utility functions and about how voters choose their voting strategies, this mechanism selects the alternative that maximizes Harsanyi’s social utility function and is Pareto-efficient.     

Great Expectations. Part I: On the Customizability of Generalized Expected Utility

We propose a generalization of expected utility that we call generalized EU (GEU), where a decision maker’s beliefs are represented by plausibility measures and the decision maker’s tastes are represented by general (i.e., not necessarily real-valued) utility functions. We show that every agent, “rational” or not, can be modeled as a GEU maximizer. We then show that we can customize GEU by selectively imposing just the constraints we want. In particular, we show how each of Savage’s postulates corresponds to constraints on GEU.     

Dynamic Choice, Independence and Emotions

From the viewpoint of the independence axiom of expected utility theory, an interesting empirical dynamic choice problem involves the presence of a “global risk,” that is, a chance of losing everything whichever safe or risky option is chosen. In this experimental study, participants have to allocate real money between a safe and a risky project. Treatment variable is the particular decision stage at which a global risk is resolved: (i) before the investment decision; (ii) after the investment decision, but before the resolution of the decision risk; (iii) after the resolution of the decision risk. The baseline treatment is without global risk. Our goal is to investigate the isolation effect and the principle of timing independence under the different timing options of the global risk. In addition, we examine the role played by anticipated and experienced emotions in the choice problem. Main findings are a violation of the isolation effect, and support for the principle of timing independence. Although behavior across the different global risk cases shows similarities, we observe clear differences in people’s affective responses. This may be responsible for the conflicting results observed in earlier experiments. Dependent on the timing of the global risk different combinations of anticipated and experienced emotions influence decision making.      

Betting on Machina’s reflection example: an experiment on ambiguity

In a recent article, Machina (Am Econ Rev forthcoming, 2008) suggested choice problems in the spirit of Ellsberg (Q J Econ 75:643–669, 1961), which challenge tail-separability, an implication of Choquet expected utility (CEU), to a similar extent as the Ellsberg paradox challenged the sure-thing principle implied by subjective expected utility (SEU). We have tested choice behavior for bets on one of Machina’s choice problems, the reflection example. Our results indicate that tail-separability is violated by a large majority of subjects (over 70% of the sample). These empirical findings complement the theoretical analysis of Machina (Am Econ Rev forthcoming, 2008) and, together, they confirm the need for new approaches in the analysis of ambiguity for decision making.     

Aspects concerning entropy and utility

Expected utility maximization problem is one of the most useful tools in mathematical finance, decision analysis and economics. Motivated by statistical model selection, via the principle of expected utility maximization, Friedman and Sandow (J Mach Learn Res 4:257–291, 2003a) considered the model performance question from the point of view of an investor who evaluates models based on the performance of the optimal strategies that the models suggest. They interpreted their performance measures in information theoretic terms and provided new generalizations of Shannon entropy and Kullback–Leibler relative entropy and called them U-entropy and U-relative entropy. In this article, a utility-based criterion for independence of two random variables is defined. Then, Markov’s inequality for probabilities is extended from the U-entropy viewpoint. Moreover, a lower bound for the U-relative entropy is obtained. Finally, a link between conditional U-entropy and conditional Renyi entropy is derived.     

Choice under risk and the security factor: An axiomatic model

The particular attention paid by decision makers to the security level ensured by each decision under risk, which is responsible for the certainty effect, can be taken into account by weakening the independence and continuity axioms of expected utility theory. In the resulting model, preferences depend on: (i) the security level, (ii) the expected utility, offered by each decision. Choices are partially determined by security level comparison and completed by the maximization of a function, which express the existing tradeoffs between expected utility and security level, and is, at a given security level, an affine function of the expected utility. In the model, risk neutrality at a given security level implies risk aversion.     

Ambiguity framed

In his exposition of subjective expected utility theory, Savage (1954) proposed that the Allais paradox could be reduced if it were recast into a format which made the appeal of the independence axiom of expected utility theory more transparent. Recent studies consistently find support for this prediction. We consider a salience-based choice model which explains this frame-dependence of the Allais paradox. We then derive the novel prediction that the presentation format responsible for reductions in Allais-style violations of expected utility theory will also reduce Ellsberg-style violations of subjective expected utility theory. This format makes the appeal of Savage’s “sure thing principle” more transparent. We design an experiment to test this prediction and find strong support for such frame-dependence of ambiguity aversion in Ellsberg-style choices. In particular, we observe markedly less ambiguity-averse behavior in Savage’s matrix format than in a more standard “prospect” format. This finding poses a new challenge for the leading models of ambiguity aversion.     

Consequentialist foundations for expected utility

Behaviour norms are considered for decision trees which allow both objective probabilities and uncertain states of the world with unknown probabilities. Terminal nodes have consequences in a given domain. Behaviour is required to be consistent in subtrees. Consequentialist behaviour, by definition, reveals a consequence choice function independent of the structure of the decision tree. It implies that behaviour reveals a revealed preference ordering satisfying both the independence axiom and a novel form of sure-thing principle. Continuous consequentialist behaviour must be expected utility maximizing. Other plausible assumptions then imply additive utilities, subjective probabilities, and Bayes' rule.     

Ambiguity,pessimism, and rational religious choice

Using a subclass of the α-maximin expected-utility preference model, in which the decision maker’s degree of ambiguity and degree of pessimism are each parameterized, we present a theory of religious choice in the Pascalian decision theory tradition, one that can resolve dilemmas, address the “many Gods objection,” and address the ambiguity inherent in religious choice. Parameterizing both the degree of ambiguity and the degree of pessimism allows one to examine how the two interact to impact choice, which is useful regardless of the application. Applying this model to religious choice is a move beyond subjective expected-utility theory, allowing us to show that a change in either the degree of ambiguity or the degree of pessimism can lead a decision maker to “convert” from one religion to another.     

Asking Price and Price Discounts: The Strategy of Selling an Asset Under Price Uncertainty

We consider fixed and asking price strategies in the context of selling an asset with Bernoullian updating of the seller’s subjective probability of sale at a given price. The determination of optimal fixed, asking and endogenous reservation prices is discussed under risk-neutrality and expected utility maximisation. With risk-neutrality, the optimal asking price exceeds the optimal fixed price when the expected gain is a strictly concave function. The seller’s choice between the fixed and the asking price strategies depends on several factors: the expected cost of haggling, price competition and the seller’s attitude towards risk.     

Eliciting beliefs

We develop an algorithm that can be used to approximate a decisionmaker’s beliefs for a class of preference structures that includes, among others, α-maximin expected utility preferences, Choquet expected utility preferences, and, more generally, constant additive preferences. For both exact and statistical approximation, we demonstrate convergence in an appropriate sense to the true belief structure.     

Causality in the logic of decision

In recent years there has been an active debate between proponents of two different models of rational decision. One model is evidential decision theory, which is characterized by the fact that it holds the principle of maximizing expected utility to be appropriate whenever the states are probabilistically independent of the acts. The other model, causal decision theory, holds that the principle of maximizing expected utility is appropriate whenever the states are causally independent of the acts. The proponents of evidential decision theory include Richard Jeffrey and Ellery Eells, who claim that evidential decision theory has significant advantages over causal decision theory. In this paper I discuss the two main advantages which have been claimed for evidential decision theory, and show that in fact evidential decision theory does not possess either of these advantages.     

Interpersonal dependency of preferences

Standard decision theoretic models disregard the phenomenon of interpersonal dependency of preferences. In this paper it is argued that interpersonal dependency of preferences is a serious challenge for standard utility theory. First we sketch the more philosophical aspects of the problem and then, using a simple, formal model for the two-person case, we show that interpersonal dependency of preferences generally results in indeterminacy of preferences (resp. of subjective utility).