Keywords: Rational inattention, dynamic programming, consumption
Abstract:
Information is, we must steadily remember, a measure of one's freedom of choice in selecting a message. The greater this freedom of choice, and hence the greater the information, the greater is the uncertainty that the message actually selected is some particular one. Thus greater freedom of choice, greater uncertainty, greater information go hand in hand. (Claude Shannon, sic.)
Every day people face an overwhelming amount of data. Every day, though, people use these for their decisions. In selecting useful information, people face a trade off between reacting quickly and precisely to news about their financial possibilities and not spending time crunching numbers to figure out their exact net worth. To match these facts, macroeconomists have adopted a number of modelling strategies able to inject inertia within the rational expectation framework. These devices, such as the costly acquisition and diffusion of information, largely rely on ad-hoc technology to generate smooth and delayed responses of consumption to a shock to income consistent with observed data. Contrary to this approach, this paper proposes a way to relate inertial behavior in consumption and savings based on people's preferences.
To this end, the paper offers a micro-founded explanation on the nature of inertia in consumption and savings. Following Rational Inattention (Sims, 2003, 2006), I model the limits of people to process information at an infinite rate by using Shannon channels.
Under this information processing constraint, individuals choose a signal that conveys information about their financial possibilities. The signal can provide any kind of information as long as its overall content is within the channel's capacity. Consumers base their expectations of the economic conditions on the signal and decide how much to consume. Thus, in my framework, the delayed and smoothed responses of savings to changes in wealth are the result of a slow information flow due to processing constraints. Combining the standard utility maximization framework subject to a budget constraint with information processing limits leads to a departure from rational expectations. My paper shows how to model this formally in an intertemporal setting. In particular, I assume that people do not know the exact value of their wealth but have an idea of their net worth. A way of thinking about this hypothesis is that people do not know exactly of what the dollar value of their paycheck (nominal) corresponds to in terms of cups of coffee (real), assuming that this is what they care about. People process information to sharpen their knowledge of how much consumption their wealth can purchase. I model initial uncertainty as a probability distribution over the possible realizations of wealth. In such a framework, it is possible to study how choices of information play out with people's preferences when they decide on consumption throughout their life time.
The challenge of this model and, more generally, of models of rational inattention is dealing with the infinite dimensional state space implied by having a prior as state. For this reason, the applications of rational inattention have been limited to either a linear quadratic framework where Gaussian uncertainty has been considered (such as Sims 1998, 2003, Luo 2007, Mackowiak and Wiederholt 2007, Mondria, 2006, Moscarini 2004) or a two-period consumption-saving problem (Sims 2006) where the choice of optimal ex post uncertainty is analyzed for the case of log utility and two Constant Relative Risk Aversion (CRRA) utility specifications. The linear quadratic Gaussian (LQG) framework can be seen as a particular instance of rational inattention in which the optimal distribution chosen by the household turns out to be Gaussian. Gaussianity has two main advantages. First, it allows an explicit analytical solution for these models. One can show that the problem can be solved in two steps. First, the information gathering scheme is found and then, given the optimal information, the consumption profile. Second, it is easy to compare the results to a signal extraction problem. When looking at the behavior of rational inattentive consumers, it is impossible to separate an exogenously given Gaussian noise in the signal extraction model from an endogenous noise that is optimally chosen to be Gaussian.
The tractability of rational inattention LQG models comes at the cost of restrictive assumptions on preferences and the nature of the signal. Constraining uncertainty of the individual to a quadratic loss / certainty equivalent setting does not take into account the possibility that the agent is very uncertain about his economic environment; ceteris paribus, more uncertainty generates second-order effects of information that have first order impact on individuals' decisions. In this sense, rational inattention LQG models are subject to the same limits as methods that use linear approximation of optimality conditions to study stochastic dynamic models.1 With little uncertainty about the economic environment, linear approximations of the optimality conditions may provide a fairly adequate description of the exact solution of the system. This fact suggests that the uncertainty at the individual level might actually be large, undermining the accuracy of both linearized and rational inattention LQG models. To assess the importance of information choices for people' expectations, it is important to let consumers select their information from a wider set of distributions that includes but it is not limited to the Gaussian family.
The theoretical contribution of this paper is to provide the analytical and computational tools necessary to apply information theory in a dynamic context with optimal choice of ex-post uncertainty. I propose a methodology to handle the additional complexity without the LQG setting. I propose a discretization of the framework and derive its theoretical properties. Then, I provide a computational strategy that is able to solve the model.
Several predictions emerge from the model. Evaluating the unconditional moments of the time series of consumption for a given degree of risk aversion, the first result of the paper is that higher information costs are associated with more persistence and higher volatility. The seemingly paradoxical results of having sluggish and volatile consumption at the same time can be reconciled if one considers that information-processing constraints prevent the consumers to respond promptly to fluctuations in wealth. To make a concrete example, suppose a person starts off with low wealth and initially chooses to consume a little. If he is risk averse, he may decide not to modify his consumption profile until he acquires more information about his wealth. As he processes information through time, he gets more and more data about his high value of wealth and changes his consumption when he is sure that he has saved enough to afford a higher consumption expenditure. The more risk averse the consumer is, the longer he waits. The longer the wait, the more wealth grows because of the accumulation of savings and current income. The combination of waiting while processing information and sharp changes once information has been processed through time generates sluggishness and volatility in consumption.
Second, by looking at the life-cycle profile of consumption I find that the behavior of consumption is smooth and persistent with several peaks along the simulated path. These peaks in consumption occur later in life for people that have access to low information flow. This effect is stronger as risk aversion increases. The logic behind this result is that risk averse consumers react to uncertainty by processing more information on their low values of wealth and keep their consumption low as a precaution until the uncertainty is diminished. They accumulate more savings throughout early adult life than their infinite-information-processing counterparts. They keep saving until the accumulation of wealth and information indicates that they can enjoy a high consumption profile.
This leads also to the finding that individual consumption can have more than one hump along its path as wealth accumulates through time. The key point is that individuals can vary their information flow during their life time. To see why, suppose that a person receives signals that his wealth is low. In this case, he wants to pay attention to his expenses and closely monitor the activity of his account. Once he makes sure that he has saved enough, he may decide to spend less effort monitoring his balance and enjoy consumption. Decumulation of savings continues until he receives information that he has emptied his checking account. This news call for his attention again, so he starts saving and monitor his balance more frequently than before. These results combined are suggestive of a precautionary motive for savings driven by information processing limits.
Third, I find that consumers with processing capacity constraints have asymmetric responses to income fluctuations, with negative shocks producing sharper and more persistent effects than positive ones. This effect is stronger as the degree of risk aversion increases. Compared with a situation in which there are no information-processing limits, in a rational-inattention consumption-savings model, an adverse temporary income shock makes consumers reduce their consumption for a longer period of time. This happens because risk-averse people who receive bad news about their finances save right away to hedge against the possibility of running out of wealth in the future. Once they have enough savings and information, they gradually increase their consumption and smooth the remaining effect of the shock over time. This result also points toward precautionary motive due to information-processing limits.
Finally, I find that the predictions of the model can be used to address important policy questions. In the context of fiscal reforms of consumer spending, I show that, as wealth decreases, rationally inattentive consumers respond faster to a tax rebate that increases their income by . For a given level of wealth, the lower the processing capacity, the longer it takes for consumption to react to shocks to disposable income. These findings make intuitive sense. A tax rebate matters more for people with lower income and, as a result, tighter budgetary constraints than for wealthy people.2 As a result, poorer people acknowledge and react faster to the positive income shocks. By contrast, wealthy people do not perceive the increase in disposable income as a significant change in their financial position. Thus, consumption for wealthy people does not change significantly, instead it adjusts slowly over time. Consider an individual that has wealth and infinite processing capacities. The reaction of consumption to a temporary positive income shock would be to adjust immediately to a new higher value of consumption so to smooth out the effect of the shock throughout time. With limited processing capacity, the individual smooths consumption slowly over time because the effect of the increase in disposable income on wealth spread out slowly through time. These predictions are in line with the empircal evidence on tax rebate (e.g., Johnson, Parker, and Soules (2006)).
My results are observational distinct from the previous literature on consumption and information (e.g., Reis (2006)). The distinguishing feature of my model with respect to previous works is its ability to generate endogenously asymmetric response of consumption to shocks.3 Finally, my paper contributes to the literature that models how people form endogenously expectations and react to the economy on the basis of their rationally chosen information.4
The paper is organized as follows. Section 2 lays out the theoretical basis of rational inattention and informally introduces the model. Section 3 states the problem of the consumers as a discrete stochastic dynamic programming problem, while Section 4 derives the properties of the Bellman function. Section 5 provides the numerical methodology used to solve the model. Section 6 delivers its main results. By comparing the predictions of the model on the preliminary evidence on tax rebates, I find that the model can be a valid instrument to address the impact of tax reforms on consumer spending. Section 7 concludes.
Rational inattention (Sims 1988,5 1998, 2003, 2005, 2006) blends two main fields: Information Theory and Economics. The first draws mainly on the work of Shannon (1948). The main contribution is to define a measure of the choice involved in the selection of the message and the uncertainty regarding the outcome. The measure used is entropy. Details on this part are in Appendix F. Based on Shannon's apparatus, the economic contribution is that of using Shannon capacity as a technological constraint to capture individuals' inability of processing information about the economy at infinite rate. Given these limits, people reduce their uncertainty by selecting the focus of their attention. The resulting behavior depends on the choices of what to observe of the environment once the information-processing frictions are acknowledged.
Consider a person who wants to buy lunch. He doesn't know his exact wealth but he knows that he has some cash and a credit card. Not recalling the expenses charged on the credit card up to that point, he can go to the bank or simply check his wallet. Going to the bank to figure out his wealth for lunch is beyond his time and interest, so he decides to check his wallet. He browses through it thinking about what he wants and what he can afford to buy for lunch. Mapping dollar bills into his knowledge of prices from previous consumption, he realizes he can only afford a sandwich instead of his favorite sushi roll. Then, he uses the receipt to update his prior on the price of sandwiches, what he thinks he has left in his wallet and, ultimately, his wealth. This updated knowledge will be used for his next purchase. Such a story can be directly mapped into a rational inattention framework.
First, the person does not know his wealth, , but he has a prior on it, . Before processing any information, his uncertainty about wealth is the entropy of his prior, , where denotes the expectation operator.6 Before processing any information, lunch too is a random variable, , ranging from sandwiches to sushi. To reduce entropy, he can choose whether to have a detailed report from the bank or to look at his wallet. The two options differ in amount of information and effort in processing their content. The choice of the option (signal) together with consumption result in a joint probability . Both dollars in the wallet and knowledge of prices of sandwiches and sushi contribute to the reduction of uncertainty in wealth of an amount equal to , which is the entropy of that remains given the knowledge of . The information flow, or maximum reduction of uncertainty about the prior on wealth, is bounded by the information that the selected signal conveys. In formulae:
The example illustrates how people handle everyday decision weighing the effort of processing all the available information (personal net worth), against the precision of the information they can absorb (walking to the bank versus checking the wallet) guided by their interest (buying lunch). This is the core of rational inattention: information is freely available but people can only process it at finite rate. Information-processing limits make attention a scarce resource. As for any other scarce resource, rational people use attention optimally according to what they have at stake. By appending an information-processing constraint to an otherwise standard optimization framework, the theory explains why people react to changes in the economic environment with delays and errors.
The appeal of Shannon capacity as a constraint to attention is that it provides a measure of uncertainty which does not depend on the characteristics of the channel. The quantity (1) is a probabilistic measure of the information shared by two random variables and it applies to any channel. Thus, the Shannon capacity does not require explicit modelling of how individuals process information. Moreover, treating processing capacity as a constraint to utility maximization produces inertial reactions to the environment as a result of individual rational choices. A rational person may not find it worthy to look beyond his wallet when deciding what to buy for lunch. The dollar bills in his wallet provide little information about current and future activities of his balance. Thus, if something happened to his current account, for example, a sudden drop in his investment, checking his wallet would give him no acknowledgement of the event. Nevertheless, the signal is capable of guiding the consumer on his lunch decision. Over time and through expenses, the person would figure out the drop in his investment and modify his behavior even with respect to lunch.
To understand the implications of the limits to information processing, I start with the full information problem.
Let be the measurable space where represents the sample set and the event set. States and actions are defined on . Let be the algebra generated by up to time , i.e., . Then, the collection such that is a filtration. Let be the utility of the household defined over a consumption good, . I assume that the utility belongs to the CRRA family, with the coefficient of risk aversion. Consumer's problem is:
Consider now a consumer who cannot process all the information available in the economy to track his wealth precisely. This not only adds a constraint to the decision problem but fundamentally affects each constraint (3)-(4).
First, because the consumer doesn't know his wealth, (4) no longer holds. His uncertainty about wealth is given by the prior . Second, before processing any information, consumption is also a random variable. This is because the uncertainty about wealth translates into a number of possible consumption profiles with various levels of affordability. It follows that to maximize lifetime utility, consumer needs to reduce uncertainty about wealth and, at the same time, to choose consumption. Hence, when information cannot flow at an infinite rate, the choice of the consumer is the distribution as opposite to the stream of consumption in (2). Another way of looking at this is that the consumer chooses a noisy signal on wealth where the noise can assume any distribution selected by the consumer. Given that the agent has a probability distribution over wealth, choosing this signal is akin to choosing . The optimal choice of this distribution is the one that makes the distribution of consumption conditional on wealth as close to the wealth as the limits imposed by the Shannon capacity allow.
Third, with respect to the program (2)-(4), there is a new constraint on the amount of information the consumer can process. The reduction in uncertainty conveyed by the signal depends on the attention allocated by the consumer to track his wealth. Paying attention to reduce uncertainty requires spending some time and effort to process information. I model the task of thinking by appending a Shannon channel to the constraint sets. Limits in the capacity of the consumers are captured by the fact that the reduction in uncertainty conveyed by the signal cannot be higher than a given number, The information flow available to the consumer is a function of the signal, i.e., the joint distribution . In formulae:
Fourth, the update of the prior replaces the law of motion of wealth by using the budget constraint in (3). To describe the way individuals transit across states, define the operator which combines the expectation in period of a variable in period with the knowledge of consumption in period , , and the remaining uncertainty over wealth. Applying to equation (3) leads to:
Let be the shadow cost of using the channel (5), and combine all these four ingredients. Then, the program of the household under information frictions is:
This problem is a well-posed mathematical problem with convex objective function and concave constraint sets. What makes it hard to solve is that both the state and the control variables are infinite dimensional. To make progress in solving it, I implement two simplifications: a) I discretize the framework and b) I show that the resulting setting admits a recursive formulation. Then, I study the properties of the Bellman recursion and solve the problem.
Before turning to the solution, I present a brief digression about how constraint (9) operates and how the difference between this model and the existing literature on rational inattention may help to build up the intuition for the solution methodology and the results.
To get a sense of how the Shannon capacity constraints affect the decision of the household, I contrast the optimal policy function for consumers that have identical characteristics but differ in their limits of information-processing.
A caveat is in order. In order to explore the interaction between information flow and coefficient of risk aversion, I solve the model in (8)-(12) information flow by fixing the shadow cost of processing information, , attached to (9) and let vary endogenously every period. In this section, I follow a different route. In order to clarify the mechanisms behind Shannon capacity as a constraint for information transmission, I fix the number of bits, , across utilities and adjust the shadow cost to map different coefficients of risk aversion to the same information flow.8 First consider . In the full information case,9 the distribution is degenerate, the choice of reduces to that of in (8).10 The resulting optimal policy is given by
Suppose now that capacity is low. In this case, rational consumers limit their processing effort by concentrating probability on the highest feasible value(s) of consumption. To see why, recall that consumers are risk averse (log-utility). They process the necessary information to learn where the boundary is and avoid infeasible consumption bundles.11 Since the Shannon capacity places high restriction on information-processing, this individual consumes roughly the same amount each period, independently of his level of wealth.
This case describes situations in which people have a vague idea of their wealth and prefer default savings/spending options (whether it is a pension plan or health insurance) rather than figuring out the exact consistency of their net worth. Figure 2 displays the resulting optimal policy. Finally, Figure 3 displays the optimal joint distribution for an intermediate case, . The first observation is that a person with a finite information flow tries to make as close to as the information constraint allows him to.
The second observation is that the optimal policy function for the information-constrained consumer places low weight, even no weight, on low values of consumption for high values of wealth. The reason why this happens depends on the utility function. A consumer with log-utility wants to maintain a consumption profile that is fairly smooth throughout the lifetime, as can be seen from (13). To avoid values of consumption that are either too low or too high, he needs to be well informed about such events to reduce the probability of their occurrence. The resulting optimal policy places a higher probability mass on the central values of consumption and wealth.
To see how the allocation of probability changes with the utility function, consider a consumer that differs from the previous only in the utility specification which now assume a CRRA form, with . As in the previous case, the optimal policy function still places a close-to-zero probability on low values of consumption for high values of wealth but now the CRRA consumer trade off probabilities about modest values of consumption and wealth so that he can have high probability mass on high values of consumption when wealth is high.
In other words, with CRRA preferences, individuals want to be better informed on low and middle values of wealth to enjoy high consumption in every period. Figure 4 illustrates this case.
The goal of this section is to compare my model with the literature in rational inattention. The first comparison is with the consumption saving model in the linear quadratic Gaussian (LQG) case 12 Sims(2003) fully characterizes the analytical solution of a consumption saving model where utility is quadratic, , constraints are linear and ex-ante optimal shape of uncertainty is Gaussian. In this LQG setting, the optimal distribution of ex-post uncertainty is also Gaussian. The Gaussian solution make a model with rational inattention in the LQG case observationally equivalent to a signal extraction problem a la Lucas.
Note that the analytical solution in Sims (2003) cannot be recovered if one assume a restriction in the support of either or (e.g., the conventional ) or a no-borrowing constraint (e.g., ). This is because both constraints break the LQ framework, necessary to obtain Gaussianity in the optimal ex-post uncertainty.
The second issue with the LQG approach is that the linear quadratic approximation gives valid predictions when uncertainty is small. This is similar to the argument for linearizing the first order condition of a problem and getting locally a good approximation. However, if one wants to explain an observed consumption and savings time series through limited processing constraints, the inertial behavior that we see in the data suggests that uncertainty is fairly big. Thus, the tractability of the LQG framework comes at the expense of effectiveness in matching the data.
The third issue, which is the most important for the purpose of this paper, is that rational inattention LQG models do not allow to explain different speed and amounts of reactions of people to different news about their wealth. For instance, consumption drops faster following a sudden layoff than in the event of a tax break. Moreover, the magnitude of the change in consumption depends on people's attitude towards risk13 and their income level14. The certainty equivalence framework that arises with Gaussian ex ante uncertainty and quadratic utility does not allow for endogenous differentiation amongst these events. In such a setting, the speed and amount of households' reactions to different news are created by sources of inertia exogenous to the model. This has been one of the criticisms to signal extraction models a la Lucas and applies also to rational inattention LQG.15 For instance, different reactions are generated by assuming that people have immediate access to some signals and not others, as in Lucas (1973) or they receive independent information about different news, as in Makowiak and Wiederholt (2008). In this paper, I choose another approach. I assume that information is freely available and I do not constrain ex-ante uncertainty to be Gaussian. Moreover, I explore the link between risk aversion and information-processing limits by allowing utility specifications of the CRRA family.
Before this paper, Sims (2006) solves a two period model with non-Gaussian ex-ante uncertainty and CRRA preferences. Sims (2006) assumes that agents live two periods, the first of which they are inattentive while the second period their uncertainty is resolved. This paper focuses on a fully dynamic rational inattention model. I depart from the work of Sims (2006) in two main dimensions. The first is conceptual. A fully dynamic model with rational inattention allows the researcher to investigate time series properties of consumption and savings. The resulting behavior reveals endogenous noise and delays of consumption in response to shock to income, with negative income shocks producing faster reactions effects as the risk aversion increases. The intuition for this result is the reaction of risk adverse individuals to signals that indicate a reduction in wealth is to immediately decrease their consumption for precautionary motives while collecting information over time about the consistency of their net worth. Complementary to these findings, richer dynamic makes the model suitable to address policy questions such as reaction to fiscal policy stimulus as I will show in the last section. This paper is also distinct from the one of Lewis (2008) . The most prominent differences are that, in Lewis (2008), households do not see consumption over time and they optimize over a finite horizon. Not observing consumption in turn implies that once the stream of probabilities is chosen at the beginning of period, the update of the beliefs is deterministic in the choice of the signal. While Lewis (2008)'s framework does deliver upward-sloping age profiles as average consumption over a fixed time length, it does not allow to study unconditional moments of consumption nor conditional response of consumption to shocks as in my framework.
The second contribution is methodological. A fully dynamic rational inattention model involves facing an infinite dimensional problem as displayed in (8)-(12). To work with this framework, I developed analytical and computation tools that are suitable to address the dynamics of a non-LQG model.
Moreover, my results are observational distinct from the previous literature on sticky information (Mankiw and Reis (2002)) and consumption and information (Reis (2006)). Mankiw and Reis (2002) assume that every period an exogenous fraction of agents (firms) obtain perfect information concerning all current and past disturbances, while all other firms set prices based on old information. Reis (2006) shows that a model with a fixed cost of obtaining perfect information can provide a microfoundation for this kind of slow diffusion of information. My model differs from the literature on inattentiveness in that I assume that information is freely available in each period but the bounds on information processing given by the Shannon channel force consumers to choose the scope of their information within the limit of their capacity. The interaction of information flow and risk aversion in my model delivers endogenous asymmetry in the response of consumption to shocks both in terms of speed and amount. This prediction constitutes a distinguishing feature of my model with respect to the literature of inattentiveness and, more generally, to the consumption-saving literature.
I consider wealth and consumption as defined on compact sets. In particular, admissible consumption profiles belong to Likewise, wealth has support . I identify by the elements of set and by the elements in I approximate the state of the problem, i.e., the distribution of wealth by using the simplex:
Let be the dimension of the belief simplex which approximates the distribution and let denote the set of all probability distribution on . The initial condition for the problem is
The consumer enters each period choosing the joint distribution of consumption and financial possibilities. From the previous section, the control variable for the discretized set up as the probability mass function where and , constrained to belong to the set of distributions. Given and and the observation of consumed in period the belief state is updated using Bayesian conditioning:
The purpose of this section is to show that the discrete dynamic programming problem has a solution and to recast it into a Bellman recursion. To show that a solution exists, first note that the set of constraints for the problem is a compact-valued concave correspondence. Second, I need to show that the state space is compact. Compactness comes from the curvature of the utility function and the fact that the belief space has a bounded support in . The compact domain of the state and the fact that Bayesian conditioning for the update preserves the Markovianity of the belief state ensures that the transition and (14) has the Feller property. Then, the conditions for applying the Theorem of the Maximum are fulfilled which guarantees the existence of a solution. In the next section, I provide sufficient conditions to guarantee uniqueness.
Casting the problem of the consumer in a recursive Bellman equation formulation, the full discrete-time Markov program amounts to:
The Bellman equation in (17) takes up as its argument the marginal distribution of wealth and uses as the control variable the joint distribution of wealth and consumption, . The latter links the behavior of the agent with respect to consumption , on one hand, and income on the other, hence specifying the actions over time. The first term on the right hand side of (17) is the utility function . The second term, , represents the expected continuation value of being in state discounted by the factor . This corresponds to interest rate which gives an annualized gross real rate of investment , with a quarterly frequency of the data. The expectation is taken with respect to the endogenously chosen distribution . I have discussed the relations in (18)-(21) earlier. Moreover, I appended the equation in (20) which constrains the choice of the distribution to be consistent with the initial prior
Next, I analyze the main properties of the Bellman recursion (17) and derive conditions under which it is a contraction mapping and show that the mapping is isotone.
To prove that the value function is a contraction and an isotonic mapping, I shall introduce the relevant definitions. Let me restrict attention to choices of probability distributions that satisfy the constraints (18)-(21). To make the notation more compact, let , , and let be the set that contains (18)-(21). I introduce the following definitions:
Endowed with these notion, it is possible to derive some properties of the solution to the Bellman equation.
First, note that the uniqueness of the solution to which the value function converges to requires concavity of the constraints and convexity of the objective function. It is immediate to see that all the constraints but (18) are actually linear in and . For (18), the concavity of is guaranteed by Theorem (16.1.6) of Thomas and Cover (1991). The concavity of is the result of the following:
Next, I need to prove the convexity of the value function and the fact that the value iteration is a contraction mapping. All the proofs are in Appendix A.
Proposition 1 can be explained as follows. The space of value functions defines a vector space and the contraction property ensures that the space is complete. Therefore, the space of the value functions together with the supreme norm form a Banach space; the Banach fixed-point theorem ensures (a) the existence of a single fixed point and (b) that the value recursion always converges to this fixed point (see Theorem 6 of Alvarez and Stockey, 1998 and Theorem 6.2.3 of Puterman, 1994).
The isotonic property of the value recursion ensures that the value iteration converges monotonically.
These theoretical results establish that in principle there is no barrier in defining value iteration algorithms for the Bellman recursion for the discrete rational inattention consumption-savings model.
I solve the model by transforming the underlying partially observable Markov decision process into an equivalent, fully observable Markov decision process with a state space that consists of all probability distributions over the core 17 state of the model (wealth).
For a model with core states, , the transformed state space is the -dimensional simplex, or belief simplex. Expressed in plain terms, a belief simplex is a point, a line segment, a triangle or a tethraedon in a single, two, three or four-dimensional space, respectively. Formally, a belief simplex is defined as the convex hull18 of belief states from an affinely independent19 set . The points of are the vertices of the belief simplex. The convex hull formed by any subset of is a face of the belief simplex. To address the issue of dimensionality in the state space of my model, I use a grid-based approximation approach. The idea of a grid based approach is to use a finite grid to discretize the uncountably infinite continuous state space. The implementation has the following steps: I place a finite grid over the simplex point, I compute the values for points in the grid, and I use a kernel regression to interpolate solution points that fall outside the grid.
If full information were available, previous history of the process would be irrelevant to the problem. However, because the consumer cannot completely observe wealth, he may require all the past information about the system to behave optimally. The most general approach is to keep track of the entire history of his previous consumption purchases up to time , denoted . For any given initial state probability distribution , the number of possible histories is with denoting the set of consumption behavior up to time . This number goes to infinity as the decision horizon approaches infinity, which makes this method of representing history useless for infinite-horizon problems.
To overcome this issue, Astrom (1965) proposed an information state approach. It is based upon the idea that all the information needed to act optimally can be summarized by a vector of probabilities over the system, the belief state. Let denote the probability that the wealth is in state where is assumed to be a finite set. Probability distributions such as that are defined on finite sets are in fact simplices. Let be the possible values that can assume. The discretization of the core state is an equi-spaced grid with values of ranging from 1 to 10. The points in the simplex are distinct values for the marginal pdf in the interval . The simplex is constructed using uniform random samples from the unit simplex. The reason why I use this methodology is that it is computationally faster than non-uniform grid and it is able to handle higher dimensional space.20 In my model, each point in the simplex is an -array whose column contains random values in the range and whose sum per row is 1. To span the simplex I use .21 The distribution of values within the simplex is uniform in the sense that it has the conditional probability of a uniform distribution over the whole -cube, given that the sum per row is . The algorithm calls three types of random processes that determine the placement of random points in the dimensional simplex. The first process considers values uniformly within each simplex. The second random process selects samples of different types of simplex in proportion to their volume. Finally, the third process implements a random permutation in order to have an even distribution of simplex choices among types.
For each simplex point, I initialize the corresponding joint distribution of consumption and wealth . I assume equi-spaced values for ranging in . The values in are chosen so that is about 3 times , roughly consistent with individual data on consumption and wealth.
Let core states and behavior states be sorted in descending order. I impose the constraint ,22. Then, given the symmetry in the dimensionality of and , the joint distribution of consumption and wealth for a given multidimensional grid point is square matrix with rows corresponding to levels of consumption. Summing the matrix per row results in the marginal distribution of consumption, . Likewise, the columns of the matrix correspond to levels of wealth. Evaluating the sum per columns of the matrix amounts to the marginal pdf of wealth, . Given the initial belief simplex, its successor belief states can be determined by Bayesian conditioning at each multidimensional point of the simplex and gives the expression:
Let be the set of all bounded real-valued function on . Then, the Bellman optimality equation of the household is described by (17)-(21).
Without loss of generality, I restrict the columns of the matrix to sum to the marginal pdf of wealth in the main diagonal. Moreover, because some of the values of the marginal per simplex-point are exactly zero given the definition of the envelope for the simplex, I constrain the choices of the joint distributions corresponding to those values to be zero. This handling of the zeroes makes the parameter vector being optimized over have different lengths for different rows of the simplex. Hence the degrees of freedom in the choice of the control variables for simplex points vary from a minimum of 0 to a maximum of .23 Once the belief simplex is set up, I initialize the joint probability distribution of consumption and wealth per belief point and solve the program of the household by backward induction iterating on the value function . To map the finer state space into Matlab possibilities, I interpolate the value function with the new values of (23) using a kernel regression of into I use an Epanechnikov kernel with smoothing parameter . 24 A kernel regression approximates the exact non linear value function in (17) with a piece-wise linear function. The following propositions illustrate this point.
Intuitively, each vector corresponds to a plan and the action associated with a given vector is the optimal action for planning horizon for all priors that have such a function as the maximizing one. With the above definition, the value function amounts to:
and thus the proposition holds.Using the above proposition and the fact that the set of all consumption profiles is discrete, it is possible to show directly the convex properties for the value function. For fixed vectors, the operator is linear in the belief space. Therefore, the convex property is given by the fact that is defined as the maximum of a set of convex (linear) functions and, thus, obtains a convex function as a result. The optimal value function is the limit for and, becuase all the are convex function, so is .
To implement numerically the optimization of the value function at each point of the simplex, I use Sims' CSMINWEL as a gradient-based search method and iterate on the value function up to convergence. The value iteration converges in about 202 iterations. Table 1 reports the benchmark parameter values and the grids.
I simulate the model for periods by drawing from the optimal policy function, , and generate the time series path of consumption, wealth and expected wealth. For each , I use the joint distribution to evaluate the time path of information flow ( ). Finally, I derive the impulse response functions for the economy by assuming temporary shocks to the mean of income, . A pseudocode that implements the procedure is in Appendix C.
Discretization | |
---|---|
Wealth Space | |
Consumption Space | |
Mean of Income, | 1.1 |
Joint Distribution per simplex point, | 2020 |
Marginal | 201 |
Marginal | 201 |
Coeff. risk aversion, | 1 |
Interest rate, | 1.012 |
Discount Factor, | 0.9881 |
In this section, I investigate the dynamic interplay of information flow and degree of risk aversion. In particular, I study different specifications of the baseline model changing degrees of risk aversion, , and different Lagrange multipliers, , representing the shadow costs of processing information in (18). Time path for each individual are average across simplex points. For the time series of the aggregate economy, I perform Monte Carlo runs and simulate the model for each path for periods. Then, I compute average across runs and simplex-points. Sample statistics are calculated after I compute these averages. I choose this way of calculating average to compare my model, tailored for individual behavior, to aggregate data. I divide the results into three parts: (1) interaction of information flow and risk aversion; (2) implications of information constraint on lifetime consumption; and (3) consumption reaction to temporary income shocks.
CRRA | CRRA | Log Utility | CRRA | |
---|---|---|---|---|
: | 1.01 | 0.98 | 0.91 | 0.83 |
: | 0.15 | 0.18 | 0.21 | 0.33 |
: | 1.41 | 1.20 | 0.86 | 0.78 |
: | 1.14 | 1.09 | 1.08 | 1.02 |
: | 0.08 | 0.09 | 0.11 | 0.14 |
: | 2.03 | 1.99 | 1.87 | 1.72 |
This finding is documented in Table 2 and in Figures 5-6. Figure 5a plots the difference between the mean of the time series of consumption between and . After deriving the time path of consumption as described above, I calculate the mean and standard deviation of the average of the time path and subtract from it the mean of the time path for the full information equivalent ().25 Figure 5a shows how this difference changes as varies and when utility is logarithmic. Figure 5b plots the corresponding difference in standard deviation of consumption as a function of .
To understand this result, consider what happens in the full information () case. With , the agent smooths consumption regardless of his utility. To appreciate how preferences towards risk play out with processing limits (), consider Figure 6c. It plots the optimal distribution of consumption for two individuals ( and ) when information is very costly to process (). In this case, a rational agent consumes a fixed amount every period in the limits of his net worth. This requires very little bits of information. In Figure 6c note how a person with log-utility puts probability mass mostly on the lower values of consumption while a more risk averse agent sacrifices smoothing consumption to allocate some probability on higher values of consumption. Assuming the same the resulting effect is solely due to consumer preference. Now consider Table 2 and Figures 6a-6b.
When , people select how much information they want to process and which values of wealth to be better informed about according to their utility. Also in this case, the higher the degree of risk aversion, the higher the quest for information (). This is exactly what Table 2 shows. In the table, the higher the coefficient of risk aversion, , the higher the information collected by the agent, , and the higher the mean of consumption. The same story can be told in terms of probability distribution as in 6a-6c. For a given level of , a person with log utility would be better informed on extreme values of wealth to avoid such values. This knowledge makes it possible to assign high probability to the middle value of consumption, as his utility commands. By contrast, a consumer with CRRA, , wants to avoid low values of consumption for high values of wealth. Processing information about these events decreases the likelihood of their occurrence and makes it possible to place high probability on high value of consumption. This mechanism makes consumption more persistent for people with a higher degree of risk aversion (cfr. Figure 6a-6c).
Processing capacity () strengthens this effect. This is because high information flow allows consumers to enjoy high and smooth consumption throughout their life time. If information flows at very low rate, households update their knowledge slowly over time and wait to modify their behavior until they have sufficient knowledge of their financial possibilities. Inertial behavior of consumption due to low information flow induces sharp changes in consumption after the consumer accumulates information. This mechanism makes consumption more volatile for people with lower information flow.
Figure 5b plots the standard deviation of consumption for several values of . As pointed out, for very high shadow cost of processing information , consumption does not vary over time. For , the volatility of consumption increases with . This result makes sense. To see why, consider again the full information version of the model. People's will to smooth consumption in full information is limited by the finite flow of information available. When deciding on the precision of their signals, risk averse people trade off lower volatility in consumption for better knowledge of low value of wealth.
The time series path of consumption, wealth and information flow drawn from the optimal policy confirm this result and offer further insights on the properties of the model.
Figures 7-8 illustrate these points for aggregate and individual time series behavior, respectively. The simulations are derived by drawing the time path of consumption and wealth from , after the value iteration has converged. Figures 7a-7c plot the average across the Monte Carlo runs and simplex points (i.e., initial beliefs about wealth). Individual time series (Figures 8a-8b) are an average of initial beliefs. To have some interesting transitional dynamics, I begin the simulation with an initial condition for wealth far from the steady state26.
To appreciate the results, consider what would happen with full information. In such a case, consumption smoothing () implies an immediate () adjustment of consumption to its long-run optimal values and no transient behavior. Thus, in that case from onwards, the simulations lead to a constant time path. Now consider Figures 7(a-c)-8(a,b). The hump in consumption comes from Result 1 and a simple intuition: information-constrained people are cautious (degree of risk aversion ), consume a little and collect information about wealth before they change consumption. For a fixed , the more risk averse they are (cfr. Figure 7a with log utility and Figure 7b with CRRA, ), the longer they wait before increasing their consumption. This inertial behavior in consumption leads to an increase in savings and, as a result, in wealth (cfr. Figure 8a-8b). Processed information keeps signaling the increase in wealth until households realize that they are wealthy enough to increase their consumption. Thus, the hump in consumption is the mirrored image of the rise (until people know they rich) and fall (once people know they are rich) in wealth. Note that, depending on the history of income shocks, consumption can have more than one hump in its path. To see why, consider a high realization of income occurring after a hump in consumption. Over time, signals about wealth convey such information, consumers start saving and history as well as humps repeat themselves. These effects are enhanced by the shadow cost of processing information, , with higher costs forcing long periods of inertia in consumption followed by sizeable changes. Note also the relationship between consumption and information flow (Figure 7c): risk averse agents would rather push forward consumption in times in which they are processing information about wealth. Finally, note from 7(a-b)-8(a,b) how the peak in consumption occurs later for an individual with higher degree of risk aversion and lower information flow. The rationale for this result is that more cautious people wait to be better informed about their wealth before modifying their consumption behavior. In particular, since a consumer with CRRA utility () chooses to be better informed about low values of wealth than a log utility consumer (cfr. Figures 7a and 7b), he processes news about high value of wealth slower than his log counterpart. The resulting additional savings for precautionary motives are triggered by both the curvature of the utility function and the bound on information-processing constraint.
The last result comes from studying how consumers with limited processing capacity react to temporary shocks to income (). Before stating the result, it is worth comparing to the predictions of standard consumption-saving literature. With full information, the response of consumption to either negative and positive temporary income shocks are immediate: consumption adjust in period to an amount exactly equal to the discounted present value of the shock, . This is the case regardless whether the shock is adverse or favorable, so long as the absolute value of these shocks match. The same holds true under certainty-equivalence with a linear constraints and quadratic utility (LQ) framework. With risk averse agents and information-processing limits, it happens that:
The logic behind this result is easily understood by considering the interdependence of information flow and coefficient of risk aversion. A risk averse person is more likely to be affected by negative events than positive ones. As soon as he receives signals that his wealth is lower than what he thought, he reacts by decreasing his consumption. The change in behavior and its persistence are more consistent the more risk averse and uninformed the consumer is. This occurs because consumers wait to gather more information before changing their behavior and, in the meanwhile, build up a savings buffer. Thus, the temporary change in income propagates slowly over time. A positive temporary income shock triggers the opposite behavior in a risk averse uninformed person. The intuition is that this type of consumer is concerned about negative wealth fluctuations and allocates most of his information capacity to prevent this event. A signal that indicates positive wealth may be ignored, generating extra savings in the meanwhile. Once this is acknowledged, a prudent consumer distributes the additional consumption driven by the income shock plus savings throughout his lifetime. This pattern of consumption behavior matches what we observe in macro data on consumption and documented in the literature as excess smoothness. Furthermore, the discrete rational inattention consumption-saving model provides a rationale for excess sensitivity in response to news on wealth.27
Since the model is non-linear, let me first explain how the impulse responses are generated and then focus on the intuition that the graphs suggest. I simulate the model drawing times from the same optimal policy distribution under two scenarios. In the first, I draw from a distribution with constant mean of the shock to income. In the second, I assume that the mean of the shocks increase/decrease in the very first period (one-time shocks) and then revert back to its original distribution. Impulse responses of consumption are the difference between the two income paths averaged over simplex-points and Monte Carlo draws of income. The impulse response functions are plotted in Figures 9a-9b. Consider Figures 9a first. They display a positive (Figure 9a) and a negative (Figure 9b) shock to income respectively. Note that for both log and CRRA and for different value of the shadow cost ( ) the reaction to a negative shocks ( ) starts from the very first period. However, the extent of the reaction varies across utilities and information costs. When , a log utility-type consumer reacts on impact by increasing savings to an extent lower than the shock. He then adjust savings and consumption so to distribute the averse shock throughout time. The same log-type but with decreases more consumption on impact than his counterpart. He increases consumption slowly over time until it reaches its new long-run value. Likewise, a consumer with risk aversion varies his saving when the shock hits to an extent that depends on his information flow. In particular, note that for the decrease in consumption on impact and in the following periods is so significant that consumers can use the accumulated savings to restore their original consumption plan. The endogenous asymmetric response to shocks, even in this very simple setting, makes rational inattention models observationally distinct from any other standard macroeconomic model. In those frameworks, either there is no asymmetric reaction (as in LQG) or the asymmetric response is due to the asymmetric magnitude of the shocks (as in models a la Lucas). These implications make the theory appealing from an empirical standpoint (e.g., think about consumers' reactions to a tax break vs. being fired from the job). Moreover, they make the theory suitable to study the impact of policy changes on private sectors decision. The 2008 Tax Rebate provides one such example.
A feature of the model worth exploring is how consumption's reaction to shocks depends on the initial value of wealth.
Drawing a time series from the probability distribution that solves the model, it is natural that the farther away wealth is from its steady state, the more consumption reacts to a shock to wealth. The interesting prediction of the model with an information-processing constraint is that for either the log or the CRRA, utility, it does matter for the impulse response whether we start from a value of wealth above or below the steady state. In both cases, the reactions are faster in case of a negative shock than a positive one. However, extent and timing are different with wealthier people reacting faster and with sharper decrease in consumption to a negative shock than poorer people do when facing the same kind of shock. This is due to the fact that poorer people already consume small amount so that when a negative shock hits, even if they receive immediately signal of the news, they only gradually reduce their consumption. Savings slowly accumulate over time until the shock is absorbed. For a given processing capacity, wealthier people can afford to reduce their consumption as soon as they acknowledge the negative shock. The jump start in savings makes it possible for them to absorb the shock faster. By contrast, a positive shock has a stronger effect on poorer people than wealthier one. To see why, consider a tax rebate. Taking two individuals with the same characteristics in terms of risk aversion and information-processing constraints but different initial net worth, the wealthier person takes longer to change his consumption behavior. When the change does occur, the magnitude is smaller than the one for a poorer person. The intuition for this result is that an increase in disposable income for a less wealthy person .implies a more sizeable financial break than the same amount does to a wealthy person. Risk aversion prevents both types of consumers from immediately disposing of the additional credit but it has a bigger effect on impact for the more constrained consumer.
Even in its simplicity, the model can be used to address important policy questions. In particular, it can be used to analyze the effectiveness of tax policy reforms on individual consumption and savings decisions. Figure 10 displays the impulse response function of consumption to a stimulus payment which increases income of with respect to its (constant) long run level. The discretized solutions are generated using equi-spaced grid of consumption and wealth, with 50 points each. Consumption takes up value in while wealth ranges from 1 to 10. I use the same parameters ( and ) of the baseline model and a simplex of size and two specifications of utility functions. In both cases I choose so that the capacities corresponds to bits and 0.88 bits28. Once the value iteration converged, I generate the impulse response function by simulating a time series path of consumption and wealth with Monte Carlo runs for each initial condition on wealth. I consider three initial values of wealth as a proxy of population with low, middle and low net worth. I then average the time series per quarters and simplex points. Figure 10 gives interesting insights on the effect of the stimulus on consumer spending. For the degrees of risk aversion considered and information capacity, the reaction of the stimulus is higher the lower the initial wealth. This is not surprising, as the stimulus payments have bigger impact on the disposable income of credit constrained consumers than richer people. For a given amount of information capacity and wealth, the higher the risk aversion, the lower the spending in the first quarter. This result also makes sense. If a consumer is risk averse and have no credit frictions, he allocates more attention in processing information about low values of wealth. This leads to processing information slower and, in turn, reacting slower to positive news to income (Result 3). Finally for a given wealth and degree of risk aversion, the lower the information processing capacity, the lower the response of consumption spending to the rebate. The findings in Figure 10 can be summarized as:
The insights one can gather from the model have strong policy implications on the effectiveness of tax reform on people's behavior. The 2001 tax rebate provides one such example. The model predicts that such a policy has greater response on impact for individual with low net worth. Figure 10 also suggests that the effect will be mild and spread out through several quarters for middle-high income households. These findings are consistent with the empircal evidence on consumers spending of 2001 tax rebates (cfr., Johnson, Parker and Soules (2006)).
This paper applies rational inattention to a dynamic model of consumption and savings. Consumers rationally choose the nature of the signal they want to acquire subject to the limits of their information processing capacity. The dynamic interaction of risk aversion and endogenous choice of information flow enhances precautionary savings.
I showed that for a given degree of risk aversion, the lower the information flow, the flatter the consumption path. The model predicts that for a given information flow, the higher the degree of risk aversion, the more persistent consumption. Also, for a given degree of risk aversion, the lower the information flow, the more volatile consumption.
Furthermore, the model predicts that consumption path has humps. Under information-processing constraints, an hump occurs when people consume a little and save a lot while collecting information about wealth. When consumers realize that they are rich, they increase consumption and decumulate savings. This increase stops when they acknowledge that their wealth is low again: they start to save and process more information. Thus, consumption decreases. Consistent with the previous two results, I find that the peak in consumption is delayed the more the individual becomes risk averse.
Differing from other life-cycle models, in my model there could be more than one hump in the consumption path. Depending on the history of the income shocks, a very low or very high realization of income affects consumers' signal through its effect on wealth. Consumers react to the news by varying savings and information over time, thereby generating another hump.
Finally, the model predicts that consumers with processing capacity constraints have asymmetric responses to shocks, with negative shocks producing more persistent effects than positive ones. This asymmetry, observed in actual data, is novel to the theoretical literature of consumption and savings. Studying the reactions of rational inattentive people to temporary income shocks can also be used to assess the effectiveness of policy reforms on consumption spending. The model predicts that, for a given level of wealth, the speed and magnitude of the consumption adjustment to the income shock depends on their processing capacity. Moreover, consumers with low wealth react faster to temporary tax relief than wealthier people. The results agree with both intuition and preliminary data on consumer spending.
The results seem to suggest that enriching the standard macroeconomic toolbox with rational inattention theory is a step worth taking.
The Bellman Recursion in the discrete Rational Inattention Consumption-Saving Model is a Contraction Mapping.
The Bellman Recursion in the discrete Rational Inattention Consumption-Saving Model is an Isotonic Mapping.
The Optimal Value Function in the discrete Rational Inattention Consumption-Saving Model is Piecewise Linear and Convex (PCWL).
For a given , Mutual Information is concave in
Pseudocode
Let be the shadow cost associated to . Define a Model as a pair . For a given specification :
In this section I incorporate explicitly the constraint on information processing and derive the Euler Equations that characterize its solution.
The main feature of this section is to relate the link between the output of the channel consumption, with the capacity chosen by the agent. In deriving the optimality conditions, I incorporate the consistency assumption (20) in the main diagonal of the joint distribution to be chosen, . Note that such a restriction is WLOG. I then show the analytical details of the derivatives with respect to control and states.
To evaluate the derivative of the Bellman equation with respect to a generic distribution , define the differential operator and as the shadow cost of processing information . Then, the optimal control for the program (17)-(21) amounts to:
This expression states that the optimal distribution depends on the weighted difference of two consumption profiles, and where the weights are given by current and future discounted utilities. Note that the differential of the marginal utility of current consumption is also weighted by the conditional optimal distribution of consumption and wealth.
The interpretation of (36) is that the optimal probability of consumption and wealth depends on both levels of current and intertemporal utility and marginal utility. In particular, there is an intertemporal trade-off by consuming the maximum value of wealth allowed by the signal, and a lower consumption . To illustrate the argument, suppose a consumer believes that his wealth is with high probability. Suppose for simplicity that allows him to spend or . The decision of shifting probability from to depends on four variables. First, the current difference in utility levels, which tells the immediate satisfaction of consuming rather than . However, consuming more today has a cost in future consumption and wealth levels tomorrow, . Optimal allocation of probabilities requires trading off not only intertemporal levels of utility but also marginal intertemporal utilities where now the current marginal utility of consumption is weighted by the effort required to process information today.
To explore this relation further, I evaluate the derivative of the continuation value for a given optimal , that is . To this end, define the ratio between differential in utilities (current and discounted future) and differential in marginal current utility as . Also, let be the ratio when current level of utilities are equalized and future differential utilities are constant, i.e., and or, . Then, an application of Chain rule and point-wise differentiation leads to
Let me focus on the explanation for the terms which characterize the optimal solution of the conditional distribution
The first term states that the optimal choice of the distribution balances differentials between current and future levels of utilities between high () and low () values of consumption. In case of log utility, the term is a likelihood ratio between utilities in the two states of the word ( and ) and the interpretation is that the higher is the value of the state of the world with respect to as measured by the utility of consumption, the lower is the optimal . This matches the intuition because the consumer would like to place more probability on the occurrence of the wider the difference between and . A perhaps more interesting intertemporal relation is captured by the terms and , both of which display the occurrence of the update distribution , . To disentangle the contribution of each argument of and , I combine the derivative of the control with the envelope condition. Let be the term led one period and define the differential between transition from one particular state to another and transition from one particular state to all the possible states as for . Evaluating the derivative with respect to the state almost surely reveals that while . The terms and reveal that in setting the optimal distribution consumers take into account not only differential between levels and marginal utilities but also how the choice of the distribution shrinks or widens the spectrum of states that are reachable after observing the realized consumption profile.
An interesting special case that admits a closed form solution is when the agent is risk neutral. Consider the framework in Section (3.2) and let utility take up the form , then in the region of admissible solution , the optimal probability distribution makes independent on . To see this, it is easy to check that in the two period case with no discounting, the utility function reduces to , which implies . That is, since all the uncertainty is driven by , the consumer does not bother processing information beyond the knowledge of where the limit of lies. In other word, the constraint on information flow does not bind. With the continuation value, exploiting risk neutrality, the optimal policy function amounts to:
In the main text, I state that the optimal control amounts to :
which can be rewritten, opening up the operator as:
where
Note that by Chain rule , for Plug (36) in the second term of the above expression and evaluating point-wise the derivatives delivers
In
(40) |
To derive the envelope condition with respect to a generic state for , let me start by placing the restrictions on the marginal distribution of wealth in the main diagonal of the joint distribution . The derivative then amounts to:
Let denote the maximum indicator belonging to Then the derivative of the state displays:
Combining first order conditions and the envelope condition after some algebra leads to the result in (40).
To illustrate how a consumer with information constraints differs from a consumer with full information and a consumer with no information, consider the following model of consumer's choice.
Suppose the household has three wealth possibilities, , and three consumption possibilities . Before any observation is made, the consumer has the following prior on wealth, , , . Moreover the consumer cannot borrow, and, if his check bounces he suffers . He derives utility from consumption defined as . His payoff matrix is summarized in Figure a.
If uncertainty in the payoff can be reduced at no cost, the consumer would set .
In contrast, if he cannot gather any information about wealth besides that provided by the prior, the consumer will avoid unpleasant surprises by setting whatever the wealth.
The difference in bits in the two policies is measured by the mutual information between and . The ex-ante uncertainty embedded in the prior for is calculated by evaluating its entropy in bits, i.e.,
bits. Since observation of provides information on wealth, conditional on the knowledge of consumption uncertainty about is reduced by the amount . The mutual information between and , i.e., the remaining uncertainty about the wealth after observing consumption, is the difference between ex-ante uncertainty of ( ) and the knowledge of given by ( ). In formulae, the mutual information or capacity of the channel amounts to:To see what this formula implies, consider first the situation in which information can flow at infinite rate. In this case ex-post uncertainty is fully resolved. Moreover, note that since the consumer is setting positive probability on one and only one value of consumption per value of wealth. This in turns implies , so the mutual information in this case will be .
Instead, if the consumer has zero information flow or, equivalently, if processing information is prohibitively hard for him, his optimal policy of setting at all times makes consumption and wealth independent of each other. This implies that . Hence, in this case and no reduction in the uncertainty about wealth occurs upon observing consumption. The intuition is that if a consumer decides to spend the same amount in consumption regardless of his wealth level, his purchase will tell him nothing about his financial possibilities. The expected utility in the first case is while in the second case .
Now, assume that the consumer can allocate some effort in choosing size and scope of information about his wealth he wants to process, under the limits imposed by his processing capacity. Let be the maximum amount of information flow that the consumer can process. Let the probability matrix of the consumer be:
Figure b: Probability Matrix
where the zeroes on the lower left corner of the matrix encode a non-borrowing constraint .29 The program of the consumer is:30
s.t. Given ,31 the optimal policy sets , , which corresponds to , . This leads to an expected utility of . Hence, consumers who invest effort in tracking their wealth using the channel are better off than in the no information case (higher expected utility) even though they cannot do as well as in the constrained case.Note that the result of trading information for the highest value to gain a more precise knowledge of the lower value of wealth is driven by the functional form of utility. For instance, a consumer with the same bound on processing capacity but CRRA utility with coefficient of risk aversion, say, , would have chosen a probability lower than his log-utility counterpart. This is because higher degrees of risk aversion induce the consumers to be better informed about low values of wealth to avoid such occurrences. The intuition is that because the attention of the consumer within the limits of the Shannon capacity is allocated according to his utility, the degree of risk aversion plays an important role in determining what events receive the consumer's attention. A log-utility consumer wants to be well informed about the middle values of his wealth, while a high risk averse consumer selects a signal which provides sharper information about the lower values of wealth, so that he can avoid high disutility. The opposite direction is taken by the less risk-averse agent.
In this section I will focus on the optimality conditions derived above for a three point distribution. The goal is to fully characterize the solution for this particular case and explore its insights.32
Let me assume the wealth to be a random variable that takes up values in
with distribution
described by:
The equation describing the evolution of the wealth is displayed by the budget constraint
where I denote by the exogenous stochastic income process earned by the household and by the (constant) interest rate on savings, . Like wealth, before processing information consumption, is a random variable. It takes up a discrete number of values in the event space . The joint distribution of wealth and consumption, , amounts to:where the zeros in the SW end of the matrix encodes the feasibility constraint and . The additional restrictions to the above matrix are the ones commanded by the marginal on wealth. That is:
Making use of the marginal distribution of wealth described above and making use of (42) together with the specifications of and , I can explicitly evaluate point-wise. To illustrate this point, using the numerical values of above, the derivatives point-wise are as follows.
In
In In Then, the first order conditions and envelope conditions amount to
Note that for .33 This result is not driven by the specification chosen for the transition function , but it is a feature of the three point distribution. Indeed, because two of the three values of wealth are at the boundaries of , the absorbing states and place tight restrictions on the continuation value through the transition function and, as a result, the update for the marginal according to (42). That is, the marginal probability on wealth in this case tends to its ergodic value . It follows that which is a constant since the functional argument is. This is what makes the 3-point distribution tractable.
For the general case, the first order condition with respect to the first control amounts to:
Representing priors in this fashion allows an explicit evaluation of the differences in the value functions in the first order conditions, since , where Since the result of the is just one of the member of the set and all the elements involved in the definition of function in are a finite set of linear function parametrized in the action set, so is the final result.
Let a prime (" ") denote the variables led one period ahead, algebraic manipulation delivers the following optimal control functions:
where
and is the function that satisfies 34. The argument of the is always positive for the first order conditions derived, implying that for each of the optimal policies the function returns a real solution amongst other complex roots, which is unique and positive. Since it is possible to calculate the derivatives of the above expression with respect to . However, the sign of the derivatives with respect to those variables is indeterminate. The rationale behind this result is quite simple. Consider the joint probability distribution . The overall effect of an increase in this probability results from the interplay of several factors. In general, if is low (or, equivalently, the capacity of the channel, , in (18) is high), a risk averse consumer will try to reduce the off diagonal term of the joint as much as possible. That is, he would set and as low as its capacity allows him to sharpen his knowledge of the state. On the opposite extreme, for very high value of the cost associated to information processing, , and will be higher, the higher the prior with respect to and . This is due to the fact that when the capacity of the channel is low -or, equivalently, the effort of processing information is high-, the first order conditions indicate that it is optimal for the consumer to shift probabilities towards the higher belief state. The intuition is that when it is costly to process information, the household cannot reduce the uncertainty about his wealth. If the individual is risk adverse as implied by the CRRA utility function, in each period, he would rather specialize in the consumption associated to the higher prior than attempt to consume a different quantity and running out of wealth in the following periods. This intuition leads to an optimal policy of the consumer that commands high probability to one particular consumption profile and set the remaining probabilities as low as possible. To illustrate this, consider a consumer who has a high value of and a prior on higher than the other priors. If he cannot sharpen his knowledge of the wealth due to prohibitively information processing effort, he will optimize its dynamic problem by placing very high probability on , i.e., increase and and decrease . Likewise, if is higher than the other priors and is high - is low-, optimality commands to decrease both and and increase .
This part addresses the mathematical foundations of rational inattention. The main reference is the seminal work of Shannon (1948). Drawing from the information theory literature, I provide an overview Shannon's axiomatic characterization of entropy and mutual information and show the main theoretical features of these two quantities.
Formally, the starting point is a set of possible events whose probabilities of occurrence are . Suppose for a moment that these probabilities are known but that is all we know concerning which event will occur. The quantity is called the entropy of the set of probabilities . If is a chance variable, then indicates its entropy; thus is not an argument of a function but a label for a number, to differentiate it from say, the entropy of the chance variable .
Quantities of the form play a central role in Information Theory as measures of information, choice and uncertainty. The quantity goes by the name of entropy 35 and is the probability of a system being in cell of its phase space.
The measure of how much choice is involved in the selection of the events is and it has the following properties:
Theorem 2 of Shannon (1948) establishes the following results:
This formula has a simple interpretation. The uncertainty (or entropy) of the joint event is the uncertainty of plus the uncertainty of after learning the realization of .
This reads and implies that the uncertainty of is never increased by knowledge of . If the two random variables are independent, then the entropy will remain unchanged.
To substantiate the interpretation of entropy as the rate of generating information, it is necessary to link with the notion of a channel. A channel is simply the medium used to transmit information from the source to the destination, and its capacity is defined as the rate at which the channel transmits information. A discrete channel is a system through which a sequence of choices from a finite set of elementary symbols can be transmitted from one point to another. Each of the symbols is assumed to have a certain duration in time seconds. It is not required that all possible sequences of the be capable of transmission on the system; certain sequences only may be allowed. These sequeences will be possible signals for the channel. Given a channel, one may be interested in measuring its capacity to transmit information. In general, with different lengths of symbols and constraints on the allowed sequences, the capacity of the channel is defined as:
To explain the argument in a very simple case, consider transmitting files via computers. The speed at which one can exchange documents depends on the internet connection and it is expressed in bits per seconds. The maximum amount of bits per second that can be transmitted is negotiated with the provider. However, this does not mean that the computer will always be transmitting data at this rate; this is the maximum possible rate and whether or not the actual rate reaches this maximum depends on the usage and the source of information which feeds the channel. The link between channel capacity and entropy is illustrated by the following Theorem 9 of Shannon:
The intuition behind this result is that by selecting an appropriate coding scheme, the entropy of the symbols on a channel achieves its maximum at the channel capacity. Alternatively, channel capacity can be related to mutual information.
In formulae:
which says that the mutual information is the average reduction in uncertainty of due to the knowledge of or, symmetrically, it is the reduction of uncertainty of due to the knowledge of . Mutual information is invariant to transformation of and , depending only on their copula.Intuitively, measures the amount of information that two random variables have in common. The capacity of the channel is then alternatively defined by
where the maximum is with respect to all possible information sources used as input to the channel (i.e., the probability distribution of , ). If the channel is noiseless, . For example, think about a newspaper editor who wants to maximize his sales. To do that, he has to choose the allocation of space for his articles in such a way that it is attractive for the consumers. In this example, is the random variable space, the random variable sales, the channel's capacity is the maximum number of pages in the newspaper and the channel itself is the best articles' allocation of space which signals that the journal is worth buying.Note also that this constraint is computationally convenient reducing the number of choice variables from to per iteration. Return to Text
This function allows to solve the functional equation
given that See Corless, Gonnet, Hare, Je rey and Knuth (1996).