Aid Allocation Constraints and The Value of Rigorous Evaluations

February 19, 2010
 
I’m taking a class on bridging research and policy with Rohini Pande and Sendhil Mullainathan this semester.  Each week we have to answer discussion questions related to our readings, and last week mine was chosen to share with the class.  I figure that’s a pretty good sign it’s worth sharing with the world at large as well. 

In your view what are (up to) three important principles that an international organization should follow in allocating development aid?
 
I’m going to take a slightly different angle to this question and articulate not what I think should be principles driving development allocation, but what I think is a more important question -- which is what do I think is the biggest constraint to effective allocation?  Hopefully I won’t lose too many points for taking this liberty.
 
The reality is that donor decisions to allocate aid are highly complex and must be made with limited information.  As Banerjee and He point out in “Making Aid Work,” they are often driven by true believers who see no value in rigorously testing the policies that they are advocating.  While ideology may be the basis for some resistance to contrary evidence, a more nuanced view is that aid allocation decisions are seriously constrained by the preferences of well-intentioned donors.  They may want to make an impact on AIDS because it is their pet cause even though targeting diarrhea might have a larger impact on public health.  They may believe in utilizing technology to improve education even through the returns might be much higher by just providing a free lunch.  As economists, we often assume that donor’s objective functions are about optimizing broad things like poverty, public health, and human rights when they might be specific things like nutrition, AIDS, and genocide.  There will always be a gap then, between what economists consider efficient allocation of resources and reality due to these constraints.  
 
 
Discuss how one or more of these principles makes the case for (or against) rigorous evaluations.

Better information can help to narrow that gap.  Rigorous evaluations have the potential to provide valuable information that can shift the preferences of donor organizations, which in turn can contribute to efficiency improvements in aid allocation. Whereas a philanthropist might believe strongly that the best way to improve global health is through mobile technology, rigorous evaluations can shed light on the relative impact of different interventions.  Information is crucial to easing the constraint that’s naturally imposed when the decision maker has her own complex preferences. 

 

Does Development Economics Have Its Own Uncertainty Principle?

February 13, 2010

In quantum mechanics there is something called the Heisenberg Uncertainty Principle: we can never know both the exact location and momentum of a particle – at small enough scales the more precise we are with one, the less precise we can be with the other.  I just realized that when it comes to drawing policy implications, development economics might have an uncertainty principle of its own.
 
Esther Duflo spoke at TED this week, talking about the need for evidence and experimentation in development.  She’s on one side of an ongoing debate about the value of randomized control trials in development economics.  “Randomistas” as Angus Deaton calls them, are suspicious of evidence of causal inference that does not result from randomization, because only through randomization can we be sure that treatment and control groups have the same characteristics.  It’s only if the two groups are the same in every way but the treatment that we can be positive of a policy’s effect on outcomes (what economists call internal validity).

This is of course impossible at the macro level.  We obviously can’t randomly assign policies to countries and even if we could there aren’t enough of them to be sure of our conclusions.  Instead at the macro level we use creative econometrics to do our best to isolate the relationship between policies and outcomes.  And even then we run into issues of reverse causality.  This gives macro level studies an issue with internal validity.  It’s messy econometrics.

Opponents of randomized experiments argue that their results can’t be generalized to a broader context (i.e. they aren’t externally valid).  They may be useful for academic research, but they are of limited policy value.  Messy econometrics, on the other hand, incorporates many places across many time periods, which makes a stronger case for their results being broadly applicable.

Do you see where I’m going with this?  Could it be that development economics has to live with a minimum level of uncertainty with its experimental outcomes, trading off internal and external validity?

Dani Rodrik’s “We Shall Experiment, But Shall We Learn?” elaborates (and inspired this post).  I highly recommend it, he even uses one of our favorite examples, bed nets for malaria, to explain the merits of various experimental approaches.  The real aha moment hit me on page 4, talking about Cohen and Dupas' random control trial:

“But do the results extend to other settings in Africa as well? One can certainly make the case that it does, but the arguments one would need to deploy are perforce informal ones and they are convincing to varying degrees.  In fact such arguments are not too different in kind from those that researchers may offer in defense of a set of instrumental variables employed in a conventional econometrics study with weaker internal validity.” 

I knew my physics degree would come in handy some day.

 
 

Problems With Global Poverty Measurements (Pt. 2 Conceptual)

February 13, 2010
 
In addition to the technical challenges with creating a global poverty count as outlined in my post below, there are also conceptual issues with poverty counts that I would be remiss to not include.  

First is the simple idea of a head count, as defined by those above or below a defined consumption level.  People's lives are not significantly different just below or just above that line, and yet those above are excluded from our numbers.  Small changes to the line can lead to big changes in the count.  Focusing on poverty counts could create an incentive to move people just above the line, so the numbers imply big improvements when in reality people's lives haven't changed that much.  

Second, poverty head counts only look at who's below a line, but not how far below it they are. As a consequence two countries could have similar poverty count numbers with drastically different welfare situations.  Other measures such as depth and severity account for how consumption varies below the line.

Third, poverty counts are based on consumption level and don't take into account consumption mix.  This means that a household that allocates nearly all of its consumption toward education, health care, and nutrition looks exactly like a household that spends a disproportionate amount on alcohol and tobacco.  This is one issue I have in particular when we look at microfinance's impact on poverty because there's evidence of shifts in the consumption mix even through total consumption doesn't go up, which could indicate welfare improvements. 

I don't by any means believe that these issues make poverty headcounts useless, but I do think they are things we should keep in mind when we are using these numbers. 
 
 

Problems With Global Poverty Measurements (Pt.1 Technical)

February 12, 2010
 
Measuring global poverty levels is hard, so hard the actual numbers might be of limited use. According to Angus Deaton, the godfather of poverty measurement, "it seems impossible to make statements about changes in world poverty when the ground underneath one's feet is changing in this way."  I thought it would be helpful to illuminate why.  

Technically speaking, creating a measurement of global poverty is a daunting endeavor.  It hinges on three key things: 1) household surveys 2) a single global poverty line, which enables aggregation across countries, and 3) measurements of global purchasing power parity, which is necessary to convert to a single currency in a way that measures how dollars translate into welfare.  Each of these have significant methodological challenges.

First there are challenges with the collection of micro-level data.  We measure poverty by looking at consumption, typically defining absolute poverty as the consumption level required to get enough calories with a buffer for shelter, clothes, etc. (Note: we use consumption instead of income because income is a misleading measure of welfare when families live off their own agricultural production).  This information is collected at the country level through household surveys.  Poverty counts are highly sensitive to survey design, which is extremely heterogeneous across countries.
 
Second is the creation of a global poverty line.  National poverty lines are determined locally, which then need to be converted into a single poverty line.  The way this is done is by taking a subset of poor countries (i.e. we don't want to include relative poverty like the US), converting to a single currency in purchasing power parity terms, and taking an average.  Counterintuitive things happen when the countries on that list change.  India's growth led to its exclusion from the list, which raised average used for the global poverty line, which led to an increase in India's poverty count for the global aggregate.    

And then there's determining PPP conversions, which is the really hard part.  How to determine the basket to measure what $10 gets you if you're a poor person in Ecuador vs. India?  At the same time that we want to measure apples to apples, the reality is that people eat oranges in some countries and apples in others.  Insisting on measuring apples to apples leads to problems if apples are expensive imported goods that poor people don't eat in some countries.  Comparing apples to oranges introduces subjectivity, which has its own problems.  The International Comparison Program (ICP) which does this work is always making improvements, but adjustments can create shifts in global poverty measurements.

In 2005, 500 million people were added to the poverty count.  This had little to do with changes in welfare, and a lot to do with updates to PPP and global poverty line measurements.  If you want to really geek out on this, Angus Deaton's paper "Price Indexes, Inequality, and The Measurement of World Poverty" gets into it in (unfortunately rather painful) detail.

There are also conceptual issues with global poverty measurements, which I'll turn to in my next post.  

 

Gmail: A Trojan Horse for Social Networking? (with a bonus Emerson passage!)

February 9, 2010

"A man should learn to detect and watch that gleam of light which flashes across his mind from within, more than the lustre of the firmament of bards and sages.  Yet he dismisses without notice his thought, because it is his.  In every work of genius we recognize our own rejected thoughts; they come back to us with a certain alienated majesty. Great works of art have no more affecting lesson for us than this.  They teach us to abide by our spontaneous impression with good-natured inflexibility then most when the whole cry of voices is on the other side.  Else tomorrow a stranger will say with masterly good sense precisely what we have thought and felt all the time, and we shall be forced to take with same our own opinion from another."   
- Ralph Waldo Emerson, Self Reliance
 
  
Emerson's Self Reliance is one of my favorite pieces of literature, and I couldn't help but think of this passage as I read today's Wall Street Journal article about a rumored upcoming feature change in Gmail.  Apparently Google is adding a new module that allows users to share status updates, as well as content across Google products, including YouTube and Picasa.

If you ask me, this is long overdue.  Since back in 2005 when a friend at Google struggled to make Orkut a player in social networking outside of India and Brazil, I've argued that Google should use Gmail as a trojan horse for social networking.  What's always made more sense to me is for Google to grow social networking through the Gmail platform.  Why?  Because email is sticky (people don't like to change their email address), people spend all day online and logged into their email accounts, and the primary social activity on the web is email.  
 
That last point no longer holders.  Back then we didn't have Facebook with its super dynamic content.  But in my opinion the biggest reason why Facebook overtook MySpace overtook Friendster is because the sites were increasingly dynamic.  We had a reason to go back -- there was a major evolution in dynamism from Friendster's testimonials to MySpace's comments to Facebook's newsfeed.

I'm happy to see Google finally gets it, although by now the Facebook train has left the station. And of course, this is a lesson for all of us to heed the wise words of a literary great.
 
 

Promoting Entrepreneurship in Developing Countries: Starting to Think Through Government's Role

February 9, 2010
 
Dani Rodrik's teaching forms the basis for how I approach industrial policy - namely that governments should intervene where markets fail, and implement policies that target those failures.  This principle also forms the basis for an issue I have with how he approaches policies to promote economic growth through innovation.

In short, Rodrik's position is that market failures lead to an inefficient allocation of resources, which is particularly acute in developing countries.  He argues that entrepreneurs do not invest in new activities due to externalities associated with the 'self-discovery' process.  Namely, entrepreneurs bear the cost of failure, but shares the benefit with new entrants if an activity is deemed profitable.  This leads to an under provision of innovation.  This externality is the basis for patents, but here we are talking about adapting existing activities in a new environment, not a new invention.  Industrial policies that promote structural changes then, can promote economic growth.

This all makes sense to me, but there's a problem.  Rodrik is taking too narrow a view of innovation with his focus on the entrepreneur instead of the broader ecosystem.  Entrepreneurship is an extremely high-risk endeavor, where decisions are made based on expected returns.  Rodrik assumes entrepreneurs do not innovate because the expected payoff is too low due to self-discovery externalities, but there are potentially other market failures within the economy that affect returns.  In particular, it is crucial to understand the absence of venture capital in most developing countries.  Without it, entrepreneurs must either invest their own capital or raise debt, both of which require them to bear greater risks than raising equity and as a result demand higher returns.  
 
Venture capital financing directly reduces the risk entrepreneurs face by transferring it to the investor.  Venture capital also reduces the chance of failure by improving the human capital of the firm through the VC's role as an advisor, providing access to its business network, and sending a positive signal to the market with its investment.  The absence of the option to raise equity thus radically changes the expected returns for the entrepreneur, and potentially has a much larger impact on decision-making than the information externality central to Rodrik's approach.

Beyond its impact to the entrepreneur's expected payoff, venture capital plays a direct role in the ecosystem for innovation.  Venture capital firms are willing to take on more risk in a single firm since high-risk investments are diversified across their portfolios. Furthermore, since venture capital firms invest within industries or in complementary industries, they directly benefit from the success of a single investment and mitigate inefficiencies due to the self-discovery information externality.
 
Since venture capital is a critical component in the ecosystem for entrepreneurship, understanding its absence in developing countries is essential to formulate industrial policy for innovation.  Is the problem low returns, or do market failures contribute?  There is reason to believe it is the latter.  Venture capital suffers from the same externalities of the discovery process as entrepreneurs, albeit to a lesser degree.  In addition, there may be a coordination failure between entrepreneurs and venture capital firms:  entrepreneurs are absent because of the lack of equity financing options, and venture capital firms must have a certain level of entrepreneurship to be profitable.  There also may be a coordination failure between venture capital firms themselves.  Such a coordination failure could exist if the information asymmetry between entrepreneurs and VCs is reduced in a competitive environment by precluding the groupthink that could emerge with a single firm.  Venture capital may also display herd behavior, wherein the most important criteria for making an investment is whether other venture capital firms want to invest as well.  

These arguments begin to provide a basis to believe that multiple market failures contribute to the dearth of venture capital in developing countries, and governments may have a role to play in promoting innovation through policies targeting the venture capital market.  Given venture capital's significant impact on entrepreneurial decision-making, an understanding of failures in the broader ecosystem for innovation, inclusive of both entrepreneurs and venture capital firms, is necessary for the formulation of industrial policy to foster structural change and economic growth through innovation.
 

Hausmann + Rodrik = A Surprisingly Bad Idea

February 8, 2010

This post is  a follow up to yesterday's about an article in this week's Economist that discusses the work of one of my professors, Ricardo Hausmann.  Though there are important caveats I think people need to understand (see my post), the work has tremendous value in helping us understand how the structure of economies evolve.  The real problem comes when Hausmann partners with Dani Rodrik and Charles Sable to translate his findings into policy prescriptions.  Somehow, something has gone terribly wrong.

The Economist article concludes: "In work with Dani Rodrik of Harvard and Charles Sabel of Columbia University, Mr Hausmann argues that governments should emulate venture funds, backing new enterprises in the hope that one will make the leap into a more densely forested area. They should spread their bets widely, monitor progress closely, and cut losses promptly."

Well first, the Economist gets it wrong in that Rodrik and Hasumann don't advocate a one size fits all, start a public VC approach.  But they've advocated it before, and I think this suggestion is a horrible idea, for two reasons.  One, because  it's probably impossible to operationalize and two, because it violates Rodrik's own first principles for industrial policy, which guide how I think about these types of government-market interactions.

Operationalizing a public venture capital fund is likely to be infeasible for a number of reasons, here I will only note the most obvious.  It would be very difficult to design and enforce an structure that protects against the incentive issues outlined above. Equally critical are the political challenges that arise from failed investments (in their papers Rodrik and Hasumann argue that if you're not failing, you're not doing it right).  Low tolerance for failure would be even greater in developing countries with limited fiscal resources.  Pressure against failure would both exacerbate the incentive issues as well as skew the fund towards less risky investments.   The government is also bound to be much worse at allocating capital than the market due to capability deficiencies.  Staffing a public fund would be extremely challenging, as the skills necessary for venture capital operation is scarce in developing countries.  In the rare instances where it does exist, it will be difficult for the public sector to provide attractive compensation.

More problematic, a public venture fund violates Rodrik's own first principles for industrial policy.  The crux of Rodrik’s approach is that 1) markets fail, 2) governments should intervene where markets fail, and 3) policies should target the failures.  Rodrik and Hausmann never address what the failure is that justifies government intervention in the financial market.  Surely failures do exist in the venture capital market, but it's unclear why the government  should go so far as provide venture capital directly, versus providing incentives to venture capital firms.  Equally central to Rodrik’s approach to industrial policy is the need to define institutional processes that balance the need to interact with the private sector for information to formulate policy with the risk of corruption and rent-seeking.  The partial ownership of firms that results from the provision of venture capital fails in this.  Huge incentive problems are created when the government becomes investor, policy maker, and regulator.

For these reasons I believe public venture funds are infeasible at best and harmful at worse.  A better understanding of failures in the venture capital market is necessary to formulate policy incorporating the insights from Hausmann and HIldago's work. 

 

Hausmann's Product Space

February 6, 2010
There's an article in this week's economist about Ricardo Hausmann's product space.  I'm happy to see it getting mainstream attention.  It's incredibly important work, and it just makes intuitive sense.  But before we start using it for policy decisions, we should be aware of some of the major caveats.

To summarize, what Hausmann and Hildago did was create a mapping of products across the global economy, defining proximity by looking at the probability of a country having a comparative advantage in one product given it has a comparative advantage in the other.  The analysis shows that the product space (aka the forest) is highly heterogeneous, with a dense core and clusters of products  as you move towards the periphery.  When they mapped specific countries and regions in the space, they observe regional patterns of specialization and that developing countries are typically in the sparser areas of the forest. 

The really interesting insights come when they looked at how economies evolve over time across the product space.  The analysis revealed that economies (composed of firms aka monkeys) evolve to produce products that are close to those they already produce (monkeys tend to jump to nearby trees).  This suggests there may be limitations in how far across the forest a monkey can jump. 

We can think about this product mapping as a proxy for capability mapping.  The implication is that economies evolve according to their existing capabilities and can't make jumps across the forest.  Industrial policy then can help facilitate larger jumps than monkeys do on their own, but is fundamentally constrained by the capabilities that exist in the economy.

There are two significant holes that need to be understood.

First, the product space is created using international trade data, which excludes both services and non-tradables.  If the takeaway for all of this is that capabilities matter, then it's important to understand proximity relationships across all economic activity, not just exported goods.  It might be the case that services or non-tradables can help bridge gaps between the exportable goods included in the current mapping.  Based on the current analysis, these are open questions and I think crucial to understand before we base policy decisions on this work. 

Second, Hausmann and Hildago haven't yet explored how the product space evolves over time.  Their analysis of how economies progress through the product space takes it as static based on the data used to create the mapping.  But there's no reason to think that should be the case.  As new technologies emerge the capabilities required to produce products should evolve as well.  They recognize this is a question for further research and that this analysis is only a first approximation, but note that economies evolve across the space at a faster pace than the space evolves itself.

Despite these issues I find this work incredibly intriguing.  The place I really struggle, however, is turning these insights into policy implications.  How to help monkeys jump farther from trees?  Hausmann pulls in Rodrik's work to answer this question.  I will save that for another post. 
 

Technology, Development, and Psychology

February 2, 2010
 
Generally, I argue that access to more information via technology is good for development. Access to information (e.g. prices) improves market efficiency.  Communication flows fostered by the Internet strengthen democracy.  With this information, people are empowered to debate the direction they want their societies to move in.  I've read my Amartya Sen, after all.

But could too much information actually be counterproductive?  Apparently, yes.  As I sat in David King's first lecture in my Culture, Power, and Politics course last week, he said something that challenged these assumptions.  He told us that the world is becoming more polarized right when information is most available.  

These two things are not unrelated.  People with strong belief systems, it turns out, tend to react instinctively.  Strong ideologues think the least about how to process information and have the most closed minds.  They are the most likely to seek out information that confirms their biases (George W. Bush, anyone?).

So here's the rub: when people have access to too much information, they increasingly must process that information in the most efficient way possible.  That is, in accordance to their ideology.  People react to the explosion of information by seeking that which confirms their bias. Our natural tendency to hear what we want to hear and ignore elements that don't fit into our world view actually gets exacerbated.

I still think access to information is a net positive in developing countries, but this serves as a reminder that the human brain works in mysterious ways that often lead to unintended consequences.  It would behoove us all to stay tuned to the findings of behavioral economics.

And while I'm at it, here's a link to Sendhil Mullainathan's TEDIndia talk last November.  In case you don't know who he is, he's a leading academic in the intersection of development and behavioral economics.  I'm lucky enough to be taking a class from him this semester so hopefully I'll have more to share, and often.  
 
 

Technology and Philosophy

February 1, 2010
 
Damon Horowitz, the CTO of Aardvark, is one of the smartest people you'll ever meet.  And one of the most interesting too.  After getting is master's in computer science at the MIT Media Lab and diving deep into artificial intelligence, he took his career for a left turn and got a PhD in philosophy from Stanford.  

A couple weeks ago he gave fascinating and thought provoking talk at the TEDx event in San Francisco about the boundary between machines and people.  He has a lot of interesting thoughts about the negative social implications of technology that hopefully he'll articulate on the TED main stage one day.

In the meantime, you can watch the talk from TEDx SOMA here. 
 
 
Make a Free Website with Yola.