The Ingenuity Gap

“The most persuasive forecast of the 21st century I have seen.” — E.O. Wilson, author of Consilience: The Unity of Knowledge and twice winner of a Pulitzer prize

“Human beings have been smart enough to turn nature to their ends, generate vast wealth for themselves, and double their average life span. But are they smart enough to solve the problems of the 21st century?” – Thomas Homer-Dixon

Can we create ideas fast enough to solve the very problems — environmental, social, and technological — we’ve created? Homer-Dixon pinpoints the “ingenuity gap” as the critical problem we face today, and tackles it in a riveting, groundbreaking examination of a world that is rapidly exceeding our intellectual grasp.

In The Ingenuity Gap, Thomas Homer-Dixon, “global guru” (the Toronto Star), “genuine academic celebrity” (Saturday Night) and “one of Canada’s most talked about and controversial scholars” (Maclean’s) asks: is our world becoming too complex, too fast-paced to manage? The challenges facing us — ranging from international financial crises and global climate change to pandemics of tuberculosis and AIDS- converge, intertwine, and remain largely beyond our ken. Most of suspect the “experts don’t really know what’s going on; that as a species we’ve released forces that are neither managed nor manageable. We are fast approaching a time when we may no longer be able to control a world that increasingly exceeds our grasp. This is “the ingenuity gap” — the term coined by Thomas Homer-Dixon, political scientist and advisor to the White House — the critical gap between our need for practical, innovative ideas to solve complex problems and our actual supply of those ideas.

Through gripping narrative stories and incidents that exemplify his arguments, he takes us on a world tour that begins with a heartstopping description of the tragic crash of United Airlines Flight 232 from Denver to Chicago and includes Las Vegas in its desert, a wilderness beach in British Columbia, and his solitary search for a little girl in Patna, India. He shows how, in our complex world, while poor countries are particularly vulnerable to ingenuity gaps, our own rich countries are not immune, and we are caught dangerously between a soaring requirement for ingenuity and an increasingly uncertain supply. When the gap widens, political disintegration and violent upheaval can result, reaching into our own economies and daily lives in subtle ways. In compelling, lucid, prose, he makes real the problems we face and suggests how we might overcome them — in our own lives, our thing, our business and our societies.

Excerpt

At 3:16 p.m. on 19 July, 1989, the jet’s tail engine blew apart. Twelve thousand meters above the U.S. Midwest, shards of the engine’s fan rotor cut through the rear of the aircraft, shredding its hydraulic systems. As fluid bled from hydraulic tubing, the pilots in the front of the…

Suggested Readings

Read a short, idiosyncratic list of the books and articles that were particularly valuable when writing The Ingenuity Gap.

The following is a short, idiosyncratic list of the books and articles that I found particularly valuable when writing The Ingenuity Gap. All of them are mentioned in the book’s endnotes, but since there are several thousand citations there, readers may benefit from a more select list. I’ve provided some comments on each of these readings in the Annotated Reading List below.
 

Ingenuity Optimists

  • Ausubel, Jesse. “Does Climate Still Matter?” Nature. 350, no. 6320 (25 April 1991): 649-652.
  • Ausubel, Jesse. “Resources and Environment in the 21st Century: Seeing Past the Phantoms,” World Energy Council Journal. (July 1998): 8-16.
  • Ausubel, Jesse. “The Liberation of the Environment,” Daedalus. 125, no. 33 (Summer 1996): 1-17.
  • Nordhaus, William. “Do Real-Output and Real-Wage Measures Capture Reality? The History of Lighting Suggests Not,” in The Economics of New Goods, eds. Timothy Bresnahan and Robert Gordon (Chicago: University of Chicago Press, 1997).
  • Simon, Julian. The Ultimate Resource II: People, Materials, and Environment (Princeton, New Jersey: Princeton University Press, 1996).

Complexity and Chaos

  • Arthur, W. Brian. “On the Evolution of Complexity,” Complexity: Metaphors, Models, and Reality, eds. G. Cowan, D. Pines, and D. Meltzer (Reading, Massachusetts: Addison-Wesley, 1994).
  • Bar-Yam, Yaneer. Dynamics of Complex Systems (Reading, Massachusetts: Addison-Wesley, 1992).
  • Crutchfield, J. P., Farmer, J. D, Packard, N. H. and Shaw, R. S. “Chaos,” Scientific American. 255, no. 6 (December 1986): 46-57.
  • Williams, Garnet. Chaos Theory Tamed (Washington, D.C.: Joseph Henry Press, 1997).

Complex Adaptive Systems

  • Kauffman, Stuart. At Home in the Universe: The Search for Laws of Self-Organization and Complexity (New York: Oxford University Press, 1995).
  • Kauffman, Stuart. The Origins of Order: Self-Organization and Selection in Evolution(New York: Oxford University Press, 1993).
  • Wright, Sewall. “The Roles of Mutation, Inbreeding, Crossbreeding and Selection in Evolution,” Proceedings of the Sixth International Congress on Genetics 1. (1932): 356-366.

Rising Complexity

  • Perrow, Charles. Normal Accidents: Living with High-Risk Technologies (New York: Basic Books, 1984).
  • Rochlin, Gene. Trapped in the Net: The Unanticipated Consequences of Computerization (Princeton, New Jersey: Princeton University Press, 1997).
  • Tainter, Joseph. The Collapse of Complex Societies (Cambridge: Cambridge University Press, 1988).
  • Winner, Langdon. “Complexity and the Limits of Human Understanding,” in Organized Social Complexity: Challenge to Politics and Policy, ed. Todd La Porte (Princeton: Princeton University Press, 1975).

Ecological Systems and Environmental Change

  • Broecker, Wally. “Unpleasant Surprises in the Greenhouse?” Nature. 328, no. 6126 (9 July 1987): 123-126.
  • Holling, C.S. “Buzz”. “An Ecologist View of the Malthusian Conflict,” Population, Economic Development, and the Environment, ed. Kerstin Lindahl-Kiessling and Hans Landberg (Oxford: Oxford University Press, 1994).
  • Holling, C.S. “Buzz”. “New Science and New Investments for a Sustainable Biosphere,” Investing in Natural Capital: The Ecological Economics Approach to Sustainability, eds. AnnMari Jansson, Monica Hammer, Carl Folke, and Robert Costanza (Washington, D.C.: Island Press, 1994).
  • Turner, B. L. II et al. eds. The Earth as Transformed by Human Action (Cambridge: Cambridge University Press, 1990).
  • World Resources Institute. World Resources. (Washington, D.C.)

Evolution of the Human Brain

  • Mithen, Steven. The Prehistory of the Mind: A Search for the Origins of Art, Religion, and Science (London: Thames and Hudson, 1996).
  • Potts, Rick. Humanity’s Descent: The Consequences of Ecological Instability (New York: Avon, 1997).

New Growth (Endogenous Growth) Theory

  • Aghion, Philippe and Howitt, Peter. Endogenous Growth Theory (Cambridge, Massachusetts: MIT Press, 1998).
  • Romer, Paul. “Two Strategies for Economic Development: Using Ideas and Producing Ideas,” Proceedings of the World Bank Annual Conference on Development Economics 1992(Washington, D.C.: World Bank, 1993).
  • Romer, Paul. “Endogenous Technological Change,” Journal of Political Economy. 98, no. 5, pt. 2 (1990): S74-S75.
  • Romer, Paul. “Idea Gaps and Object Gaps in Economic Development,” Journal of Monetary Economics. 32, no. 3 (1993): 543-573.
  • Romer, Paul. “The Origins of Endogenous Growth,” Journal of Economic Perspectives. 8, no. 1 (1994): 3-22.

Market-Induced Technological Innovation

  • Barnett, Harold and Morse, Chandler. Scarcity and Growth: The Economics of Natural Resource Availability (Baltimore: Johns Hopkins Press for Resources for the Future, 1963).
  • Hayami, Yujiro and Ruttan, Vernon. Agricultural Development: An International Perspective (Baltimore: Johns Hopkins University Press, 1985).
  • Hicks, J.R. The Theory of Wages (London: Macmillan, 1932).
  • Olson, Mancur. “Big Bills Left on the Sidewalk: Why Some Nations are Rich, and Others Poor,” Journal of Economic Perspectives. 10, no. 2 (Spring 1996): 3-24.
  • Petroski, Henry. Invention by Design: How Engineers Get from Thought to Thing(Cambridge, Massachusetts: Harvard University Press, 1996).
  • Schmookler, Jacob. Invention and Economic Growth (Cambridge, Massachusetts: Harvard University Press, 1966).
  • Smith, V. Kerry, ed. Scarcity and Growth Reconsidered (Baltimore: Johns Hopkins Press for Resources for the Future, 1979).

Rational-Choice Theory

  • Green, Donald and Shapiro, Ian. Pathologies of Rational Choice Theory: A Critique of Applications in Political Science (New Haven, Connecticut: Yale University Press, 1994).
  • Ostrom, Elinor. “A Behavioral Approach to the Rational Choice Theory of Collective Action,” American Political Science Review. 92, no. 1 (March 1998): 1-22.

Constraints on Science

  • Barrow, John. Impossibility: The Limits of Science and the Science of Limits (Oxford: Oxford University Press, 1998).
  • Kahn, Herman and Wiener, Anthony. “The Next Thirty-Three Years: A Framework for Speculation,” Toward the Year 2000: Work in Progress, eds. Daniel Bell and Stephen Graubard (Cambridge, Massachusetts: MIT Press, 1967, 1997), 73-100.

Limits to Social Ingenuity

  • Falkenrath, Richard, Newman, Robert and Thayer, Bradley. America’s Achilles’ Heel: Nuclear, Biological, and Chemical Terrorism and Covert Attack (Cambridge, Massachusetts: MIT Press, 1998).
  • Olson, Mancur. The Rise and Decline of Nations: Economic Growth, Stagflation, and Social Rigidities (New Haven, Conneticut: Yale University Press, 1982).
  • Rauch, Jonathan. Demosclerosis: The Silent Killer of American Government (New York: Times Books, 1995).
  • Tuchman Mathews, Jessica. “Power Shift,” Foreign Affairs. 76, no. 1 (January/February 1997): 50-66.
  • Wright, Robert. “Hyperdemocracy,” Time. 145, no. 3 (23 January 1995): 41-46.
Ingenuity Optimists

I’ve long been intrigued, annoyed, and — ultimately — influenced by the ideas of the late Julian Simon, who taught in the College of Business and Management of the University of Maryland. Simon fancied himself a population economist; he was almost fanatically optimistic in his belief that human beings could deliver copious ingenuity in response to any and all challenges. I once playfully called an early draft paper about the ingenuity gap “the ultimate response,” since I saw it as a direct reply to Simon’s book The Ultimate Resource. For those unfamiliar with his work, I would therefore strongly recommend The Ultimate Resource II: People, Materials, and Environment. In a similar vein are the ideas and arguments of Jesse Ausubel of Rockefeller University. I have huge respect for Jesse’s work, although we disagree about many things. Three good examples of his thinking are, “Resources and Environment in the 21st Century: Seeing Past the Phantoms,” World Energy Council Journal; “The Liberation of the Environment,” Daedalus; and “Does Climate Still Matter?” Nature. A fascinating study of the progress of human ingenuity in one particular domain, that of light-producing technology, is William Nordhaus, “Do Real-Output and Real-Wage Measures Capture Reality? The History of Lighting Suggests Not,” in The Economics of New Goods.

Complexity and Chaos

Complexity and chaos are extremely difficult ideas, if one wants to understand them properly, but an excellent starting point is the still classic article by James Crutchfield, J. Doyne Farmer, and Norman Packard titled “Chaos” in the December, 1986 issue of Scientific American. The most accessible and thorough treatment of chaos theory I’ve found is Garnett Williams, Chaos Theory Tamed. If you’re looking for a comprehensive technical treatment of complexity theory, I would recommend Yaneer Bar-Yam, Dynamics of Complex Systems. This is not a book for the faint-hearted, and some knowledge of mathematics is helpful, but Bar-Yam is quite daring in his treatment of the social and philosophical implications of complexity at the end of his book. Overall, I found it immensely helpful.

On the sources of complexity in biological, technological, and social systems, I know of no better analysis than W. Brian Arthur’s article “On the Evolution of Complexity” in Complexity: Metaphors, Models, and Reality. This is truly a ground-breaking piece that has, Arthur tells me, received remarkably little attention since it was published. My account of his argument in chapter 4 of The Ingenuity Gap cannot possibly do it justice. Highly recommended!

Complex Adaptive Systems

Closely related to the study of complexity is the fascinating new field of complex adaptive systems, which I discuss briefly in chapter 11 of The Ingenuity Gap. Stuart Kauffman provides a good introduction to recent thinking in this area in At Home in the Universe: The Search for the Laws of Self-Organization and Complexity; he develops a more technical argument about self-organization in biological systems in The Origins of Order: Self-Organization and Selection in Evolution. Much of this work is centered on the concept of a “fitness landscape,” an idea first introduced by Sewall Wright in 1932 in an amazingly prescient article titled “The Roles of Mutation, Inbreeding, Crossbreeding and Selection in Evolution,” Proceedings of the Sixth Internatihonal Congress on Genetics.

Rising Complexity

Countless writings discuss the technological and social implications of rising complexity in our world, but I found four particularly stimulating. The seminal discussion of the perils of complex technological systems is Charles Perrow’s book Normal Accidents: Living with High-Risk Technologies; it has been recently update and reissued. Gene Rochlin looks at some of the unexpected consequences of the communication and information revolution in Trapped in the Net: The Unanticipated Consequences of Computerization. On the social side, Langdon Winner’s wonderful article, “Complexity and the Limits of Human Understanding,” is extraordinarily rich with insights on the social and cognitive challenges posed by rising complexity. It can be found in a book that’s worth reading in its entirety: Organized Social Complexity: Challenge to Politics and Policy. Finally, for a far more apocalyptic but tremendously provocative study of the risks of increased social complexity, see Joseph Tainter, The Collapse of Complex Societies.

Ecological Systems and Environmental Change

Where does one start if one wants to learn about the ecological and environmental changes humankind is producing on Earth? There is a staggering amount of information available, but much of it, unfortunately, is of dubious quality. As a standard reference, one that I use regularly, I recommend the biennial publication World Resources published by the World Resources Institute in Washington, D.C. Every two years, this publication provides an in-depth treatment of selected issues relating to global environmental change, as well as detailed data tables on everything from population growth to deforestation and energy consumption for every country on the planet. It is a high-quality publication that can quickly become indispensable.

An astonishingly thorough and comprehensive study of the effects of human activities on Earth in recent centuries is B. L. Turner II et al. eds., The Earth as Transformed by Human Action. Of course, not only do we need to know something about what we’re doing to the planet, we also need to know how these activities affect the complex ecologies around us. Readers of The Ingenuity Gapwill remember that I have been particularly influenced by the work of the renowned ecologist C.S. “Buzz” Holling. See especially his article, “New Science and New Investments for a Sustainable Biosphere,” chapter 4 in Investing in Natural Capital: The Ecological Economics Approach to Sustainability. Also see C. S. Holling, “An Ecologist View of the Malthusian Conflict,” in Population, Economic Development, and the Environment. My first real exposure to the implications of nonlinearities in complex environmental systems came through Wally Broecker’s famous 1987 article on ocean current systems: “Unpleasant Surprises in the Greenhouse?” Nature. This article is a blockbuster; it should be required reading for every senior policymaker in the world.

Evolution of the Human Brain

On the evolution of the human brain and our cognitive and creative abilities, I have found the work of both Rick Potts and Steven Mithen to be fascinating and compelling. I’ve corresponded with them both, and I know they are a bit dubious about the way I integrate their respective ideas. I’ll leave it to readers of The Ingenuity Gap to judge whether the integration succeeds. Regardless, I would heartily recommend their books: Rick Potts, Humanity’s Descent: The Consequences of Ecological Instability; and Steven Mithen, The Prehistory of the Mind: A Search for the Origins of Art, Religion, and Science.

New Growth (Endogenous Growth) Theory

I began the intellectual quest described in The Ingenuity Gap with an extended visit to the world of New Growth (or Endogenous Growth) theory in economics (as described in chapter 9). The key person here, of course, is Paul Romer. He has written a large number of path-breaking articles, most of which, unfortunately, are difficult going for the non-economist. Those that particularly influenced my thinking are: “Endogenous Technological Change,” in the Journal of Political Economy; “Idea Gaps and Object Gaps in Economic Development,”in the Journal of Monetary Economics; and “Two Strategies for Economic Development: Using Ideas and Producing Ideas,” in the Proceedings of the World Bank Annual Conference on Development Economics, 1992. If you want an account of the evolution of thinking about endogenous growth see Paul Romer, “The Origins of Endogenous Growth,” in the Journal of Economic Perspectives. Philippe Aghion and Peter Howitt provide a comprehensive technical treatment of this whole perspective in Endogenous Growth Theory.

New Growth (Endogenous Growth) Theory

I began the intellectual quest described in The Ingenuity Gap with an extended visit to the world of New Growth (or Endogenous Growth) theory in economics (as described in chapter 9). The key person here, of course, is Paul Romer. He has written a large number of path-breaking articles, most of which, unfortunately, are difficult going for the non-economist. Those that particularly influenced my thinking are: “Endogenous Technological Change,” in the Journal of Political Economy; “Idea Gaps and Object Gaps in Economic Development,”in the Journal of Monetary Economics; and “Two Strategies for Economic Development: Using Ideas and Producing Ideas,” in the Proceedings of the World Bank Annual Conference on Development Economics, 1992. If you want an account of the evolution of thinking about endogenous growth see Paul Romer, “The Origins of Endogenous Growth,” in the Journal of Economic Perspectives. Philippe Aghion and Peter Howitt provide a comprehensive technical treatment of this whole perspective in Endogenous Growth Theory.

Market-Induced Technological Innovation

My ingenuity argument is, in many ways, a reply to simplistic neo-classical models of market-induced technological innovation. An especially important neoclassical treatise on the sources of innovation is Jacob Schmookler’s 1966 book Invention and Economic Growth. Much early neo-classical thinking focused on market responses to natural resource scarcity. The work of the induced-innovation theorists was key, beginning in 1932 with J.R. Hicks, The Theory of Wages and culminating in 1985 in Yujiro Hayami and Vernon Ruttan, Agricultural Development: An International Perspective. While Hayami and Ruttan deal mainly with agricultural systems, a more general neo-classical analysis of scarcity is Harold Barnett and Chandler Morse, Scarcity and Growth: The Economics of Natural Resource Availability, published in 1963. Although dated, the Barnett and Morse book remains important; for a more contemporary treatment, see V. Kerry Smith, ed., Scarcity and Growth Reconsidered.

One of the problems with neoclassical theories of innovation is that they tend to ignore the social, institutional, and political context within which markets operate — a context that largely determines whether markets work well. Mancur Olson argues decisively that institutions and governance matter in “Big Bills Left on the Sidewalk: Why Some Nations are Rich, and Others Poor,” in the Journal of Economic Perspectives. Non-economists reading this article might say “so what, we’ve known that institutions matter all along”; but until recently mainstream economists were surprisingly resistant to this idea. For a fun and down-to-earth account of how technological innovation often works in practice — an account that is, once again, sensitive to the myriad non-market factors that affect innovation — see Henry Petroski, Invention by Design: How Engineers Get from Thought to Thing.

Rational-Choice Theory

Economics is the queen of the social sciences. In chapter 11 of The Ingenuity Gap, I discuss some reasons why the social sciences, especially political science, seem so unsuccessful at generating truly useful knowledge. One problem may be the basic metaphor or “model” of human beings that guides social science research. At the core of much contemporary theory in political science and economics is rational-choice theory, a set of axioms and hypotheses about human behavior that presumes we are, essentially, utility-maximizing calculating machines. A powerful recent attack on this theory is Donald Green and Ian Shapiro, Pathologies of Rational Choice Theory: A Critique of Applications in Political Science. As I discuss in the book, the political scientist Elinor Ostrom tries to redeem a version of rational-choice theory in her impressive 1997 Presidential Address to the American Political Science Association titled “A Behavioral Approach to the Rational Choice Theory of Collective Action,” published in American Political Science Review.

Constraints on Science

The social sciences may be generally a mess, but we shouldn’t assume that the natural sciences like physics, chemistry, and biology are, in contrast, entirely free of constraints that restrict their progress. John Barrow’s book, Impossibility: The Limits of Science and the Science of Limits, is a fascinating treatment of factors — from chaos to intractability — that can keep science from doing everything that we want it to do. And if you want a startling reminder of how past predictions of scientific and technological progress, even by the foremost experts of the time, can be largely wrong, read the mid-1960s forecasts of Herman Kahn and Anthony Wiener in “The Next Thirty-Three Years: A Framework for Speculation,” which appears in Daniel Bell and Stephen Graubard, eds., Toward the Year 2000: Work in Progress.

Limits to Social Ingenuity

Finally, ingenuity supply, especially the supply of social ingenuity, is often derailed by powerful elites and subgroups whose interests would be hurt by institutional reform. New communication and information technologies can make these groups more powerful relative to government. Building on the pioneering work of the economist Mancur Olson in his book The Rise and Decline of Nations: Economic Growth, Stagflation, and Social Rigidities, Jonathan Rauch and Robert Wright dissect this phenomenon in American society. See Jonathan Rauch, Demosclerosis: The Silent Killer of American Government; and Robert Wright 1995 article, “Hyperdemocracy,” in Time. Jessica Tuchman Mathews makes a similar point about societies around the world, and about international society too, in “Power Shift,” in the January/February, 1997 issue of Foreign Affairs. The ultimate power shift will occur when subgroups get access to weapons of mass destruction. It seems a far-fetched possibility, until one reads Richard Falkenrath, Robert Newman, and Bradley Thayer, America’s Achilles’ Heel: Nuclear, Biological, and Chemical Terrorism and Covert Attack.

The Upside of Down

© 2000 by Thomas Homer-Dixon
Publisher: Vintage Canada

#1 Non-Fiction Bestseller in Canada

Winner of the 2001 Governor General’s Nonfiction Literary Award

Praise For

“Thomas Homer-Dixon is a sort of Bruce Chatwin of ideas. Reading the meditations that his travels around the world prompt in him is addictive.” —National Post

“The greatest strength of The Ingenuity Gap us in Homer-Dixon’s ability to illustrate the thin line between order and chaos, prosperity and starvation, or compassion and carelessness in today’s world. The book is a wake-up call to all citizens to take notice of our collective deterioration and therefore…it has the potential to be one of the most important and revolutionary books of recent years.” —Calgary Herald

“Homer-Dixon switches adroitly between reviewing what the academics say and his own impressions of a range of locations seen at first hand that epitomise features of the global society he is examining…. Throughout, Homer-Dixon manages to dramatise the scale of the problems while maintaining a degree of optimism about our ability to tackle them…. wish Homer-Dixon many readers: his book could actually make a difference.” —The Times Higher Education Supplement

“Displaying impressive breadth of learning, Homer-Dixon explores such complex problems as international financial crises, AIDS, overburdened air control systems, yawning gulfs of wealth and poverty, runaway population increases, a crush of information, the fragmentation of ungovernable cities and a host of ecological problems…. Closely reasoned, accessible and lucid.” —The Washington Post

“Thomas Homer-Dixon is one of the few people on the planet who could have tackled what he defines as the world’s overriding issue: the yawning ‘ingenuity’ gap between the need for practical solutions to complex problems, from global warming to Third World poverty, and the actual supply of workable ideas.” —Maclean’s

“If this sounds like pretty sophisticated stuff, it is. But Homer-Dixon doesn’t lose the reader, nor does he assume we are academics. His prose is spirited and accessible.” —The Globe and Mail

Scroll to Top