📚 The Coming Wave

📚 The Coming Wave

BOOK INFORMATION

The Coming Wave: Technology, Power, and the Twenty-first Century's Greatest Dilemma
Mustafa Suleyman (with Michael Bhaskar)
2023
300 pages
Technology/Current Affairs/Futurology

KEY TAKEAWAYS

HOOK

We are approaching a critical threshold in human history where artificial intelligence and synthetic biology will soon surround us, organize our lives, and simultaneously create unprecedented prosperity and existential risk; yet none of us are prepared for the impossible choices that lie ahead.

ONE-SENTENCE TAKEAWAY

The coming wave of AI and synthetic biology presents humanity with an existential dilemma: how to contain technologies that offer immense benefits while posing catastrophic risks, all while navigating the narrow path between technological catastrophe and authoritarian control.

SUMMARY

The Coming Wave by Mustafa Suleyman stands as a seminal work that urgently warns humanity about the unprecedented technological revolution already underway. As a co-founder of DeepMind and current CEO of Microsoft AI, Suleyman brings unparalleled insider perspective to his analysis of how artificial intelligence and synthetic biology are converging to create a technological wave that will fundamentally reshape human existence within the coming decade.

The book begins by establishing the concept of technological waves throughout history: periods where multiple innovations converge to transform society. Suleyman argues that the current wave, driven primarily by AI and synthetic biology but also encompassing quantum computing, robotics, and clean energy, represents something fundamentally different from previous technological revolutions. These technologies are characterized by four key features: asymmetric impact (giving massive power to individuals), hyper-evolution (extremely rapid development), omni-use (applicable across countless contexts), and autonomy (increasingly independent operation).

Suleyman draws on historical patterns to demonstrate how technologies have consistently proliferated despite attempts at containment, using examples from nuclear weapons to automobiles. However, he argues that AI and synthetic biology present a fundamentally different challenge due to their accessibility, dual-use nature, and the difficulty of monitoring their development. Unlike nuclear weapons that require massive infrastructure, these emerging technologies can be developed in garages or small labs, making traditional containment strategies ineffective.

The heart of the book examines the specific technologies driving this wave. Suleyman provides firsthand accounts of AI's rapid advancement, from DeepMind's breakthroughs with AlphaGo to the emergence of large language models like ChatGPT. He explores how synthetic biology, powered by CRISPR gene editing and DNA synthesis, is similarly advancing at an exponential rate. The convergence of these fields creates possibilities that were previously unimaginable, from AI-designed miracle drugs to engineered pathogens, while simultaneously creating unprecedented risks.

A central theme is the threat that these technologies pose to the nation-state and global order. Suleyman argues that governments are "sleepwalking into disaster," unprepared for how AI and biotechnology will undermine national security, public safety, and economic stability. The technologies enable both extreme centralization of power (enriching tech companies and empowering authoritarian governments) and fragmentation (equipping secessionists and ideological factions to create autonomous entities).

The book's core contribution is establishing "the containment problem" as the defining challenge of our age. Suleyman presents a stark dilemma: uncontained, these technologies will wreak havoc on humanity, but containment mechanisms requiring authoritarian surveillance would be similarly catastrophic. This creates a "narrow path" that society must navigate between catastrophe and dystopia.

In the final sections, Suleyman outlines ten interdependent strategies for containment, ranging from technical safety measures and audits to international cooperation and aligned incentives. He emphasizes that regulation alone is insufficient and that a coherent approach across governments, companies, and scientists is essential. While acknowledging that containment seems nearly impossible, he argues that the benefits of the coming wave make it worth fighting for.

INSIGHTS

• The Containment Problem is Fundamental: Unlike previous technologies, AI and synthetic biology cannot be effectively contained through traditional methods due to their accessibility, dual-use nature, and rapid development pace
• Historical Patterns Repeat but with New Complexity: While technology has always proliferated despite containment attempts, the current wave presents unique challenges due to the convergence of multiple powerful technologies
• Four Characteristics Define the Wave: Asymmetric impact, hyper-evolution, omni-use, and autonomy make these technologies fundamentally different from previous technological revolutions
• Nation-States Are Unprepared: Governments are not equipped to handle the security, economic, and social challenges posed by AI and synthetic biology
• The Narrow Path is the Only Way Forward: Society must navigate between the extremes of catastrophic technological harm and authoritarian control mechanisms
• Incentives Drive Unstoppable Momentum: National pride, technological arms races, profit motives, and global challenges create powerful incentives that make technological advancement essentially unstoppable
• Pessimism Aversion Blinds Us: People naturally resist facing technology's potential negative consequences, making it difficult to prepare for and mitigate risks
• Convergence Amplifies Impact: The intersection of AI, synthetic biology, robotics, and quantum computing creates possibilities and risks far beyond what any single technology could achieve alone
• Technical Solutions Alone Are Insufficient: While safety measures are important, effective containment requires coordinated international cooperation and institutional innovation
• The Benefits Make the Fight Worthwhile: Despite the risks, the potential benefits such as curing diseases, solving climate change, abundant energy make containing these technologies essential rather than abandoning them

FRAMEWORKS & MODELS

The Containment Problem Framework

This is the central analytical framework of the book, explaining the challenge of controlling powerful technologies:

Components:

• Accessibility: Technologies that can be developed with minimal infrastructure and resources
• Dual-Use Nature: Applications that can be used for both beneficial and harmful purposes
• Monitoring Challenges: Difficulty in detecting or tracking development and use
• Proliferation Incentives: Strong economic, political, and social drivers for widespread adoption
• Containment Dilemma: The choice between uncontrolled proliferation and authoritarian control mechanisms

Application: This framework helps analyze why traditional containment strategies fail with emerging technologies and what new approaches might be needed.

Evidence: Suleyman provides numerous examples, from nuclear weapons (partial containment success) to file-sharing technologies (containment failure), to illustrate how different technologies present different containment challenges.

Significance: This framework reframes the discussion around technology regulation from whether to control to how to control, acknowledging the fundamental tensions involved.

The Four Characteristics Model

This framework explains why the current technological wave is unprecedented:

Components:

• Asymmetric Impact: Technologies that give individuals or small groups power previously held only by states or large organizations
• Hyper-Evolution: Extremely rapid development cycles that outpace traditional regulatory and adaptive mechanisms
• Omni-Use: Applicability across vast numbers of contexts and purposes, making comprehensive regulation impossible
• Autonomy: Increasing ability to operate independently of human control or intervention

Application: This model helps explain why AI and synthetic biology present fundamentally different challenges than previous technological revolutions.

Evidence: Suleyman provides numerous examples of how each characteristic manifests in current technologies, from AI systems that can generate biological weapons to DNA synthesis technologies that enable garage-based genetic engineering.

Significance: This framework provides a vocabulary and analytical structure for understanding why traditional approaches to technology governance are inadequate for the coming wave.

The Narrow Path Framework

This framework outlines the difficult choices facing society in managing technological advancement:

Components:

• Catastrophe Risk: The danger of uncontrolled technological development leading to existential threats
• Authoritarian Risk: The danger of overbearing surveillance and control mechanisms undermining freedom and democracy
• Balance Point: The difficult middle ground that avoids both extremes
• Implementation Challenges: The practical difficulties of achieving and maintaining this balance
• Global Coordination: The necessity of international cooperation to address inherently global challenges

Application: This framework helps policymakers and society understand the difficult trade-offs involved in managing emerging technologies.

Evidence: Suleyman analyzes historical examples of societies struggling with similar balances, from nuclear technology to internet governance, to illustrate the challenges of finding the narrow path.

Significance: This framework moves beyond simple pro/technology debates to acknowledge the complex trade-offs and difficult choices that lie ahead.

KEY THEMES

• The Inevitability of Technological Progress: Throughout the book, Suleyman emphasizes that the coming wave of technology is essentially unstoppable due to powerful incentives and momentum. This theme is developed through historical examples showing how technologies consistently proliferate despite attempts at control, and through analysis of the current drivers of AI and biotechnology advancement.
• The Fragility of Current Institutions: The book consistently highlights how existing governmental, economic, and social institutions are unprepared for the challenges posed by emerging technologies. This theme is developed through analysis of how AI and biotechnology will undermine traditional state functions, economic systems, and social structures.
• The Dual Nature of Technology: Suleyman repeatedly emphasizes that the same technologies that offer tremendous benefits also pose catastrophic risks. This theme is developed through numerous examples of how AI and synthetic biology can be used for both constructive and destructive purposes, creating fundamental governance challenges.
• The Historical Pattern of Technological Waves: The book places current developments in historical context, showing how technological revolutions have repeatedly transformed society. This theme is developed through analysis of previous technological waves and their impacts, while arguing that the current wave is fundamentally different in scale and nature.
• The Urgency of Collective Action: Suleyman stresses that addressing the containment problem requires unprecedented global cooperation and coordinated action. This theme is developed through analysis of why individual nations or companies cannot effectively address these challenges alone, and through proposals for international cooperation mechanisms.

COMPARISON TO OTHER WORKS

• vs. "Superintelligence" by Nick Bostrom: While Bostrom focuses primarily on the long-term risks of superintelligent AI, Suleyman examines the more immediate challenges of current AI and synthetic biology. Bostrom's work is more philosophical and future-oriented, while Suleyman's is more practical and focused on near-term challenges and policy solutions.
• vs. "AI Superpowers" by Kai-Fu Lee: Lee's book focuses on the geopolitical competition between the US and China in AI development, while Suleyman takes a more global view of technological risks and governance. Lee emphasizes national competition, while Suleyman emphasizes international cooperation and shared risks.
• vs. "The Precipice" by Toby Ord: Ord examines existential risks more broadly, including natural disasters and asteroids, while Suleyman focuses specifically on technological risks from AI and synthetic biology. Ord's work is more comprehensive in scope, while Suleyman's is more detailed on specific technological challenges.
• vs. "Weapons of Math Destruction" by Cathy O'Neil: O'Neil focuses on the current harms of algorithmic bias and discrimination in AI systems, while Suleyman addresses more existential and large-scale risks. O'Neil's work is more grounded in current social impacts, while Suleyman's is more forward-looking and strategic.
• vs. "Life 3.0" by Max Tegmark: Tegmark explores the long-term future of intelligence in the universe, while Suleyman focuses on the more immediate challenges of the coming decades. Tegmark's work is more speculative and philosophical, while Suleyman's is more practical and policy-oriented.

QUOTES

• "We are approaching a critical threshold in the history of our species. Everything is about to change." - This opening statement sets the urgent tone of the book and establishes the significance of the technological changes ahead.
• "The coming wave is coming." - Suleyman repeats this phrase throughout the book to emphasize the inevitability and imminence of the technological transformation he describes.
• "Containment seems impossible, but the benefits of the coming wave are worth fighting for." - This quote captures the central dilemma of the book while acknowledging the difficulty of containment while arguing that it's essential to try.
• "The containment problem is the defining challenge of our age." - This statement establishes the core thesis of the book and frames the discussion around technology governance.
• "Soon you will live surrounded by AIs. They will organize your life, operate your business, and run core government services." - This vivid description illustrates the pervasive impact Suleyman expects AI to have on daily life in the near future.

HABITS

• Technological Literacy: Develop understanding of AI, synthetic biology, and other emerging technologies to make informed decisions about their development and governance
• Risk Assessment: Practice evaluating both the benefits and risks of new technologies, rather than focusing exclusively on either optimism or pessimism
• Systems Thinking: Consider how technologies interact with each other and with social, economic, and political systems rather than viewing them in isolation
• International Perspective: Recognize that technological challenges are global and require international cooperation rather than national solutions
• Preparedness Mindset: Accept that technological change is coming and prepare personally and professionally for rapid transformation
• Ethical Consideration: Regularly evaluate the ethical implications of technological development and use
• Policy Engagement: Participate in discussions and decisions about technology governance at local, national, and international levels
• Adaptive Learning: Commit to continuous learning about rapidly evolving technologies to stay informed about new developments and risks
• Balanced Skepticism: Maintain neither blind faith in technological progress nor blanket opposition, but rather a nuanced understanding of both benefits and risks
• Collaborative Problem-Solving: Seek diverse perspectives and work with others across disciplines and sectors to address complex technological challenges

KEY ACTIONABLE INSIGHTS

• Develop Technological Literacy: Invest time in understanding AI, synthetic biology, and other emerging technologies to make informed decisions about their development and governance
• Support International Cooperation: Advocate for and participate in international efforts to address technological risks, recognizing that no single nation can effectively contain these technologies alone
• Promote Safety Research: Support and fund research into technical safety measures for AI and biotechnology, such as off switches, alignment research, and containment mechanisms
• Demand Transparency: Push for greater transparency in technology development and deployment from both private companies and government agencies
• Engage in Policy Discussions: Participate in democratic processes and discussions about technology governance, ensuring that diverse voices are heard in decisions about technological development
• Prepare for Disruption: Both personally and professionally, prepare for the disruptive impacts of AI and automation on jobs, services, and social systems
• Support Dual-Use Research Guidelines: Advocate for and follow guidelines that help prevent beneficial research from being misused for harmful purposes
• Build Resilient Systems: Support the development of social, economic, and political systems that can withstand the disruptions caused by emerging technologies
• Promote Ethical Development: Encourage ethical considerations in technology development from the earliest stages, rather than as an afterthought
• Stay Informed and Adaptive: Commit to continuous learning about technological developments and be prepared to adapt strategies as new information and capabilities emerge

REFERENCES

• AI Research and Development Literature: Suleyman draws on extensive research in artificial intelligence, including his own work at DeepMind and current developments in large language models and AI safety research
• Synthetic Biology Research: The book incorporates cutting-edge research in genetic engineering, CRISPR technology, DNA synthesis, and their applications in medicine, agriculture, and other fields
• Historical Technology Studies: Suleyman references historical analyses of technological revolutions and containment attempts, from nuclear weapons to internet governance
• International Relations Literature: The book engages with scholarship on international cooperation, arms control, and global governance mechanisms
• Economic Studies: Suleyman incorporates research on technological disruption, economic transformation, and the relationship between technology and economic systems
• Political Theory: The book draws on political philosophy and theory regarding the relationship between technology, power, and governance
• Risk Assessment Literature: Suleyman references research on risk assessment, catastrophic risk management, and existential risk studies
• Policy Analysis: The book incorporates policy research on technology governance, regulation, and international cooperation mechanisms
• Ethics Philosophy: Suleyman engages with philosophical work on technology ethics, dual-use dilemmas, and the moral implications of technological development
• Case Studies and Examples: Throughout the book, Suleyman uses numerous case studies from his experience at DeepMind and observations of current technological developments to illustrate key points

Crepi il lupo! 🐺