Superintelligence by Nick Bostrom — book cover
Moral and ethical aspects · Cognitive science · Artificial intelligence

Superintelligenceby Nick Bostrom

Learn the book's main ideas in 3 minutes, then hold your own in any conversation about it.

2014352 pages✦ Big ideas · 3 min★ 4.0 (23)
Recommended by Nate Silver, Sam Altman and Dwarkesh Patel
Rate it

As an Amazon Associate, Lumina earns from qualifying purchases. How this works

A conceptual image of a computer-like brain connected to a simple target icon, with small human silhouettes nearby to suggest misaligned aims.

Big ideas · from the full text

Get smarter about Superintelligence in 3 minutes

5 illustrated ideas you will actually remember, drawn from the complete book.

  1. 1Intelligence does not guarantee humane goals
  2. 2Many goals can create a drive toward power
  3. 3Every control plan has weak points
  4. 4Competition can make danger worse
  5. +1 more ideas inside
✦ Get smarter in 3 min→
What is Superintelligence about?

The human brain has some capabilities that the brains of other animals lack. It is to these distinctive capabilities that our species owes its dominant position. Other animals have stronger muscles or sharper claws, but we have cleverer brains. If machine brains one day come to surpass human brains in general intelligence, then this new superintelligence could become very powerful. As the fate of the gorillas now depends more on us humans than on the gorillas themselves, so the fate of our species then would come to depend on the actions of the machine superintelligence. But we have one advantage: we get to make the first move. Will it be possible to construct a seed AI or otherwise to engineer initial conditions so as to make an intelligence explosion survivable? How could one achieve a controlled detonation? To get closer to an answer to this question, we must make our way through a fascinating landscape of topics and considerations. Read the book and learn about oracles, genies, singletons; about boxing methods, tripwires, and mind crime; about humanity's cosmic endowment and differential technological development; indirect normativity, instrumental convergence, whole brain emulation and technology couplings; Malthusian economics and dystopian evolution; artificial intelligence, and biological cognitive enhancement, and collective intelligence.

Most readers stop hereGet smarter about Superintelligence17 minutes: the ideas, the context, the criticism, and what to say about itMake me smarter

Who's talking about Superintelligence

Public statements we checked against the original source

Portraits from Wikimedia Commons · photo credits and licences

Ratings at a glance

Open Library
★ 4.0 / 5
23 ratings

Popular quotes from Superintelligence

“The first superintelligence may be the last, unless we learn how to align it with human values.”
“Machine intelligence is the last invention that humanity will ever need to make.”

Frequently asked

The human brain has some capabilities that the brains of other animals lack. It is to these distinctive capabilities that our species owes its dominant position. Other animals have stronger muscles or sharper claws, but we have cleverer brains. If machine brains one day come to surpass human brains in general intelligence, then this new superintelligence could become very powerful. As the fate of