The intelligent monster that you should let eat you

by David Solomonoff

If one ever encountered a 'utility monster', it might pose an ethical dilemma (Credit: Getty Images)

Imagine a monster with a set of words so powerful you have to let it eat you. It might sound fanciful, but we’re on a trajectory to inventing one.

As we edge closer to the possibility of intelligent synthetic minds, we will need to weigh up how we design them, what we do and don’t allow them to do, and crucially, how to ensure their needs are aligned with our own.

If our demise meant their success, then by the basic utilitarian logic that we should maximise well-being in the world, they’d have an argument for metaphorically eating us.

Source: The intelligent monster that you should let eat you – BBC Future

Leave a Comment

%d bloggers like this: