Yuval Noah Harari warns against A.I. bots deceptively passing as people online—and calls for real-world punishments including jail time to prevent it.
KRISTOF VAN ACCOM / Belga / AFP)
Few would argue fake money poses no threat to the financial system. If you can’t trust that currency is real, buying and selling gets more difficult, with implications for the economy. But according to one noted author, not enough attention goes to another danger: A.I. bots on social media pretending to be real people.
“Now it is possible, for the first time in history, to create fake people—to create billions of fake people,” Israeli historian and author Yuval Noah Harari said this week. “You interact with somebody online, and you don’t know if it’s a real human being or a bot.”
“If this is allowed to happen,” he continued, “it will do to society what fake money threatens to do to the financial system. If you can’t know who is a real human and who is a fake human, trust will collapse, and with it, at least free society. Maybe dictatorships will be able to manage somehow, but not democracies.”
‘AI bot swarms taking over’
Twitter owner Elon Musk is also aware of the bot problem. He tweeted in March that “only verified accounts will be eligible to be in For You recommendations,” calling it “the only realistic way to address advanced AI bot swarms taking over. It is otherwise a hopeless losing battle.”
Harari called for “very strict rules” against “faking people.”
“If you fake people, or if you allow fake people on your platform without taking effective countermeasures, so maybe we don’t execute you, but you go to 20 years in jail,” he said.
Facing such consequences, tech giants would quickly “find ways to prevent the platforms from being overflown with fake people,” he said.
As for why such rules don’t exist already, he noted that until now creating fake people in such a way “was technically impossible.” Counterfeiting money, by contrast, has long been possible, and governments have enacted “very strict rules” against it to “protect the financial system.”
He noted that he wasn’t calling for laws against creating such bots, but rather, “you’re not allowed to pass them in public as real people.” For example offering an A.I. doctor is fine and “can be extremely helpful,” he said, but only “provided it’s very clear that this is not a human doctor…I need to know whether it’s a real human being or an A.I.”
Subscribe to Well Adjusted, our newsletter full of simple strategies to work smarter and live better, from the Fortune Well team. Sign up today.