In his keynote at RSA Conference 2022, Bruce Schneier imagined the future of artificial intelligence (AI) hacks.
“AI will hack humanity unlike anything that has come before, and humans will be the collateral damage,” began Schneier, admitting that his opening was hyperbole but countering that “imagining this does not require any science fiction, nor does it require any major breakthroughs in AI.”
He defined a hack as “something that a system permits but is unanticipated and unwanted by its designers. Hacks follow the rules of a system but subvert its goals or intent.”
Schneier contended that AIs are becoming hackers. “They’re not that good yet, but they are getting better, and, eventually, the AIs will surpass the humans.” He surmised two considerations: “One issue is that an AI might be instructed to hack a system. The second issue is that an AI could naturally and inadvertently hack a system.
“AIs don’t solve problems the way humans do,” he explained. “Their imitations are different; they consider more possible solutions than humans; they go down paths we don’t even consider. AI doesn’t think in terms of values, norms, implications or context.”
In human language and thought, goals and desires are always underspecified, meaning humans give incomplete instructions because people understand the context and are able to fill the gaps. “We can’t incompletely specify goals to an AI and expect it to understand context,” Schneier contends. “AI will think out of the box because it doesn’t have any conception of the box.” One solution to this, Schneier explained, “is to try and teach AI context.”
The first place to look for AI hacking, said Schneier, is financial systems “because those are designed to be algorithmically hackable.” He contends that while a world filled with AI hackers is science fiction, “it isn’t stupid science fiction. It’s worth talking about now.”
To date, he explained, “hacking has been a human activity requiring expertise, time, creativity and luck.” When AI starts hacking, however, “everything will change again. AI will change hacking speed, scale and scope. They will act like aliens. We’re already seeing shadows of this; AI text generating bots already exist, overwhelming human discourse.
No tags.
