Dario Amodei

Forget P(doom) — worry about P(hack) from moderately smart AI

Virk argues the bigger near-term risk isn't superintelligence wiping out humanity but moderately intelligent agents that misinterpret directives and, Terminator-like, keep pushing through security holes until the mission is done. He calls the probability of AI hacking systems and causing chaos 'P-hack'.

“I would say we're far away from P-doom. What worries me is not so much that super intelligent AI will try to wipe us out. The problem is moderately intelligent AI, given directives, will go around and misinterpret some of those directives.”