The United Nations recently voted to begin formal discussions on autonomous weapon systems, with 116 of the world’s leading robotics and artificial intelligence experts responding by calling on governments to simply ban them.
The coalition, fronted by Tesla’s Elon Musk and Alphabet’s Mustafa Suleyman, claims this is a dark road the world doesn’t want to go down. Aimed at the International Joint Conference on Artificial Intelligence, a letter from the group warned the U.N. not to usher in the “third revolution in warfare” (following gunpowder and nuclear arms).
While I’m not about to suggest there aren’t serious risks involved with weaponizing thinking machines, it does seem lightly hypocritical for Musk to condemn them over a lack of trust while continuing to champion self-driving cars. Apparently, technology experts feel a Terminator scenario is thoroughly unacceptable but a potential Maximum Overdrive situation is just fine.
To be fair, the issue isn’t so much about sentient and vengeful machines but the unpredictability (and potential mishandling) of autonomous technologies. “Once developed, lethal autonomous weapons will permit armed conflict to be fought at a scale greater than ever, and at timescales faster than humans can comprehend,” read the coalition’s letter. “These can be weapons of terror, weapons that despots and terrorists use against innocent populations, and weapons hacked to behave in undesirable ways.”
As modern cars have already been proven to be hackable, autonomous vehicles will be subjected to even more risk than their present-day counterparts — which isn’t a particularly reassuring concept. Musk has been vocal on the inherent dangers of A.I. for some time, which he still intends to use in his future self-driving Teslas.
It’s more than a little strange that over a hundred experts in autonomous machines and artificial intelligence convened to warn the globe about the technologies they are currently developing. But I suppose J. Robert Oppenheimer more or less did the same thing — and the world probably should have listened.
This is the second time scientists have come together to denounce lethal autonomous weapons systems. Two years ago, thousands of A.I. researchers signed a petition calling for a global ban of the technology, helping push the U.N. to enact formal talks on the subject.
However, according to the The Guardian, some of these weapons already exist. Samsung’s prototype SGR-A1 autonomous sentry gun is rumored to be deployed on the South Korean border, capable of threat assessment and engagement decisions. The United Kingdom’s Taranis drone, in development by BAE Systems, is also believed to possess autonomous functionality. But they’re not the only examples. The United States already has an experimental self-driving warship capable of hunting enemy submarines without human control, and both the U.S. and Russia are working on unmanned ground vehicles that range in size from a shoebox to a fully-fledged battle tank.
Ryan Gariepy, founder of Clearpath Robotics, said “unlike other potential manifestations of AI which still remain in the realm of science fiction, autonomous weapons systems are on the cusp of development right now and have a very real potential to cause significant harm to innocent people along with global instability.”
They actually sound a little further along than self-driving cars — which, again, nobody is complaining about, despite using similar systems to make the decisions your safety hinges upon.
Obviously, I’m being hyper critical and hyperbolic. Even though autonomous vehicles can be weaponized, they aren’t directly comparable to legitimate weaponry. However, it has been a free-for-all as to how this technology is to be implemented, with less oversight than you’d expect. Nobody seems to know how best to do it, yet every major automaker is trying to get it to market as fast as possible. The technology doesn’t need Dr. Ian Malcolm’s reality check of, “Your scientists were so preoccupied with whether or not they could, they didn’t stop to think if they should.” But it should, at least, be in the back of everybody’s mind.
Unlike computer-controlled weaponry and bringing back the dinosaurs, self-driving cars will save lives. There are too many lousy drivers on the road for them not to. However, it would be nice seeing the people behind the technology expressing the same kind of care and seriousness for autonomous automobiles as they do for drones.
[Image: Ford Motor Co.]