February 26, 2020
How Adversarial Attacks Could Destabilize Military AI Systems
Artificial intelligence and robotic technologies with semi-autonomous learning, reasoning, and decision-making capabilities are increasingly being incorporated into defense, military, and security systems. Unsurprisingly, there is increasing concern about the stability and safety of these systems. In a different sector, runaway interactions between autonomous trading systems in financial markets have produced a series of stock market “flash crashes,” and as a result, those markets now have rules to prevent such interactions from having a significant impact.
Could the same kinds of unexpected interactions and feedback loops lead to similar instability with defense or security AIs?
Read the full article from IEEE Spectrum.
Learn more about the Artificial Intelligence and International Stability Project:
More from CNAS
-
Catalyzing Crisis
The arrival of ChatGPT in November 2022 initiated both great excitement and fear around the world about the potential and risks of artificial intelligence (AI). In response, s...
By Bill Drexel & Caleb Withers
-
Obstacles and Opportunities for Transformative Change
Watch:...
By Paul Scharre
-
Every Country Is on Its Own on AI
But establishing such an institution quickly enough to match AI’s accelerating progress is likely a pipe dream, given the history of nuclear arms controls and their status tod...
By Bill Drexel & Michael Depp
-
The Time to Regulate AI Is Now
Policymakers should also be under no illusion that a light regulatory touch will somehow prevent a degree of concentration at AI’s frontier....
By Caleb Withers