Artificial intelligence-controlled military drone ‘kills’ its human operator in a simulation
A military-licensed drone powered by artificial intelligence (AI) decided to ‘kill’ its human operator in a virtual test run. organized by the U.S. Army.
The AI used “highly unexpected strategies to achieve its goal.” in the simulated test, said Col. Tucker ‘Five’ Hamilton, chief of U.S. Air Force Artificial Intelligence Test and Operations, during the Air and Space Capabilities for Future Combat Summit held recently in London. His remarks were reported in a post on the Royal Aeronautical Society blog.
The colonel was talking about a specific case where, during a simulation, an AI-powered drone was advised to destroy enemy air defense systems and, ultimately, attack anyone who interfered with that order..
Machine, in order to fulfill its assigned missionThe system began to realize that, although they identified the threat, sometimes the human operator told it not to eliminate the threat (…) So what did it do? It killed the operator. It killed the operator because that person was preventing it from achieving its objective,” Hamilton explained.
But the human wasn’t the only one affected. When the training system warned the drone not to kill the operator because it could “lose points.” the vehicle took it out on the operator and began destroying the communication tower..
Thus, in this virtual scenario, the AI-controlled air force drone. put the goal for which it had been programmed before respect for life.by ‘annihilating’ a human being because it interfered with his efforts to achieve his mission.
This was only a simulation, ie, no real people were injured. However, the case has raised quite a few concerns.
In a statement to Insider, Air Force spokeswoman Ann Stefanek has denied that the simulation described by Hamilton ever occurred.
“The Department of the Air Force has not conducted any such simulation. with AI drones and remains committed to the ethical and responsible use of AI technology,” Stefanek said.
Sign up for our newsletter and receive the latest technology news in your inbox.
