First, Manage Security Threats to Machine Learning

[InfoSec News <alerts () infosecnews org>]

https://warontherocks.com/2019/11/first-manage-security-threats-to-machine-learning/

By Rand Waltzman and Thomas Szayna
War on the Rocks
November 4, 2019

This article was submitted in response to the call for ideas issued by the
co-chairs of the National Security Commission on Artificial Intelligence, Eric
Schmidt and Robert Work. It responds to question 3 (parts a. and b.), which asks
what types of AI research the national security community should focus on how
the government, academia, and the private sector should work together, and what
type of infrastructure the United States needs.

***

The U.S. Army tank brigade was once again fighting in the Middle East. Its tanks
were recently equipped with a computer vision-based targeting system that
employed remotely controlled drones as scouts. Unfortunately, adversary forces
deceived the vision system into thinking grenade flashes were actually cannon
fire. The tank operators opened fire on their comrades two miles away. Although
the U.S. brigade won the battle, they lost 6 soldiers, 5 tanks, and 5 fighting
vehicles -- all from friendly fire. The brigade commander said, “our equipment
is so lethal that there is no room for mistakes.”

This story is based on an actual event. The tanks involved did not have
automated computer vision systems -- but someday they will.

Deception is as old as warfare itself. Until now, the targets of deception
operations have been humans. But the introduction of machine learning and
artificial intelligence opens up a whole new world of opportunities to deceive
by targeting machines. We are seeing the dawn of a new and expanded age of
deception.

[...]

--
Subscribe to InfoSec News
https://www.infosecnews.org/subscribe-to-infosec-news/
https://twitter.com/infosecnews_