But as the drone demonstrations highlight, more widespread use of AI will sometimes make it more difficult to keep a human in the loop. This might prove problematic, because AI technology can harbor biases or behave unpredictably. A vision algorithm trained to recognize a particular uniform might mistakenly target someone wearing similar clothing. Chung says the swarm project presumes that AI algorithms will improve to a point where they can identify enemies with enough reliability to be trusted.

Knight, W. (2021, May 10). The Pentagon inches toward letting AI control weapons. Wired. https://www.wired.com/story/pentagon-inches-toward-letting-ai-control-weapons/