Robert Sheckley nailed the problem with drones in 1953:
Don sends us, “the Gutenberg Project’s copy of Robert
Sheckley’s 1953 story Watchbird from Galaxy Magazine about one nightmare
scenario arising from the use of armed drones to solve all our
problems. Also made into TV and radio episodes.”
“I have an objection.” Gelsen stood up. His colleagues were glaring coldly at him. Obviously he was delaying the advent of the golden age.
“What is your objection?” the representative asked.
“First, let me say that I am one hundred per cent in favor of a machine to stop murder. It’s been needed for a long time. I object only to the watchbird’s learning circuits. They serve, in effect, to animate the machine and give it a pseudo-consciousness. I can’t approve of that.”
“But, Mr. Gelsen, you yourself testified that the watchbird would not be completely efficient unless such circuits were introduced. Without them, the watchbirds could stop only an estimated seventy per cent of murders.”
“I know that,” Gelsen said, feeling extremely uncomfortable. “I believe there might be a moral danger in allowing a machine to make decisions that are rightfully Man’s,” he declared doggedly.
“Oh, come now, Gelsen,” one of the corporation presidents said. “It’s nothing of the sort. The watchbird will only reinforce the decisions made by honest men from the beginning of time.”
“I think that is true,” the representative agreed. “But I can understand how Mr. Gelsen feels. It is sad that we must put a human problem into the hands of a machine, sadder still that we must have a machine enforce our laws. But I ask you to remember, Mr. Gelsen, that there is no other possible way of stopping a murderer before he strikes. It would be unfair to the many innocent people killed every year if we were to restrict watchbird on philosophical grounds. Don’t you agree that I’m right?”