The head of the Red Cross and the United Nations on Tuesday warned that autonomous weapons that can kill people without human involvement could soon be used in conflicts and called for urgent negotiations to restrict their use.
"We are now dangerously close to crossing a moral red line: the autonomous targeting of humans by machines," said United Nations Secretary-General Antonio Guterres and President of the International Committee of the Red Cross Mirjana Spoljaric in a joint statement.
"Negotiations must begin now to urgently adopt a legally binding instrument to regulate autonomous weapon systems with clear prohibitions and restrictions," they said. States are meeting in Geneva on potential new rules next week amid mounting concerns over the role of AI-assisted semi-autonomous weapons that have been used in conflicts in Ukraine, Sudan, Gaza, and in Iran and the Gulf.
These discussions, ongoing since 2014, have made some progress but technology has also advanced.
Fully autonomous weapons are already in use by some armies, such as anti-missile systems on warships, but for now they are not known to be used against human targets.
Human rights groups also worry that AI-driven systems cannot be adequately predicted or controlled, raising the risk of fatal errors such as a failure to recognise an injured or surrendering soldier. And once such errors occur, it is harder to hold perpetrators to account in any future war crimes cases, they say.
"States must show political courage and move beyond incremental discussions towards decisive action", the joint statement said, calling for those talks to begin in November when a major conference is planned in Geneva.
