site banner

Transnational Thursday for October 31, 2024

Transnational Thursday is a thread for people to discuss international news, foreign policy or international relations history. Feel free as well to drop in with coverage of countries you’re interested in, talk about ongoing dynamics like the wars in Israel or Ukraine, or even just whatever you’re reading.

2
Jump in the discussion.

No email address required.

Israel is using AI tools with little oversight to determine whether an individual is a Hamas operative.

I'm not sure what is actually being reported here. So far I see two facts being alleged - that Israel is using AI system to figure out who could be Hamas operative, which is 90% accurate (spectacular number if true, to the point I even suspect they are being over-optimistic), and that Israel is using phone tracking to locate specific suspects. The latter has nothing to do with AI, as for the former - I am not sure what is supposed to happen after a certain person has been identified as "90% likely to be Hamas operative". The article uses phrases like "automated kill chain", but there's no evidence or even allegation such thing actually exists in any meaning of the word "automated" - do they mean if the system identifies a person, he would be automatically targeted by some killing machine without human supervision? If so, why don't they say it explicitly and describe what this system is and how they know about it? If no, then what "automated" means?

And on the other hand, I am not sure what kind of oversight you would put on such a system. Let's assume you indeed had a system which with probability of 90% can tell you whether or not certain guy in Gaza is in Hamas. Now, how would you verify it? Obviously, if you had some better system, you'd use that one from the start. You could review the data yourself - but do you have better than 90% accuracy? I mean, if you spot some hilarious bug in the system - on the level of "black vikings" and other hilarious bugs in public LLMs, sure. You can block that. Like if the system marked every guy with name "Muhamad" as Hamas member, than you can notice it and overrule the system. But let's say you didn't notice that. Moreover, you tried it 100 times and went out and captured those guys and 90 of them admitted that yes they are in Hamas, or you found Hamas membership card on them and so on. E.g. let's assume 90% is true. How do you oversight that system then? Verifying each person manually is impossible - there are like 50 thousands of them, and most of them are hiding and it's impossible to verify anything about them until they are either captured or dead. So what do you base your supervision on?