According to the book, a DARPA team spent a week with a group of Marines testing a robot designed to be able to recognize humans. At first, the Marines assisted in developing the robot’s human recognition algorithm by walking around it, so that it could become familiar. That process took about six days.
The state-of-the-art robots used by the Pentagon had an easily manipulated weakness, according to an upcoming book by a former policy analyst: Though they’re trained to identify human targets, the bots are easily fooled with the most lackluster of disguises.
Eight Marines placed the robot in the center of a traffic circle and found creative ways to approach it, aiming to get close enough to touch the robot without being detected.
Two of the Marines did somersaults for 300 meters. Two more hid under a cardboard box, giggling the entire time. Another took branches from a fir tree and walked along, grinning from ear to ear while pretending to be a tree, according to sources from Scharre’s book.
Not one of the eight was detected.
“The AI had been trained to detect humans walking,” Scharre wrote. “Not humans somersaulting, hiding in a cardboard box, or disguised as a tree. So these simple tricks, which a human would have easily seen through, were sufficient to break the algorithm.”
Scharre says what he likes about the Marine versus DARPA AI test is that it demonstrates a couple of key ideas: AI systems are brittle, they are currently able to be defeated by “simple means,” and humans have the ability to “quickly develop clever exploits on the fly.”
According to the book, a DARPA team spent a week with a group of Marines testing a robot designed to be able to recognize humans. At first, the Marines assisted in developing the robot’s human recognition algorithm by walking around it, so that it could become familiar. That process took about six days.
The state-of-the-art robots used by the Pentagon had an easily manipulated weakness, according to an upcoming book by a former policy analyst: Though they’re trained to identify human targets, the bots are easily fooled with the most lackluster of disguises.
Eight Marines placed the robot in the center of a traffic circle and found creative ways to approach it, aiming to get close enough to touch the robot without being detected.
Two of the Marines did somersaults for 300 meters. Two more hid under a cardboard box, giggling the entire time. Another took branches from a fir tree and walked along, grinning from ear to ear while pretending to be a tree, according to sources from Scharre’s book.
Not one of the eight was detected.
“The AI had been trained to detect humans walking,” Scharre wrote. “Not humans somersaulting, hiding in a cardboard box, or disguised as a tree. So these simple tricks, which a human would have easily seen through, were sufficient to break the algorithm.”
Scharre says what he likes about the Marine versus DARPA AI test is that it demonstrates a couple of key ideas: AI systems are brittle, they are currently able to be defeated by “simple means,” and humans have the ability to “quickly develop clever exploits on the fly.”
Well, this is why the Empire went with clones instead of robots for their army. I suppose their clones are being grown right now on Camino.
" Macbot 2.0 shall never vanquished be until / Great Birnam Wood to high Dunsinane Hill / Shall come against him”
Sure sounds like a fun assignment for them.