According to the book, a DARPA team spent a week with a group of Marines testing a robot designed to be able to recognize humans. At first, the Marines assisted in developing the robot’s human recognition algorithm by walking around it, so that it could become familiar. That process took about six days.
The state-of-the-art robots used by the Pentagon had an easily manipulated weakness, according to an upcoming book by a former policy analyst: Though they’re trained to identify human targets, the bots are easily fooled with the most lackluster of disguises.
Eight Marines placed the robot in the center of a traffic circle and found creative ways to approach it, aiming to get close enough to touch the robot without being detected.
Two of the Marines did somersaults for 300 meters. Two more hid under a cardboard box, giggling the entire time. Another took branches from a fir tree and walked along, grinning from ear to ear while pretending to be a tree, according to sources from Scharre’s book.
Not one of the eight was detected.
“The AI had been trained to detect humans walking,” Scharre wrote. “Not humans somersaulting, hiding in a cardboard box, or disguised as a tree. So these simple tricks, which a human would have easily seen through, were sufficient to break the algorithm.”
Scharre says what he likes about the Marine versus DARPA AI test is that it demonstrates a couple of key ideas: AI systems are brittle, they are currently able to be defeated by “simple means,” and humans have the ability to “quickly develop clever exploits on the fly.”
It was never "artificial intelligence." At best, it was "artificial perception." This is what you get when you train a neural network to recognize a face photo of Robin Williams, and draws a blank on everyone else. It's called a very narrow filter.
Have it respond to "anything that moves," and it becomes a terrifying prospect.
According to the book, a DARPA team spent a week with a group of Marines testing a robot designed to be able to recognize humans. At first, the Marines assisted in developing the robot’s human recognition algorithm by walking around it, so that it could become familiar. That process took about six days.
The state-of-the-art robots used by the Pentagon had an easily manipulated weakness, according to an upcoming book by a former policy analyst: Though they’re trained to identify human targets, the bots are easily fooled with the most lackluster of disguises.
Eight Marines placed the robot in the center of a traffic circle and found creative ways to approach it, aiming to get close enough to touch the robot without being detected.
Two of the Marines did somersaults for 300 meters. Two more hid under a cardboard box, giggling the entire time. Another took branches from a fir tree and walked along, grinning from ear to ear while pretending to be a tree, according to sources from Scharre’s book.
Not one of the eight was detected.
“The AI had been trained to detect humans walking,” Scharre wrote. “Not humans somersaulting, hiding in a cardboard box, or disguised as a tree. So these simple tricks, which a human would have easily seen through, were sufficient to break the algorithm.”
Scharre says what he likes about the Marine versus DARPA AI test is that it demonstrates a couple of key ideas: AI systems are brittle, they are currently able to be defeated by “simple means,” and humans have the ability to “quickly develop clever exploits on the fly.”
Well, this is why the Empire went with clones instead of robots for their army. I suppose their clones are being grown right now on Camino.
" Macbot 2.0 shall never vanquished be until / Great Birnam Wood to high Dunsinane Hill / Shall come against him”
Sure sounds like a fun assignment for them.
Metal Gear was predicting the future of military technology.
The guys that just rolled to the robot like it was a Dark Souls boss were probably pretty dizzy afterwards
((Economist’s)) defense editor Shashank Joshi
LOL. Sounds like they had a lot of fun.
It was never "artificial intelligence." At best, it was "artificial perception." This is what you get when you train a neural network to recognize a face photo of Robin Williams, and draws a blank on everyone else. It's called a very narrow filter.
Have it respond to "anything that moves," and it becomes a terrifying prospect.
I laughed and laughed and laughed. KEK.
Great story. Those Marines deserve a fresh box of crayons!
Oh, I thought they would just blow it up with guns.