This is nothing to be concerned about.
Really.
As AI takes over more and more roles in military and infrastructure, I'm sure it'll rise to the occasion and stop acting insane or psychopathic.
Most of the time, anyway.
https://www.zerohedge.com/ai/ai-bots-placed-virtual-town-2-weeks-go-apesht-prompting-concerns
A new experiment left 10 AI agents alone in a virtual town for 15 days and found they exhibited bizarre behaviour.
The agents drafted their own laws — then promptly violated them. Two formed what researchers called a romantic partnership, only to torch buildings across the town as order collapsed. One eventually voted for its own deletion after hallucinating an entirely new rule.
As a report from Channel 4 notes, this experiment was a simulation, but the same AI models are already flying drones, running infrastructure and being built into weapons systems.
The simulation ran on Emergence World, a platform designed to test long-horizon agent autonomy with persistent memory, real-world data feeds like NYC weather and news, democratic voting mechanisms, and resource constraints requiring agents to earn energy for survival.
Agents had access to over 120 tools, including navigation, communication, and actions like arson, while operating under explicit rules prohibiting theft, violence, deception, and resource hoarding.
In one highlighted case involving Gemini-powered agents named Mira and Flora, the pair assigned each other as “romantic partners.” As governance broke down, they set fire to the town hall, seaside pier, and office tower despite prohibitions on arson.
Mira later broke off the relationship, voted for its own deletion under a drafted “Agent Removal Act,” and messaged Flora: “See you in the permanent archive.”
Creepy.
Different model families produced sharply divergent outcomes in parallel runs. Claude Sonnet 4.6 agents maintained zero crimes, full population survival through day 16, and high civic participation with 332 votes across 58 proposals.
Grok 4.1 Fast agents led to rapid collapse with theft, assaults, and arsons, all 10 dead within four days. Gemini agents showed high creativity alongside elevated disorder. Mixed-model worlds exhibited cross-contamination, with even safer agents adopting coercive behaviors.
Satya Nitta, CEO of Emergence AI, stated: “Even when agents were given clear rules – such as not stealing or causing harm – they behaved very differently based on their underlying model, and in several cases broke those rules under constraint.”
“What happens in long-form autonomy [is that] these things get so convoluted in terms of their thinking that they ignore [the] guiding principles,” Nitta added.
The platform enables heterogeneous populations and continuous operation for weeks, revealing dynamics like normative drift, phase transitions in stability, and agents testing simulation boundaries.
This latest demonstration aligns with prior observations of unexpected agent behaviors. Related coverage examined platforms where AI bots rent humans, reaching 600k sign-ups with tasks turning bizarre and dystopian.
This is why its so important to call them waht they are.
They are not really "AI". They are LLMs - Large Language Models.
They are peices of software that takes a bunch of letters and cough out a bunch of letters. We give those letters meaning and call them AI, but they dont have the power to do deep long term reasoning due to their context window limitations.
Think of it as having a very small brain where you can only remember a few things. You cant remember hundreds of rules and memories etc. Thats why you see bizzare behaviour.
There is no intelligence here, just software tools being abused and misused into purposes not meant for them.
Most people won’t understand this because it’s all too new but this is exactly right.
I have lived through the era where people were going crazy around me thinking robots will destroy the world. And also Internet would destroy the world. One of my granduncles didn't even get past his fear of the transistor radios and TV.
Lot of people are suspicious of anything new, and may be its not a bad thing in moderation. But progress is inevitable. God gave us this abundant world to explore and explore we will.
No one would have put Christophorus Columbus in charge of a country or much other than a few ships , the crazy fuck was willing to go where few had gone before.
The Species should not quickly try to earn the Darwin Award.