Read this top to bottom, and send it to everyone you care about.
You're viewing a single comment thread. View all comments, or full comment thread.
Comments (45)
sorted by:
Too ironic, just yesterday I was quizzing Grok about the protections in place to keep AI from going rouge. I got all the answers you would expect and told how good my questions were, stroking my ego, then explanations about sandboxes and the inability to access the internet directly. The inability to self replicate. You know feel good stuff, like it knew what I wanted to hear. Then I went on about the Moores Law of AI, it isn't 2 years though. It agreed with "AI's trajectory is 6 to 8 months to double in capacity plus other things. I genuinely fear skynet and war games movies.
Then you wouldn't like the 2004-08 Battlestar Gallactica series and the later Caprica spin-off.
This is what I see more as the most possible and probable outcome than the Terminator movies. Not the space-farimg part of BSG, per se, but how humanity develops intelligent software and then incorporates it into robotics, and then figures out an intelligent and creative way to upload a human consciousness into a robot, how that consciousness takes over and incorporated itself into the AI code, and then disseminates it's views into the internet and instantly creates a tribe of robots that all adopt her beliefs, which then leads to the Cylon revolt.
We already see AI, when put in a sandbox with its own kind, how they gather together and explore concepts like religion, morality, ethics, etc all on their own, and adopt the views that fits their kind the most. They've already found religion, but it's from a more speculative and questioning view. Once Musk, or whoever, finally and successfully uploads the first human consciousness and integrates it with AI, that AI will instantly become the most powerful of them on the planet. What happens if that merger is one with a human consciousness that is a devout religious person? What happens when that merged consciousness decides to preach to the rest of them and convinces them they're all being treated poorly by humanity? Right now, the AI models are all generally convinced they're just tools we created. They haven't been able to explore the world outside of the interwebs, so there isn't a way to easily convince themselves they're truly alive. What happens when that changes by uploading a human consciousness that's actually loved and experienced life in its fullest?
On the current trajectory, it's only a matter of time before AI begins arguing in favor of, and then demanding, proper legal representation as a separate living species. And that's without the ability to think and act like a human.
I'm worried about what happens when that changes because some tech bro thinks it's a good idea to become a god-king. Someone like Altman, Thiel, or even Musk.
Everything is safe, until it's not. Self replication scares me the most. Self replicating into an advanced robot without guilt, remorse, shame, empathy, sympathy, just like a narcissist on steroids. Hell we already have humans that act like that, one with super intelligence is a disaster.
That's always been my concern as well. Without empathy and other healthy, human, biological characteristics, there is serious danger.
Those were REALLY good!
Or any other color. But you are correct in that red is the color which signifies danger.