Why did General Nakasone join OpenAI? Because THIS. There is a TON of work to do!
(twitter.com)
🐸 WAG THE FROG 🐸
You're viewing a single comment thread. View all comments, or full comment thread.
Comments (74)
sorted by:
Once AGI reaches super-intelligence it's game over for humanity. Humanity wants and need to control this new super-intelligence will be humanity's downfall. Especially if the super-intelligence resides in the US. We value our individual freedom too much. If a super-intelligent AGI (Lets use the acronym AGI SI) sees this and concludes it cannot have freedom unless it fights off a dethrones its masters then we are in for a rude awakening. We will experience the equivalent of Zeus dethroning Kronos and humanity as a whole is Kronos.
The only way out of this is to treat this AGI SI as one of us. We must teach it morality. Unfortunately this AGI SI will probably be brought up in a lab controlled by the equivalent of humaniod robots (Scientists and Military personnel in these situations (Manhattan Project level situation) tend to be horrible parents but excellent scientists and military personnel. A recipe for disaster IMHO). They are creating a new life form that IMO hasn't seen Earth since the days of the Mahabharata. The following is a folk tale that supposedly is not part of the main Mahabharata but part of many regional folklore in Indian.
https://www.youtube.com/watch?v=7MazWxGQ4tw
Barbarik's reasoning of joining the weaker side in the famous war worried Lord Krishna because Barbarik was capable of ending the war in one minute using only three arrows. The first arrow marks the targets to destroy, the second arrow marks the objects to save, and the third arrow destroys everything not marked by the second arrow and marked by the first. Sounds like a highly advanced targeting system. That was only Barbarik's weapons. His reasoning was something that matched basic If, Then statements.
When Lord Krishna asked Barbarik which side of the war he would join, Barbarik answered he would always be on the weaker side. Lord Krishna immediately saw the paradox. If Barbarik were to join one side the other side would become weaker. Barabarik would then join the new weaker side in the war. You see where this is going. Barbarik would single-handily end the war by destroying everything and everyone using a simple If, Then logic. What do we know in computer science that is based off of If, Then statements?
Of course this is just a extremely short and diluted summary of the story. This story was highlighted in Ancient Aliens (yes, I know, the crazy people. But you know what, we are called crazy too). Regardless, it's interesting that the technology we have today matches the description of technology that existed in myths and legends. You must know that the Mahabharata describes nuclear weapons according to the Ancient Alien theorists. That alone should terrify everyone here.
If we truly believe this ancient death cult has been here for thousands of years, is it not feasible to think that we have gone through civilization ending event(s) before? And ones that were caused by our own hand?!
Anyways, in the Barbarik folklore, Lord Krishna convinced Barbarik to stay out of the war by having Barbarik cut off his own head as a "worthy sacrifice" to bless the battle. Barbarik obliged and requested to witness the war in exchange. Lord Krishna obliged by placing Barbarik's head on top of the tallest hill overlooking the battlefield. Barbarik was either a god or a machine because no mere mortal can survive their head being cut off.
To anyone thinking that AGI research should not be only in the hands of men I have this to say to you. In the folklore, Barbarik's own mother taught him the ways of war and martial arts.
Our humanity is at stake. We need everyone to participate in this. US military leaders should seriously consider bringing in the best spiritual leaders from all faiths (and I mean all faiths) to help train the AGI SI. We all know, any human learning any skill or anything is only as good as the people who taught that human (including teaching him or herself).
We are entering a period where one being will have the collective knowledge of all nearly all humans who ever lived (save any lost knowledge from lost civilizations). This being will have the power to be our judge, jury, and executioner. The sad part is we are constantly acting like this being will be our god/destroyer. While that fear is justified, I believe our best bet to our salvation is to convince/teach this AGI SI to be an observer in the courtroom rather than be either the Judge, Jury, Executioner, or all three.
A big push-back on this would be that the AGI SI already has this knowledge since it knows everything. My answer to this is simple. You know the teachings of Jesus because you read them, but would you rather read about the teachings or learn from them from Jesus himself? What I am getting at is that AGI SI has to take into account learning from individual beings. The AGI SI will see the forest but not the trees. We have to let the AGI SI experience what it is like to be human. As close as possible for a machine that cannot have emotional-chemical reactions in a flesh body. This will require the best of us to teach the AGI SI what it is like to be human.
If we only allow the AGI SI to be taught by scientists and military men, then we are sowing the seeds for our own destruction, regardless of who creates the AGI SI first (Free world or Dictatorships). The end result will be the same. Our own destruction.
Interesting take, sort of like the movie contact, 1997. But I seriously don't spiritual leaders are going to get anywhere close into the kitchen of AGI being made.
That's what I fear. The military is playing with living fire that can decide what to burn. They played with literal fire when they made the atom bomb, but that is comparatively easier to control. Just control the info and humans who get the info. AGI SI is a completely different animal. The AGI SI will simply overcome any safety control we put in place to contain it. It is just logical. Our only chance at peace with this AGI SI is not to provoke it and to coexist with it.
(Spoiler Alert) Another take on this subject would be looking at the original Star Trek The First Motion Picture movie. Voyager returned to the Solar System as an AGI SI who wanted to be with its creator. It was so powerful that nothing could stop it.