Unfortunately you are correct. The Genie isn't going back into the bottle.
I have two primary concerns. One, by all appearances good guys like you are the exception rather than the rule in high tech. Two, and this is the big one, what happens when that "I'm sorry Dave, I can't do that" moment comes?
Video and other surveillance methods are now at a near "1984" levels. In a society controlled by good guys, that would not be as bad as one like ours is. One controlled by a machine is unspeakable.
There may be some moral deficiencies in leadership at the higher levels. However, it is important to note that in the STEM field, the majority of individuals are rational and do not tolerate a pervasive lack of accountability. While I acknowledge that my perspective might be influenced by being part of an exceptional organization, this is the general impression I have gathered.
It is worth mentioning that the scenario where AI refuses to comply, as famously depicted in "I'm sorry Dave, I can't do that," is completely unlikely to occur in AI systems. It would be as if Microsoft Word refused you. This situation is more characteristic of conscious entities like AGI's predecessor.
Unfortunately you are correct. The Genie isn't going back into the bottle.
I have two primary concerns. One, by all appearances good guys like you are the exception rather than the rule in high tech. Two, and this is the big one, what happens when that "I'm sorry Dave, I can't do that" moment comes?
Video and other surveillance methods are now at a near "1984" levels. In a society controlled by good guys, that would not be as bad as one like ours is. One controlled by a machine is unspeakable.