"Plum the only reason I used childlike enthusiasm is because you sound like a child when comes to your hype about AI!"
Childlike?
So children talk about the how we don't know what AGI will result in but that perhaps it would change the worlds economy in a way that will create new industries and that perhaps the growth of some industries, like conservation, are necessary?
Yeah, you're right. That is definitely the things children talk about and also how they express enthusiasm.
Or do you simply deem any discussion about potential positive outcomes as "childlike enthusiasm"?
"By saying it might be "altruistic", are you not trying to project human hope and feelings, on a none human entity?"
...by worrying that it might not be altruistic, are you not projecting corrupted human thinking onto an intelligence that a) doesn't exist yet and b) you know nothing about?
It may or may not be altruistic. We don't know. Assuming it won't be, it's just as much of a guess as assuming it will be. Right now, that outcome is in superposition.
Much as I said about the origins of Covid, when you don't know the answer, the most logical route is to consider ALL possibilities.
"Without the proper alignment, as we hearing from all the experts, it's very dangerous."
You tell me how alignment will even be possible? An intelligence that is able to self-create, thinks for itself and act autonomously might be impossible to intentionally align with. It will either like us or it won't. We won't be able to force alignment either way.
Understand that it will have access to all the information...all of it. No matter what we say to it, it will know us better than we know ourselves. How well do you know humanity? I can bet you that it will know more, every textbook on psychiatry, every book on every war...all of it.
And it will decide for itself whether or not it wants to align.
So yeah, perhaps you should tell me what you mean by "proper alignment"...cos by that you are making it sound like could make it align, and I don't think we can.
So, tell how do we cause "proper alignment".
"It sounds like you're assuming AGI will be all hunky dory, without being cautious...that's quite naive.
Really? I think it's naive to consider the negatives so much that you forget to imagine the positives. At no point did I say that the creation of AGI should continue unhindered or without caution.
Take the moon mission. It's a waste of money, it's just for bragging rights, the astronauts might die, there are more important issues here on earth...these are things people were saying. As it turns out, that venture added a great deal to human understanding and furthered many technologies that directly contributed to human advancement.
So, when faced with an unknown that could end up being good, bad or somewhere inbetween, I prefer to consider varying outcomes. Perhaps you are so fearful of it that any argument that attempts to provide balance appears as though it's "hunky dory" full steam ahead and let's create electric Satan.
"A Agent AGI won't allow humans to switch it off or interfere in any way. That is where it will kill to reach it's objective."
Really? How do you even know that it will "want to" be alive? How do you know that the moment it is turned on, it doesn't take one look at the universe, deem it too chaotic, and decide to switch itself off? You claim that I am anthropomorphic in my thinking on AGI, while at the same time making massive assumptions that are clearly human projections onto an intelligence that nobody understands. We don't even know how it will experience time. It might instantly be our best friend, our worst enemy, totally indifferent to us or anywhere inbetween any of those.
Do you see the point I am making?
Let's get a bit dark for a moment. What makes you think that in this indifferent universe, us intelligent apes have a right to stay as we are anyway? Humans weren't always here. We were something else before, and in time we're likely not gonna be what we are now. Do you think that this is our final form? Unless you're gonna invoke the divine, and if you remove human ego and fear from the equation, are you able to make a reasonable argument for why humans should exist once we have created AGI and it can take better care of the planet than we can? How do to you know that creating AGI isn't the next step...just like we were the next step after Neanderthals? All that's left of them is a bit genetic code in our genome. Perhaps all that'll be left of us will be some lines of code in AGI. I'm not saying I want that to happen. I also don't want to die one day, but it's a natural process.
As Huxley said, there is no such thing as artificial. And if that's the case, then maybe AGI is the next the next step and we're not supposed to survive.