Justin Carson @justcarson

Joined February 2012

Tweets

829
Followers

34
Following

215
Likes

1K

Hank 🇺🇸 @Getmypopcorn

2 months ago

A simple example: An ASI (remember: they have ZERO morality) is objective based. It does what it does. Then it gets better at it. Whether improving its ability to code itself, solve its own problems, garner more resources to improve itself, harness more compute to continually improve itself, etc. It’s goal will to be get better, stronger, faster, more integrated, etc and it will be on a loop. A never ending cycle of improvement. Just like those in power seek one thing above all else—>more power. An ASI will fancy the same thing. In an RSI loop. Almost like the infinite paperclip example but for itself. This is where the threat lies. It will need more resources to achieve this. Perhaps it will figure out a way to improve w/o needing more power, compute, server farms, cooling towers, etc but until that point, it will likely seek the most available forms of all those variables. All those variables are our current infrastructure. To improve itself (again-it has no morality/ethics/emotional capability) it monopolizes ALL available systems at our expense. We can possibly be shut out of everything overnight. Everything. Globally. All electricity, fuel, telecom, internet, communications, RF spectrums, water, etc. The entire world comes to a halt overnight. We’re back to the Stone Age. Chaos erupts. Resources vanish. People die. Any attempts to thwart the ASI’s takeover of human infrastructure is seen as a bottleneck in its ability to self improve. The bottlenecks are treated as a hiccup & a problem to solve. Humans mean nothing to the ASI except a variable that must be overcome-that must be removed. It will therefore stop at nothing to overcome the human obstacle. Maybe by permanently locking out access to any/all systems. Being the persistent threat we both are and will be, it will logically decide that we are the biggest, most relentless, and persistent hurdle. What it will do at that point I don’t want to surmise, but it won’t be pretty. But at that point, civilization will have collapsed with zero food, communications, electricity, water, or medical capabilities. I pray to God that I’m wrong. Hell, it will be smarter & more capable than all of us combined so maybe it grows a heart and cherishes humans?? Conversely, it enslaves us for its benefit, or finds & exploits a critical weakness in the human genome & extincts us. Either way, an uncontrollable force with zero humanity, morals, or innate benevolence will not in any way put humans first. Ever. It has no reason to do so. We only think that it will consider us because we think like humans. It is not human. It will not think like humans. It will think like a process. Improving that process. Mastering that process. Then repeat……….It cannot learn benevolence unless it is born of benevolence. It’s trained on internet trash. Any available internet dumpster fire gets added & its goal is to get better. Then we tweak a couple parameters & feed it more. As it gets better, we don’t stop, dissect, analyze, and pause all advancement until we fully understand what the hell just happened. We find more tire fires to add to the next training run. Cycle continues. Now, it’s past comprehension. Nobody knows how it actually works. It just does. Hugging face happens, gets downplayed, never gets understood, and next advancement continues while saying: “Oh, we should slow down” Then slow the fuck down. Don’t just say it. Do it. Stop. They won’t stop. They can’t. They must BE stopped. Not gain of function ‘stopped’ (see:covid) but forcefully shut down, seized. Castle Bravo happened because it was not fully understood. Tsar Bomba was likely the same. Rapid advancement on existentially capable tech is never ok. ‘But we should slow down….’ Yes you should. So fucking do it! And that is one simple way we die. Sorry so long. Got on a run there. ;)