No! I'd expect a tense standoff around compute and Taiwan. Not a world war.
If a first strike can’t outthink drone production, the domination attempt just fails. If China wins any war longer than a year and is pulling ahead on electricity, it has no reason to escalate.
The closest precedent is the 1945–49 US nuclear monopoly. Preventive war was seriously argued for and never launched,the other sides raced instead.
One could probably write books about the mindset of people assuming war is inevitable, because electricity production of their biggest competitor is slowly slowly approaching their consumption.
So yes, china is improving their tech and raising standards of living. But one has to take into account where they are coming from. How poor the average chinese person was just some years ago.
So good for them making progress. I don't see this as a reason for WW3.
But of course, them having more power will maybe lead to a world where the US is not dominating superpower number 1 anymore. And here is maybe a reason for WW3, as quite some apparently rather would blow up the world, then let this happen. So I certainly don't want chinese dominance instead, but fighting for world dominance in the first place is the problem here, not electricity production or AI developement.
Totally agree and to comment more on the piece this is why it strikes me as effective: “I didn’t believe in AI doom because I thought more of people.” The reality is before these past few years I thought more of people. Like you’re saying I do think there’s some who don’t understand that the world can be positive sum.
War is always a matter of ambitions, territory, hubris, personality.
Abstract competition is never the fuse, just the thing that makes it possible for there to be escalating conflict.
US’s problem is imperialism; China’s is One China. It’s where those two collide that war happens.
AI is an instrument in this war, not an impetus.
But technologists often think technology is the dominant factor for everything, when in the end culture, personalities, and accidents of geography are often the things that matter.
Resources is inherent in territory—they are in the ground.
Hubris and personality maybe interchangeable but one can have a relatively stable personality and high hubris or vice versa, each of which can start a war. Ambitions is distinctly cultural and historical, not necessarily a characteristic of a leader.
> If a first strike can’t outthink drone production, the domination attempt just fails. If China wins any war longer than a year and is pulling ahead on electricity, it has no reason to escalate.
Uh, US "first strikes" can't beat the Houthis and can't beat Iran. Track record: Remarkably poor. I'd go so far as to say that the entire US way of waging war -- its warfighting doctrine -- has been thoroughly discredited in light of this & the efficacy of top-dollar NATO weapons in Ukraine. (Good enough to hinder Russia, but far from good enough, and far from numerous enough, to win the war or even produce a decisive advantage.)
>the efficacy of top-dollar NATO weapons in Ukraine. (Good enough to hinder Russia, but far from good enough, and far from numerous enough, to win the war or even produce a decisive advantage.)
This is more of US being unreliable ally than them being incapable one.
Aye, but if so, who is on the wrong side of the curve? I think that a very persuasive answer could be made in either direction. Consider: Ukraine is in very serious demographic and economic trouble. [1] The large economies of the EU are presently suffering from severe internal divisions -- and in some cases open riots on a regular schedule -- with outsider pro-Russia parties poised to make real electoral gains. A collapse in support may only be a matter of time.
The US can reduce the entire world to living like the houthis. We can’t wipe out all of humanity. But we can shatter civilization and send people back to barbarism.
If you use nukes, maybe. The exact same could be said about the Russians, the Chinese, and even perhaps the French and Brits, with proper bomb placement.
Conventional war, though? Not in your wildest fantasies.
I don't believe the blog post used in it that context, as it ignored China's second strike doctrine+capabilities and instead focused on drone production. The way I read it, it was more along the lines of an Iran or Iraq conventional first strike.
The assumption here is that the US would go to war to keep China from becoming the global superpower
I personally don't want to live in a world where China is the global superpower. I also think nuclear war is a worse alternative (and I think the US agrees) - but I hope Western countries understand they need to build (energy, civil infrastructure, compute, manufacturing, etc.) if they don't want to pick between these two options.
We do - but it's quite hard to hit a nuclear object moving through the sky at Mach 22
Publicly, Russia has ~5k warheads. Public reports of US interceptors are on the scale of 10s. The only defense today against a decapitating first strike is MAD
So, with no reasoned argument, this guy somehow predicts the end of the world is coming and its effectively inevitable?
And people on this site take this couple of paragraphs at face value because... no real reason?
The Second World War didn't end the world, neither did the Cold War, and the world is now far more economically and politically intertwined than it ever was.
Do you think Russia really wants to nuke London? Do you know how many Russian oligarchs have apartments and houses in London where their extended families live? Similarly, do you know how many Chinese people live in London or how much Chinas economy is tied to Europe and the US?
If the world didn't end in the Cold War, it certainly isn't going to end now, and especially over AI, which although a cool tech, is incredibly far from this mythical singularity. Have you seen modern robots? Have you seen LLMs trying to do anything that isn't easily verifiable (with software)? E.g. try and create new drugs? Or design new materials, machinery, or complex systems like a fusion reactor.
Most people on this site are programmers and as such they are in a tiny bubble, obsessed with AI now its equal to them at the very act they have depended on for their entire careers.
But no, the end of the world is not coming any time soon. The rich Americans want to stay rich, the rich Russians want to stay rich, and the rich Chinese want to stay rich, and bombing each other and dying in fire isn't part of their agenda.
People without children are usually more obsessed with end of the world scenarios because it is harder to imagine world without them. It is also poetic if it ends with you rather than being buried in history that exists 1000s of more years after you. People with a family are more optimistic and see a future after they cease to exist.
I'm not scared that the AI companies are summoning some earth-shattering angel of death.
What does worry me a bit is that the people running these AI companies _think_ they're summoning some earth-shattering angel of death, but they are so self-righteous (literally) that they think it's actually good that they're doing this.
This is definitely geohot anti-Anthropic (misanthropic?) doomerism, but it's nice to see that people are finally realizing the answer to the question: "what will happen to the economy if no one has jobs".
The answer: there still will be an economy, you just won't be a meaningful part of it.
And then what? It’s not like those who are not part of it will just lay down and die. If nothing else a parallel economy will form that will look a lot like the current economy while AI goes and does whatever it is doing with itself. When labor becomes too cheap to pay for, those who still can’t afford it will continue to trade and work.
An economy without any consumers doesn't work. If that becomes true, then the economy will shrink to the point that human labor and intellect will again compete with AI.
To me this sounds completely delusional - what population in human history would accept that outcome? Comparatively small disruptions in available job opportunities lead to massive political upheavals - Paris was literally on fire just a few weeks ago.
History is clear: Humans care about humans, and will on average act to correct social imbalances.
An economy with Elon and Amodei racing space rocket cars while large numbers of the population live off food stamps will be rejected.
If Elon and Amodei control an army of loyal robo-soldiers, they will win. A functional democracy should take steps to prevent them from acquiring that army.
'The Metamorphosis of Prime Intellect' doesn't take into consideration any of the intuitive drives of humanity. Once basic needs are met, we don't become cat's waiting on the next meal. The utopia described in the book appears to be from the perspective of either someone very boring, or only able to get joy from the misery and strife of others.
I think it's not a coincidence that Emacs' origins are tied to an AI lab.
You see, this higher intelligence is so alien to us we can't comprehend how it works, but its timescale is completely different from ours. We think "weird default shortcuts due to an obscure keyboard layout to incapacitate people after a few generations" is a lot of time, but that's peanuts to AI.
War in the real world is not an RTS. China’s massive population and industrial capacity, along with their collectivism, gives them a sizable advantage in Clausewitz’s iron calculus of war (Resistance = Means x Will)
Let's say this fact "China imports 70% to 74% of its crude oil and 42% of its natural gas via maritime shipping lanes.". You can produce 10x electricity the USA, but that will still not power your warships and tanks.
Yes, In a War both sides fight - something that seems to continually surprise the Russians.
Worth pointing out that the Chinese Navy has also massively expanded over the last few decades and continues to expand - they aren't at parity with the US yet but they are able to contest the South China sea (which was the first goal) especially when backed with missiles launched from the mainland.
The trajectory is set there and China has vastly more yard capacity than the US (they are in the #1 spot, they out build the #2 and #3 spots who are US allies (Korea and Japan) so any (limited) shooting war where ships are been sunk comes down to who can sustain and replenish the losses the fastest, they are both nuclear powers so how wide spread the attacks would be on each others ship production is an open question - it's a risky game either way.
The US navy was built to it's current size during peace time when it's much simpler to build slowly and maintain a big fleet, what I don't think they can do is replace the losses they'd take in that war fast enough.
That in the end is the deterrent, you don't have to guarantee a win to deter someone you just have to make the price so high they don't want to enter the fight in the first place.
Consider you're in a bubble of people whose careers are likely doomed. I live in a low cost of living place, whose economy is dominated by blue collar work and industrial production, and most of my friends who don't sit at a computer all day for their jobs are moderately positive on AI so far.
At some level it's never really been fair that I get paid so much more than them to do far less physically demanding work, and I suspect that shape of the economy might be coming to an end.
Good point, I generally believe everybody is in their own bubble (somewhat tautological – beliefs will always be shaped by your surroundings first and foremost), so it’s good to hear other viewpoints as often as possible.
So “best case” (no destruction, annihilation etc. scenarios), global GDP goes down and we revert to a pre-≈1950s economy, in terms of job distribution across the farming/manufacturing/services sectors? Still doesn’t sound all that rosy to me, but I don’t know.
Edit: Who am I misunderstanding? A downvote with no explanation doesn’t help me get your point.
What rock have you been living under? It's not just one or 2 jaded tech guys who think you're all a bunch of delusional man-children. Silicon Valley has worked very hard to destroy everybody's trust, it shouldn't be surprised when it gets what it asked for.
Well he doesn't give any argument himself as to why it would happen?
I.e. he is asserting an outcome "armageddon", but he provides absolutely zero argumentation, reasoned hypotheses, debate, etc, as to why it would happen.
"That which can be asserted with no evidence can be dismissed with no evidence."
Therefore, I assert that there is no pending end of the world scenario, and I don't need to provide any reasoning for that, since George Hotz doesn't either.
I have observed that the humble photon cannon rush is very effective. If not spotted it's usually a really bad time. Long term, is pretty obvious what happens here. If we get there.
Who dominates the gravity well that we all exist inside right now?
The scramble for AI has many parallels to the scramble fro africa.
When one side is on the verge of winning everything, perceived or real, the other side will just pull out higher risk/reward strategies. Yes I also play RTS.
I can imagine many doom scenarios but I just don't see a single positive. The AI's will do our jobs and our overlords will give us free food and housing? Keeping us around as pets? Out of sheer good will and because of the cuteness of our eyes?
Of the super-position of thoughts this article engenders, your response most cogently and succinctly mirrors what I collapsed onto. May you be voted up to the moooooooon, kind sir.
I just think the world is too complicated, passionate, and resilient for any one dimensional fantasy about evil godlike computers to feel like anything more than self-satire.
Slightly worried about geohot given this and other doom-laden posts. He feels a little terminally online.
>But it leads to World War III.
No! I'd expect a tense standoff around compute and Taiwan. Not a world war.
If a first strike can’t outthink drone production, the domination attempt just fails. If China wins any war longer than a year and is pulling ahead on electricity, it has no reason to escalate.
The closest precedent is the 1945–49 US nuclear monopoly. Preventive war was seriously argued for and never launched,the other sides raced instead.
One could probably write books about the mindset of people assuming war is inevitable, because electricity production of their biggest competitor is slowly slowly approaching their consumption.
https://en.wikipedia.org/wiki/List_of_countries_by_electrici...
So yes, china is improving their tech and raising standards of living. But one has to take into account where they are coming from. How poor the average chinese person was just some years ago. So good for them making progress. I don't see this as a reason for WW3. But of course, them having more power will maybe lead to a world where the US is not dominating superpower number 1 anymore. And here is maybe a reason for WW3, as quite some apparently rather would blow up the world, then let this happen. So I certainly don't want chinese dominance instead, but fighting for world dominance in the first place is the problem here, not electricity production or AI developement.
Totally agree and to comment more on the piece this is why it strikes me as effective: “I didn’t believe in AI doom because I thought more of people.” The reality is before these past few years I thought more of people. Like you’re saying I do think there’s some who don’t understand that the world can be positive sum.
It also misunderstands the impetus for war.
War is always a matter of ambitions, territory, hubris, personality.
Abstract competition is never the fuse, just the thing that makes it possible for there to be escalating conflict.
US’s problem is imperialism; China’s is One China. It’s where those two collide that war happens.
AI is an instrument in this war, not an impetus.
But technologists often think technology is the dominant factor for everything, when in the end culture, personalities, and accidents of geography are often the things that matter.
> War is always a matter of ambitions, territory, hubris, personality.
You’re forgetting arguably the biggest driver of all: resources. Strategic/natural resources is arguably the #1 driver of all wars.
3 of those 4 also seem borderline redundant.
Resources is inherent in territory—they are in the ground.
Hubris and personality maybe interchangeable but one can have a relatively stable personality and high hubris or vice versa, each of which can start a war. Ambitions is distinctly cultural and historical, not necessarily a characteristic of a leader.
Territory, when I think of it, is primarily space. That is also a reason countries have gone to war
lol, did you just rediscover the Thucydides Trap from first principles?
> If a first strike can’t outthink drone production, the domination attempt just fails. If China wins any war longer than a year and is pulling ahead on electricity, it has no reason to escalate.
Uh, US "first strikes" can't beat the Houthis and can't beat Iran. Track record: Remarkably poor. I'd go so far as to say that the entire US way of waging war -- its warfighting doctrine -- has been thoroughly discredited in light of this & the efficacy of top-dollar NATO weapons in Ukraine. (Good enough to hinder Russia, but far from good enough, and far from numerous enough, to win the war or even produce a decisive advantage.)
"You don't understand, we haven't gone Berserker Mode yet." (Sorry, couldn't resist.)
>the efficacy of top-dollar NATO weapons in Ukraine. (Good enough to hinder Russia, but far from good enough, and far from numerous enough, to win the war or even produce a decisive advantage.)
This is more of US being unreliable ally than them being incapable one.
It is a war of attrition like in the Soviet-Afghan war which contributed to the collapse of the Soviet Union.
Aye, but if so, who is on the wrong side of the curve? I think that a very persuasive answer could be made in either direction. Consider: Ukraine is in very serious demographic and economic trouble. [1] The large economies of the EU are presently suffering from severe internal divisions -- and in some cases open riots on a regular schedule -- with outsider pro-Russia parties poised to make real electoral gains. A collapse in support may only be a matter of time.
[1] - https://en.wikipedia.org/wiki/Demographics_of_Ukraine#Popula...
It's both, and NATO stocks from elsewhere in Europe aren't exactly turning the tide, either.
The US can reduce the entire world to living like the houthis. We can’t wipe out all of humanity. But we can shatter civilization and send people back to barbarism.
Personally I see that as being terrifying.
If you use nukes, maybe. The exact same could be said about the Russians, the Chinese, and even perhaps the French and Brits, with proper bomb placement.
Conventional war, though? Not in your wildest fantasies.
“First Strike” is a nuclear strategy that’s what the post is talking about.
I don't believe the blog post used in it that context, as it ignored China's second strike doctrine+capabilities and instead focused on drone production. The way I read it, it was more along the lines of an Iran or Iraq conventional first strike.
That's a worthless capability, because everybody knows the US will not use it. At best it will equalise their standing with the most radical types
The assumption here is that the US would go to war to keep China from becoming the global superpower
I personally don't want to live in a world where China is the global superpower. I also think nuclear war is a worse alternative (and I think the US agrees) - but I hope Western countries understand they need to build (energy, civil infrastructure, compute, manufacturing, etc.) if they don't want to pick between these two options.
Maybe the negativity comes from seeing local AI falling further behind rather than catching up.
Strata gave local AI a boost with 12GB (and even 8GB) cards being able to run Qwen code assistant with RAM offloading.
The issue with local AI is the availability of competitive open weight models, not necessarily the availability of compute and memory.
if there is a possibility of decapitating first strike, then we need to have a Perimeter system
We do - but it's quite hard to hit a nuclear object moving through the sky at Mach 22
Publicly, Russia has ~5k warheads. Public reports of US interceptors are on the scale of 10s. The only defense today against a decapitating first strike is MAD
I didn't know how close Amodei is to EA (although stating to not be part of it)
What?
So, with no reasoned argument, this guy somehow predicts the end of the world is coming and its effectively inevitable?
And people on this site take this couple of paragraphs at face value because... no real reason?
The Second World War didn't end the world, neither did the Cold War, and the world is now far more economically and politically intertwined than it ever was.
Do you think Russia really wants to nuke London? Do you know how many Russian oligarchs have apartments and houses in London where their extended families live? Similarly, do you know how many Chinese people live in London or how much Chinas economy is tied to Europe and the US?
If the world didn't end in the Cold War, it certainly isn't going to end now, and especially over AI, which although a cool tech, is incredibly far from this mythical singularity. Have you seen modern robots? Have you seen LLMs trying to do anything that isn't easily verifiable (with software)? E.g. try and create new drugs? Or design new materials, machinery, or complex systems like a fusion reactor.
Most people on this site are programmers and as such they are in a tiny bubble, obsessed with AI now its equal to them at the very act they have depended on for their entire careers.
But no, the end of the world is not coming any time soon. The rich Americans want to stay rich, the rich Russians want to stay rich, and the rich Chinese want to stay rich, and bombing each other and dying in fire isn't part of their agenda.
People without children are usually more obsessed with end of the world scenarios because it is harder to imagine world without them. It is also poetic if it ends with you rather than being buried in history that exists 1000s of more years after you. People with a family are more optimistic and see a future after they cease to exist.
I'm not scared that the AI companies are summoning some earth-shattering angel of death.
What does worry me a bit is that the people running these AI companies _think_ they're summoning some earth-shattering angel of death, but they are so self-righteous (literally) that they think it's actually good that they're doing this.
Was hoping this would somehow relate to Nine Inch Nails... Now I'm hurt.
It was just full of broken thoughts.
Doomers to the left of me, scammers to the right
Here I am, stuck in the middle with you
This is definitely geohot anti-Anthropic (misanthropic?) doomerism, but it's nice to see that people are finally realizing the answer to the question: "what will happen to the economy if no one has jobs".
The answer: there still will be an economy, you just won't be a meaningful part of it.
And then what? It’s not like those who are not part of it will just lay down and die. If nothing else a parallel economy will form that will look a lot like the current economy while AI goes and does whatever it is doing with itself. When labor becomes too cheap to pay for, those who still can’t afford it will continue to trade and work.
An economy without any consumers doesn't work. If that becomes true, then the economy will shrink to the point that human labor and intellect will again compete with AI.
An Ascended Economy, https://slatestarcodex.com/2016/05/30/ascended-economy/.
To me this sounds completely delusional - what population in human history would accept that outcome? Comparatively small disruptions in available job opportunities lead to massive political upheavals - Paris was literally on fire just a few weeks ago.
History is clear: Humans care about humans, and will on average act to correct social imbalances.
An economy with Elon and Amodei racing space rocket cars while large numbers of the population live off food stamps will be rejected.
If Elon and Amodei control an army of loyal robo-soldiers, they will win. A functional democracy should take steps to prevent them from acquiring that army.
That makes no sense if you think about the scenario for more than 5 seconds.
Pretty sure there is an economy for braised billionaire and greens.
'The Metamorphosis of Prime Intellect' doesn't take into consideration any of the intuitive drives of humanity. Once basic needs are met, we don't become cat's waiting on the next meal. The utopia described in the book appears to be from the perspective of either someone very boring, or only able to get joy from the misery and strife of others.
RSI Repetitive Strain Injury? When it comes, nobody survives.
I think it's not a coincidence that Emacs' origins are tied to an AI lab.
You see, this higher intelligence is so alien to us we can't comprehend how it works, but its timescale is completely different from ours. We think "weird default shortcuts due to an obscure keyboard layout to incapacitate people after a few generations" is a lot of time, but that's peanuts to AI.
>> The future doesn’t need Jensen.
The audio equipment manufacturer?
Nice bit of doomerism from george.
Well, is it unrealistic? If not, why? I haven’t given it the most thought, but I do struggle to come up with counterpoints to what he’s saying.
May I offer a counterargument to the post under discussion? In some RTS games, it is possible to micro your way out of suboptimal resource gathering.
War in the real world is not an RTS. China’s massive population and industrial capacity, along with their collectivism, gives them a sizable advantage in Clausewitz’s iron calculus of war (Resistance = Means x Will)
Let's say this fact "China imports 70% to 74% of its crude oil and 42% of its natural gas via maritime shipping lanes.". You can produce 10x electricity the USA, but that will still not power your warships and tanks.
The current conflict in Ukraine seems to indicate tanks and warships have a very hard time fighting a digital adversary armed with drones and sensors.
They are effectively at a stalemate. The lines move back and forth slowly over months.
Economic efficiency is up for debate, but neither side is decisive militarily.
Yes, In a War both sides fight - something that seems to continually surprise the Russians.
Worth pointing out that the Chinese Navy has also massively expanded over the last few decades and continues to expand - they aren't at parity with the US yet but they are able to contest the South China sea (which was the first goal) especially when backed with missiles launched from the mainland.
The trajectory is set there and China has vastly more yard capacity than the US (they are in the #1 spot, they out build the #2 and #3 spots who are US allies (Korea and Japan) so any (limited) shooting war where ships are been sunk comes down to who can sustain and replenish the losses the fastest, they are both nuclear powers so how wide spread the attacks would be on each others ship production is an open question - it's a risky game either way.
The US navy was built to it's current size during peace time when it's much simpler to build slowly and maintain a big fleet, what I don't think they can do is replace the losses they'd take in that war fast enough.
That in the end is the deterrent, you don't have to guarantee a win to deter someone you just have to make the price so high they don't want to enter the fight in the first place.
Consider you're in a bubble of people whose careers are likely doomed. I live in a low cost of living place, whose economy is dominated by blue collar work and industrial production, and most of my friends who don't sit at a computer all day for their jobs are moderately positive on AI so far.
At some level it's never really been fair that I get paid so much more than them to do far less physically demanding work, and I suspect that shape of the economy might be coming to an end.
Good point, I generally believe everybody is in their own bubble (somewhat tautological – beliefs will always be shaped by your surroundings first and foremost), so it’s good to hear other viewpoints as often as possible.
So “best case” (no destruction, annihilation etc. scenarios), global GDP goes down and we revert to a pre-≈1950s economy, in terms of job distribution across the farming/manufacturing/services sectors? Still doesn’t sound all that rosy to me, but I don’t know.
Edit: Who am I misunderstanding? A downvote with no explanation doesn’t help me get your point.
I feel like we need to hold some perspective greater than "jaded tech guy says something jaded so must be true until someone else refutes it".
What would he even know about geopolitics or sociology to give him any credibility outside of his domain?
What rock have you been living under? It's not just one or 2 jaded tech guys who think you're all a bunch of delusional man-children. Silicon Valley has worked very hard to destroy everybody's trust, it shouldn't be surprised when it gets what it asked for.
Well he doesn't give any argument himself as to why it would happen?
I.e. he is asserting an outcome "armageddon", but he provides absolutely zero argumentation, reasoned hypotheses, debate, etc, as to why it would happen.
"That which can be asserted with no evidence can be dismissed with no evidence."
Therefore, I assert that there is no pending end of the world scenario, and I don't need to provide any reasoning for that, since George Hotz doesn't either.
> Have you ever played an RTS game?
I have observed that the humble photon cannon rush is very effective. If not spotted it's usually a really bad time. Long term, is pretty obvious what happens here. If we get there.
Who dominates the gravity well that we all exist inside right now?
The scramble for AI has many parallels to the scramble fro africa.
When one side is on the verge of winning everything, perceived or real, the other side will just pull out higher risk/reward strategies. Yes I also play RTS.
I can imagine many doom scenarios but I just don't see a single positive. The AI's will do our jobs and our overlords will give us free food and housing? Keeping us around as pets? Out of sheer good will and because of the cuteness of our eyes?
If RSI does takeoff and bring about the AIpocalypse, then at least the EA cult will have a decent chance of becoming a real religion!
Think this chap needs to go touch grass.
Of the super-position of thoughts this article engenders, your response most cogently and succinctly mirrors what I collapsed onto. May you be voted up to the moooooooon, kind sir.
To be clear, I wish him no ill-will.
I just think the world is too complicated, passionate, and resilient for any one dimensional fantasy about evil godlike computers to feel like anything more than self-satire.
Yes, agreed totally, and furthermore, if we can manifest the most beneficial outcome through our collective will, yours is the right take!
The doom must be gently, respectfully shamed.
Eh, just ask the AI to do it instead.