Eric Schmidt谈AI、与中国的较量及美国的未来
- Schmidt对中国的修正判断是,芯片管制和更浅的资本市场正把北京从“疯狂的AGI战略”引向在各个领域部署AI。 中国团队正瞄准消费应用和机器人,包括尝试复制中国电动车的打法。在美国追逐前沿智能的同时,“我们最好也在日常应用上与中国人竞争”。
- 开放模型已变成一场地缘政治分发竞赛,Schmidt担心中国可能胜出。 中国正像推进“一带一路”一样扩散开放权重和开放训练数据,而美国基本仍聚焦于封闭权重和封闭数据。DeepSeek R1的强化学习工作,以及8位甚至4位精度的使用,使低成本部署——以及Schmidt所说、可以装进手机的美国03模型——成为战略优先事项。
- AI革命“被低估了”,但Schmidt将强大智能体与能够自行选择目标的机器区分开来。 他预计,特定领域的超级智能专家可能在6到7年后出现,而旧金山流行的预测是“3年左右”;但他表示,目前“没有证据”表明系统能够自行设定目标函数。在此之前,AI仍将处于“中间到中间”,由人类控制端到端工作流。
- 当一架搭载2公斤载荷、成本4000至5000美元的飞机能够摧毁一辆价值3000万美元的坦克时,无人机战争颠覆了国防经济学。 Schmidt先称,对手看不见的强化学习作战方案可能阻止攻击;但在后续交锋中,他驳回主持人以相互确保摧毁为基础的框架,称其“不是威慑”。主持人强调,基础设施级无人机战争没有赢家,而Schmidt表示,最终人类仍然必须跨过一道线。
- Relativity Space是一场高度依赖执行的发射押注,其背后的物理学之不成熟令Schmidt意外。 其火箭可产生400万磅推力,发射质量约80%是推进剂、18%是火箭本体,只有2%是载荷。低地球轨道订单已满;“我们只需要把火箭发射出去。”
- 美国的优势建立在资本市场、大学、创业者的无序和移民之上,但人口结构正威胁需求基础。 Schmidt称,中国约为“2位父母对应1.00”,韩国为“2位父母对应78”,并据此认为人类正在“集体选择人口减少”;老龄化随后意味着客户减少、收入结构性下滑。他更广泛的前提是,美国和西方应通过更快投资于人才、企业和基础设施来取胜:“各位,别把事情搞砸了。”
1. 中国选择部署,而非投入最昂贵的AGI竞赛
Schmidt改变了看法:他曾认为中国是同量级的AGI竞争者,美国的芯片限制只能拖慢中国。现在看来,硬件约束和更浅的资本市场让中国很难靠“孤注一掷、祈求好运”筹集约1亿美元的数据中心资金,因而转向实用型部署。
他在上海看到,机器人公司正尝试复制中国电动车的打法:资金充足但没有美国式估值,工作强度惊人,并专注于把AI应用到消费产品和实体机器中。
地缘政治风险在于分发。Schmidt将中国的开放权重和开放训练数据描述为一种新的“一带一路”:世界大部分地区可能采用中国模型,而不是美国模型;他更希望模型底层学到的是西方价值观。
针对主持人称Meta的开源行动执行失误,Schmidt表示,目前还不能确定该公司会彻底转向封闭路线。他还认为,DeepSeek R1通过更低数值精度的正向和反向强化学习,进一步复杂化了Meta的处境——其使用8位、甚至4位精度,而美国通常采用16位训练。
Schmidt说,Sam Alman曾表示03模型的最小版本会以开放权重发布,并告诉他这一版本已经发布。他形容该模型远小于“10的26次方”,可以装进手机,为美国模型扩散提供了另一条路径。
2. 智能体先于能够自行选择目标的机器到来
Schmidt一开始给出的判断相当激进:智能体会变得强大、彼此协作,并越来越多地自主运行计算机。但在未来几年,他仍预计助手会按照人类指令和提示词行动,而不是拥有自身意志的独立智能。
“旧金山叙事”预计,递归自我改进系统,以及化学、物理或数学领域的天才型系统,会在“3年左右”出现。Schmidt认同这一方向,但认为这些领域专家可能还要6到7年;当主持人指出天才型系统并不等于通用智能时,他表示同意。
他划定的AGI边界,是系统能够自行设定目标函数;而今天“没有证据”表明系统具备这种能力。技术难点在于目标变化:人类会持续修正目标,当前系统则围绕既定目标进行优化。他的测试是:如果只给模型1902年当时可获得的信息,它能否通过跨领域类比,先推导出Einstein的狭义相对论,再推导出广义相对论。“如果我们能解决这个问题,那我认为一切就结束了。”(“If we can solve that problem, then I think it’s over.”)
Schmidt自己的乐观框架是,人类负责“端到端”,而经过提示、验证和迭代的AI处于“中间到中间”。人类定义目标、发出提示并进行验证,AI完成大量中间环节的工作。他尚未看到递归式自我改进。自己投资的初创公司声称已经接近这一阶段,但它们的乐观判断最终只让他给出“5—10年”的粗略估计。
3. 廉价自主系统颠覆战争成本
乌克兰让Schmidt看到,一个没有海军或空军的国家,如何在兵力约以3比1落后的情况下利用自动化作战。乌克兰的抵抗极具创新性,但俄罗斯在第二轮、第三轮攻势中的强势表现也印证了他的警告:“敌人也有发言权。”
决定性指标是交换比。一架售价4000至5000美元的零售无人机,可以携带2公斤载荷,摧毁一辆价值3000万美元的美国坦克,使许多传统装甲装备在经济上难以为继。更广泛地说,机动系统正在取代大量固定军事基础设施。
无人机如今比迫击炮、手榴弹或火炮更具成本效益;随后双方都会部署无人机,形成围绕探测和摧毁展开的无人机对抗反无人机竞争。作战原则变成无人机在前、人跟在后。Schmidt见过乌克兰人通过Starlink,在远处从Kev指挥作战。主持人还提到,乌克兰无人水面艇袭击俄罗斯黑海舰队,帮助打通从Odessa出口粮食的通道;他称这部分约占乌克兰经济的6%或10%。
Schmidt设想的终局是,双方各自拥有约100万架无人机,并使用对手无法看见的强化学习作战方案。他起初认为,这种不确定性会大幅提高相互攻击的威慑门槛。主持人则将基础设施级无人机战争描述为双输局面,并追问相互确保摧毁;Schmidt回答说“这不是威慑”,并将威慑定义为施加高于攻击价值的惩罚。他仍预计,破坏性攻势会一轮轮展开,最终人类不得不跨过一道线。
4. Relativity的订单已满,但仍取决于一次艰难发射
Schmidt确认自己是Relativity的第一位或较早期投资者,也曾投资SpaceX、Swarm和Starlink。他选择Relativity,是因为“火箭真的很酷,而且真的很难”;他原以为火箭技术已经像喷气发动机一样成熟,后来才发现它仍同时是一门艺术和科学。
Relativity的火箭可产生400万磅推力,测试时普通金属固定装置都无法将其固定住。火箭质量约80%是推进剂、18%是飞行器本体,只有2%是载荷;物理学家告诉他,这一比例是与地球引力较量6个十年的结果。
Relativity定位为低地球轨道竞争者,订单已经排满。Schmidt的总结很简单:“我们只需要把火箭发射出去。”
5. 只有人才与需求持续,美国优势才能不断累积
Schmidt说自己支持工作与生活平衡,但反对基本上完全居家办公,尤其是对20多岁的人而言;他们需要通过现场听资深同事争论来学习。针对中国名义上违法、但广泛实行的朝9晚9、每周6天“996”,他的态度很直接:想在科技领域取胜,就必须接受取舍。
他的更广泛地缘政治前提很明确:“我希望美国赢。”他把这一立场与赋予自己机会的美国梦联系起来,也与前几代人为维持自由主义和民主所进行的斗争联系起来。他认为,美国的优势在于混乱中的创造力、聪明的资本配置、深厚的金融市场、大学、创业者,以及令欧洲和亚洲羡慕的工业基础。“我们应该庆祝这一切。应该为它加柴。应该让它越来越快地发展。”
人口结构是内部约束。Schmidt称,中国约为“2位父母对应1.00”,韩国为“2位父母对应78”,并认为人类正在“集体选择人口减少”。人口收缩和老龄化意味着客户与收入下降,单靠创新无法让企业扭转这一趋势。
他总体支持移民,认为这有助于美国应对人口问题,同时也表示,全球层面的机制需要更广泛的回应。他的方案是继续投资于合适的人才、企业和基础设施。
[Music] I honestly believe that the AI revolution is underhyped. Now, why is this all important? >> Eric Schmidt is here. He's the former Google executive chairman and CEO. >> These agents are going to be really powerful, and they'll start to work together. We're soon going to be able to have computers running on their own, deciding what they want to do. Now we have the arrival of a new nonhuman intelligence which is likely to have better reasoning skills than humans can have. >> So if you were emperor of the world for 1 hour, the most important thing I do is make sure that the west wins. >> Ladies and gentlemen, please welcome Eric Schmidt. [Music]
Hi. Hi. Looking good. Good to see you.
Good to see you.
You're looking, Eric. You're looking. Very nice.
Oh my God. David, good to see you.
David Sax is here as well. It's like a reunion of all of our former companies. David, why did you quit after all?
My old boss.
What was it like working with Young Freedberg? Take us back.
Can I tell a story? We had to come down to Orange County, and they were like, “Hey, we're going to take the plane.” It was Eric's plane. We got on the plane, and then he went up and flew the plane. I'm in the back of the plane by myself.
Was it a King Air?
I was like, “The CEO of Google is flying me down to Orange County.” It was incredible. That was my first time actually hanging out with Eric.
It was my Gulfream.
That's right. He was way too smart.
Way too smart. Was he focused? Did he contribute? Did he move the needle?
But he was very smart. Okay, that's kind of our consensus of the pod as well.
Look, you guys know this guy well. He's really that smart. He taught me more stuff than most of the employees at Google, and then you left.
Well, tell us what you've been doing—no, no, wait. Before that, I have to ask you this question. There was a recently deleted video from Stanford.
Oh no.
You had a moment of clarity where you said, “Hey, at Google, people are like, ‘Too much work-life balance. They need to commit. They need to work harder.’ We had Sergey at the last event. He's going back to work, so Sergey got the message. Predicting Sergey's behavior is something I can fail at. I tried for 20 years. I am not in favor of essentially working at home.
“And the reason is, many of you guys work at home to some degree, but your careers are already established. Think about a 20-something who has to learn how the world works. They come out of Berkeley or Dartmouth, and they're very well-educated. When I think about how much I learned when I was at Sun, just listening to these older people who were 5 or 10 years older than I was argue with each other in person, how do you recreate that in this new thing?
“And I'm in favor of work-life balance, and that's why people work for the government. Sorry.”
That's right.
Sorry. If you're going to be in tech and you're going to win, you're going to have to make some trade-offs. Remember, we're up against the Chinese. The Chinese work-life balance consists of 996, which is 9:00 a.m. to 9:00 p.m., 6 days a week. By the way, the Chinese have clarified that this is illegal. However, they all do it.
That's who you're competing against.
I brought everybody back to the office. It's so much better.
So, let's just pick up on that theme. You don't need to defend the government.
No, no. Believe me, I don't see the need to. I'm an unpaid, part-time adviser to the government.
But we are in this high-tech competition with China. They obviously care about AI, too. They're trying to race ahead. I understand that you recently made a trip there. How do you handicap this competition?
You and I just talked about this as part of your incredibly important work in the White House. I had thought that China and the United States were competing at a peer level in AI, and that the good work that you and your predecessors have done to restrict chips was slowing them down. They're really doing something different from what I thought.
They're not pursuing crazy AGI strategies, partly because of the hardware limitations that you've put in place, but partly because the depth of their capital markets doesn't exist. They can't raise, based on a wing and a prayer, $100 million—or maybe the equivalent—to build the data centers. They just can't do it.
The result is that they're very focused on taking AI and applying it to everything. While we're pursuing AGI, which is incredibly interesting and which we should talk about—and all of us will be affected by this—we'd better also be competing with the Chinese in day-to-day stuff: consumer apps, which is something you understand very well, Chamath, robots, and so forth and so on.
I saw all the Shanghai robotics companies, and these guys are attempting to do in robots what they've successfully done with electric vehicles, right? Their work ethic is incredible. They're well-funded. It's not the crazy valuations that we have in America. They can't raise the capital, but they can win across that.
The other thing the Chinese are doing—and I want to emphasize this because it is a major geopolitical issue—is that my own background is open source. In the audience, you all know that open source means open code. Open weights means open training data.
China is competing with open weights and open training data, and the US is largely, and for the majority, focused on closed weights and closed data. That means that the majority of the world—think of it as the Belt and Road Initiative—is going to use Chinese models and not American models.
I happen to think the West and democracies are correct. I'd much rather have the proliferation of large language models and that learning be done based on Western values.
Eric, we had a major open-source initiative with Meta. They have an incredible balance sheet and tremendous technical firepower, but they seem to have misexecuted and are now taking a step back and reformulating something that, to your point, looks a little bit more closed source.
It's not clear. Alex Wang's a good friend. He's come in, he's taken over, and he's obviously incredibly capable. I would not say that they're going fully closed.
I think they also got screwed up because the DeepSeek people, with R1, did such a good job, right? If you look at the reasoning model in DeepSeek, and in particular their ability to do reinforcement learning forward and back, forward and back, and forward and back, this is a major achievement. It appears that they're doing it with less precision—less numeric precision—than the American models.
As a bit of a technical thing, there's something called FP64, FP32, and FP16. The American models are typically using 16-bit precision for their training. The Chinese are pushing eight and now even four.
Is there something that the larger American companies need to be doing in open source so that we can actually combat this?
A number of the large companies have said that they want to be leaders in open source as well. Sam Alman indicated that the smallest version of the 03 model would be released, I believe, with open weights, and they have done so. He told me, anyway, that this model is much smaller than 10 the 26. It's much easier to train, and it will fit—or can fit—on your phone.
One path is to say that we'll have these supercomputers doing AGI, which will always be incredibly expensive and so forth. But we also have to watch to make sure that the proliferation of these models for handheld devices is under American control, whether it's OpenAI, Meta, Gemini, or what have you.
Recently, you took over Relativity Space, and I think for people who don't know, this is a business whose ambition is effectively to compete with SpaceX.
I think you were the first investor, or the earliest investor, in it.
I was.
I'm sorry.
It's okay.
You lost some money in the first round. What happened? Did you get crammed down?
No, no, no. I mean, all of us did.
All of us—I mean, look.
I've been very happily an investor in SpaceX, Swarm, and Starlink. Relativity was—
And by the way, Swarm is a big deal.
So thank you.
Yeah, Swarm has been a really great success for them and, I think, for the world.
But what I was going to ask you is, walk us through the evolution of the space market. Why did you decide—of all the companies you have the capital base to put your money into anywhere—why did you pick that business? Why now?
Rockets are really cool, and they're really hard. As you know, I'm a pilot and I know lots about jets, and I had assumed that rockets were as mature as jet engines. They're not. It is an art and a science. These things are very hard to do.
The amounts of power—I mean, in our case, the rocket is 4 million pounds of thrust. You have to hold the thing down to test it. You can't even hold it with metal things. You have to have other things to hold it down as well. There's so much force; otherwise, it will take off.
Another interesting thing about rockets is that a rough number is that 2% of the weight of the rocket is the payload, 18% is roughly the rocket, and 80% is the propellant. My reaction as a new person is, “You're telling me you can't do any better?” The physicists say, “After 60 years of physics, that's the best we can do to get out of the gravitation of Earth.”
And so, I think rockets are interesting and they're challenging. There's always an opportunity for competition. In Relativity Space's area, it's essentially a LEO company, a LEO competitor. So, low Earth orbit satellites, that sort of thing. The order book is full. We just have to launch the rocket, and this entry into space happened. I'm not sure how well known this is.
So, you can go as far as you want to go into this, but you've done a lot as well in next-generation warfare. Do you want us to talk about that, how you ended up there, and what role that plays, and just give us a landscape? Maybe David asked about the China question, but they're all kind of interrelated.
Well, in the first place, I'm a software person, not a hardware person. I explain to people that hardware people go to different schools than software people, and they think slightly differently. So, I'm always at a limitation in these new industries.
I had worked for the Secretary of Defense and had a top-secret clearance and all that. I was given a medal for trying to help the Pentagon reorganize itself. When the Ukraine war started, I was watching, and I thought, well, here's an opportunity to see how a country that has no navy and no air force does this with automation.
And, indeed, it has been a spectacular success as a matter of innovation, even though Ukraine was outnumbered 3 to 1, with huge differences in kinetic strength, weapons, mobilization, and so forth. Ukraine has held on really quite well.
What's happening now is you're seeing essentially the birth of a completely new military-national-security structure. One way to think about it is that, first of all, I've seen it live, and I will tell you that real war is much worse than the worst movies you have ever seen about war. That's all I'll say. It's really horrific, and it's to be avoided at all costs.
And then, for obvious reasons—and I love all these people who say, "Well, you know, the warmongering talk"—be careful what you wish for, because the other side gets a vote. When I started working and trying to understand what Ukraine was doing, Russia was pushed back, and they've come back with a very, very strong second and third round. So, the enemy gets a vote in this situation.
But to go on, the rough way in which war will evolve is that, first, things will have to be very, very mobile and very much not in fixed places. This takes out most of the military infrastructure that exists in the world.
Things like tanks, of which we're now building a whole bunch more—stronger tanks here in America—don't make any sense in a world where a 2-kilogram payload from a well-armed drone can destroy the tank. It's called the kill ratio. That drone costs $5,000 or $4,000 at retail. The American tank costs $30 million. You can send an awful lot of those drones to destroy those tanks.
The likely evolution goes something like this. First, people learn that drones are like rifles and like artillery. It's more efficient to use drones now than to use mortars, grenades, or artillery. That's clear if you just look at the economics, in terms of cost-effectiveness, as it's called.
The next thing that happens is that both sides develop drone capabilities, which is what you're seeing now, and each then becomes a war of drone against drone. So, you have drone against anti-drone. The shift then moves to: How do you detect the enemy drone, and how do you destroy it before it destroys you?
The doctrine ultimately is that the drones are forward and the people are behind. I've seen operations, for example, sitting in Kev, where the Ukrainians are commanding things over Starlink, I might add, at a distance in the drone war, and they're very, very effective. So, we've solved the latency problems, we've solved the timing problems, and so forth in that area.
The ultimate state is very interesting, and I don't think anyone has foreseen this. If you go back to our conversation about RL and planning, which is what you're seeing with AI, let's say that we're on one side and we have 1 million drones, and there's another side over here that has another 1 million drones.
Each side will use reinforcement-learning AI strategies to develop battle plans, but neither side can figure out what the other side's battle plan is. Therefore, the deterrence against attacking each other will be very high.
Today, the way military planners operate is that they count weapons. They say, "Well, you have this many and I have this many, and you can do this kind of maneuver," and so forth. But in an AI world where you're doing reinforcement learning, you can't count what the other side is planning. You can't see it. You don't know it.
I believe that will deter what I view as one of the most horrendous things ever done by humans, which is war. Because unless there's a perfect balance between the sides, there will be some mutual destruction of the drone supply, like there would be with any artillery stock in traditional warfare, and whoever's left ends up winning.
Well, it's very important to understand that there are no winners in war. By the time you have a drone battle of the scale I'm describing, the entire infrastructure of your side will be destroyed, and the entire infrastructure of the other side will be destroyed. These are lose-lose scenarios.
Isn't there an equilibrium, though, that this can also create, where, because of that mutually assured destruction, there's a deterrent?
Well, I'm arguing that it's not a deterrence.
Right.
Deterrence can be understood as: I want to hit you—which I don't—but I want to hit you so much that, if I do that, the penalty is greater than the value of me hitting you.
Right.
And that's how deterrence works.
But that seems like a great advantage and upside of this move toward drones and automation that we don't have today.
Well, there are many advantages to moving to drones and automation. One, they're much, much cheaper, right? They're much, much cheaper.
Yeah.
And two, you can stockpile algorithms. You can essentially learn and learn and learn. And remember, you can also build training data that's synthetic, so you can be even better than the others.
The final question I've been asked by our military is: What's the role of a traditional land army? I wish I could say that all of these human behaviors can occur without humans being at risk. I don't think so.
I think that the way robot war—essentially, drone war—will occur is that there will be these destructive waves, but eventually humans are going to have to cross a line.
After we've depleted them. So, you're investing in this drone technology, and then do you think Optimus and humanoid robots are the next volley in this new warfare?
It's going to be a long time before we see humanoid robots, which is what we see in the movies all day, right? It will be a very long time before we see that.
What you're going to see is very, very fast mobility solutions, right? Air-based solutions and also hypersonics.
Hypersonics, also things underwater. There's a lot of that going on. It's a different domain. If you look at the muro and some other boats that the Ukrainians used, they have essentially used USVs to destroy the Russian fleet in the Black Sea.
This was crucial for them because they needed to be able to export the grain from Odessa, and it's like 6% or 10% of their economy. It's a very big deal, and they did that with drones.
Eric, it seems like there's this overarching worldview that you have. You have this view on AI. There's all the stuff you're doing now in drones, in warfare, and in rocketry. It all converges, quite honestly, because in the next 5 or 10 years, these things will all come to pass.
How do you view the world? What is the role of America? What is your role as a capitalist, as a technologist, as a statesman?
I want America to win, right? I am here because of the American dream. The people who invested in me—in my case, Berkeley and so forth—people took a chance on me. I want the next generation to have that.
I also want you all to remember that I was just in Honolulu as part of the World War II surrender ceremony, and they talked about fighting tyranny. We forget that our ancestors, our great-grandparents, or whatever, fought the Great War to keep liberalism and democracy alive. I want us to do that.
How do we do that as Americans? We use our strengths. What are our strengths? We're chaotic, confusing, loud, but we're clever. We allocate capital smartly. We have very deep financial markets. We have this enormous industrial base, universities, and entrepreneurs, which are represented here.
We should celebrate this. We should stoke it. We should make it go faster and faster. I spend lots of time in Europe because of the Ukraine stuff. They are so envious of us. When you're in Asia, they are envious of us. Don't screw it up, guys. That's what I want to work on.
Can I just ask you about something outside of this external conflict? We had a conversation with Alex Karp today, and we actually had Tucker Carlson here yesterday. Some of the dialogue was around—I don't know if the right term is—the erosion of the West, and that there may be social issues brewing in the West that may be hurting us from the inside.
How much do you observe or spend time on these issues? The metric that often is cited now is declining birth rates in the West, and that our population—and we're going to talk with Elon in a few minutes about this—
Oh, sorry.
Oh, we just ruined my surprise. My bad. Oops.
Sorry. There’s your surprise guest. Sorry. Elon is a good friend, and he’s addressing this issue of population directly himself, trying to problem-solve for it. Good for you.
Is it a reflection of something going on? There’s a rise of Mandani getting elected in New York. Some of the historic values of the West seem to be under a state of transformation right now.
One metric of the success of a society is its ability to reproduce. I think this is a legitimate concern for the West. It’s much worse in Asia. The Chinese number is about 1.0 0 for 2 parents. In Korea, it’s now down to 78 for 2.
It’s really important to recognize that we as humans are collectively choosing to depopulate. The numbers are staggering, right? Imagine a situation where, instead of having growth, you have shrinkage. Furthermore, they’re getting older.
As a business, all of a sudden, your revenue is declining. There’s nothing you can do because you can’t innovate with fewer and fewer customers. If you put it in a business context, ignoring the moral issues, which are all very real, it’s just bad, right? We have to solve that problem.
I happen to be broadly in favor of immigration because I think immigration helps us solve that problem. But as a global mechanism, we have to address that.
In any case, from my perspective, you’re going to have these issues, but America is organized around the concept of American exceptionalism. As long as we understand that the way we make progress is by investing in the right people and the right businesses, having a strong capital market, and investing in the infrastructure that they need, we’ll be fine.
That is my actual opinion. Can we go back to AI for a second?
Eric, I think you can help us get to, let’s call it, a bipartisan understanding of these issues. I think you think really clearly about this. In the wake of Chad GBT launching at the end of 2022, I think the discourse was really dominated in 2023 and 2024 by this idea of AGI, and that AGI was imminent.
I think it created almost a panicky atmosphere in Washington among policymakers. You saw things like, “We’ve got to restrict open source, because then China will get it.” This was before DeepSeek launched, and then we saw that actually they’re ahead of us on open source.
It feels like there’s been a pullback a little bit from the AGI narrative, which I think is actually a good thing. I think it’s more conducive to calm, rational policymaking. What’s your perception of AGI right now? Where are we on that whole train?
So, first of all, the speech that the president delivered about a month ago about AI strategy, which I think you probably wouldn’t say, but you kind of wrote it for him, was exactly right. So, thank you.
David collaborated with an amazing leader who we all respect and admire so much, Eric.
Yes. Nevertheless, saying I wrote it was way too strong. Actually, but anyway—
If you didn’t write it, then it must have been your twin. But in any case, you got the emphasis right, which was that investment in research and investment in the kind of stuff that we do is really, really important.
I don’t agree with you on this AGI thing because there’s this group which I call the San Francisco narrative, because they all live in San Francisco. Their narrative goes something like this: Today, we’re doing agents. The agentic revolution will change businesses, which I agree with. What happens is that the systems will become recursively self-improving, with recursive self-improvement, as it’s called.
If you have a scale-free problem—and a scale-free problem, for example, is programming or math, where you can just keep doing it—you get these enormous, fast gains if you buy enough hardware, do enough software, and so forth. That is still underway.
The collective view of that group is that in the next 3-ish years, they believe we will get forms of superintelligence. The way they define it is basically a savant: a chemistry savant, a physics savant, or a mathematics savant. I don’t agree with 3 years, but I do agree that it’ll be maybe 6 or 7 years.
But if it’s a savant in a particular area, is that general intelligence?
It’s not general intelligence yet. general internal intelligence is when it can set its own objective function.
Right?
And there’s no evidence of that. There’s no evidence right now of the ability to set your own objective function.
The thinking—and I’m writing a paper on this, so I’ve been studying it—is that the technical problem is non-stationarity of mathematical proofs. What you’re doing is trying to solve against an objective function, but the objective function keeps changing, which is how humans operate. Your goal changes every day, whereas computers have trouble with that. As a math problem, we don’t have an algorithm yet for LLMs that can do that. People are working on it.
The test will be: Can you, basically, using the information available in 1902, derive the same thing that Einstein did with special relativity, followed by general relativity? We cannot do that today.
Most people believe that the way this will be solved is through analogy. The theory of great geniuses is that they understand one area extremely well, and they’re so brilliant that the person can then take their ideas and apply them to a completely different domain. If we can solve that problem, then I think it’s over. Then we get to AGI, and it’s a whole different world.
I think one of the reasons why it’s hard to replace a human—and JK and I debate this—is that humans are end-to-end. We can do the whole job. You have a sort of complete understanding, and you can pivot very easily.
AI, at least as we know it today, is not end-to-end. It has to be prompted. You get an answer, and that answer has to be validated. Then you have to ask a new question because it never gives you exactly what you want. You have to apply more context and go through an iterative loop. Finally, you get to an answer that has business value.
The way biology puts it is that AI is not end-to-end; it’s middle-to-middle. Humans are end-to-end. As a result, instead of AI replacing all of us, AI will be very synergistic with humans because we can define the objective function, do the prompting, and work with it to iterate. It does a lot of the work in the middle.
That seems to me like a very optimistic, less dystopian take on it. What you just said is exactly what’s going to happen for the next few years: each of us will have assistants that, on our command and with our prompting, will be incredibly helpful for whatever problem we have.
People are using these things for relationship advice, for talking to their kids—I mean, it’s all crazy stuff. But the fact of the matter is, that’s it. To me, the real question is: When does it cross over to having its own volition, its own ability to seek information, and solve new problems? That’s a different animal.
But have we seen any evidence of recursive self-improvement yet?
Not yet. I’ve funded a number of startups that claim to be close to it, but of course these are startups, and you never know, which tells me it’s 5–10 years, cutting numbers.
What do you think Google’s doing on this front?
I’m not at Google anymore. Every version of Gemini is at the top of the leaderboard. Gemini 2.5 just overtook everybody, and I’m sure there’s another one coming. Demis is working really hard on this question about scientific discovery. That is a path to getting to AGI.
Eric, we appreciate the work you’re doing. We appreciate you being here with us. We appreciate what you’ve done—the impact you’ve had on Silicon Valley and society.
I am so happy to be part of this. You created this incredible community, and there are all these smart people who spend all their time listening to you.
Very concerning.
Wow, Eric. Thanks, Eric. Appreciate you. Cheers. All right.