[BidClub_]
Invest Like the Best · · 76 分钟

Ben Thompson谈大科技、中国与资金将尽的AI热潮 - [Invest Like the Best, EP.487]

Patrick O'ShaughnessyBen Thompson

播客
TL;DR
  • Thompson认为,美国在AI上取得决定性“胜利”反而会很危险,因为在美国凭借AI获得压倒性军事优势这一极端情景下,中国从博弈论角度最优的回应就是“炸掉TSMC”。 他称把制造业迁回美国的反制方案是“魔法般的思维”:从晶圆厂、执行器到前驱体,对中国的依赖“不发生冲突就不可能解决”;即便Apple转向印度,也只是分散供应链而非彻底退出——这是一份成本高到天文数字、没人愿意真正支付的保险。他也不认为AI一定能解决现实世界的制造问题。
  • 当前的均衡——OpenAI和Anthropic处于前沿,中国实验室通过蒸馏模型保持“落后约6-9个月”——“总体上对美国有利”,而且可能比很多人想象的更持久。 “开源等于免费”的说法“让我觉得很奇怪”:Kimi“推理服务成本非常高”,开源模型省掉的是研发成本,不是推理成本。
  • 近期AI基础设施扩张面临的约束,可能既不是算力也不是电力,而是资金。 扩张最初靠自由现金流启动,随后科技公司在大约1年内“把债务市场彻底用穿”;Google开始发行股票,NVIDIA则在搭建规模达5000亿美元的工具,试图吸纳养老金和保险资金——“接下来呢?”铁路行业的先例是:19世纪70年代,“全世界就是没钱了”,但铁路仍继续运营并向美国西部扩张。
  • Google令人震惊的股权融资,让人不禁猜测Berkshire可能正是Google的模板:Search可以是See's Candies,AI则可以是BNSF。 当资本规模超过某个阈值后,企业看的是绝对值而非百分比——面对一个“基本等于所有白领工作”的TAM,即便AI利润率更低,也可能远远超过拥有完美利润率的搜索;在“天文数字般更大的蛋糕”中占据更小份额,也没人会抱怨。
  • 科技行业整体并不理解大宗商品市场,算力正在经历一个经典周期:今天投入的钱会在2028-29年变成算力,而回本周期是“在稀缺时代测出来的”。 Jassy和Nadella所说的“只在有需求时按需购买GPU”需要打个问号——“我不确定这是不是一派胡言”——因为闲置的机房壳体最终可能被填满;即便AI需求无穷无尽,只要收入在资本耗尽之后才到来,也可能出现“断层式爆雷”。
  • TSMC的保守策略把风险以放弃利润的形式转嫁给了大科技公司,而这种稀缺最终“救了Intel”。 没有理性的人会主动购买负期望值保险,因此,解决对TSMC依赖的唯一办法,就是出现一个大到足以迫使大科技公司在经济上必须扶持Intel和Samsung追赶的算力应用;Thompson预计Intel将宣布一项重要合作伙伴关系。
  • NVIDIA的利润率“并不自然”:25%的兜底安排和循环融资本质上都是变相降价,因为“风险从来不会消失,只会转移”。 它真正的竞争对手是拥有更低资本成本、把TPU(约20%卖给Anthropic)和Trainium对外作为商品出售的超大规模云厂商;只要电力持续充足,这些芯片就有更多时间追赶。泡沫留下的长期遗产,可能是能源充裕——AI版的WorldCom光纤。
  • OpenAI以“约100倍的规模”重演了Dropbox的错误:消费者不愿为软件付费,也不想变得更高效。 如果ChatGPT刚上线就转向广告,“Google会陷入大得多的麻烦……Meta也会陷入大得多的麻烦”;如今最大的LLM变现,可能就是Google和Meta广告收入的增量,因为它们的广告市场是全球规模的验证机器。
摘要 · 为研究而整理的核心内容

1. 美国在AI上取得决定性“胜利”,可能招致中国炸掉TSMC

  • Thompson开场便抛出挑衅性观点:“我认为美国赢下这场竞争会非常麻烦。” 在最极端的情景中,掌控AI意味着获得军事优势,甚至能够解决制造业问题——不过他并不认为AI一定做得到,因为制造业牵涉现实世界——“中国从博弈论角度最优的回应是什么?炸掉TSMC。” 他认为,一些实验室把国家安全主导地位当作目标,而不是当作危险本身,这与现实存在“根本性脱节”。
  • Patrick反问,到那时美国难道不会已经拥有本土晶圆厂?Thompson回答:“这有点像魔法般的思维。” 从晶圆厂、执行器到前驱体,美国对中国的依赖“不发生冲突就不可能解决”,因为针对一个从中国采购的竞争对手进行供应链回迁,代价将极其高昂;Apple转向印度也只是局部调整,更像一份成本高到天文数字、没人愿意支付的保险。
  • 谈到背后的动机,他说:“所有人都可以利用一个好用的假想敌……从AI交易的角度看,没有什么比‘我们必须击败中国’更有效。” 他的建议是不要照搬对手,而是“更多开放、更多创新、更少自上而下的控制”——“美国的成功之道,是站在最前沿,并顺势加码。”

2. 当前均衡对美国有利,“免费”的开源模型并不免费

  • AI竞赛有点像台湾:一个“实际上看起来没那么糟”的现状,只是不知道能持续多久。OpenAI和Anthropic显然位于前沿,“谁知道Google在发生什么”,Groq和Meta也在追赶。中国实验室通过蒸馏模型把差距控制在6-9个月。他“仍然有些怀疑”中国会反超:芯片是一个原因;而要追上一个借助AI改进AI、持续加速的前沿系统也非常困难——这一点在2家领先实验室身上“似乎正在成为现实”。
  • 谈到开源模型,他说:“所有人都把它们称为免费……不,AI不可能免费使用。” GLM和Kimi都承担着真实的推理成本——“Kimi推理服务成本非常高”;如果前沿实验室利用AI优化自身技术栈,它们的单位服务成本最终也可能结构性降低。
  • 他认为最大的已知未知,是在“Mythos”引发恐慌以及“Hugging Face事件”之后,实验室的回应可能不是降低风险,而是干脆不再发布模型。所有人都拿Fable去评判Mythos,却失去“对前沿究竟是什么的任何感知”,形成一种虚假的安全感,而这个差距“只会随时间推移不断扩大”。

3. AI热潮可能撞上融资缺口,Google融资暴露Berkshire类比

  • 让他担忧的是资本投入与回报之间的时间错配:“我们正在沿着资本曲线向下走。” 基础设施扩张最初靠自由现金流启动,随后“科技公司击穿债务市场的速度相当惊人——大概只花了1年”;现在Google开始发行股票,NVIDIA的5000亿美元工具则在吸纳养老金和保险资金。“接下来呢?” 如果现金流不能及时转正,“我们可能会迎来一次大爆炸”——而Patrick给出的背景数据是,今年资本开支约8000亿美元,明年预计达到1.3万亿美元。
  • 铁路行业当年就是这种情况:长期回报项目依靠短期资金融资,直到19世纪70年代“全世界就是没钱了”。但铁路仍继续运营并向美国西部扩张;更有意思的是,“现在流入Google的铁路资金就是Berkshire的钱”。即使发生爆炸,也不会阻止AI继续进步;Thompson相信AI最终带来的经济影响将达到天文数字,对社会的影响也会非常重大。泡沫“放到人类历史的整体尺度上最终并不重要”,即使它们造成的破坏非常严重。
  • Google发行股票为什么令他震惊?“这可是Google……如果他们真的如此笃定,为什么要牺牲自己的上行空间?” 他的答案要从See's Candies和BNSF说起:BNSF仅1年的自由现金流就超过See's Candies一生的产出,因为当资本规模足够大时,“你开始生活在一个看绝对数字、而不是百分比数字的世界里”。
  • 他给出的对应关系是:Search是“有史以来最完美、最漂亮的商业模式之一,也是最纯粹的聚合器”,而AI“只是在焚烧现金”。但如果AI的TAM“基本上等于所有白领工作”,最终随着机器人发展甚至覆盖一切,那么即便被稀释后只拿到“天文数字般更大的蛋糕”的一小部分,也没人会抱怨。Berkshire可能“不只是Google的投资者,也是Google的模板”。

4. 一边看多、一边无法完全信服:可验证领域的问题

  • 他坦言自己“非常看多,但在某些方面没那么看多”。AI在编程和数学上非常出色,但这2个领域都可以验证;他想看到的不是国际象棋或围棋,而是另一个例子。当实验室圆桌讨论的嘉宾把他当成看空者时,他“有点恼火”,因为“我本来就认为我们能解决国际象棋,也认为我们能解决围棋——它们都是可知的领域”。AI究竟在哪个“真正……不可知的空间”取得了成功?
  • 一个可能的解释是,模型蒸馏的是“人类思考的最终状态”——Reddit上的评论,而不是评论背后的思考轨迹和情绪。“如果Neuralink真正的回报,其实是捕捉人类思维的轨迹”,并把它作为训练数据,会不会大幅拓展AI能力?
  • 即使能力冻结在今天的水平,市场规模也已经巨大:“世界上有很多人,有点像有意识的AI”——他们在可验证的领域运转良好,被分配工作并完成工作。因此他称自己是“勉强的加速主义者”:“我们回不去了,而最糟糕的事情就是卡在现在这个位置。”
  • 医疗“绝对是最大的机会之一”:如果对所有医疗记录进行机器学习,可能在“非常短的时间内”产生大量发现,但监管构成了门槛。双刃剑在于:人类“创造需求的能力基本上是无限的”,而“制造监管红 tape和混乱的能力也相当无限”。

5. 边际成本回来了,也击穿了微软的定价模型

  • 聚合理论建立在零边际成本之上:“在一个丰饶的世界里,真正困难的问题不是分发,而是发现”;变现可以在不依赖人工的情况下扩张,Google和Meta的大多数广告主从未与任何人交谈。Patrick反驳称推理成本“现在是真实存在的”,Thompson回应,关键就在于成本差异:一个让ChatGPT帮忙写菜谱的用户,服务成本大致相当于打开一个网页;但测试时扩展是“直接的边际成本——你思考的每1秒更久,都在花更多钱”。这2类用户“根本不在同一个宇宙里”。
  • Microsoft新的E7方案——每用户每月100美元,另加使用费——“问题重重”:企业按年度而不是按月度做预算;按席位计费的软件曾被不假思索地嵌入人员编制预算,“不是资本开支,但有点像资本开支”;而按月审查账单,会引出“我到底在为什么付费?这些产品分别有多好?”的问题。他们不得不这么做,因为高Token用户的成本远高于100美元;但又必须让客户稍微思考一下,“不能思考太多,否则整个模型就会被打破”。

6. 消费者不愿付费,也不想提高生产力:OpenAI以100倍规模重演Dropbox

  • “硅谷每10年都必须重新学会2件事:消费者不想为软件付费,消费者也不在乎提高生产力。” 经典案例就是Dropbox:Jobs说“你是一个功能,不是一家公司”,随后经历2年低谷,最终从底层重建企业权限体系——因为当员工生产力提升时,公司愿意付费。至于消费者:“我已经工作了一整天,为什么回家还要提高生产力?我想坐在沙发上刷Reels。”
  • “你看到的就是OpenAI以大约100倍的规模重演Dropbox的故事。” 订阅卖出了很多,“但还不够多”;就在“Anthropic正在把我们打得很惨”迫使OpenAI转向企业市场之际,广告转型显得格外尴尬。如果一开始就押注广告,“我认为Google会陷入大得多的麻烦。我认为Meta也会陷入大得多的麻烦。”
  • 广告之所以更适合消费者,是因为“你对消费者的变现能力是无限的,因为涨价由广告主承担”;不存在类似Netflix那样的价格弹性天花板。“向人收费很难,免费给人东西很容易。”

7. 科技行业不懂大宗商品:今天的钱变成2028年的算力

  • 算力短缺源于2023-24年投资不足,而TSMC在2023年、2024年和2025年都下调了增长率,因此“算力短缺会进一步恶化”,今天的支出“最终都会在2028年和2029年体现为算力”。Jassy和Nadella所说的“只有需求出现时才买GPU”需要打个问号:“我不确定这是不是一派胡言”——已经建好的机房壳体属于沉没资本,不会被长期闲置。
  • 他用航运解释这一机制:一艘船的成本是折旧,而折旧“只是会计上的虚构——钱已经付出去了”,所以船无论如何都要运行,价格最终会向边际成本靠拢。COVID期间,集装箱价格从3000-4000美元涨到17000-18000美元;如果所有人都按2年交付周期下单造船,价格可能暴跌。只有当价格跌破真实边际成本时,供应商才会退出,供给减少后价格才能恢复。存储行业的繁荣与崩溃也是同一套机制。
  • 数据中心经济学的陷阱在于:“你是在稀缺时代测量回本周期。这个回本周期在丰饶时代还能成立吗?” 多头认为,测试时扩展意味着“我们会永远短缺”——“也许确实如此”;但即便这样,如果收入在资本投入之后才到来,“我们仍可能出现一个断层”。

8. 存储把自己变成了靶子,TSMC的谨慎反而救了Intel

  • 存储行业经历惨烈周期后,整合成纪律严明的3家巨头。Samsung“在下行周期中投资”,这需要“极大的勇气和纪律”,并且“基本上消灭了日本厂商”;但这种纪律与一个它们迟迟没有意识到的长期需求变化发生了冲突。他的类比是:存储厂商就像伊朗,而封锁霍尔木兹海峡会促使别人绕开你——“假设伊朗想在2035年关闭霍尔木兹海峡,那不会产生任何影响”。如今算法优化的第一目标就是减少内存用量。
  • TSMC“可能更糟,因为这里只有一家”。TSMC的保守主义要求一座晶圆厂运行30年,但这并没有消除风险——“风险不会消失,只会转移”;它转移到了大科技公司身上,表现为放弃的收入和利润。Great Recession期间,新管理层削减支出、解雇所有人后,Morris Chang复出并表示:“iPhone刚刚发布……我们需要投资,而不是削减。” Chang是科技高管界“拉什莫尔山上独一无二的人物”。
  • 当TSMC“合作起来如此出色”时,理性上没人愿意承受培训Intel的痛苦,直到短缺严重到无法忽视。“稀缺最终救了Intel……归根结底,这是TSMC自找的”;他预计Intel将宣布一项重要合作伙伴关系。更一般的规律是:没人会购买负期望值保险,因此,唯一的解决方案就是打造一个规模大到“让我们免费获得地缘政治保险”的算力应用。Patrick的总结是:“高价格的解药就是高价格。”

9. Amazon是他最看好的布局,Apple也许只是运气好

  • 被问到大科技中最好的布局,他的答案始终是“Amazon”——因为Amazon是自己的“第一优质客户”。AWS并不是闲置产能:它先服务外部客户,再服务内部客户;物流业务则走了相反的路径;早期Graviton和Trainium“很糟糕”,但借助Redshift等托管服务隐藏在后台,获得了足够的规模来持续改进,如今Trainium已经在运行Anthropic。核心零售业务“感觉坚不可摧”,“他们的护城河比任何人都深”。
  • Apple暂时缺席AI,可能是“运气比实力更重要”的局面:“如果你拥有客户入口,供应商自然会找上门”;未来消费级聊天机器人可能直接在设备端运行——“用客户的电力”,无需承担推理账单。风险在于重演Microsoft错失移动端的陷阱:假设手机永远是中心,而环境式AI最终会在各处出现。
  • 关键在于产品气质:“AI是一项概率性事业,而Apple是确定性产品之王”——从来不会出现iPhone召回。“Apple不做AI我完全没问题,我希望他们继续制造伟大的设备。”

10. “他们以为自己正在创造上帝”,Microsoft则在执行IBM剧本

  • 谈到前沿实验室,他说:“永远不要低估信仰的力量。他们以为自己正在创造上帝。” OpenAI“有点像主流教会——每周日都去做礼拜”;Anthropic则像福音派,“全情投入”。Meta进军前沿AI,是“创始人能量最纯粹的体现之一,不论好坏”;Google只需要让Search“不要死得太快”。至于太空数据中心那套玩法(原话为“SpaceX AI”),拥有模型的逻辑最弱——如果差异化来自轨道算力,“为什么要浪费数十亿美元?”
  • Microsoft有意不站在前沿,因此每季度仍有400亿美元自由现金流,并支付100亿美元股息;它在执行Gerstner时代的IBM剧本:什么都做得平庸,“这就是垄断的代价”,于是出售中间件、可靠性和咨询服务,像IBM当年“让整个美国企业界上线”。所有企业销售,本质上都是“那些长期目标是把你锁定在自己体系里的公司,通过让你害怕被别人锁定,来争取把你拉进来”——这就是Oracle笑话的由来。
  • 这既理性又带有绝望色彩:“归根到底,我们为什么还在使用Microsoft的产品?” AI在保护记录系统的繁琐迁移工作上“好得出人意料”;而Codex、Claude式代理正“像一支射向心脏的箭”,直指Microsoft拥有的界面层。因此更广泛的判断是:对数字公司而言,“不站在前沿反而更加鲁莽”。

11. Meta的广告市场是全球规模的验证机器

  • Meta的结构性特点是:Instagram“创造了这么多收入,而Facebook为内容支付的成本是0美元”。如果由Meta自己生成AI内容,其利润率反而会比现有模式更差;但对YouTube来说可能增厚利润,因为推理成本可能低于支付给创作者的收入分成。多头逻辑是:在AI充斥的世界里,“人们对人与人连接的渴望会更强”;TikTok已经证明,社交网络此前只是人为限制了内容质量,社交网络本身可能重新变得重要。
  • 最常被忽略的一点是:“现在最大的变现可能不是Anthropic或OpenAI,而是Google和Meta正在获得的广告收入增量。” 它们的广告市场通过全球规模的用户点击和购买结果,以及大量A/B测试,验证AI生成的广告创意;大多数广告都是一次性消耗品,但类似LLM的预测——“这个人下一步可能想看这个”——只需提升几个百分点,回报就可能达到数十亿、数百亿美元。仅这一点就足以支撑前沿AI投资。
  • Thompson感到遗憾的是,Zuckerberg“20年来几乎从未真正谈过广告的社会价值,只是偶尔提及”;Sheryl Sandberg式的案例布道也“从未真正补上”。与此同时,他称Apple的ATT是“科技史上最严重的反垄断违法行为之一”,并认为Apple在公交车上的广告是“不诚实”的呈现;华尔街不愿为Meta的AI支出提供资金,部分原因在于Oculus累计投入了“超过1000亿美元”,而他从一开始就非常反感这项业务。

12. NVIDIA的利润率并不自然,能源充裕可能才是泡沫的真正遗产

  • Patrick问算力和智能是否都会成为商品,Thompson没有回避,反而表示认同:“商品会改变世界……互联网就是一种商品。它改变了世界,所以智能最终成为商品并改变世界,并不奇怪。” 差异化产品会限制自己的TAM;商品之所以影响巨大,恰恰是因为所有人都能拥有。
  • NVIDIA通过把降价从损益表上移走,维持了表面利润率:25%的兜底安排、对新云厂商的股权投资,以及承诺采购算力至2030年,都在降低交易对手的资本成本,因为“Nvidia承担了风险……风险从来不会消失,只会在别处出现”。如果按真实价格计算,这种期望值转移“就是降价”——“我们确实已经看到降价,只是它们以非常奇怪的方式呈现出来。”
  • 真正的竞争对手是超大规模云厂商:Google大约将20%的TPU卖给Anthropic,Jassy也几乎确认Trainium会对外销售;这些芯片以商品而非差异化产品的方式出售,背后依靠的是“更低的资本成本。这是一场资本之战”。CUDA的护城河“已经大幅削弱,因为模型不在乎自己运行在哪种芯片上”;Elon购买NVIDIA并不是“因为它们最好”,而是“因为它们最具可替代性”。
  • Thompson认为,电力不足原本可能更早成为NVIDIA的护城河:在受约束的世界里,Token效率会胜出;但美国“上线的电力远超预期”(包括表后建设、西德州天然气和核电重启),给了Trainium和TPU追赶的时间,“这些利润率似乎很难持续”。泡沫留下的长期遗产可能是能源本身,就像“我们的核心互联网至今仍运行在WorldCom的光纤上”:“生活在能源充裕的世界里会是什么样?甚至很难想象。”
Patrick O'Shaughnessy

So, Ben, if you can believe it, look how long it's been since we last did this. The world was very different. There was no AI at the time. We talked mostly about aggregation theory. I thought a fun place to begin, since the world has changed so much, is to hear what you think it would mean for the US to win the AI race.

1. US Dominance Creates Danger

Ben Thompson

I think it would be very problematic for the US to win. Let's say we take the most fantastical scenario, where if you control AI, basically, your military is better than anyone else's. Somehow, it fixes our manufacturing and all these things that I don't think AI is necessarily going to do because they deal with the real world. But in this world, what is the game-theory-optimal response of China? To blow up TSMC.

Game theory can get very convoluted and complex. To me, this one actually isn't that complicated. There is a fundamental disconnect that I have with a lot of the rhetoric coming out of Silicon Valley, coming out of one of the labs in particular. If we get to a place where we have meaningful superiority from a military and national security perspective, I think that's very dangerous for the world.

Patrick O'Shaughnessy

But in that state, how much does it extend beyond TSMC being blown up? Because in that state, I would assume we figured out how to build fabs here in the US, to some degree, and are less reliant on that one choke point.

Ben Thompson

I think there's a little bit of magical thinking, which I just invoked, in terms of manufacturing—whether it be fabs, actuators, or all these precursors. I think the degree to which we are dependent on China is underappreciated, and it's not something that is going to be fixed outside of a conflict. Fixing so many of these things is going to be dramatically dumb.

If your competitor is sourcing from China and you're going to start sourcing or getting things from the US, you're going to be at such a disadvantage, relatively speaking, that you're just not going to do it. You do it when you have literally no choice. That works for very big headline items. You can browbeat Apple to move some of its iPhone manufacturing to India, for example.

But even that is a good example, because Apple is not truly moving out of China. It's diversifying to an extent, but it would just cost so much. It's like paying an insurance policy that, if you don't have to pay it and it's astronomically expensive, you're just not going to pay it.

It's one of those hypotheses that I just have a hard time even grokking, because the only world I see where we truly pull out and have no dependency on China—such that if they want to blow up Taiwan, who cares? There's no impact on us—seems pretty fantastical to me. I think there's a bit of facing reality in this regard that is not present in these conversations.

Patrick O'Shaughnessy

Put yourself in their shoes. What do you think the motivations are?

Ben Thompson

Everyone can use a good bogeyman. I think from the AI trade perspective, nothing works better than, “We have to beat China.” And I do think we need to beat China. We need to be competitive.

I despair at the extent to which, over the last few years in particular, so many of our responses, particularly from a political perspective, have been to try to be like China. I think we should be going the other direction: more openness, more innovation, less top-down control, fewer restrictions on speech, and things along those lines. America succeeds by being on the leading edge and by leaning into that.

Patrick O'Shaughnessy

You said that the US being purely dominant in AI is probably not the right end state for the world. What is your ideal equilibrium for how this goes worldwide?

2. AI Settles Into Equilibrium

Ben Thompson

There's a bit where AI right now is kind of like the Taiwan situation, in that the current status quo actually doesn't seem so bad. The question is, how sustainable is it? But maybe it's sustainable for longer than we think.

The way I think about it right now is that OpenAI and Anthropic are clearly on the frontier. Who knows what's happening with Google? Then Groq and Meta are chasing them. Meanwhile, the Chinese are very capable and very smart, and are also definitely distilling these models to stay about 6 to 9 months behind. It feels like a pretty good equilibrium that I think is generally favorable to the US.

Now, the question is, how long can it stay this way? There are lots of questions there, such as whether the Chinese can actually pull ahead. I'm still a little skeptical for various reasons, whether it be chips or anything else. Getting to the leading edge when you're 6 to 9 months behind is very difficult.

It's going to be instructive to see how Meta and Groq do in terms of actually catching up, especially as we get to a world of AI improving itself—using AI to make AI better—which I think is definitely a real thing. You see a real acceleration from both OpenAI and Anthropic recently. That was theorized, and it seems to be coming true. To the extent that's true, can you actually catch up?

The other question about this, by the way, is to what extent that applies to cost to serve—to marginal costs. If you can apply AI to optimizing your stack, figuring things out, and analyzing all the data, is your cost to serve structurally lower than anyone else's?

This is the thing about the open-source models. The talk about them being free is bizarre to me because it's marginal costs. You still have to run inference, like with GLM or Kimi. Kimi is very expensive to serve. The cost per answer is significantly higher.

When everyone refers to these as free, it feels like, in the narrative, people have it in their heads that free is free. “Now I can use AI for free.” No, you can't use AI for free. You're not necessarily paying the R&D cost to create the AI, but you're definitely paying for the inference to run it.

Now, I kind of like where we are. The pushback would be, “That's right now. It's not going to stay that way,” which I think is a fair pushback. But I don't know—it may last way longer than we think.

Patrick O'Shaughnessy

If you could know anything about the future of how this will go, to be more confident in where the equilibrium will end up, what would it be? Is it the length of the S-curve—how far up the S-curve we are? At some point, these things presumably will level out, maybe not. What would be the thing you'd want to know that would give you a better sense of what the future might look like?

Ben Thompson

I am concerned that, with the scare around people freaking out about Mythos and this Hugging Face incident, the actual implication is not that we reduce these dangers, but that we just stop releasing stuff. We, on the outside, start to lose any sense of where exactly—

Patrick O'Shaughnessy

What's actually the frontier?

Ben Thompson

—what is actually the frontier and where it is. There becomes a false sense of security, because right now everyone's basing their understanding of Mythos on Fable. But how good is Fable actually relative to Mythos? That gap is only going to increase over time.

So I think that's a real question that I'm not sure about. This question of the recursiveness of AI making itself better—does that lead to a takeoff? At the end of the day, there are timing questions in lots of different ways. I'm worried about the timing mismatch in terms of the actual return on investment producing enough revenue to fuel investment. We're working our way down the capital curve. We started with free cash flow.

The speed with which the tech companies blew through the debt markets is incredible. It took a year, and now Google’s issuing equity. NVIDIA’s putting together this—

Patrick O'Shaughnessy

This $500 billion thing.

Ben Thompson

This $500 billion thing to tap into pension funds, insurance floats, and things like that. What’s after that? Where does the money come from after that? Well, ideally, we actually flip back to free cash flow funding this. But if there’s a gap there, if we don’t get there soon enough, then we could have a big blowup. At the same time, even if we have this blowup, AI is not going away. It’s not going to stop improving. It’s going to keep progressing in a way that makes us look back on the dot-com era, the railroad era, or whatever bubbles throughout history as ultimately immaterial in terms of the broad scope of humanity, even if they were very devastating.

Patrick O'Shaughnessy

What can the railroads teach us, do you think? It’s now the last big build-out, right, in terms of percentage of GDP or getting there.

Ben Thompson

I think we might be bigger at this point, or it was the biggest.

Patrick O'Shaughnessy

It’s in the ballpark.

3. Railroads Expose The Funding Risk

Ben Thompson

The railroads had a real duration mismatch. To build a railroad and make money off it was a decade- or multiple-decades-long endeavor, whereas you had to issue money to pay for it in the short term, and the world ran out of money.

Patrick O'Shaughnessy

Got it.

Ben Thompson

Right? I think that is probably the aspect—that’s why people reach for the railroads. Everyone talks about whether we’re going to have enough compute or enough electricity. Maybe the nearest-term question is, are we going to have enough money? That’s a bizarre thing to think about. That’s what happened in the 1870s. The world just ran out of money. The funny thing is, the railroads kept operating, and they expanded the West. Their contributions to GDP were astronomical. They’re still contributing to GDP. Railroad money is what’s going into Google right now from Berkshire Hathaway. Like, was—

Patrick O'Shaughnessy

That’s very funny.

Ben Thompson

No, it—

Patrick O'Shaughnessy

It’s quite literal.

Ben Thompson

Berkshire Hathaway has this problem. To me, this NVIDIA deal is very much paired with the Google equity issuance, which I thought was shocking when it happened.

Patrick O'Shaughnessy

Why was it shocking?

Ben Thompson

Because it’s Google. They can’t raise money. Why are they issuing equity? Why are they reducing their upside if they believe so strongly in this? But the Berkshire comparison is interesting because, to a rough approximation, they have See’s Candies, famously, right? It’s a tremendously high-margin business. The problem with a lot of high-margin businesses is the percentage profit you can make is very high, but the absolute profit you can make is capped.

Patrick O'Shaughnessy

No reinvestment runway.

Ben Thompson

That’s right. You’re just accumulating cash. The brilliance of the BNSF Railway thing was that they took the See’s Candies profits and said, “Here’s another industry whose margins are way worse, but the absolute dollar amounts are so large that those much worse margins result in absolute profits that are much larger.” BNSF in 2025, or something—the amount of free cash it threw off in 1 year was more than See’s Candies had thrown off in its entire lifetime, even though you’re talking about a low-margin business compared to a very high-margin business.

I think there’s an aspect from Berkshire Hathaway where, once your capital gets so large, you start operating in a world of absolute numbers as opposed to percentage numbers. The reason I thought that story was so interesting is that it seems to capture where Google itself might be going. It was very symbolic for them to invest in Google. Google has this unbelievable high-margin business of search, one of the most perfect, beautiful business models of all time, and the purest aggregator of them all. It scales in every direction, doesn’t have to invest any money to do it, and everything’s zero marginal cost. It’s amazing.

Meanwhile, there’s this AI opportunity, which requires just astronomical amounts of money. It’s incinerating cash. But you can imagine that if AI is intelligence, and its TAM is basically all white-collar work, and eventually, with robotics—

Patrick O'Shaughnessy

Probably more, right? Yeah, yeah.

Ben Thompson

Everything, potentially. The absolute profits available here, even if the margins are lower, are so much larger. Will we look back and see that Google Search was See’s Candies? It feels like that’s what’s happening. In that world, you use all your free cash flow. They’ve done that. You tap the debt markets to the tune of hundreds of billions of dollars. They’ve done that. You issue equity. What does an equity issuance do? It dilutes your interest in the company as a shareholder, so you have a smaller percentage of the pie. Well, if you have a smaller percentage of an astronomically larger pie, at the end of the day, no one’s going to be complaining.

It is very symbolic that Berkshire is the symbol of that equity issuance. Is Berkshire actually not just an investor in Google, but a model for Google and where they’re going?

Patrick O'Shaughnessy

I’m curious: setting aside the commercial and competitive components of this, how AI-pilled, on the pure technology, would you say you are relative to other people thinking about this space?

4. AI Struggles Beyond Verifiable Domains

Ben Thompson

I have a view that is both super bullish and less bullish in some respects.

Patrick O'Shaughnessy

Okay.

Ben Thompson

I am not fully convinced about the generalizability argument. AI is clearly incredible at coding. It blows my mind that people were doing this a year ago, actually writing out code. It’s very good at math, obviously, but the obvious riposte is that these are verifiable domains. What is the evidence, or where is the compelling evidence, that being very good at verifiable domains cleanly translates to being very good at unverifiable domains, or domains that have very long verification loops? I think that’s still a little bit to be determined.

It’s interesting because I raised this question, and there were some people at the labs who were on a panel. I was annoyed at the answer because the answer took me for an AI bear. “Oh, well, people thought we couldn’t solve chess or we couldn’t solve Go, and we solved those easily enough.” I’m like, “I thought we could solve chess. I thought we could solve Go because they’re knowable domains.” Scale was the answer to both of those, but both of those were also bounded.

What is the go-to example that’s not chess, not Go, that is genuinely in a new, unknowable space, where it’s doing things that were not possible? That is the “I’m not fully convinced” sense.

However, AI, at a rough approximation, is trained on all the data of the internet. All the data of the internet—that’s distillation. It distilled all of the end state of human thought. The actual—

Patrick O'Shaughnessy

No traces.

Ben Thompson

Typing on Reddit. It doesn’t have the traces. It doesn’t actually have the thought, the emotion, or whatever that went into typing that comment or writing that essay. Say Neuralink, whatever. What if the actual payoff from Neuralink is capturing the traces—

Patrick O'Shaughnessy

Training data.

Ben Thompson

—of human thought that actually dramatically expand the capabilities of these models?

My sense is that a huge number of jobs, a huge amount of economic activity, does not exist in these domains that I’m not convinced AI is good at. Actually, there are a lot of people in the world who are, to a certain extent, like sentient AIs. They operate very well in verifiable domains. They’re given jobs, they do them, and it’s almost like a somewhat pessimistic view of humanity, to a certain extent.

But I think that market is so large that, if the models did not improve at all from where they are right now, the economic opportunity would still be massive. I wrote an article a while ago. There’s the whole accelerationist movement. I called myself a reluctant accelerationist. I think we need to push forward because we can’t go back, and the worst thing we can do is get stuck where we are.

So I’m very AI-pilled in terms of its impact on the economy and its upside in terms of monetization. I’m not sure about the timing.

Patrick O'Shaughnessy

What would be the gradient toward it? Imagine law or medicine, where I don’t know whether or not you would consider those verifiable. Law is a code of some sort. Medicine—we have a certain state of understanding of things.

Ben Thompson

I think medicine is by far one of the biggest opportunities. It’s both one of the biggest opportunities and one of the most challenging ones because of all the regulations and all the access. If you could turn AI and machine learning loose on all the medical records, I think the number of discoveries and improved treatments we could come up with very rapidly would be unbelievable. So that is a very optimistic view. On the flip side—

Patrick O'Shaughnessy

It’s not happening.

Ben Thompson

When is that going to happen, right? I think the optimistic frame I put on humans is that our capacity to create needs is sort of unlimited. I think we’ll do a very good job of creating new opportunities and jobs in the fullness of time. The more pessimistic way to put it is that our ability to create red tape and muck is also fairly unlimited. How much of our economy is actually made up of more and more jobs we’ve managed to create that just make us busy and make us slow, to a certain extent?

Patrick O'Shaughnessy

If I go back to the early 2010s, maybe aggregation theory was stewing in your brain, and then you published it in 2015. I think it's fair to say that theory, that idea, defined the winners and losers of that era of technology. I'm really curious how you're thinking about what theory or principles will define this era of winners, from a financial perspective and a market-cap perspective.

5. Aggregation Theory Meets AI

Ben Thompson

I go back and forth even just on the question of aggregation theory itself. How much does that apply in this current era?

Patrick O'Shaughnessy

Just the same thing. Yeah, yeah.

Ben Thompson

Yeah, because a pushback that people have is that one of the key components of aggregation theory is zero marginal costs. Zero marginal costs shows up in lots of ways. The one that I focused on at the beginning was distribution. People say, “Oh, I don't have distribution. I have to pay Google threads.” Well, no, you have a website. Your problem isn't that you have distribution. Your problem is that you don't have demand, and you're paying for demand when you're paying for ads and things on those because the aggregators control demand.

They control demand because, in a world of abundance, the hard problem is not distribution; it's discovery. How do you actually find what you're interested in? So the companies that solve discovery in their domain come to dominate that market. They get a virtuous feedback loop. That's aggregation theory in a nutshell. The other thing is transaction costs. There are no transaction costs. Google can scale to the whole world, and they can scale to the whole world not just on the user side, but also on the monetization side. The vast, vast, vast majority of advertisers on Google or Meta never talk to someone at Google or Meta. They just go up and buy ads. It's all done by computers.

Patrick O'Shaughnessy

The perfect business.

Ben Thompson

And those computers, from a business perspective, cost $0. AI obviously changes that significantly. Inference costs are real. But then again, how real are they?

Patrick O'Shaughnessy

They're real right now.

Ben Thompson

I don't know. Are they?

Patrick O'Shaughnessy

It depends on the company, but they're way more real than those prior examples.

Ben Thompson

For sure, but you have this incredible spread. You have people—I think the vast majority of people who are using AI today are using it as basically a Google substitute or a recipe maker, or whatever it might be. My suspicion is that the cost to serve those people is extremely low, basically similar to serving them a webpage. I would imagine it's marginally higher, but not that much higher.

Then you have, on the other extreme, people who are actually leveraging test-time scaling. It used to be we just scaled by making the models bigger and bigger. Now you can scale as far as time: How long do you think about the answer? Well, you could think about the answer for days—

Patrick O'Shaughnessy

Days.

Ben Thompson

—or weeks or months. That is directly marginal cost. Every second longer you're thinking is costing more money. This speaks to how we think about AI and inference as one question. That's why I was pushing back on you. But actually, the marginal-cost question for the different users—the user using free ChatGPT and the user trying to solve a math theorem—they're not even remotely in the same universe.

I think you see this challenge actually in the enterprise in a very interesting way. Microsoft recently shifted its enterprise plan. They came out with an E7 plan, $100 per user per month. That includes some amount of usage, but then they also are charging for usage on top of that. I think this is a kind of fraught position for Microsoft because the positive way to think about Microsoft is that they do everything you need as a business. Every individual component might not be the best, but you get it all for one price, and they all mostly work together. If you're particularly a small or medium-sized business, or even a large enterprise, there's real value in that.

That's right. It makes life easy. The moment you start having to think about how much you're paying, it's not just that that's a new decision; it's also untethered from headcount. Microsoft got the benefit when you were hiring a new employee. You would think about the cost of that employee, and baked into the cost of that employee was $100 a month or $50 a month for their license. It was a thoughtless revenue stream for Microsoft.

Now, if you think about usage, you have to think every single month, “How much do I want to spend?” That introduces 2 problems. Number 1, most companies aren't set up to do this. They make budgets once a year. This idea that we're going to be thinking about our budgetary allotment on a monthly basis doesn't compute.

There's an aspect where they're used to thinking about CapEx decisions or one-time costs, and there's a bit where, when I'm talking about the loaded cost of an employee, it's not CapEx, but it's kind of like CapEx. You make the decision up front, and you don't think about it anymore. The decision's sort of already made. But if you're thinking about usage, you have to do it again.

The final thing is, if you're looking at your Microsoft bill every month and asking, “How much did I use?” you start thinking about, “What am I paying for? How good is each of these products? Should I actually just start thinking about spreading this out?” I think they had to do it because that extreme user who uses a ton of tokens and is actually leveraging AI costs way more to Microsoft than $100 a month. They can't support them, but they want to hold on to the set cost for the vast majority of employees who can fit in that. They need to ask their customers to think a little bit for those extreme employees, but they don't want them to think too much because that breaks the model in very surprising ways.

Patrick O'Shaughnessy

Are you surprised at all that the recipe builder user, who is very low cost to serve, hasn't had a great business model emerge around them just yet? Google and Facebook sort of perfected the business model in this prior era. They haven't seemed to figure this out at all.

6. Consumer AI Needs Advertising

Ben Thompson

I am frustrated but not surprised. This is obviously a market that should be supported by advertising. That is why advertising is always the consumer business model. Consumers don't want to pay. There are 2 things to understand about consumers that Silicon Valley has to relearn about every 10 years. Number 1, consumers do not want to pay for software, and number 2, consumers do not care about being productive.

We went through this in early SaaS. The canonical company for this, in my mind, is Dropbox. Dropbox was an unbelievable product, especially when it first came out. In business school, I was one of the first people to use Dropbox, and that went off like crazy. I have so much storage still in my free Dropbox because I gave out my code to so many people.

Drew Houston made this amazing product that was so easy to use and absolutely seamless. He was very clear about this. He wanted to build a consumer company, and there's that famous story of him meeting with Steve Jobs. Apple was interested in acquiring Dropbox, and they were like, “Oh, we wanna build a company,” and Steve was, you know, “You're a feature, not a company.”

That plain-Jane, just-file-sync product—Apple did make it a feature, as iCloud Drive. With Dropbox, they grew very fast, and then they had a 2-year lull. In that 2-year lull, what they had to do was basically completely rebuild the app from the bottom up because not enough consumers were going to pay for it.

Enterprises could see the value. But if you want enterprise, you need permissions, you need control, and you need someone else to be able to set all these sorts of things. Their app wasn't created to do that at all. So they had to rebuild the whole thing and realize, “The only way we're going to make money is by selling to companies.”

Why do companies pay? Because companies are paying employees. To the extent they can make their employees more productive, they're getting a greater return on their investment. It's the complete inverse of a consumer. A consumer's like, “I spent all day working. Why do I want to come home and be more productive? I want to sit on the couch and watch Reels.” But you see that with AI, and you also have this overarching skepticism of advertising.

I've gotten so much traction on Stratechery by being an advertising appreciator, and I go back and read my early articles about advertising that were directionally correct but also not very good at all. But I got so much traction doing it because I was the only person writing about advertising.

In a world where everyone wanted to have a blog and Twitter, no one wanted to talk about advertising. But even now, in Silicon Valley, there's this embarrassment about the fact that the Valley is, in many respects, monetized by advertising. Particularly during the last 8 years, there was this sense that Facebook was icky.

Patrick O'Shaughnessy

The best engineers don't want to go work on this problem.

Ben Thompson

And so you literally had OpenAI replaying the Dropbox story, but at 100× the size, being like, "No, we're going to sell subscriptions to consumers." They did. They sold a lot, but they didn't sell enough. If you're going to be in the consumer market, you have to be doing advertising.

They're doing advertising now. It's a little weird that they finally pivoted to doing advertising. At the same time, they're like, "Oh, crap, we need to go after the enterprise because Anthropic is kicking our rear end." So I'm not quite sure what they're doing there.

They have been rolling out ad features very rapidly, things like copying the connections with retailers, so you know if a purchase went through and can do all the tracking and things like that. I'm very interested to see how that goes. There's a bit where, had they leaned into advertising immediately, as soon as ChatGPT was a hit, I think they would have a killer ad product right now.

I think Google would be in much bigger trouble. I think Meta would be in much bigger trouble because if you have this flywheel—the thing about advertising with consumers is your ability to monetize the consumer—

Patrick O'Shaughnessy

Goes up as the volume goes up, yeah.

Ben Thompson

—is infinite because the advertiser is bearing the price increase, so there are zero elasticity issues. If you're charging consumers a price, if you want to raise the price, like Netflix, this is their problem with the subscription plan. How much can they raise prices before consumers rebel and drop a tier or give up the service entirely?

Charging people money is hard. Giving people things for free is easy.

Patrick O'Shaughnessy

Is easy.

Ben Thompson

And it's very frustrating that OpenAI did not pursue this sooner.

Patrick O'Shaughnessy

I know you've been spending time with some of the big money firms and sources of capital. What is your sense of their appetite right now, and how are they thinking about the future? Because I think this year it's going to be 800 billion or something that we're going to spend in CapEx. Next year is supposed to be 1.3 trillion, I think, is the current estimate. It's going to keep going up from there.

We're burning through all the compute that gets installed basically immediately. It's such a strange circumstance that we can use the capacity right away, as soon as it's online.

7. Compute Scarcity Masks Commodity Risk

Ben Thompson

Well, that's the thing, though. There are a few timing mismatches happening right now. We can't use it right away. All the bulls on Twitter are always like, "We don't have enough compute, we don't have enough compute."

We don't have enough compute because there was insufficient investment made in 2023 and 2024, which, yes, absolutely, is true. And by the way, if you think there's not enough compute, TSMC decreased its rate of growth in 2023, in 2024, and in 2025. Our shortage of compute is going to get worse in the next few years because the lead time for a fab is even greater than for a data center.

Today, when we say there's not enough compute, it's not like all the money that the companies are putting in today manifests in compute tomorrow.

Patrick O'Shaughnessy

That equals a shortage of compute, yeah.

Ben Thompson

No. It all manifests in compute in 2028 and 2029. On the calls, both Andy Jassy and Satya Nadella are out there saying, "Look, we're just building data centers. These are the shells. We might not use them now; maybe we'll use them in the future, and we only buy GPUs when we know there's demand for them."

That is a great story to tell. I'm not sure that I think it's a lot of BS because the reality is, if you've built the shell, that money is sitting there. You're not going to let it just sit there. If you've invested a fixed cost—and this is the whole logic of commodity markets—I think tech in general doesn't understand commodity markets.

Tech is, by and large, focused on: If I produce a highly differentiated product, and that differentiation could be software, it could be a network in terms of developers, it could be a social network sort of thing where we're peer-to-peer—where I'm highly differentiated—then my ability to charge higher prices provides my profit margin.

The classic example is Apple. They have their ecosystem, their software, third-party products, and all those things, so they can charge 50% margins on their iPhone. Everyone looks at Apple as the ideal business model. That's how you run a business.

But in a commodity market, the price is set by the marginal supplier.

Patrick O'Shaughnessy

Cost to serve is all that matters.

Ben Thompson

That's right. I had a good friend in Taiwan who is in shipping. It's a fascinating industry. It's kind of like the airlines, too, another industry that I love to look at.

You buy a ship, and the cost of that ship is depreciation. Your marginal cost is actually quite low. It's the fuel to run the ship, the cost of the crew, and your port fees. Not that much. What that means is, you're going to run that ship—

Patrick O'Shaughnessy

As full as you possibly can.

Ben Thompson

No, you're going to run it no matter what.

Patrick O'Shaughnessy

Yeah.

Ben Thompson

And you're going to bring down the price of a container as low as it needs to be to cover your marginal costs. Now, your paper losses in this situation might be very large because your accounting loss includes depreciation, but the depreciation is an accounting figment. You already paid the money.

You're going to run that ship at whatever the market will bear. And the container—the beauty of the container is that it is a pure commodity—the price in the market is going to be the marginal cost.

Now, if it gets low enough, at some point people will exit because their marginal costs mean they're actually losing money on a shipment. Not just paper money, but actual, real money. They will exit, but then the supply is diminished, so the price will go back up, and you get this interplay of coming in and out.

But then, if the market's very high, like it was during COVID, it's like, "Wow, we're making so much money right now because there's not enough supply." There wasn't enough supply of ships, so containers went from usually being 3,000 or 4,000 to 17,000 or 18,000. The amount of money that these shipping companies made in a very short amount of time was insane.

What happens, though? Well—

Patrick O'Shaughnessy

Build more ships.

Ben Thompson

Imagine if we had more ships, right? The problem is it takes 2 years to build a ship. If everyone makes this decision simultaneously, you suddenly have a lot of ships, the price plummets, and so forth.

Where we see this is in components, in memory in particular. Memory is famous for boom-and-bust cycles, with people entering the market late. But to what extent are data centers going to be memory makers?

Right now, everyone can see we don't have enough compute. So everyone's like, "We absolutely have to be investing because there's so much money to be made. And look at our payback period." The problem is, you're measuring your payback period in a time of scarcity. Is that payback period going to hold in a time of abundance?

The bulls say there's never going to be a time of abundance. AI—

Patrick O'Shaughnessy

We're going to be short forever.

Ben Thompson

That's test-time scaling.

Patrick O'Shaughnessy

Yeah.

Ben Thompson

We're going to be short forever, which maybe we will be. My concern is, even if that's right, we could still have an air gap in that there's so much money going into it right now and not enough has come online to actually make sufficient revenues to handle the situation where we run out of capital.

I believe in AI. I think it's a real thing. I think the economic impact is going to be astronomical. I think all the concerns about societal impact are very real and are going to come to bear in a major way.

You can believe all that and still be worried about whether we're going to make the bridge to this actually generating the level of returns necessary to continue fueling this going forward.

Patrick O'Shaughnessy

Can you zoom in on TSMC and the component makers where fabs are involved? So far, at least my understanding is that they've been quite conservative in their willingness to expand capacity and build new fabs, and they've not met the market's demand with similar growth.

Is that just rate-limiting this whole thing and preventing us from getting one of these giant overbuilds?

8. Chipmakers Shift The Risk

Ben Thompson

We can talk about a few different ones. We'll start with memory. Memory used to have tons and tons of memory makers. Every time there'd be a boom, memory makers would reenter the market. New countries would come in—Taiwan used to have a memory market, for example—but you would get these exact dynamics.

If there's a shortage of memory, there's so much money to be made, but you can't bring capacity online immediately. It's the same as shipping and the same as what we're seeing right now. That would spur people to come into the market, you'd get too much capacity, prices would plunge, and people would just get blown out.

The issue is that the upfront cost for these is so large, just like buying a ship. Building a fab is even more expensive. And memory now—the leading edges of memory are using things like EUV machines—so the costs are getting into the billions of dollars for these lines.

What happens every time with these boom-and-bust cycles is that some people would enter, and more people would get washed out.

You go through these famous historical moments for these memory cycles. Companies just get blown out. One of the most interesting memory stories is how Samsung sort of took over memory. They saw it as an opportunity, studied history, and realized that the way to take over the market was to invest into downturns so that they were ready when the next cycle came around, which requires a ton of guts, discipline, and money.

But they did that and basically wiped out the Japanese. That’s when the South Koreans generally took over the market in a major way. But it got down to 3, and the problem with 3 is that it’s not a monopoly, but it’s kind of an oligopoly. They all became a lot more disciplined about not making the mistakes of the past. They’re not colluding, but they’re all on the same page about not doing that.

I think that dynamic ran head-on into the current moment, where it just took a while for them to realize that there was a secular shift in memory demand that didn’t exist for a very long time. I think the memory solution will be solved eventually. The other risk they run is Apple’s lobbying to get Chinese memory. What is the number-one focus of algorithmic changes? How can we use less memory?

I think the memory makers probably screw themselves in the long run by creating such a massive target on their backs. I’ve analogized memory makers to Iran. The issue with the Strait of Hormuz is that it’s very effective. It’s more effective if you don’t use it, because then it’s always hanging out there as something you could do.

Now they did it, and it turns out it worked, but the UAE and Saudi Arabia are going to build pipelines and new ports. They’re not going to let this happen again. It’s very painful right now, but say Iran wants to close the Strait of Hormuz in 2035—it’s not going to have any effect because it will have been built around.

My concern for the memory makers is that they might have done the same thing. No one’s going to let themselves get into this situation again as far as memory goes. TSMC is arguably worse because there’s only 1. There is 1 company on the leading edge. Obviously, Intel and Samsung are trying to get there.

It’s the same thing. All markets carry risk, and a lot of the question is who ends up holding the risk? What I think a lot of the tech companies didn’t fully appreciate is the extent to which TSMC has offloaded risk onto the big tech companies.

The way they’ve done that is that the risk TSMC is worried about is overcapacity. If we build too much, it’s not just that we built too much and have all these fixed costs that aren’t being fully utilized. If we build a fab, we expect that fab to run for 30 years. We baked in too much capacity into the system for years and years and years. So they are very biased toward being much more conservative.

There’s a little bit of a culture component to this, too. One of the most interesting TSMC stories, analogous to that Samsung story, was that Morris Chang retired in the late 2000s. New leadership took over. There was the Great Recession, and so they pulled back their planned spending.

He comes in, fires everyone, and says, “The iPhone just launched. This is the biggest opportunity we’ve ever seen. We need to be investing, not cutting.” They invested through the Great Recession and through that downturn. That’s what laid the foundation for them taking over leading-edge semiconductors during that time.

Morris Chang is a one-of-one on my Mount Rushmore of the greatest and most impactful tech executives of all time. The entire fabless model is so critical to what tech is and what it does. There was also just the guts to do that at that time, particularly for someone who lived there, in a culture that doesn’t necessarily tend to make those sorts of bets.

TSMC was pretty conservative, to be totally honest. So what happens, though? Where did the risk go? TSMC is saying, “We don’t want to take the risk.” Risk doesn’t disappear. It just moves.

The risk is right now that every single big tech company realizes that if we had more compute, we could be making more money. So there’s lots of foregone revenue and foregone profits that are the manifestation of the risk TSMC handed off to them. Risk doesn’t disappear. It just gets handed off.

Sometimes that risk doesn’t manifest in losing money; it manifests in not making money. There is money not being made right now because they were very excited about 5G. They did a big wave of investment and expanded their fabs around 2020, 2021, and 2022. They said, “Oh, yeah, we’re good.”

Like I said, ChatGPT came out in 2022 and was a big thing in tech in 2023. In 2024, their growth rate went down. In 2025, their growth rate went down. In 2026, it’s up now.

It was very funny because I was writing about this a while ago, and then I think it was 1 or 2 earnings calls ago. Suddenly, C.C. Wei, the CEO and chairman, was talking about use cases for AI throughout the whole earnings call in a way he never had before.

This is why the memory makers are scared. Usually, there’s a bullwhip, and they’re worried about being at the end of the bullwhip, where demand happens and works its way down the chain. They’re at the end, and then they double down. It’s already too late. They’re wasting all their money.

I think the thing with AI is that if it’s a bullwhip, it’s the longest bullwhip of all time. There’s still so much to be built, and it just took a while for Asia to get the message to these companies. I think they’ve by and large gotten it, but once they get the message, it then takes several years for that to actually materialize.

Patrick O'Shaughnessy

Do you have a sense for how long you think it will take, given the extreme shortage of compute?

Ben Thompson

The interesting thing is what this means for Intel and Samsung’s logic businesses. I’ve been writing about the problem of this dependency on TSMC for years. One of my first articles, in 2013, was exhorting Intel. I said, “You have to build a fab business. You’re not going to be a designer anymore. There’s a huge business in manufacturing chips.”

I thought I was late writing it then. Their stock went to the moon throughout the 2010s as they rode the cloud wave. It wasn’t until 2020 that they finally realized, “We fell behind. By the way, there’s this huge opportunity. We’re totally unprepared for it. We don’t have a customer-service mindset or culture, organization, or all the IP building blocks—all these things that TSMC has.”

And they need a customer. They need customers to help them actually build a real foundry business. So I would write about this as a problem, and I would write about the China issue: You’re dependent on a company that is 60 miles offshore from our greatest geopolitical opponent, who thinks it’s theirs. These are big problems.

That’s where I came to appreciate this insurance issue. If a big tech company went to Intel and said, “Intel, you make our chip,” the biggest benefactor of this is going to be Intel, because it’s going to learn how to work with a partner. The biggest pain is going to be the big tech company, because it’s going to have to figure out how to work with Intel.

We could just go to TSMC. They are awesome. They are so great to work with. We know they’re going to do a good job. It just never made rational sense for anyone to go work with Intel. That was their fundamental problem.

In an unchanging world, TSMC would just win forever. But this is where TSMC, in some respects, made the same mistake as the memory makers and made the same mistakes as Iran, if I can continue the analogy.

Because they didn’t invest in the last few years, the shortages are going to be so acute. Big 10 companies that we're foregoing so much revenue and so many profits because they don’t have enough compute will go through the pain of getting Intel up to speed and getting Samsung’s logic business up to speed. The scarcity is what ultimately saved Intel.

I expect that at some point they’re going to announce some major partner for the first time, and it’s going to be a big deal. But ultimately, TSMC brought it on themselves.

Patrick O'Shaughnessy

It’s the “cure for high prices is high prices” thing.

Ben Thompson

For sure.

Patrick O'Shaughnessy

We’re going to route around them.

Ben Thompson

Yep. There are all these things that, as an analyst sitting on the side, you can write about, and it’s one of those things I learned: No one’s going to pay for insurance that they don’t need when that insurance’s expected value is negative.

The way to solve the geopolitical problem of dependence on TSMC is to come up with a compute use case that is so massive that everyone is economically incentivized to bring other people up to speed. Then we get the geopolitical insurance for free.

Patrick O'Shaughnessy

If you think about the top 10 or 15 technology companies, which ones do you think have the most interesting setups for their businesses today?

9. Tech Giants Choose Their AI Strategies

Ben Thompson

The answer’s always Amazon. The reason Amazon is so compelling is the extent to which they build for themselves. They are their first-best customer. They provide the scale to get basically anything off the ground, which they then sell to other people.

AWS is the most obvious example. AWS, contrary to popular thought, was not spare Amazon capacity. It took a long time to get Amazon.com onto AWS. What it drove was the understanding that we can’t be having so many meetings. We need to have compute that you can plug in—a pure API surface. You don’t need to talk to anyone; it’s just there.

And, oh, by the way, if we do that for our internal retail teams, we could do that for anyone. It turns out the retail business is so big, we have to start with everyone else.

AWS actually started serving external customers before it served internal ones, but now it serves them all. You've got other products like, say, logistics, where it was the opposite. Right now, we're using external providers for our logistics—UPS, FedEx, and USPS. We need to build this up ourselves. Now they've built it up themselves, and they're offering it to third parties. Other people can use their delivery services.

You see this in market after market. They're talking about some of their AI products or their chip products. What's the beauty of the Graviton or the Trainium, particularly the early versions? The early versions were terrible, but if you're on Amazon and you're using some of their managed services, like, say, their Redshift database service, they don't tell you what the processor is underneath that. You're just buying a managed service. So they can put all their crappy processors underneath the services they're selling, and that gives them the volume and capacity to—

Patrick O'Shaughnessy

It's better, yeah.

Ben Thompson

—iterate them and get better, and they get to the point where they can actually sell them externally. Because they were the first best customer for Graviton, Graviton got better. Because they were the first best customer for Trainium, Trainium got better, and now Trainium is obviously running Anthropic's AI products. We'll see if any of them take off. They have call-center software. Their call center, or their customer experience, is going through AI. By the way, it's pretty good.

Patrick O'Shaughnessy

I haven't tried it.

Ben Thompson

Moving back to America, I've been buying lots of stuff. Every summer, I'd buy lots of stuff in a very brief amount of time. Sometime in the last year or so, you can go on and you're clearly talking to a chatbot, but the chatbot does a great job, and it actually does take care of the problem, so you could see that starting to work in that regard.

They're building up these AI services for their own business that they're going to make broadly available, and some of them will work, some of them won't. It's such an elegant approach, given they have so many investments in the real world. Their core business feels so impervious to the model version of AI. It will benefit from AI, but their moat feels deeper than anyone's as far as their core business, and their ability to generate new business lines organically is very compelling.

Patrick O'Shaughnessy

What about Apple? They sat this whole thing out, it seems.

Ben Thompson

It feels like it might be a situation of better be lucky than good, to a certain extent. Apple has their whole ecosystem. At the end of the day, they do own access to customers, so they can get suppliers. This is the classic aggregator play: If you own access to customers, suppliers come to you, not the other way around. So they can get suppliers for their AI as needed.

To the extent it's true that people don't want to be productive and just want a chatbot, not only can Apple serve them a chatbot and finally get a Siri that works, but you can see a future where this absolutely can work on-device, and they don't even need to pay for inference costs because they're using the customer's electricity. I don't think we're quite there. There's a reason they're using Google Cloud and NVIDIA chips, but you can certainly imagine a future where that's the case.

They're in physical goods. Actually making phones is hard. Having retail and distribution for physical goods means they're more insulated. The smartphone is so perfect. It's small enough to fit in your pocket, but it's big enough to watch basically anything on. You can run your whole life on it. All your entertainment is there.

When we talk about customers who just want to be entertained, the TV is now an accessory. It's all on your phone. I don't see anyone taking over the phone. The question is: Is the phone always going to be the center? Or is there a bit where, particularly in the home, this is where OpenAI's efforts are very interesting, where you want an ambient AI that you just talk to and it tells you what you need?

Apple is the best positioned to provide that, but can they provide that without having leading-edge models? Can they provide that if they're so phone-centric, or is it like a Microsoft situation? Microsoft didn't miss mobile. They were very early to mobile. The problem is their mobile was a small PC. They assumed the PC would always be the center, and their phones were going to be something that was based on that.

Apple realized, "No, we need to reset." The iPod helped them realize that. Microsoft went with Windows and all that, but will Apple fall into a Microsoft-like trap, assuming the phone's so good it's always going to be the center, and then figuring out what goes around it? Or is this finally the time when ambient AI, the cloud—just AI in general being everywhere—can manifest through your phone, through a device, or on your computer, and is actually better and disruptive to them?

I think it's possible. I also think it's totally valid for Apple to double down on what they do. The other thing about the AI stuff is: On what basis should we expect Apple to be good at this? At the most crude level, AI is this probabilistic endeavor. Apple is the king of deterministic products.

A physical product—you ship that iPhone, you ship it once, and it's got to be good. If it's bad, it costs you billions and billions and billions of dollars. Apple's never had an iPhone recall. It's amazing. That care and decision-making and diligence and fierceness in terms of your supply chain, and making hard decisions, is very, very different from everything that goes into making great AI. I generally prefer companies to do what they're good at. So from my perspective, I'm fine with Apple not doing AI. I want them to keep making great devices.

Patrick O'Shaughnessy

Of the five potential frontier AI winners—OpenAI, Anthropic, Gemini, SpaceX AI, Groq, and Meta—which of those firms do you think has the most interesting setup?

Ben Thompson

OpenAI and Anthropic obviously are the riskiest, but also have the biggest upside. Never discount the power of belief. They think they're creating God. The most impactful things in history have usually been fueled by religion.

The 2 religious organizations in Silicon Valley are OpenAI, which is kind of like mainline, and Anthropic. They go to church every Sunday. They're sort of like evangelicals. It is core to their belief. That goes a long way.

The fact that you need to make a business work for you to survive goes a very long way. Google just needs search to not die too quickly. Meta has the huge advertising business. In a world where Meta was run by anyone other than Mark Zuckerberg, they would not be on the leading edge. That is one of the purest manifestations of founder energy, for better or for worse.

Their business is so amazing. You see them easily doubling down on that. Google has Google Cloud and TPUs, and they've been doing research in this. It makes sense why they're pursuing this. Meta being like, "Actually, we're going to hire a completely new team and we're going to start from scratch"—this, again, is pretty insane. Credit to Mark Zuckerberg in that regard. Again, you can decide whether that's a good idea or not.

And then SpaceX AI, data centers in space, the theory is there. Do they have to own their own model, though, to do that? They'd get better margins if they do. Then again, if we actually run out of data centers on Earth, whether through political opposition or power or whatever it might be, they can run whatever model they want, as we're seeing with them selling their capacity to Anthropic right now.

They're all pretty interesting. The case for SpaceX AI is probably the weakest because the data center-in-space play is so highly differentiated. If that plays out, I'm not sure to what extent they need to even have their own model, so why are you wasting billions and billions of dollars in the meantime? That's a fair question.

From a tactical perspective, I love the Cursor acquisition. That makes so much sense for both companies, and so I've been intrigued to see what they do. Meta is probably the most interesting.

Patrick O'Shaughnessy

You've written a lot about this recently.

Ben Thompson

I think there's a very good case to make that it is more reckless not to be on the frontier if you're a digital company. The counter to Meta is actually Microsoft. Microsoft is not on the frontier. Microsoft had $40 billion of free cash flow last quarter. Microsoft paid a $10 billion dividend last quarter. There's some money, but their play is, "Oh, we're going to play all these off each other. We're going to provide middleware. We're going to provide the platform that enterprises will build on us, and we're going to disintermediate the models."

I think it's a rational play. It's the IBM play of the '90s. History echoes. Everyone talks about Google following in Microsoft's footsteps, but Microsoft follows IBM, and you can see that to an extent.

Patrick O'Shaughnessy

What did IBM do? What's the analogy?

Ben Thompson

Well, IBM had this dominant position. We talked about it in the '70s, and then you fast-forward to the '90s, and IBM is this very distressed asset. The thought was that IBM needed to break up into all these different pieces.

Lou Gerstner comes in and takes it over. Gerstner's real key insight at IBM was, "We're pretty mediocre at everything." It's kind of like what I talked about with Microsoft before, and that's the price of monopoly. Once you've been a monopoly, you kind of lose your capacity to be good because you didn't need to compete anymore.

I think a lot of incumbent tech companies have this problem. It didn't matter what they did; they were going to rake in money. If you don't have the pressure, if you don't have the incentive, if you don't have the fear of death or the fear of God, as we talk about these monopoly companies—

Then you don’t do your best work. The problem is that once you lose that muscle, it’s gone. You’re just sort of fat and flabby. So what Gerstner realized is that the worst thing IBM could do would be to break it up into component pieces, because all those component pieces are actually not very good.

Our biggest asset is that we’re big. It’s like, what? No. What does it mean that we’re big? It’s the ’90s, this Internet thing’s coming along. There are all these companies that know they have to figure out the Internet, and they don’t know what to do.

They need someone who can come in, understand their business, and help them get online. That’s basically what IBM did. So they built out—and this is an echo of what’s happening now—a huge consulting force, and they put all their time into building basically middleware. They would go in and put this layer between a company’s old-school mainframe, which all these companies had, and modern web services on the other end, so they could have websites and e-commerce sites and all these sorts of things.

That gave IBM a 30-year lease on life. Yes, in theory, you could go get point solutions from all these hot Silicon Valley startups, but you don’t understand that. You don’t know how to do that. You know us. We’ll come in, we’ll create all this middleware, build this big consulting force to help you implement it, and you’ll get online.

IBM basically brought all of corporate America online. That’s Microsoft’s playbook. Microsoft will help you figure out AI. It will help you figure it out in a way where you’re not giving away the crown jewels to these companies. We’re going to build this platform, this harness, this sort of middle layer. We’re dependable, we’re stable. You know us. We have backward compatibility to the ’80s. You can build on us, and then we’ll manage all the changing models and what’s updating and do all those sorts of things.

Does that mean you’ll get the absolute best experience? No. Middleware saws off the sharp edges. You sort of get a lowest-common-denominator capacity. This is the oldest enterprise sales motion. How did Oracle go to market? Oracle went to market in the 1980s with Larry Ellison and another technology taken from IBM—or IBM just didn’t want it: relational databases. They said, “You don’t want to be locked into IBM. Relational databases you could run anywhere. Come with us.” The reason this is a joke is because Oracle—

Patrick O'Shaughnessy

Everyone’s locked in to Oracle.

Ben Thompson

—they lock you in more than anyone, right? But all enterprise sales are companies whose long-term goal is to lock you in, getting you on board by trying to make you scared of being locked into somebody else. All the cloud companies are like, “Oh, portability, whatever. You can do whatever.” They’re like, “Oh, just use our service that only runs on our cloud, and now you’re locked in.” That’s Microsoft’s playbook. It’s a very rational playbook, and I think it makes sense.

That’s why they have extra money, because they’re not on the frontier. They are building massive data centers, but they’re building data centers for inference. They’re not building them for training, and their story that they’re investing in response to customer demand is more believable in that regard. They’re not having to tell a fungibility story where they’re building big data centers for training that will be used for inference down the road, maybe.

Patrick O'Shaughnessy

Go back to this notion that it’s reckless not to be in the front.

Ben Thompson

The reason why that’s concerning, though, is that at the end of the day, why are we using Microsoft products again?

Patrick O'Shaughnessy

Because we did before.

Ben Thompson

To what extent does it actually make sense to have all these artifacts, all these documents, all these email inboxes? Can’t AI just do that? There’s a real threat here to Microsoft’s software business. The whole systems-of-record thing is funny, because one reason why systems of record are so powerful is that it’s so hard to move them somewhere else, because it’s a very tedious, repetitive job.

AI is actually surprisingly good at that. Microsoft isn’t so much a systems-of-record company. They do have some of the Dynamics business, but it’s the user interface. It’s where you actually interact with the computer.

That’s the part—when you see Codex, Claude, Cowork, or whatever—it is aimed like an arrow at the heart of what Microsoft has. In the long run, all digital companies are threatened, but Microsoft is very much so. Their strategy is sound. It’s also desperate in an existential way, and also in a they-might-pull-it-off-because-they’re-desperate sort of way.

Meta is not threatened immediately, but this is where my bullish view of AI comes in. I think all digital companies are threatened, and Meta is a digital company. They have software. One worry is that AI takes up more and more time. Time ultimately is Meta’s currency.

We saw OpenAI try the Sora thing, but it didn’t really take off. Social networks are actually pretty hard; they also cost a lot of money. It’s really interesting. So this came up with the creator-payment stuff.

YouTube very famously has paid creators from the beginning, and that’s a much bigger drag on the business than people appreciate, because YouTube has marginal costs for its content. Now, unlike Netflix, they don’t have to pay that cost upfront. They’ll pay it after the fact, so their revenue sharing is a better model than Netflix’s model. Netflix has to pay upfront for content and then ideally make more money. YouTube pays along the way, but Facebook, or Meta—

Patrick O'Shaughnessy

Pays nothing.

Ben Thompson

They pay nothing. Instagram is this unbelievable product that generates all this money for which Facebook pays zero dollars for content. It’s unbelievable.

It’s funny because you could see a world where, for YouTube, AI-generated content could theoretically be a positive, because the inference cost of generating content could be less than what they’re sharing with creators. For Meta, AI-generated content, to the extent they’re the ones generating it, is actually a worse margin profile than what they have today, because what they have today is free.

So they have attention. There’s a bullish world where Meta is actually very well placed, because in a world where we’re interacting with AI all the time, the desire for a human connection becomes greater, and it’s Meta going back to its roots.

One of Meta’s biggest mistakes, actually, was that Meta was always a social network company. They killed Snapchat, or stopped Snapchat’s growth, by realizing Snapchat was a great product: “Let’s layer it onto our network.” They brought their network to bear to kill Snapchat.

The reason why TikTok was just a blind spot for them is that TikTok is classified as a social network, and it’s not a social network at all. TikTok is an entertainment product. It doesn’t matter who you follow on TikTok. What you see on TikTok is a function of what you watched, and you’re going to get more of the same.

It’s a user-generated content network, and the insight from TikTok was that limiting the best content to your social network is an artificial constraint. We’re going to give you the best content from across the whole network, and the vast majority of content is going to be crap, but this is an absolute-numbers question. You don’t think about margins; you think about absolute numbers.

Even if the margin for great content is infinitesimal, if we have a ton of content, the absolute amount of great content is going to be very large. Then Meta is like, “We’re a social network.” Meta is serving you content from your network of people you know, and TikTok is serving you the best content from around the world. That’s why they took a huge chunk out of them.

Meta had to shift. That’s what’s happened with Instagram and with Reels: it’s not really a social network. It is an entertainment product that pulls from the entire network, and social networking is like the group chat.

It’s possible in AI, actually, that social networking is important again, because we actually want humans. We want to have some sort of connection to them. That will be interesting to see how that plays out.

But the other thing with the models is they’re so impactful on advertising. The biggest impact of the models—the biggest monetization right now—is probably not Anthropic or OpenAI. It’s the incremental gain that is happening for Google and Meta.

Most of the stuff is pre-LLM, but we’re getting to LLMs, whether it be generating advertising content. What do we want? We want verifiable domains. How do you verify if a generated image is good for an ad? Does the ad sell or not?

They actually can validate their image creation and their text creation in a way no one else can, and their validation is the ad marketplace—running a gazillion A/B tests on all these different things to see what works and what doesn’t. Most ads are a throwaway. It’s fine. The vast majority of ads don’t convert.

They have this massive advantage, this huge liquid market that is a verification machine, where the verifiers are humans deciding whether to click on that ad and make a purchase or not, but they’re doing it at global scale. That can actually create a feedback loop to make their products better.

You’re also going to get a world where ad matching is actually still fairly crude. Here are the qualities of the person; here are the qualities of the ad. It’s like you create an embedding, a vector calculation, and see what numbers match, and then you sort of match an ad to the person.

What do LLMs do? LLMs predict. We’re going to move to this world where Meta’s going to look at people and say, “This person probably wants to see this next,” and they’re going to go find that thing and show it to them. The potential upside in terms of showing people better ads that are more relevant to them is enormous. They only need to increase a few percentage points for the returns to be billions and billions of dollars.

This alone is worth Meta investing in being on the leading edge and having these amazing models. I think a big problem Meta has is that they don't tell this story. It's weird, but Mark Zuckerberg has the same problem Sam Altman does: he doesn't love ads.

They have the best ad business in the world. They have an ad business that I think is a societal positive. You and I have set up these little content businesses that make great money. Content is—you get a ride on social media. I grew up on Twitter, with people sharing my links. It was amazing.

If you're selling some product, the beauty of the internet is that there is a niche out there that wants that product. The question is: How do you find the niche? Facebook advertising. That's what it does. It helps products find the people who didn't even know they wanted that product, but when they get it, they're so happy they got it. That's a huge societal positive.

You have a new business from a new entrepreneur making a new product. You have customers who are happy they got something that they didn't know they would get otherwise. Those customers, by the way, got lots of free entertainment, and they didn't have to pay for it along the way. Meta made a bunch of money for itself and its shareholders, which is basically everyone in the world.

This is why advertising is great, and Meta's advertising in particular is awesome. I get frustrated that Meta doesn't talk about that. Mark Zuckerberg has never really talked about the societal benefits of advertising, except in passing, in 20 years. He's handed it off to other people to take care of, and maybe there's a bit where him not paying attention is why there is a certain grit and grind that goes into building an advertising business.

People get frustrated or have questions about data and all those sorts of things, and maybe there was a bit where he didn't want to be involved in it and washed his hands of it. But you saw this when Apple passed ATT, App Tracking Transparency. It was one of the worst antitrust violations in the history of technology: Apple unilaterally obliterating all these business models while they're simultaneously building their own advertising business and doing all this tracking. Why? “Trust us.”

Meanwhile, they're running these advertisements. Remember that advertisement of people on the bus, overhearing everyone around them and what they're saying? That was such a dishonest representation of how advertising works on the internet. You had Tim Cook in Congress talking about companies selling data. Facebook's not selling your data. That's valuable to them. Why would they sell the data?

Meta was not prepared to respond. I think you saw this with Sheryl Sandberg back in the day. On every call, she would talk about advertising and how great it is, and have a bunch of case studies of people who were benefiting from advertising and these new entrepreneurs. Then she left, and it's kind of like that hole never got filled.

It feels like it's a company that's embarrassed. “We make a lot of money from ads, but we got glasses and we're doing AI.” It's like, you have ads, and ads are awesome. I think if they had communicated that more consistently, they would be in a better place generally from a PR perspective. They would have been in a better place relative to Apple, and I think they would have an easier time right now convincing Wall Street: Let us invest.

The other problem is they've spent a cumulative hundred-some billion dollars on Oculus, which I hated all along, and so there's a bit of: Why should we let you spend money again?

Patrick O'Shaughnessy

The one major player and company that we haven't talked about much is Jensen and NVIDIA, and I'm curious how you would tie this back to the notion of not understanding commodity markets in Silicon Valley, whether or not you think compute ultimately is a commodity. I'm curious whether or not you think intelligence will ultimately be a commodity. It's interesting that intelligence and compute, which seem to be by far the most interesting and important topics in tech, both might be commodities and less differentiated than tech's prior products.

10. NVIDIA Faces Commodity Pressure

Ben Thompson

Well, that's always the case, though. The most interesting thing about the internet is free distribution. Bandwidth is a commodity. The fact that I can pull out my phone right now and connect to any information source in the world for free, free on a marginal-cost basis, is because it's a commodity. It changed the world. Commodities change the world.

There is an aspect of differentiated products: By definition, they have lower TAMs because there's an elasticity aspect to it. Not everyone can afford to pay for it. People's willingness to pay is going to differ, and your market is going to be constrained. Apple is never going to serve the whole world by selling a device, whereas Google can because it's free. That matters.

You're paying for a commodity, but to the extent it is available to everyone is the extent it is impactful. The internet is a commodity. It changed the world, so I don't think it'd be weird that intelligence ends up a commodity and changes the world.

Patrick O'Shaughnessy

Commodities often are not thought of as as good of businesses as these differentiated, high-margin products. I'm curious for your thoughts on Jensen and NVIDIA specifically.

Ben Thompson

NVIDIA's position is definitely unnatural. You look at NVIDIA—they've maintained all their margins. Isn't that amazing? It's 2026, and everyone's coming for them, and they're still charging however much money for a chip.

But they're actually not maintaining their margins, because of this whole question of circular financing. People talk about Lucent and things like that, and NVIDIA is providing a 25% backstop. If you actually ascribe a value to NVIDIA taking equity in the neoclouds or whatever, they guarantee they're going to buy all their compute through 2030. Why do they do that? So that the entity in question can get a lower cost of capital, so they can buy more GPUs—

Patrick O'Shaughnessy

Buy the stock chip.

Ben Thompson

—et cetera. But implicit in that is: Why do they get a lower cost of capital? They get a lower cost of capital because NVIDIA assumed risk. This is my point before: Risk never disappears. It just appears somewhere else. Taking on risk has a price.

There is a world where AI takes off, it never stops, and everything is fine, and NVIDIA captured all the upside of their risk. But there's also a world where, say, it's this new cloud they backed. A ton of compute comes to market. The hyperscalers have plenty of compute. They don't have enough compute. NVIDIA is paying for compute that no one wants. They just lost a bunch of money.

If you think about it, there's an expected value of that investment. That expected value is not 0. It's not 100%. It's somewhere in the middle, but that is a diminution of NVIDIA's profitability if you actually look at their business holistically. What that is is a price cut.

The price cut didn't show up in margins. It didn't show up in what they're offering, but a lot of what NVIDIA is doing is asking, “How can we maintain our margins even if, in the wide-view, sort of discounted-cash-flow, expected-value, holistic view of our company—” People do discounted cash flows, but are you actually considering all these pieces?

The reality is that moving stuff off the balance sheet, by and large, works, but they're doing all these deals to maintain what feels somewhat unnatural. We have seen price cuts. They're just manifesting in these very bizarre sorts of ways.

In the long run, I think the challenge is that their ultimate competitors are the hyperscalers, particularly Google and Amazon. Google and Amazon aren't just building their own chips; they're also looking to sell those chips externally. Google already made a deal to sell, like, 20% of its TPUs to Anthropic.

On the last earnings call, Andy Jassy practically confirmed that they'll be selling Trainium 3s, or maybe Trainium 4, or those Trainium chips, eventually externally. Which makes sense. That gives them a long-term buy into these companies. There's a huge amount of R&D that goes into developing chips. They get more leverage on their spend. It all makes sense.

By the way, they're not selling their chips on differentiation. They're selling their chips as commodities. NVIDIA's the one selling the differentiation. People aren't going to Amazon to use Trainium, so they're not cannibalizing the attractiveness of their cloud by selling Trainium outside. So they're NVIDIA's biggest problem, because what's the number-one advantage that the hyperscalers have?

Patrick O'Shaughnessy

Scale.

Ben Thompson

Lower cost of capital. It's a capital fight. They have a lower cost of capital than the neoclouds do. The neoclouds will buy NVIDIA left, right, and center.

By the way, it also makes total sense why SpaceX Si, like Elon's out there saying, “We will always buy NVIDIA because they're the best.” No, you'll buy NVIDIA because they're the most fungible. NVIDIA is truly the most fungible.

CUDA's moat is dramatically diminished because the models don't care what they run on, and that's what actually matters—what's built on top of the models. But it still matters. It's still something of a moat.

If you want to play the game SpaceX is playing, where we're going to build a lot and rent it out, but reserve the right to pull it back, of course you're going to be on NVIDIA, because the easiest way to rent it out is to be on NVIDIA.

You saw this very early, by the way. You go back to 2024, 2023, and NVIDIA starts talking about all these sovereign clouds. They start talking about—they tried to come up with these Neotron models. They had this thing in 2024, I remember. It was the first one where it was the rock-star GTC in San Jose, in this huge coliseum, and Jensen Huang comes out.

It was a very boring GTC. The old ones used to be NVIDIA demonstrating 50 gazillion things as they threw stuff at the wall.

They knew they had something with GPUs, and they were trying to find the use case.

Patrick O'Shaughnessy

Get people excited about them, yeah.

Ben Thompson

Once LM showed up, it was like, “Oh, we have the use case.” But they were coming up with all these enterprise offerings. I can’t remember what they were called, but they were these modules, basically, that, of course, were free, but only ran on NVIDIA. You could see what they were doing: They were trying to lock people in.

Intel is a good example here. AMD cleaned them out in hyperscaler sales because the hyperscalers would put in the effort to get things working on AMD versus Intel. There are still small differences even though they’re x86. Because they’re buying at such scale, the investment to do it is worth it to get a better chip, a lower price, or whatever it might be.

The part of Intel’s business that never floundered was selling to governments and selling to enterprises. They don’t have the resources of a hyperscaler. They’re not buying at that scale. They’re just going to keep buying what they had before. That’s why NVIDIA talks about selling to sovereign clouds. That’s why they talk about selling to enterprises, because they want to get into these markets where they’re not going to be balancing this chip versus that chip.

The hyperscalers have always been the threat to NVIDIA for that reason. They’re actually bigger. So you have this issue where the hyperscalers are the threat. The hyperscalers have a better cost of capital than the other companies Nvidia wants to buy them. That’s how you get this deal this week. I see this deal as a response.

That’s why it goes with the Google deal. Google can just issue equity. The shareholders don’t love it, but their monetization capacity is much higher than NVIDIA’s, or than NVIDIA’s customers’. I think what NVIDIA is hoping for—maybe they wouldn’t say this in so many words—is that if we get to a world where we actually run out of power, that’s probably good for NVIDIA. Because in a world where we’re totally constrained on power—

Patrick O'Shaughnessy

Everyone will want the best stuff.

Ben Thompson

—we have to get the best efficiency—

Patrick O'Shaughnessy

Yeah, yeah.

Ben Thompson

—the best token efficiency. And I think NVIDIA is still the most token-efficient, so that is a good world for them.

Probably the biggest problem for NVIDIA over the last couple of years is that I think the US has actually brought a lot more power online than expected. It surprised me. Whether it be what Elon did behind the meter, which has been replicated, or West Texas and natural gas, or even restarting nuclear plants—

Patrick O'Shaughnessy

You love how the US responds to these things.

Ben Thompson

It’s awesome. It’s actually one of the biggest encouraging signals about the US. I was writing early on, “Assume this is a bubble. You want there to be a long-term payout.” With the dot-com bubble, we got fiber in the ground. And, by the way, Google’s played this game before. Google built its business by buying up dark fiber. They had the killer search engine, but so much of the power behind what they do is because they bought up all this dark fiber that was basically free after the dot-com era.

Our core internet still runs on WorldCom fiber. That was a lasting benefit. The railroads—BNSF is throwing off money that’s going to Google from Northern Pacific and Jay Cooke selling bonds to retail investors. You want a bubble that produces something that lasts.

Very early on, it was like, “What’s going to last from AI?” The GPUs don’t last that long. Data centers, okay, fine, but what is it going to be? Power. It has to be power. If we’re in a world where this all blows up and we have way too much power, that is an amazing world to be in.

We’ve always been energy-constrained. Energy undergirds everything. What would it be like to live in a world of energy abundance? It’s hard to even imagine because our minds are so constrained by the fact that we’ve actually always been in energy scarcity.

I think we’ve done an unbelievable job. Power, for sure, is a constraint. It’s going to be a constraint, but I think it has taken longer to become a constraint than anyone expected, and I wouldn’t be surprised if that includes Jensen Huang. I think he thought insufficient power was going to be NVIDIA’s moat sooner than it happened.

It turns out that the longer we have enough power, the more time Amazon has to make Trainium better, and the more time Google has to make TPUs competitive from an efficiency standpoint. And if we get into a world where that happens, this is a world where those margins seem very hard to sustain.