[BidClub_]
Sharp Tech · · 33 分钟

(预览)Google开始起舞:Gemini周的赢家与输家,OpenAI面临广告难题

Andrew SharpBen Thompson

播客
TL;DR
  • Gemini 3 在基准测试中的横扫,确实验证了 Google 的回归,但不能证明每位用户都会体验到最强模型。 Ben Thompson 的基本判断是,这些分数“总体上是准确的”,因为 Google 拥有最终胜出所需的资源、经验和一体化技术栈;但他仍表示,自己既没有立场,也没有资格认证谁是“业界最佳”。

  • Anthropic 成为本周另一大赢家,因为编码是 Gemini 唯一没有领先的基准项目。 Thompson 认为,Anthropic 自他判断的 Claude 3.5 时代起建立的优势,持续得出人意料;Andrew Sharp 则说,这种优势“暂时构成护城河”。

  • 当团队可以针对测试进行优化、甚至作弊时,基准排名就很难解读。 Thompson 以 Llama 4 的专项版本为例:通过基准测试博弈来掩饰平庸模型,意味着“该有人掉脑袋了”。一位朋友对 Google 官僚主义倾向的概括是,它“围绕基准测试打造产品”,现实世界的翻译能力究竟如何,仍未有答案。

  • Google 的战略武器不只是 Gemini 3 的质量,还有一套可能长期低于竞争对手的 TPU 成本结构。 模型与芯片协同设计、更便宜的专用硅片,以及不必让 NVIDIA 抽取利润,叠加 Google 庞大的现金流,形成了 Thompson 所说的“相当具有毁灭性”的组合,不过其中部分规模化收益目前仍停留在理论层面。

  • ChatGPT 的装机量可能像 Windows 的生态一样,削弱技术上更强的 Gemini 对用户的吸引力。 Thompson 提到 ChatGPT 有8亿或9亿用户,但随后表示,别引用他关于这个数字究竟对应周活、月活还是日活的说法。两人都强调,改变用户习惯比争夺一块尚未形成的市场更难:“即便 Gemini 更好”,ChatGPT 也已经足够好,而且用户足够多。

  • 发布周的热度,正在超过用户辨别模型差异的能力。 Thompson 自己对比时,ChatGPT 在 UniFi 带宽控制和火鸡盐水腌制时长上都胜过 Gemini,后者还漏掉了至关重要的晾干表皮步骤;这些例子虽属个案,却说明了判断模型差异的难度,也呼应了 Sharp 对 iPhone 的类比:产品在持续进步,但越来越稳定,也越来越不惊艳。

摘要 · 为研究而整理的核心内容

1. Gemini 3 终于让 Google 按自己的节奏起舞

  • Sharp 以2023年的几句挑衅为 Gemini 3 定调:Altman 担心一个“慵懒的搜索垄断者”,Nadella 则希望这个“800磅重的巨兽”起舞,还希望外界记住是他让它跳起来的。Pichai 当时温和回应,不要“随着别人的舞曲起舞”;如今这句话已经变成 Google 逆袭叙事的一部分。

  • Thompson 认为,基准测试的问题首先是感知问题:对很多用户而言,AI 已经足够好,差异反而越来越难以察觉。“向下看比向上看容易”,而模型可能很快就会让几乎所有人都只能仰望,却无法可靠判断彼此的智力差距。

  • 模型能力依然“非常尖刺化”:它可能在一个领域表现出色,在另一个领域产生幻觉,也可能明显从 Reddit 抽取内容。因此,Thompson 觉得 AI 最有意思的地方,一是没有标准答案、创造力有价值的任务,二是正确性可以客观验证的任务。

2. 编码让 Anthropic 保住领先,也暴露了基准博弈

  • 在这套被报道的测试中,Gemini 领跑了除编码以外的所有基准项目,编码仍由 Anthropic 占据第一。Thompson 认为,Anthropic 在 Claude 3.5 左右发现了某种“让所有人都大吃一惊”的东西,形成了出人意料且持久的领先,因此成为“本周最大赢家之一”。

  • 编码尤其具有信息量,因为“代码必须能跑”:要么编译成功,要么失败;要么抛出错误,要么不抛出。这种可验证性既支持可信的测量,也支持强化学习循环——通过测试模型输出,再持续改进后训练。

  • 公开基准测试很容易被扭曲。Thompson 提到 Llama 4 的专项版本,并批评任何“通过作弊掩饰失败”的团队:底层模型平庸本身已经是一个问题,但“失败”加上“掩盖失败”,就意味着“该有人掉脑袋了”。

  • Google 的问题更隐蔽。一位朋友曾把它的官僚主义弱点概括为围绕基准测试打造产品——“你测量什么,就会得到什么”——因此 Gemini 的高分可能代表真实优势,也可能只是 KPI 优化。Thompson 的态度不是直接否定,而是继续放回现实世界里使用。

3. 日常任务刺破发布周叙事

  • Thompson 对模型的使用偏好已经随着实际体验发生变化:Grok 4 曾让他觉得是“一次巨大跃进”,但浏览器摩擦和疑似下滑的质量又让他回到 ChatGPT,后者在他看来反而一直在变好。他看重的是持续的实用性,而不是发布周的兴奋感。

  • 在一个 UniFi 网络问题上,Thompson 说 ChatGPT 解释了如何用服务质量策略限制访客带宽,随后提醒软件处理可能拖慢整个网络。Gemini 漏掉了这个选项,转而建议使用独立接入点,并通过100Mbps路由器或交换机连接——“第一,这个答案就很离谱。”

  • Thompson 认为,火鸡料理是一个他愿意相信自己真正擅长的领域。在他的对比中,ChatGPT 覆盖了解冻、湿盐水腌制,以及让火鸡裸露放置以晾干并烤脆表皮;Gemini 开始得太晚,也跳过了晾干步骤,意味着最后会得到湿软的表皮。“你要是想谈什么叫动摇信心,这就是。”

  • Sharp 的反驳是,这些发布越来越像成熟期的 iPhone:曾经令人震撼的跃进,如今变得更稳定,也“没那么性感”。Thompson 表示同意,但补充说,Google 不仅拥有强势的逆袭叙事,也有充分的结构性理由让人相信它最终会在技术上领先。

4. TPU 经济学把 Gemini 的质量优势变成更大的威胁

  • Thompson 原本就预计 Google 最终会造出最强模型:它研究这个问题的时间最长,拥有巨量资源,还掌握完整的一体化技术栈。Google 发明了 Transformer,但 OpenAI 更模块化的 Azure/NVIDIA 架构仍然先行一步;如今 Gemini 为 Google 的一体化路线提供了重要验证。

  • TPU 的可编程性不如 GPU,但结构更简单,制造成本也更低。Google 可以协同设计训练架构与芯片,围绕 TPU 的能力做架构选择;Thompson 将单体模型与 mixture-of-experts 系统放在一起比较,指出两者在通信和扩展能力上各有取舍。

  • 新一代 TPU 设计可能支持在不同系统或设施之间实现更强的扩展能力,但 Thompson 并没有声称 Gemini 3 已经验证了这一具体能力。此次发布真正验证的是,Google 的模型团队与硬件团队之间的协同“正在产生回报”。

  • 经济层面的结果,可能是一种“可持续的成本优势”:Google 不必支付 NVIDIA 的利润,使用更便宜的芯片,即便有 Broadcom 协助,也仍能保留大部分核心诀窍。再加上 Thompson 所说“前所未有地强”的现金流,Sharp 的总结就很明确了:现金比几乎所有公司都多,成本还有可能比所有人都低。

5. ChatGPT 的装机量可能压过 Google 的一体化优势

  • Thompson 纠正了 Windows 与 Mac 的标准历史叙述:DOS 及其软件生态早于 Mac 出现,而 Windows 继承了与这套装机基础的兼容性。Mac 更早引入图形界面,也可能是更好的产品,但 Windows 实际上先占据了具有经济决定性的那一层软件。

  • 这段历史也修正了“一体化系统总会输给模块化系统”的简单结论。消费市场奖励一体化,因为用户就是买单的人,而且“用户体验的质量没有上限”;企业采购则让表格和组织约束拥有更大影响力,即便 SaaS 已经推动了自下而上的采用。

  • AI 并不是从零开始。Thompson 提到 ChatGPT 有8亿或9亿用户,但紧接着表示,别引用他关于这个数字究竟是周活、月活还是日活的说法。迁移这些用户比争夺一块尚未成形的市场更难,Gemini 只是在体验上略胜一筹,未必足以改变行为。

  • Sharp 的反驳值得保留:Google 真正的胜利,可能是守住 Search,同时做大 Cloud 和 YouTube,而不是把 ChatGPT 用户全部转化过来。Thompson 最后的类比也认同这一点:消费级 AI 可能会重演 PC 时代——一体化的 Mac“更好,但这并不重要,因为所有人已经在用 Windows”。

Andrew Sharp

Hello, and welcome to a free preview of Sharp Tech. Hello, and welcome back to another episode of Sharp Tech. I'm Andrew Sharp, and on the other line, Ben Thompson. Ben, how you doing?

Ben Thompson

You know, Andrew, there is—

Andrew Sharp

Oh, boy.

Ben Thompson

Take, like, an NBA—

Andrew Sharp

Deep sigh.

Ben Thompson

... take, like, an NBA basketball player. There are sort of 2 curves in their career. The first is athleticism. When you come into the league, you might still have a little bit more of a peak, particularly if you need to put on weight. Giannis would be a good example of this: He comes in very spindly, very thin, and puts on a bunch of muscle.

Andrew Sharp

Mm.

Ben Thompson

But over time, you're going to peak relatively early in athleticism. Then it's going to go downhill, and yet we don't say a player's prime is when they're 23 or 24. We consider it to be usually when they're 27, 28, or 29.

Andrew Sharp

28, 29.

Ben Thompson

The other curve is the increase in experience and understanding of how to actually play basketball.

Andrew Sharp

The game slows—

Ben Thompson

The game—

Andrew Sharp

...down the further—

Ben Thompson

That's right.

Andrew Sharp

...you go in your career.

Ben Thompson

And it's good that the game—

Andrew Sharp

Yes.

Ben Thompson

...slows down, because your body slows down as well. And so there's this period where the athleticism has declined, but not enough, and the experience has increased to more than make up for it. Eventually—

Andrew Sharp

Mm-hmm.

Ben Thompson

...however, you can be as experienced as you want, and you just don't have it athletically anymore.

Andrew Sharp

The lines on the graph diverge a little bit too much. Blake Griffin, on Amazon's new NBA coverage, was talking about the moment he knew he had to retire. He was running up and down the court with Evan Mobley, and he was playing for three or four minutes. This was Blake Griffin on the Boston Celtics, three or four years ago, and there was a foul. He was standing at the free-throw line next to Evan Mobley, and he looked up at Evan Mobley, who had been running up and down the court like nothing happened. Blake Griffin had his hands on his knees and was exhausted, and he was like, “Man, it's time to go.” So is that what you're confronting, that sort of moment right now?

Ben Thompson

No, no. The experience is you just learn how to do things, right? You learn how to write, to turn something out every day, to be a professional podcaster. Even when you're not feeling it, when you're feeling tired, you sort of get amped up.

Andrew Sharp

Mm.

Ben Thompson

You're ready to do it. You learn how to do things like tease. There are segments in this podcast that I'm going to give a little hint toward. They involve getting old.

Andrew Sharp

Okay.

Ben Thompson

And I... So I like to think that my experience is improving and is enough to compensate for the horrific reality that we have a question on this rundown that has been on the rundown for a couple of weeks. I was sure we had addressed this question previously. I got in an argument with you. I brought in Dummen [?] to review it, a professional podcast listener. He's like, “No, I don't think you talked about that.”

And you know what? My memory, on which I've depended to a near-absolute basis my entire life, is something I've just unknowingly relied on. There are so many things that are based on, “I just remember.” “How do you cite that article from 2017?” I'm like, “I don't know, I just thought of it and decided to link it.”

Andrew Sharp

Yeah.

Ben Thompson

Fading fast, Andrew. I am facing my mortality. I am praying the experience. I am hoping that AI can save me.

Andrew Sharp

Well, at least yours is a colorful, age-induced dementia, because you are effectively imagining podcast conversations that we did not have on the show.

Ben Thompson

It's true.

Andrew Sharp

So—

Ben Thompson

So wait, I need the readers—if there is a question on this podcast that you think we covered before, you have to email in.

Andrew Sharp

Email in for Ben's sanity. Exactly. Make Ben feel better over the Thanksgiving holiday.

Ben Thompson

As long as we're looking ahead, I have a topic on here that's going to look ahead to Thanksgiving.

Andrew Sharp

Another tease.

Ben Thompson

Another tease.

Andrew Sharp

Okay.

Ben Thompson

That's right. And we will do a Thanksgiving episode next week per tradition, unless there's big news.

Andrew Sharp

Yep.

Ben Thompson

It was Thanksgiving three years ago when the OpenAI stuff went down.

Andrew Sharp

That's right.

Ben Thompson

We know because it was the Las Vegas GP. It was the first one, and it was—

Andrew Sharp

And we had to keep delaying the podcast. We were going to record in person in Las Vegas, and we had to keep delaying it because the news kept coming hot and heavy that week.

Ben Thompson

Right. I got back Sunday night, and I was delaying writing, which was good because Satya Nadella drops this tweet at around 2:00 a.m. “Oh, yeah, we're acquiring”—or whatever it might be—Sam Altman and Greg Brockman. Man, what a weekend that was.

So, barring something like that, we're going to have our silly, off-topic, massive mailbag. If it's about tech, it has to be clever and funny. We're not doing strategy breakdowns—X, Y, or Z. We're going to have a fun time. That's the plan.

Andrew Sharp

Indeed, and if you've got questions for that episode, please submit them by 8:00 p.m. Eastern on Monday. Ben and I will record the episode on Tuesday afternoon, but I have to put the rundown together Monday night. And by the way, as bad as you feel for imagining podcast conversations that we didn't have, I am heartened to know that you actually read the rundowns before we come on to record every episode. This is evidence.

Ben Thompson

We did have this knockdown, throwdown fight approximately 8 minutes ago, so don't give me too much credit.

Andrew Sharp

That's true.

Ben Thompson

But yes.

No, actually, you know what my thought was? My thought was I should not read the rundowns, because if I hadn't read this rundown previously and seen this question, which has been on there for a couple of weeks, I wouldn't have had this problem. So actually, I'm being punished for being prepared.

Andrew Sharp

Okay.

1. Google Starts Dancing

Andrew Sharp

Well, in any event, we are going to begin with Gemini and 3 quotes from 2023. Sam Altman in February 2023 said, “If I were sitting on a lethargic search monopoly and had to think about a world where there was going to be a real challenge to the way that monetization of this works and maybe even a temporary downward pressure, I would not feel great about that.”

And then Satya Nadella—

Ben Thompson

Where did he say that?

Andrew Sharp

What's that?

Ben Thompson

Where did he say that?

Andrew Sharp

He said that on Stratechery—in a Stratechery interview. That's right. I should credit the outlet here, okay?

Ben Thompson

Thank you.

Andrew Sharp

Sam Altman to Stratechery in February 2023. Satya Nadella to The Verge in February 2023 said—

Ben Thompson

We don't need to cite everyone.

Andrew Sharp

Fair enough. At the end of the day, Satya said, “They're the 800-pound gorilla in this. That is what they are. And I hope that with our innovation, they will want to come out and show that they can dance. And I want people to know that we made them dance.”

Ben Thompson

Look, I keep using the Altman quote because it's on Stratechery.

Andrew Sharp

Uh-huh.

Ben Thompson

But this is the killer quote.

Andrew Sharp

It's terrific.

Ben Thompson

So I guess we ought to credit The Verge. It's so good.

Andrew Sharp

And then another quote that I had missed at the time, but I saw as I was preparing: Google CEO Sundar Pichai with a nice, mild-mannered response—“One of the ways you can do the wrong thing is by listening to noise out there and playing to someone else's dance music.”

I totally missed that at the time, but it's a wonderfully nerdy response from him. So there you have it, Ben. That's where we were 2 years ago: Google moving to its own beat. Two years later, Gemini is here. It's beating the competition on every model benchmark but one, and we'll talk about the implications for a variety of AI players.

One threshold question, though: As an analyst, how do you handle the release of a new model like this? How much stock do you put in various benchmarking tests?

2. Benchmarks Are Hard To Trust

Ben Thompson

It's really tough, and it's actually something that I've thought a fair bit about. This is sort of going to be an issue, challenge, question, and reason for optimism for OpenAI, actually, which I think we're going to get to in a bit, perhaps per our recycled question originally.

Andrew Sharp

There you go. Another tease.

Ben Thompson

The reality is, AI is already so good for so many situations for so many people that it's harder and harder to perceive what differences there are.

Andrew Sharp

Yeah.

Ben Thompson

Now, you could argue that's because you're too stupid, which very well may be the case. At some point, AI is like... It's easier—how to put this? If you're smarter than different people—

Andrew Sharp

Mm-hmm.

Ben Thompson

...you can perceive the differences in intelligence. If you're not as smart as other people, they're all just smarter than you.

Andrew Sharp

Yeah.

Ben Thompson

And one of the fortunes of being in Silicon Valley and getting to know lots of people is that I've definitely talked to people who are much smarter than me, and I'm not sure how much smarter they are than me.

They’re just smarter than me. And I’ve talked to other people that I’m like, “Eh, I can kind of rate you guys.” I know sort of who’s where. It’s an uncomfortable topic, but you can see down easier than you can see up.

Andrew Sharp

Yeah.

Ben Thompson

And one of the challenges with AI is, if it’s not there yet, it’s going to get to the point where it’s sort of looking up for everyone.

Andrew Sharp

Mm-hmm.

Ben Thompson

And so, what’s the difference between X, Y, and Z? Now, AI also tends to be very spiky. There’s some stuff it’s just really good at, and some stuff where you can tell it’s making it up. It will hallucinate much more in particular topic areas, or it will just get stuff wrong. Or you can really see the seams: you’re just pulling straight from Reddit.

Andrew Sharp

Yeah.

Ben Thompson

Probably the most useful and important areas for benchmarking are areas like coding, for example, and the reason is that they’re verifiable.

Andrew Sharp

Mm-hmm.

Ben Thompson

And this is a point that I’ve been making again and again. Andrej Karpathy had a tweet along similar lines this week, where AI is the most interesting at the 2 ends of the extreme. The one extreme is where there’s no right answer; this is where hallucination is actually a positive trait. It makes up new stuff. That’s actually incredible.

Andrew Sharp

Yeah.

Ben Thompson

Computers have never done that before. The other extreme is where you know if something is right or wrong. This is why code, I think, has been a huge area, because the code has to run.

Andrew Sharp

Mm-hmm.

Ben Thompson

It either runs or it doesn’t. It compiles or it doesn’t. It throws errors or it doesn’t. And in areas that are verifiable, not only can you know how good it is, but you can also do reinforcement learning, where you can do post-training to make the base model even better by running it through a bunch of tests and then learning from them and getting better over time. So what’s interesting about these benchmarks is, by the way, the one benchmark Gemini did not come in first in was coding.

Andrew Sharp

Mm-hmm.

Ben Thompson

Anthropic is still number 1. Anthropic figured something out with, I think it was Claude 3.5, that blew everyone’s mind as far as coding, and it’s been a sustainable, persistent lead. Which has probably surprised me a bit. I don’t know what secret sauce there is and if it’s going to be figured out eventually.

Andrew Sharp

Right, is it replicable?

Ben Thompson

But that’s a very positive sign. Yeah, I think Anthropic was actually one of the big winners of this week, where their bread and butter is the one thing that Gemini did not beat, at least according to benchmarks.

Andrew Sharp

Yeah. They have a moat for now.

Ben Thompson

Now, the benchmark problem. Well, the other problem is the benchmarks are public. They do their best to keep the questions secret and adjust them and all these bits and pieces.

Andrew Sharp

That’s part of what I wonder about: are models just being trained to the benchmarks at this point, and how much do we really learn from any of this?

Ben Thompson

Well, sometimes explicitly. Like, Llama 4 released this benchmark-specific version, and it scored super high.

Andrew Sharp

Yeah.

Ben Thompson

I don’t understand the people who are critical of people in Meta AI being—well, set aside the superintelligence and who they hired. If you have a team that is disguising their failure by cheating, heads need to roll.

Andrew Sharp

Yeah.

Ben Thompson

There are multiple issues going on, not just in the failure, but in the cover-up and all those sorts of things. And Mark Zuckerberg—one of the many reasons he looked bizarre, I think, in the interview I did with him last year, and kind of dumb in, I think, the interview with Dwarkesh in the same week—is sitting out there on a spit trying to defend the fact that he has a team that was cheating on benchmarks to cover up their failure.

Andrew Sharp

Yeah.

Ben Thompson

That’s just not okay.

Andrew Sharp

Their failure being effectively a mediocre model.

Ben Thompson

That LaMDA 4 wasn’t very good. Yeah.

Andrew Sharp

Yeah.

Ben Thompson

It was a sort of poor model, and they’d sort of gone the right direction with this monolithic sort of approach.

Andrew Sharp

Mm-hmm.

3. Google Builds To The Benchmark

Ben Thompson

Now, the funny thing about Google and Gemini—this is not an assertion about Gemini 3. All I will say is that there was a friend I was having a discussion with, and this was a while ago, I want to say 6 months or so, where they were tongue-in-cheek characterizing the various AI teams.

Andrew Sharp

Yeah.

Ben Thompson

They were talking about the weaknesses in the teams. I think something about Anthropic was the goody-goody two-shoes bit: “Oh, we’re so special,” blah, blah, blah. The OpenAI bit—or they said that they reflect their founders. I can’t remember exactly what it was. I’m so sorry. I don’t want to speak for this person, who I’m not naming because I’m butchering whatever they said.

Andrew Sharp

I was going to say—

Ben Thompson

The OpenAI one—

Andrew Sharp

I have no idea what was trying to be said, even, but that’s fine.

Ben Thompson

Right, the OpenAI one was—the complaint about OpenAI is that it sort of kisses up to you all the time—

Andrew Sharp

Yeah, cloying.

Ben Thompson

—and it’s just telling you what you want to hear.

Andrew Sharp

Mm-hmm.

Ben Thompson

Right. And saying, “Yeah, that’s Sam Altman as well.” That was sort of the funny one as well. But Google was—Google builds to the benchmark. That’s part of the bureaucratic nature of a large company. You get what you measure.

Andrew Sharp

Sure, KPIs.

4. Gemini Faces Real World Tests

Ben Thompson

And so it’s just interesting that they made this observation to me a while ago, and here we are today, and Gemini’s blowing the doors off in terms of benchmarks, but does that actually translate in the real world? I don’t know. And it’s really hard. From my perspective, what I do want to do is use Gemini regularly.

Andrew Sharp

Mm-hmm.

Ben Thompson

When Grok 4 came out, it was a big leap forward, and I used it regularly. Then I got sick of using it in the browser on my desktop, where I use it the most.

Andrew Sharp

Yeah.

Ben Thompson

It got a little worse. ChatGPT seemed to get a little better. I went back to ChatGPT. So I do need to use it more.

Andrew Sharp

Yeah.

Ben Thompson

What’s interesting, for what it’s worth—and this is pure anecdata, which means it’s probably not worth anything—there were 2 extended discussions I was having with ChatGPT. I started on ChatGPT.

Andrew Sharp

Mm.

Ben Thompson

One was about a networking issue and one was about turkey preparation. Now, the networking issue I know enough to be dangerous, but I wouldn’t say I’m an expert. What I will say is that the ChatGPT answer blew the Gemini answer out of the water.

Andrew Sharp

Hmm.

Ben Thompson

It actually answered the question. It gave specific references, and it said why the solution I wanted was probably not a good idea. So I have all Ubiquiti UniFi equipment. I wanted to see: can I limit the bandwidth on the guest network? And you can do this through quality-of-service policies, but that’s going to kill your overall networking because it’s no longer on a dedicated hardware channel; it has to do it in software. Your whole thing will be slowed down. So it gives me this whole way out: “Yes, you can do it. This is how, but you might not want to do it because of why.”

Gemini didn’t even list the QoS option. Its option was to get completely separate access points for your guest network and put it on a 100-megabit router or switch.

Andrew Sharp

Yeah.

Ben Thompson

Number 1, bizarre answer. Number 2, there was an answer it didn’t get. So anyhow, whatever. That happens.

Andrew Sharp

Less comprehensive. Sure.

Ben Thompson

Yeah.

Andrew Sharp

One example.

Ben Thompson

That happens. I don’t want to give one example. Now, what I am an expert at, I would like to think, is turkey preparation.

Andrew Sharp

Great.

Ben Thompson

I’m a big believer in the wet-brine approach for turkey preparation. The problem with turkey is that people complain it’s dry. I have my own brine for poultry that I think is phenomenal. My chicken is world-class, and I’ve done turkeys in lots of different ways. I’ve done it in the oven. I’ve actually done it on the grill. It worked very, very well. I’m going to do a smoker this year, so—

Andrew Sharp

Have you fried a turkey yet?

Ben Thompson

I have not. I might try that in the future. I’m going to try the smoker this year. That’s sort of a new thing, but I do have the brining process down pretty pat.

Andrew Sharp

Mm-hmm.

Ben Thompson

And I was reviewing what’s the timeline from thawing the turkey—

Andrew Sharp

Look at this.

Ben Thompson

—to doing—

Andrew Sharp

Prepping. Love it.

Ben Thompson

Right.

Andrew Sharp

Leaving no—

Ben Thompson

And so I was like—

Andrew Sharp

—stone unturned before next week.

Ben Thompson

No, no, well, because you’ve got to start early. It takes 3 or 4 days to thaw, and then you would brine it. The key thing is that after the brine, you need to leave it uncovered in the refrigerator so the skin dries out, so you’ll get crispy skin.

Andrew Sharp

Hmm.

Ben Thompson

ChatGPT covered all that and gave me a good timeline. I’m like, “Oh, I should put this in Gemini.” Gemini skipped the step of drying out the skin.

Andrew Sharp

Oh, boy. Gemini forgot to throw it in the fridge to let—

Ben Thompson

Um—

Andrew Sharp

—the skin dry.

Ben Thompson

Really, you want to talk about a confidence shaker.

Andrew Sharp

Failed that benchmark.

Ben Thompson

We’re talking about Thanksgiving dinner, and it started out like, “Oh, start thawing on Sunday night.” I’m like, “What? That’s way too late. What are you talking about?” I go through it, and it’s like I’m going to pull it out of the brine. No, then you’re going to get soggy skin. Ugh.

Andrew Sharp

Oh, boy. Wow.

Ben Thompson

Nothing to do with the economic implications of AI. Probably totally irrelevant and just bad luck for Gemini, but it speaks to why this is very difficult.

Andrew Sharp

Yeah. It’s mystifying.

For me as a normie, it’s mystifying to know how much stock to put in any of these tests. Every model release is hyped for a week or so in advance. John Coogan of TBPN compared these releases to iPhone releases, where 10 years ago there would be mind-blowing leaps that would make the whole world stop, and now the improvements are steadier and less sexy than they were a year and a half ago.

That isn’t to say they don’t matter, but vibes-wise, it’s just sort of a shift as the ecosystem grows up here. Does that resonate with you at all?

Ben Thompson

Well, I think so, and it speaks to a couple of factors here. Number 1, Google does have the comeback narrative behind them.

Andrew Sharp

Yeah.

Ben Thompson

Narratives matter, right? That’s how you framed this discussion from the beginning. As a longtime professional NBA podcaster who is one of the biggest proponents of narratives, that led to one of your really terrible takes that Russell Westbrook should have been MVP as a 6-seed a few years ago, just because you love the narrative.

Andrew Sharp

Yeah.

Ben Thompson

This is a great narrative, right?

Andrew Sharp

Yeah.

Ben Thompson

There are also systemic, structural reasons why you would expect Google to have the best model. They have the most resources. They’ve been working on it the longest. They have this fully integrated stack, which at the beginning you would expect the integrated player to actually do better.

The whole theory is that through integration, when stuff isn’t good enough, you can solve a bunch of small problems and do it better. Over time, as you get to the iPhone level where everyone finds it boring, it starts making more sense to have component pieces and people competing at different levels.

We had the opposite. Google invented the transformer, but then we had OpenAI running on Azure and using NVIDIA—a much more modular approach—coming in and being in the lead. Even with all my turkey problems and my networking issues, my base assumption is that the benchmarks are broadly correct.

Andrew Sharp

Okay.

Ben Thompson

I would expect Google to eventually get the best model. If it’s now or it’s the next one, whatever, I’m not surprised.

Andrew Sharp

Interesting. We’re going to go company by company. You wrote about winners and losers on Wednesday after Gemini week, but one specific question I had on Google and the integration: Google trained this model on TPUs, their Tensor Processing Units, not NVIDIA GPUs. For Google’s prospects specifically, how significant is that detail?

5. Google Has A TPU Advantage

Ben Thompson

Pretty significant. I think everyone had this sense that TPUs—which Google started developing a decade ago, particularly the latest versions—like NVIDIA GPUs, actually, to be fair, were not tailor-built for LLM workloads.

That’s more important for the TPUs because they’re less capable and less programmable than a GPU. It’s like a simplified version of what a GPU can do, but a GPU actually does more stuff. It’s more programmable and can do more things.

Part of the reason GPUs are more expensive and more complicated is not just because NVIDIA charges a lot; they’re more expensive to make. They’re more complex chips, and a larger chip means you have more yield issues, et cetera, et cetera.

Andrew Sharp

Theoretically, they should be able to serve AI at a lower cost than everybody else with TPUs.

Ben Thompson

Well, yeah, especially once they get the right TPUs in place, in theory. Those TPUs can be developed, again at least in theory, hand in hand with their model development team.

The model, as they develop it, can inform how they decide to train it, for example. As I mentioned, Llama was monolithic. It was one big clump of digital neurons sort of figuring it out, as opposed to a mixture-of-experts approach, where you have different ones that light up in different places.

That presents its own problems in terms of crosstalk, traffic, communicating, and making sure you’re not overweighting one, et cetera, et cetera. This was in the context of DeepSeek, which used a very aggressive mixture-of-experts approach. They did it in a sort of unique way that let them do it with relatively low capabilities, which we should go back to in a moment.

For Google, there are architectural choices that go into training. Google can make those choices with knowledge of what TPUs are capable of. I believe that with the last generation of TPUs, they’ve been really focused on having much more scalability—not just one big system, but actually having much stronger assumptions around being separate, and even potentially being in separate facilities over time.

They’re building toward that, so you don’t need one monolithic, huge data center. You can actually do something that is in different locations, for example. All of which introduces a ton of cost and complexity, et cetera, et cetera. The more you can build with those things in mind, at least in theory, the better.

Andrew Sharp

Yeah.

Ben Thompson

So this is a validation—not necessarily of the different-locations thing, but whatever they’re doing between the model building and the TPU design is paying off. The implication is that they have a sustainable cost advantage going forward.

Number 1, they’re not paying NVIDIA margins. Number 2, TPUs are cheaper to make than GPUs. The margin advantage is probably the more important one. They get to internalize all that.

Andrew Sharp

Yeah.

Ben Thompson

Broadcom helps in some respects, but Google is doing most of the secret sauce. Broadcom’s margins aren’t going to be anywhere near what NVIDIA’s are, because Broadcom isn’t making the chip. Google is using some baseline. It’s more that Broadcom gets a percentage of the stuff, not that they get to charge whatever margin they want on top of it.

Andrew Sharp

Mm-hmm.

Ben Thompson

So, yeah, this is the real economic threat here, and it’s substantial. Google has huge cash flow—better than ever, by the way.

Andrew Sharp

More cash than anybody, potentially at cheaper costs than everybody else.

Ben Thompson

That’s right.

Andrew Sharp

Yeah.

Ben Thompson

That’s right. Pretty devastating combination. To the extent that this is validated, it’s a big deal.

Andrew Sharp

Mm-hmm.

Ben Thompson

We can get to what that means for the other companies, but, yeah, it’s validation. It’s not a surprise, but it is important validation.

Andrew Sharp

Yeah. So, if Google’s model, Gemini 3, is in fact best in class, what are the opportunities—

Ben Thompson

And for the—let’s assume it is best in class. Again—

Andrew Sharp

Yeah, for the purposes of this conversation—

Ben Thompson

I’m not in a position or qualified to say that for sure.

Andrew Sharp

Let’s assume—

Ben Thompson

Yeah, but yes.

Andrew Sharp

—that they killed it here. What opportunities for Google interest you most going forward in light of this success?

6. The Integration Advantage

Ben Thompson

What’s interesting is that, at least in past eras, the smartphone era is probably the best example. To go back to the beginning of Stratechery, I’ve told this story a million times, but at the time when I started, the broad sentiment was, “That’s neat that Apple invented the iPhone, but Android is going to obliterate them because modular beats integrated,” blah, blah, blah.

Andrew Sharp

Mm-hmm.

Ben Thompson

Look what happens to Windows versus the Mac. As I’ve noted, the Windows-versus-the-Mac analogy is actually widely misunderstood, most prominently by—

Andrew Sharp

Ahistorical, yeah.

Ben Thompson

—the late Dr. Clayton Christensen. But it’s just totally wrong. It wasn’t the case that the Mac was first and then Windows came in and ate its lunch. It was the case that DOS was first, rode on the coattails of IBM, built up a huge customer base and software ecosystem, and then the Mac launched.

Yes, the Mac was the first GUI, but Windows, which came later, ran all the DOS applications. So, actually, Windows was first when it came to the installed base and all those sorts of things. It’s not an applicable analogy.

Andrew Sharp

Yeah.

Ben Thompson

The iPhone was different because the iPhone actually was first, and Apple built up a customer base and a developer base that was not going to just leave and go to Android.

It's funny how these myths about the past basically permeate everything. Everyone's analysis is totally wrong because of it.

Andrew Sharp

Yeah.

Ben Thompson

I mean, it's the lowest-hanging fruit Stratechery ever had. If you actually change one of these facts about your understanding of what happened 20 years ago, your conclusions are going to be totally different. And boy, I could build a business just stating this very obvious thing.

Andrew Sharp

And now here we are. No, I was not aware of that history until about a year and a half into hosting this podcast, when it came up, and I cannot believe that people basically just got the facts wrong in terms of the sequencing of what happened.

Ben Thompson

Yep.

Andrew Sharp

And that informed—

Ben Thompson

Yep.

Well, because the sequence was that the Mac came before Windows, and the Mac famously sued Microsoft for stealing the concept, which of course Apple stole from Xerox—or borrowed. Great artists steal, whatever it is. It's understandable that this is the popular conception because the Mac did have the first GUI, the WIMP interface. Microsoft was second. But it misses the actual important layer: the software layer, third-party developers in particular, and the underlying OEM ecosystem. All that came before the Mac.

Andrew Sharp

Uh-huh.

Ben Thompson

Okay.

Andrew Sharp

So how does that relate to where we are and where Google might go?

Ben Thompson

Actually, it's interesting to contrast these two. And now—ugh—I'm actually regretting my update yesterday because I didn't dive into this. But that's okay. That's what Stratechery is for.

Andrew Sharp

Exactly.

Ben Thompson

So if you look at the smartphone era, that's sort of what you would expect, or at least what I would expect. The big article I wrote about this—it was arguably the article I started Stratechery to write—was “Why Clayton Christensen Was Wrong.”

Andrew Sharp

Mm-hmm.

Ben Thompson

It's a classic of the genre. You come up respecting someone, learn from someone; they're your hero. But to truly—

Andrew Sharp

Take a shot at a legend.

Ben Thompson

Break through, you gotta take ’em down.

Andrew Sharp

Make a name for yourself.

Ben Thompson

That's right.

Andrew Sharp

Of course, yeah.

Ben Thompson

So what he was wrong about was the insistence that modularization would always beat integration in the long run. One of my takeaways in that article is that consumer markets are different because the user is the buyer. There is no ceiling to the quality of the user experience. This led to Eugene Wei really expanding on the invisible asymptote idea: you could just always get better and better and better in this respect.

Andrew Sharp

Mm-hmm.

Ben Thompson

And so that meant that, actually, no, Apple wasn't going to be disrupted because consumers were not just going to decide, “Oh, this very abstract, spreadsheet-driven calculation of value relative to capabilities and suppliers and all this sort of thing—I'm going to switch to Android now.” All the examples Clayton Christensen used were in B2B businesses, where people are paid to be rational, to do spreadsheets, and to decide which one to choose.

Andrew Sharp

Yeah.

Ben Thompson

I pointed to all these examples—I think it was autos or consoles, or lots of other things; consoles was definitely a big one—that stayed integrated because their focus was on elevating the user experience in a market where the buyer is the user.

Andrew Sharp

Mm-hmm.

Ben Thompson

And so they're going to value that. Design matters in the consumer space in a way it doesn't always matter in the enterprise space. If you're the spreadsheet guy making buying decisions, one of your columns in your spreadsheet is user experience. It's not the driving factor.

Andrew Sharp

Right.

Ben Thompson

When you have to use it, that's why people complain about their enterprise software, right? It's because there are lots of other factors.

Andrew Sharp

It clearly has not been the driving factor for white-collar work over the last 30 years.

Ben Thompson

Right. Well, to some extent it did get better, and this is a great thing about the SaaS era and the whole bottoms-up philosophy: you win a team and then it spreads throughout the company. The good thing about that is that it necessitates it being good.

Andrew Sharp

Mm-hmm.

Ben Thompson

So you get evangelists within your company that buy stuff and spread it around. The quality of enterprise software went up dramatically in the SaaS era relative to what was before, but still nothing like the consumer market.

Andrew Sharp

I'm thinking of—

Ben Thompson

And so in that—

Andrew Sharp

The battles I wage with Microsoft Teams on a weekly basis.

Ben Thompson

Yes. Uh—

Andrew Sharp

That's what comes to mind when I think of—

Ben Thompson

Still pretty rough.

Andrew Sharp

Good enough—

Ben Thompson

Let me tell you—

Andrew Sharp

Solutions.

Ben Thompson

There's a reason we do use Teams for various things at Stratechery, and all our conversations happen in WhatsApp because it is much better.

Andrew Sharp

That's right.

Ben Thompson

So generally, in the smartphone era, we saw that integration is particularly powerful in the consumer market because you can deliver a better user experience if you're just managing the whole thing from front to end. Even if you're giving up certain efficiencies along the way, those efficiencies—having modular interfaces—are costly in terms of the user experience.

Andrew Sharp

Mm-hmm.

Ben Thompson

Because there are just rough edges that you're having to tie together. And as a rule, I think that's a useful thing to think about. The problem is that we're not starting from scratch today. ChatGPT is in the market. They have 800 or 900 million weekly active users. Don't quote me on weekly active users; it's monthly or daily, whatever.

Andrew Sharp

Yep.

Ben Thompson

It's a much more difficult task to get people to change than it is to win a market fresh. So even if Gemini is better, how many people are actually going to even try it, given that ChatGPT is still pretty good and better for unified networking and cooking turkeys?

Andrew Sharp

Totally. That's what I wonder about as everybody freaks out about Google. It seems like there's been an awakening of sorts to Google's dominance, but I'm unclear how much Gemini's model performance really moves the needle in that story. The big win here is preserving search dominance over the last couple of years and growing the cloud business and YouTube, et cetera. I understand why there's been an awakening to Google's dominance. It's just unclear what Gemini really means in that story because everyone I know still uses ChatGPT, not Gemini, and maybe that'll change, but I would guess not in the near term.

Ben Thompson

Well, this is where it's interesting to go back to the PC era and the whole point I just made: the PC era started out modular.

Andrew Sharp

Mm.

Ben Thompson

And then the integrated player came in, got a rabid fan base that was also very small, and never really got large.

Andrew Sharp

Yeah.

Ben Thompson

And that might be the better analogy for the consumer market in AI: the Mac was better, but it didn't matter because everyone was already using Windows.

Andrew Sharp

All right, and that is the end of the free preview. If you'd like to hear more from Ben and I, there are links to subscribe in the show notes, or you can also go to sharptech.fm. Either option will get you access to a personalized feed that has all the shows we do every week, plus lots more great content from Stratechery and the Stratechery Plus bundle. Check it out, and if you've got feedback, please email us at email@sharptech.fm.