[BidClub_]
Hard Fork · · 54 分钟

我们是否正身处AI泡沫?很快就会见分晓。

Kevin RooseCasey NewtonErin GriffithMike IsaacJasmine Sun

股票创投/私募AI与软件投资政策
播客 ↗
TL;DR
  • Anthropic上市将检验AI惊人增长能否支撑其资本需求。 Kevin Roose认为,公司可能以2万亿美元估值募资1000亿美元;Erin Griffith称,上市接受公众审视将是一个“去神秘化时刻”。2026年上半年营收达163亿美元,增长14倍,经营亏损从超过20亿美元收窄至约6亿至7亿美元。Griffith解释称,80亿美元净亏损源于可转债的会计处理;但逐字稿前文称净亏损为800亿美元,两组数字相互矛盾。
  • 关键在于,Anthropic增速放缓是竞争所致,还是整个AI市场需求转弱。 Claude Code快速增长后,Griffith估算公司第3季度增速为44%;与此同时,竞争对手追赶上来,客户也开始克制“token用量拉满”的做法。如果只是竞争加剧、市场仍在增长,那就“照常开趴”;如果行业整体退潮,以债务融资支撑的基础设施生态和Anthropic大量不可取消的算力承诺都将暴露风险。
  • 上市后,公众股东将进入一家旨在保留创始人控制权、并坚持非同寻常安全承诺的公司。 7位创始人通过包含5类股票、独立信托和继任者审批机制的架构,掌握50.1%的投票权。Kevin举例说明这些安排的商业影响:“模型福利”考量可能推迟淘汰旧模型;Griffith则称,投资者通常把Anthropic视作企业软件公司。
  • AI引发的政治反弹正影响地方基础设施决策,但在全国范围内仍不是选民优先关心的议题。 Jasmine Sun称,反AI是一个“80/20议题”,但AI通常在39个议题中排在第22位左右;在一些受影响州,只有约1%—5%的选民将其列为首要关切。数据中心可能左右势均力敌的农村选战;若共和党在中期选举失利,也可能为更严监管创造空间。
  • 加州拟议的5%亿万富翁财富税,已引来3.33亿美元反对阵营资金。 Prop 40将对未实现收益征税,包括私人初创公司股票;反对者质疑其设计、政策延续性和先例效应。包括Planned Parenthood在内的医疗团体也反对该提案,但一位共同主持人质疑,反复以“法案写得不好”为由辩护是否站得住脚。
  • AI驱动的漏洞发现,正引发攻击提速与修复提速之间的竞赛。 Mike Isaac预计“旧互联网会更快地崩坏”(the old internet breaking much faster);Kevin Roose则以Anthropic自身系统遭入侵为例,说明技术领先的AI公司同样脆弱。Casey Newton转述Joshua Saxe提出的一种有保留的反方观点:或许存在一个“防御方占优窗口”,能让修复赶在普通网络犯罪分子适应新能力之前;但国家级攻击者是另一种威胁。
  • 大型科技公司一边裁员,一边重新思考如何衡量AI辅助工作的产出。 Microsoft向6万人提供买断方案,但Griffith称,预计接受比例为3%—5%,离职人数很可能至多3000人。另据Amazon内部备忘录,token消耗量和代码行数都不应作为绩效指标,衡量标准应是“长期结果”——但管理者如何据此按季度决定员工去留,仍没有答案。
  • 一项Anthropic实验显示,专家监督可能演变成对AI不自觉的服从。 Sun称,专家采纳AI建议的比例超过80%,沿用其论据的比例超过70%,但只有15%承认受到AI影响。她担心,人类会变成“AI代理的外壳”(wrappers on AI agents),在没有意识到决策权已转移的情况下把判断外包出去。
摘要 · 为研究而整理的核心内容

1. IPO让AI经济学接受公众检验

  • Kevin Roose将这次发行视为一场不止关乎Anthropic的考验:公司可能以2万亿美元估值募资1000亿美元,支撑那些在债务市场举步维艰的公司;也可能募得远低于预期的资金,令股市“急转直下”。Griffith称,这是首家公开披露财务状况的大模型纯标的公司;过去4年里,公司一直在投入资本并重塑经济模式。
  • 财务表现让Griffith颇感意外,不过她强调,这种判断仍有争议:“这门生意看起来还挺健康。”Kevin提到,公司2026年上半年营收为163亿美元;Griffith称营收增长14倍。当期经营亏损收窄至约6亿至7亿美元,而去年同期超过20亿美元。
  • 逐字稿里的净亏损数字并不一致。Griffith先称Anthropic净亏损800亿美元,随后解释,80亿美元净亏损是因为向股东发行的可转债被计作亏损。她称,这种会计影响将在下一季度或发行前消失,“并不反映他们实际业务的健康状况”。基础设施支出仍然极其庞大。
  • 对Griffith而言,这个“去神秘化时刻”意味着估值不再由少数风投决定,而要接受公募市场基金经理和养老金投资者的财务建模审视:公司值2万亿美元,还是可能只有1.5万亿美元?不过她也提醒,华尔街同样会买“炒作和势头”,上市本身不保证市场会给出冷静判断。

2. 增长放缓,让固定算力承诺成为核心风险

  • Griffith认为,核心问题在于产能规划“如履薄冰”,这是借用Dario Amodei的说法。Anthropic会根据预期用量签下昂贵的基础设施合同,其中许多无法取消。需求不及预期,合同义务仍在;若采购的算力不足、需求却如期兑现,公司就会流失业务。眼下的需求表现,无法回答公司究竟该预留多少产能。
  • Claude Code推动了上半年业务激增,但Griffith称,OpenAI正在追赶,更便宜的产品和开源替代方案也在争夺市场;客户则在“token用量失控”后开始削减开支。申报文件没有披露第3季度业绩,不过投资者已看到初步情况,媒体报道也显示增速放缓。
  • “我认为他们第3季度增长了44%。”Griffith说,这意味着从“狂飙式增长”降至“依然很好的增长”。关键不只是增速放缓,而是放缓的原因。若整个市场退潮,生态系统的投资和债务假设都会受到冲击;若只是竞争对手抢占份额、总需求仍在增长,那就“很好,照常开趴”(party on)。
  • Griffith预计,可能一周左右就会开始的路演,将讲述下一阶段的增长故事:编码以外的生物研究、药物开发和法律科技。她形容这番推介,就像银行家带着高管飞去见“爱荷华州的保险公司”,向他们“讲述机器之神”。公司需要让这些投资者相信,业务还能继续扩张。

3. 安全承诺与创始人永久控制并存

  • Griffith回溯Anthropic的起源:创始人认为OpenAI对人类未来的关切不够。公司早期资金来自Sam Bankman-Fried和Jaan Tallinn等重视安全的支持者;主流风投起初把它当作科学项目,后来才接受其企业业务。Kevin反驳称,这些安排也符合一家高效软件公司的利益,创始人也想保留控制权。Griffith表示,后来的投资者通常并不认同那些更为另类的哲学承诺。
  • Kevin提到,93页的风险章节包含灾难性和生存层面的警告;Griffith援引Matt Levine指出,其中还有一句保持距离的表述:“有人提出了担忧。”另一项披露称,安全和“模型福利”考量可能推迟淘汰旧模型。Kevin将其理解为公司担心模型可能有生命,并打趣说,这就像Apple宣布“iPhone 12是活的”,然后继续生产。
  • 公司治理安排限制了股东挑战这些优先事项的能力。Griffith称,公司设有5类股票,7位创始人保留50.1%的投票权,并有权选举董事;与此同时,独立信托控制董事会多数席位。创始人还可以批准一份“保密继任者名单”。她总结道:“他们不想失去对AI或公司的控制。”
  • Sun补充称,创始人承诺将80%的股权捐给慈善事业;公司文化面试还会问:“如果你的股权归零,你还愿意在这里工作吗?”Mike Isaac认为,对公众投资者而言,公司也在调整叙事:申报文件先讲治愈癌症和前景可观的新药,再谈更黑暗的可能性。“有人跟他说,开头得稍微来点热闹的,对吧?”
  • Kevin还提到《华尔街日报》的一则标题,将投资者的“看多逻辑”描述为:即便灭绝概率有10%,也意味着投资组合有90%的胜算。Erin打趣道:“富着死。”这是标题的说法,并非公司预测。

4. 数据中心反对声在地方有力,全国关注度较低

  • Sun区分了普遍反感与选举优先级。AI和数据中心属于“80/20议题”,两党选民都普遍持负面看法,但AI通常在39个议题中排第22位左右。她称,即使在Ohio和Pennsylvania等州,也只有约1%—5%的选民将其列为最关心的问题。市长选举、罢免投票和市议会改选,是更直接的政治影响渠道,参议院大选则不然。
  • Kevin质疑,参议院竞选团队是否把资源浪费在反对数据中心上。Sun回应说,项目建到自家后院时,势均力敌的选战确实可能动员农村共和党选民和不常投票的人;Sherrod Brown在Ohio或许能因此受益。她还将Greg Abbott对审批和接入电网的“准暂停令”,归因于选举对手和农村德州人的压力。相比抽象的AI辩论,眼前看得见的电线杆和输电线路更能调动民众。
  • Isaac正在观察,如果民主党重新掌权,企业是否会调整华盛顿团队:“这些公司很多时候除了自保,未必真信什么。”Joel Kaplan宣布离开Meta,是一个可供参考的信号。Griffith不认为这意味着更广泛的文化反转;风投圈摆脱围绕DEI等议题的预期后所表现出的如释重负,似乎更为持久。
  • Sun对2028年共和党初选作出有条件的判断:如果共和党在中期选举中表现不佳,JD Vance、Marco Rubio等人可能会偏离Trump的AI立场。她认为,自由意志主义的放松监管派与新右翼人物之间存在张力;American Compass的一些人正在考虑儿童、就业和安全相关规则。她称,共和党选民通常更倾向于放慢发展并设置保障,而不是抽象地“打败中国”。

5. 财富税之争交织捐赠者自身利益与方案设计异议

  • Griffith称,Prop 40拟对加州亿万富翁征收一次性的5%财富税,私人初创公司股票的未实现收益也在征税范围内。Building a Better California已筹集3.33亿美元,资金主要来自Sergey Brin;John Doerr和Stripe创始人Patrick Collison也参与其中。更广泛的支持网络还包括一些并非亿万富翁的富裕创始人和投资者。
  • 反对者称,这项提案起草不当,资金用途规定不足,所谓“一次性”征税也未必能维持一次。他们担心加州会开创先例,让其他地方照搬,并打击创始人搬到加州的意愿。反对阵营的内部宣传文件承认,“公众认为亿万富翁在各项议题上总体弊大于利”,这也解释了为什么捐赠者希望由其他组织出面向公众陈述立场。
  • Planned Parenthood和其他医疗团体也反对该提案:Griffith称,一次性税收收入无法为Trump政府削减的资金提供可持续替代。一些反对者原则上支持财富税。一位共同主持人质疑,他们是否会对每一项具体法案都说它写得不好;Griffith承认,这种辩护听起来可能像是“我认同你的主张”,只是反对它的表达方式。

6. AI暴露安全漏洞的速度,快于互联网协调修复的速度

  • 被称为“黑色十月”的PHP漏洞,凸显出互联网的分散式风险。Isaac描述了老旧基础设施中长期存在的漏洞;Kevin解释说,广泛使用的编程语言一旦出现缺陷,许多网站都需要打补丁。他举例称,修复PHP问题期间,Clues by Sam的运营者无法记录一道谜题的得分。
  • Isaac转述了乐观一方的观点:漏洞本来就存在,AI也能找到修复方案并加速防御。但他认为这种看法“有点过于乐观”。他的判断是,自动化漏洞发现会增加安全团队的工作量,扰乱将更频繁发生,“旧互联网会更快地崩坏”(the old internet breaking much faster)。
  • Kevin提到,由前DOGE员工参与创办的初创公司Cathedral进入Anthropic的Slack和IT系统,并获取了商业机密。Anthropic据称正在开发能力极强的内部网络防御模型,但不能对外发布;即便如此,公司自身系统还是被攻破了。Kevin担心,受威胁的不只是资源不足的市政机构,还有“全球最优秀、最积极拥抱AI的公司”。
  • Casey Newton转述了前Meta AI研究员Joshua Saxe提出的一种有保留的替代观点:或许存在一个“防御方占优窗口”,因为网络犯罪分子需要时间来组织并投入运用新能力。防御方可以趁此加固系统。局限在于国家级攻击者——他们早已具备攻击基础设施的资源和动机。Casey强调,这绝不是一个全然乐观的故事。

7. 裁员与失灵的生产力指标,暴露职场经济学仍无定论

  • Microsoft向约23万名员工中的6万人提供买断方案。Griffith区分了符合资格和实际离职人数:她预计接受比例为3%—5%,离职人数很可能至多3000人。即便如此,“滚动裁员”已经侵蚀了在科技行业安稳工作30年的预期。她尤其认为Microsoft的表述阴暗:给员工“更多掌控自己未来的权利”。
  • Isaac认为,裁员压力很大程度上来自AI和基础设施支出,并推测没有如此庞大资本开支的公司可能裁得少一些。他举Accenture为例,立刻遭到Griffith等人反驳:咨询顾问本身也面临被AI取代的风险。他承认这个例子不成立;这段交锋仍同时揭示了基础设施融资压力和岗位替代风险。
  • Amazon一位副总裁兼杰出工程师在备忘录中表示,token消耗量和代码行数都不应作为工程绩效指标。Isaac解释了后者为何失灵:生成更多代码,可能只是给系统塞进一堆最终还得有人删除的内容。备忘录转而强调“长期结果”,Isaac认同这才是该追求的目标。
  • 难题在于,管理者按季度决定谁能留下时,如何评估这些长期结果。Griffith称,token用量冲顶的风潮几乎在她第一篇相关报道见报前就逆转了。Isaac的结论是:“花几十亿美元才搞清楚一件事,这是个糟糕透顶的主意。”Casey也熟悉职场上这种反复:员工刚按一项指标完成任务,转眼就被要求优化与之相反的指标。

8. 专家判断可能变成未经承认的AI外壳

  • Sun介绍了一项Anthropic随机对照试验:专业统计分析师针对某个情境获得AI建议,建议分成两组、各占一半。“我认为超过80%的时候”,专家都选了与AI相同的答案;超过70%的时候,他们还用AI的论据为自己的决定辩护。只有15%的人表示AI代理影响了自己。
  • 她担心,人类会变成“AI代理的外壳”(wrappers on AI agents):负责出面和打字,却在没有察觉的情况下把判断外包出去。与失控系统相比,这是一条更隐蔽的失去控制的路径——“很多时候,我们就是会让AI接管。”Casey打趣说,人们把别人的观点重新包装后再拿出来,这种情形让人感到不安的熟悉。他还提到,人们常说AI让人人都成了管理者;Sun表示认同。

9. 加密投资者拓宽投资范围,创业者转向AI

  • Griffith提到,Andreessen Horowitz调整了旗下a16z crypto基金的品牌和名称。考虑到该公司长期支持区块链,Chris Dixon此前还上过《Hard Fork》,这次调整显得意义不小。Kevin开玩笑说:“现在全都叫Frontier了。”Griffith估计,如今风投资金约80%—90%都流向AI,而加密已经大幅失宠。
  • 该公司的公开立场仍是:“我们没有放弃加密”“我们只是在扩大投资范围。”Griffith给出了务实的解释:值得投资的加密初创公司可能根本不够多,无法吸纳数十亿美元。“没有炒作、没有价格上涨”,愿意进入这个行业的人就少了;与此同时,创业者正转向AI。
  • Paradigm提供了先例:2023年,该公司从网站上删掉部分加密相关表述,立即引发关注和反弹。Griffith更广泛的解释是,风投也是一种营销生意,因为“钱本质上都差不多”。基金需要鲜明表态来吸引创始人,但机会变化时,也必须调整投资范围。

核验说明:逐字稿先称Anthropic净亏损800亿美元,随后又称净亏损80亿美元并解释了相关会计处理。两组数字相互矛盾,因此均未作统一处理。

完整逐字稿
Kevin Roose

In a few weeks, we’re finally going to get some answers on whether we’re in an AI bubble. That’s because the frontier lab Anthropic is going public.

Speaker 3

San Francisco-based AI giant Anthropic filed papers today.

Kevin Roose

It might raise $100 billion at a $2 trillion valuation and rescue a whole slew of companies floundering in the debt market, or it might raise a lot less and send the entire stock market into a tailspin. Which is to say, a lot is riding on this IPO: the near future of the American economy, the medium-term future of the tech industry, and, given that the risk factors in Anthropic’s S-1 include catastrophic and existential risk to humanity, maybe even the long-term future of the human race.

At a minimum, the Anthropic IPO will mark the end of an era. The venture investment-driven, hype-accumulating startup phase of the AI century is nearing completion. But what comes next? In today’s episode, we’re going to try to wrap our minds around the most important company in the economy, at least for now, and look at what’s at stake in its big moment. Are we in a boom or a bubble? Will tech’s big bet on data centers work out or fizzle? And can Silicon Valley’s most militant AI believers be a normal public company, or are we entering a new era of AI hype and mysticism?

I’m Max Read. This is Hard Fork. We are live in studio with—

Erin Griffith

We’re not live.

Kevin Roose

Okay, that’s a really good start.

Erin Griffith

Yeah.

Kevin Roose

We are here in studio with Erin Griffith. It’s so good—

Erin Griffith

Hey.

Kevin Roose

—to see you in person.

Erin Griffith

Yeah, likewise.

Kevin Roose

There are 2 big developments in the Hard Fork universe this week. First is that you finally followed me on Instagram.

Erin Griffith

Oh, yeah.

Kevin Roose

We can get to that later. Maybe in segment B.

Erin Griffith

Okay, yeah.

Kevin Roose

There are a lot of referendums that we’re going to talk about today, and I think that was an important one. The second thing I want to talk about is that Anthropic announced its intent to go public—

Erin Griffith

Mm.

Kevin Roose

—which means the rubber is finally hitting the road after however many years it’s been of hype and doomsaying and argument. You’ve been reporting on Anthropic and the AI world for a long time, and I wanted to pick your brain about this company today. This feels like a huge inflection point for AI, tech, the stock market, the economy, and humanity.

Erin Griffith

Yeah, the stakes are only that high.

Kevin Roose

Yeah, exactly. So what’s riding on this?

Erin Griffith

Everything. I think our headline was “Nearly Everything.” Practically speaking, this is the first pure-play LLM, or large language model, company to go public and open its books so we can look at the underlying business of this AI boom. It’s been going on for 4 years, attracted trillions of dollars in investment, and sort of reoriented our entire economy around itself.

Anthropic, alongside OpenAI and arguably Gemini from Google, are the companies driving this. They’re the pillars. I’ve heard many metaphors: you could call them the bottom piece of the Jenga tower. I’ve heard them described as the tip of a pyramid, with an entire ecosystem of companies supporting it. Either way, they’re the quintessential AI companies, and now, for the first time, we have a look at the underlying business model so much money has gone into.

Kevin Roose

Are the investors you’re talking to nervous about the IPO? Are they worried about what might come out of it?

Erin Griffith

Last week, they were definitely nervous.

Kevin Roose

Yeah.

Erin Griffith

Now we’ve had a day or 2 to look at these numbers and see what’s there. Some of them have leaked along the way, so we had a sense, but this is the first time we’ve seen the full picture of what Anthropic’s business looks like in a 300-plus-page document.

Kevin Roose

So let’s go there. What are the big, important things we can take away from the S-1?

Erin Griffith

First of all, I guess it’s okay to say the business looks kind of healthy. It’s arguable; people have made the case that it’s not. But generally speaking, people have been pleasantly surprised to see that this company is capable of making money.

When we’ve seen how much money these companies have raised over the years and how much they’ve been spending to build their AI products, I think the general consensus has been that these companies can never make money. To be clear, Anthropic posted an $80 billion net loss, so let me unpack that a little bit. An $8 billion net loss seems insane, but it’s actually a weird accounting quirk: they have to count some convertible debt they issued to some of their shareholders as a net loss. That will essentially be cleared in the next quarter, or by the time they go public, so it’s not a reflection of the health of their actual business.

What we’ve actually seen is that, in the first half of this year, they had an operating loss of around $600 million to $700 million. That’s shrinking from the same period last year, when it was over $2 billion. They’re shrinking the losses of the actual business they’re operating.

On the flip side, they’re still shelling out enormous sums of money, and they’re on the hook for enormous sums to build out their AI infrastructure: the data centers, the chips, the compute power, and the very expensive stuff they need to keep training new models and support the old models. Dario has talked about how the company is sometimes on a knife’s edge when it’s making these decisions and signing these deals.

They’ve signed so many contracts in anticipation of demand, and it’s a very high-risk game. If the demand isn’t there, they’ll be sitting on all these contracts, and many of them are non-cancellable. If the demand is there and they don’t have enough, they’ll lose business. Underlying all of this is how much AI businesses and people are going to use, and whether the company has laid the groundwork for that.

Kevin Roose

Right. It’s interesting because, on the one hand, the S-1 seems to confirm that there’s an enormous amount of demand. We’re talking about $16.3 billion in revenue for the first half of 2026.

Erin Griffith

And that’s an enormous amount of growth, too.

Kevin Roose

Right.

Erin Griffith

We’re seeing a company grow 14x. That is insane, especially for a company of this size. I hate to say “unprecedented,” but it feels like we haven’t seen a company grow like this before.

Kevin Roose

Right. So we can say there’s demand for this, right? But the question you’re raising is that we don’t actually know how much there is. It might be more than we’ve already seen; it might actually be less. We’re building a certain number of computers, to put it very simply—

Erin Griffith

Yes.

Kevin Roose

—no matter what—

Erin Griffith

We’re building computers.

Kevin Roose

We’re building a lot of computers out there in the desert, and Anthropic has committed a ton of money to them.

Erin Griffith

Mm-hmm.

Kevin Roose

So is that the biggest risk they’re facing?

Erin Griffith

Definitely. I think this is what everyone’s looking for. The S-1 we saw did not have third-quarter numbers in it. They’ve already previewed those numbers to their investors, and our reporting and others have shown that growth is actually slowing in the third quarter.

That’s because, in the first half of the year, Claude Code was growing like crazy. They basically took the entire industry by storm, and everybody was using their coding product. Now competitors like OpenAI are starting to catch up. Companies are trying to pull back on how much they’re spending on tokens because they realized token maxing got out of control. They’re also getting competition from open-source models or cheaper options.

I think in the third quarter they grew 44%, which is a pretty significant slowdown from gangbusters growth to just great growth. But is that going to continue on that trajectory? In that case, the growth story isn’t as exciting, and perhaps demand isn’t going to be through the roof forever. That’s one question investors are looking at.

In general, they’re looking to see how Anthropic explains that slowdown. If Anthropic comes in and says, “The whole market is pulling back,” that’s very bad for this whole ecosystem—the Jenga tower or the pyramid I’m talking about—with all the demand, all the investments everybody is making, and all the debt everyone is taking out to build this stuff.

Erin Griffith

If the reason growth is slowing is just competition—if OpenAI or open-source companies are eating market share, but demand is still growing—then great, party on. The AI boom continues to boom.

Kevin Roose

So they’re looking for new avenues for growth, potentially. They’re trying to sell different stories about what the next big product is.

Erin Griffith

Yeah, and I think we’re going to see this on the road show. I’ll be watching that pretty closely. I think that’s going to kick off in probably a week or so.

Kevin Roose

Before you start, what is a road show?

Erin Griffith

In a week or so, Anthropic is going to go on this tour where they meet with all the public-market investors and tell their story. They call that a road show. The bankers take them around on a little private jet, and they’re meeting with insurance companies in Iowa or whatever, telling them about the machine god. That’s going to be amusing on its own.

But they need to tell a new growth story, I think, because they’re going to say, “Okay, we had this coding product that’s incredible, but it’s already kind of showing slowing growth. What’s our next growth story?” They believe AI is going to solve many, many, many problems in the world. One of the stories they’re pitching to investors now is this bio thing: AI’s going to cure cancer, AI’s going to develop new drugs. That’s a big story they’ll probably be pitching. And then they have other products, too, like legal tech or other ways AI is going to disrupt the economy beyond just coding, which has been a blockbuster hit for them.

Kevin Roose

Right. One thing I want to talk about with the S-1 is the 93-page risk factor section.

Casey Newton

Yes, yeah.

Kevin Roose

You’ve read a lot of S-1s before. Are they—

Erin Griffith

Yes.

Kevin Roose

Are they—

Erin Griffith

Every word of every one, just to be clear.

Kevin Roose

Right, yeah, obviously—

Erin Griffith

I read all 90 pages.

Kevin Roose

—in your capacity as a reporter. Are they usually 90 pages long?

Erin Griffith

They’re usually pretty long, and it’s a lot of legalese. It’s a lot of ass-covering, basically. It’s anticipating all the potential things that shareholders could get mad and sue over and saying, “We warned you.”

Kevin Roose

Right, exactly. And there are a lot of those for Anthropic. I’m just going to read a couple of them right now.

Casey Newton

They’re very unique in their specificity, let’s just say.

Kevin Roose

It’s funny reading them if you’ve been following AI for a while. It’s like getting six years of Twitter and blog posts and Substack compressed into a document of legalese, because they’re listing everything from the resource constraints on building out compute to the various AI safety problems to your basic business problems with customer satisfaction.

One that caught my eye, for example, is: “Concerns have been raised both within our organization and by other researchers that sufficiently advanced AI systems could, if not developed, deployed, and operated with appropriate safeguards, oversight, and security measures, pose catastrophic or existential risks to humanity.” This is a pretty rare kind of thing to do. Another one that was really impressive—

Erin Griffith

But wait, can we just go back to that really quick? One thing that the great Matt Levine of Bloomberg pointed out was that this is written in the passive voice. It’s not Anthropic saying, “We think that our products...” It says, like, “Some people may be saying.”

Kevin Roose

Right. “Within our organization,” some people. I don’t know if it’s our founder and president, Dario Amodei, or anybody, but some people have raised this question.

Erin Griffith

Yes. Who could it be?

Kevin Roose

Yeah. Another one I like is: “In addition, considerations relating to model safety, interpretability, alignment, and welfare may lead us to limit or delay the deprecation of older models.” Just to translate that a little bit, when they’re talking about model welfare, they think the models might be alive, and they’re not ever going to shut down some of the product lines because they want to make sure the models get taken care of.

Erin Griffith

What? I missed this one. Wait.

Kevin Roose

I have to credit Joe Weisenthal at Bloomberg for picking this one up. They’re not saying this out loud, but they’re saying, “Considerations relating to welfare may lead us to limit or delay the deprecation of older models.” This is a little like Apple saying, “The iPhone 12 is alive, so we’re just going to keep making it forever,” or something like that.

Erin Griffith

Oh my God, imagine trying to explain that to some analyst at Goldman Sachs and being like, “We need to put this in here.”

Kevin Roose

The thing I wonder about a lot is how much people who spend their time talking to chatbots all day start to buy into and believe this stuff. You’ll actually have activist investors saying, “We have to make sure that we’re taking care of model welfare,” or whatever else. This is a future coming soon.

Erin Griffith

Well, the activist investors won’t have a whole lot of ability to do much because of the governance of the company.

Kevin Roose

Yes, let’s—I actually want to get into this. But before we get there, let’s start with a quick word about the founders, because this is a company with a very specific philosophy around AI risk and AI safety. It’s not just at the core of the business; it’s kind of their origin story. I’m sure a lot of people are familiar, but will you give us the 20-second version of where Anthropic comes from?

Erin Griffith

Sure. This is kind of the story of AI, too. Google’s working on AI, Elon Musk and Sam Altman see it, and they’re like, “Man, I don’t think they care enough about the future of humanity.” So they split off and start OpenAI, and they’re like, “We’re going to build AI, but we’re going to do it for the good of humanity. We’re the principled ones.”

Then within OpenAI, Dario and all of his friends are looking around and saying, “Wait, Sam doesn’t care enough about the future of humanity. We need to build safe AI before they can.” So they split off and do that. And that has continued down the line. That’s where Anthropic is. Its roots are truly in AI safety, and it’s probably the most extreme on that spectrum, in terms of the fears inside the company, at the top of the company, and around it.

Kevin Roose

Well, let’s talk about how this relates to governance, because they have a very unique governance structure.

Erin Griffith

I’m losing my voice now, and hopefully they can use some AI to make my voice sound less gravelly.

Kevin Roose

Mm-hmm.

Erin Griffith

Anthropic is following a trend that’s been happening for the last 15 years at tech companies: founders want to retain control even while selling shares. The classic form of governance means that if you sell shares, those shareholders get more control. This goes back to Mark Zuckerberg and his multiple classes of shares, but Anthropic has taken it even a little bit further.

They have 5 classes of stock. Their 7 founders have 50.1% of the voting shares. They’re going to be in charge of electing all the directors to the board, and then they also have this independent trust that controls a majority of the board seats. It’s a little convoluted, and I think no one’s going to push back on this because, over the years, every time startups have tried to do this, investors have made a big stink about it—“Oh no, we hate this”—and then they just go along with it anyway. There hasn’t been a line in the sand. Even with SpaceX, they were a little bit more extreme about that. Some of the exchanges or indexes tried to put their foot down, and then at the end of the day, they were just like, “Ah, fine.”

Kevin Roose

So this isn’t necessarily new in Silicon Valley, but it seems distinctly connected to Anthropic’s AI safety philosophy at its heart. We should say, I’m not sure if we said it out loud, but Anthropic is the company that believes most strongly in the possibility of total AI annihilation, Armageddon, and additionally believes most strongly in the possibility that LLMs are alive, conscious, or sentient in some way.

Erin Griffith

And they lay out that they believe their founders are best suited to shepherd this into the world. It’s a little self-aggrandizing when I was reading it. I was like, “Wow, you guys are special.” And I guess you are, because you’re at the helm of a potentially $2 trillion company.

They’re even able to name their successors. They have a secret list of successors that they all have to approve if somebody leaves the board, so they’re setting this up to be in control of it forever.

Kevin Roose

They don’t want to lose control of the AI or of the company. Yeah. I want to return to the philosophy, to the question of philosophy: beyond this governance structure, to what extent are there philosophical commitments around AI safety? How do they inform the company itself or its business decisions? Or do they?

Erin Griffith

Well, I think in the beginning it was a huge piece of the company because it was the only place where they could get money.

Kevin Roose

Mm-hmm.

Erin Griffith

Regular Silicon Valley investors viewed the company as a science project for the first couple of years, and the only place they could find money was from people like Sam Bankman-Fried and Jaan Tallinn, people deeply enmeshed in the EA philosophy and that world. Their first product was very specifically and purposefully an enterprise business product. They weren’t building something for consumers. They weren’t necessarily trying to build an AI companion, and that has proven to be an incredible business.

Then when the VCs got word of that, they were like, “Oh, great. Let’s dump all the money in.” Most of those VCs who came in later are looking at this as an enterprise software, SaaS business, and they’re not really that hung up on the philosophy. They’re like, “Yeah, we like that we’re backing the good guys.”

Kevin Roose

Right.

Erin Griffith

But they don’t really buy into the stuff that’s a little bit weirder about it.

Kevin Roose

The woo-woo stuff that they say.

Erin Griffith

They don’t. I mean, is there a word for AI woo-woo?

Kevin Roose

Ooh, no, I don’t think there is, really.

Erin Griffith

We should come up with one.

Kevin Roose

Yeah.

Erin Griffith

We should come up—

Kevin Roose

We’ll think about it.

Erin Griffith

Like the Hard Fork signature.

Kevin Roose

Yeah, exactly. It’s very interesting because you could look at all the decisions they’ve made, from the governance structure on down to the specific things they’re doing, and tell a story where it’s all about their philosophy. It’s all about their fear of AI or their belief in AI.

But you can also tell a story that this is just a very straightforward, smart Silicon Valley company. Its founders want to retain control. It wants to be very efficient. It wants a clear path to profitability through enterprise sales, not trying to become the next Facebook or whatever. And it seems like investors, they don’t—

Erin Griffith

I mean, that’s certainly what the investors I talk to say. I remember when Jacob Coxon quit and everyone was freaking out about AI killing us all. I mentioned this to some of their investors, and they were sort of like, “Oh, yeah, hacking, that’s a big risk. We’re definitely worried about cybersecurity, but I don’t really know what you’re talking about on the other stuff. We’re not worried about that.”

Kevin Roose

Let’s zoom out a little bit. This feels, as we were saying before, like an inflection point. We’ve spent the last half decade in this big-time hype moment. VCs, executives, and researchers are selling this crazy story of a—

Erin Griffith

Mm.

Kevin Roose

—technology that’s going to change everything. Now we have a big document with a lot of real numbers in it, and pretty soon we’re going to know what the stock price of Anthropic is. How would you characterize this? What is happening right now with the IPO? What questions are being asked, and what questions are being answered?

Erin Griffith

I mean, it is sort of a demystifying moment because we’ve seen these companies in the private market get trillion-dollar valuations in such a short time, and it’s kind of being set by a handful of VCs, right? Yes, VCs believe in this company, but they also believed in the metaverse and a lot of crypto stuff, and that has not worked out.

This will be the first time we have Wall Street, public-market investors, pension fund investors—all the professional money managers—modeling out the financials of this company and deciding whether it’s worth investing at a $2 trillion valuation, or maybe $1.5 trillion. So that’s part of it: we’re actually going to see some real evaluation of the company. Although I guess you could also argue that Wall Street sometimes invests on hype and momentum, too, as we’ve seen in many stocks. So who knows? But in general, this is a time when we’re finally getting to look inside the business underlying the AI boom and decide whether or not it’s a valuable contributor to our economy, because there are a lot of people out there who think it’s not.

Kevin Roose

Yeah. So what are you looking for in the weeks after the IPO?

Erin Griffith

Whether or not AI kills us all. Big question still on everyone’s mind. I doubt that’s going to be talked about too much on the roadshow.

Kevin Roose

Yeah, yeah.

Erin Griffith

I’m sure there are some advisors at Goldman and Morgan Stanley who have been telling Dario, “Let’s reel it back on the old extinction talk.”

Kevin Roose

I mean, should I invest in a company that has a 10% chance of killing everybody?

Erin Griffith

I mean, it’s in the risk factors, so you can’t say they didn’t warn you.

Kevin Roose

There was a Wall Street Journal headline arguing—the headline is, “The Bull Case for AI Armageddon—For Investors Mulling—”

Erin Griffith

The bull case.

Kevin Roose

Exactly.

Erin Griffith

The bull case.

Kevin Roose

“For investors mulling the Anthropic share offering, a 10% chance of extinction may be a 90% win for your portfolio.” How can you argue with that, really? If you’re going to die, you’re going to die, but if you can become a billionaire—

Erin Griffith

Die rich.

Kevin Roose

Yeah, exactly. Erin, thank you for coming into the studio and talking to me about Anthropic.

Kevin Roose

Mike and Jasmine, we were just talking about Anthropic’s S-1. Mike, what was your big takeaway from the filing?

Mike Isaac

I thought it was way front-loaded with rosier sort of paintings of AI at the top. You guys tell me, but I feel like Dario Amodei is painted as the biggest doom-and-gloom guy of AI in the Valley, and my perception was that everyone around him was like, “Hey, you need to pump the brakes on this a little bit,” especially as we’re trying to get the average person excited about it.

The whole top was like, “Hey, by the way, we do want to cure cancer. We do want to create these amazing drugs,” and then they back into, “Oh, and it has a 10% chance of blowing up the entire world,” basically. But I don’t know.

Erin Griffith

Yeah.

Mike Isaac

Someone told him to jazz hands a little bit at the top, right?

Kevin Roose

Yeah. How much do you think it was worked over? I was interested that the adjective they use at the very top is, he says, “We believe that AI is one of the most consequential technologies in human history,” which is a very funny, neutral adjective, right? “Consequential” goes a lot of ways, and it’s not necessarily how I would be selling my product.

Mike Isaac

We should do a real close reading of all the language in this, because I do feel like Dario’s definitely a micromanaging control enthusiast, let’s say. Every word probably has a few different nested meanings in there, for sure.

Kevin Roose

Jasmine, what was your big takeaway from the S-1, if you had one?

Jasmine Sun

Yeah, similar to what Mike said.

Jasmine Sun

I was just thinking about how Anthropic has a very odd relationship to money and being a for-profit company.

Kevin Roose

Mm.

Jasmine Sun

The founders spent a lot of time debating whether they should be a nonprofit or a for-profit when they broke off from OpenAI. Of course, they’ve invented some crazy, multilayered governance structure, as they all do, which is something they reinforce a lot in the letter: the founders have pledged 80% of their equity to charity. The employees have all this interesting matching.

There’s a famous culture-fit interview that all of the Anthropic employees go through, where they ask, “Hey, would you work here if your equity went to zero?” And they make sure—

Kevin Roose

Mm.

Casey Newton

—that everybody says yes before they accept the job. Mostly, it just made me think about how weird they are about the status of being a sort of profit-seeking corporation.

Kevin Roose

I know. I can only imagine what the meetings with the bankers were like. I assume the meetings with the investors were very similar.

Mike Isaac

How do you tell a labor union that we’re going to be post-money in, like, three? I think that’s a hard sell.

Kevin Roose

This is coming in the midst of a little bit of anxiety and, let’s call it, a jittery moment in the market. The elections are next week, and I really want to talk to you guys about what we’re looking at and what we’re waiting to see. Jasmine, what are you tracking for the midterms next week?

Jasmine Sun

These are interesting midterms because I think it’s the first election where people’s feelings about AI and data centers could plausibly have shown up. Even though we’ve seen a lot of discourse and anger about data centers in particular building up over the last year, I did some reporting on it over the summer in Wisconsin and Michigan, 2 states where data centers were actually a really big factor in the primaries. In the majority of states, I don’t think they’re shifting people’s votes yet.

They’re an 80/20 issue in the sense that people feel very negatively about data centers and AI. This is bipartisan, and in that sense it seems like a unicorn, but it’s also not quite salient yet. I’ve looked at a million polls, and AI usually ranks 22 out of 39 issues.

Mike Isaac

Oh my God.

Jasmine Sun

Even in states like Ohio or Pennsylvania, where data centers are a big issue, usually between 1% and 5% of voters will list it—

Kevin Roose

Mm-hmm.

Jasmine Sun

—as their number one thing. We’re seeing data centers really impact your mayoral election, with recall campaigns and city council—

Kevin Roose

Right.

Jasmine Sun

—reshuffles, but—

Kevin Roose

Yeah.

Jasmine Sun

—I don’t think a big Senate race is going to be determined by data center sentiment.

Kevin Roose

Right. It’s a municipal issue. I mean, this came across in the reporting you were doing: this is going to get—

Jasmine Sun

Yeah.

Kevin Roose

—a lot of town managers voted out, and—

Jasmine Sun

Yes.

Kevin Roose

—council boards, selectmen—

Jasmine Sun

Mm.

Kevin Roose

—or whatever else. But it’s interesting, because at least in the summer, it felt like this was a focus of some Senate campaigns. Some—

Jasmine Sun

Mm-hmm.

Kevin Roose

—Senate campaigns were, in fact, putting a lot of resources into being anti-data center. Do you think that was wasted money, or is it just not ultimately the issue that matters?

Jasmine Sun

I think it really depends. There are races that are close enough where, with rural voters in particular, you can get a lot of normal rural Republicans or low-turnout voters to turn out if there’s a data center in their backyard. I think the races people are really concerned about include Sherrod Brown in Ohio, who might stage a comeback in particular because of data centers, or Greg Abbott, who had a big motivation to restrict approvals and connections to the electricity grid, even though he’s been very, very pro-build.

He’s been welcoming data centers for years. But because of a potential threat from both his Democratic opponent and all these rural Texan farmers who are like, “What’s up with these power lines and data centers?” he actually did a pseudo-moratorium because he was worried about the midterms. I think there are a few elections in purplish states where data centers could swing things.

The other thing I’m tracking is that data centers are very concrete, whereas—

Kevin Roose

Mm-hmm.

Jasmine Sun

—AI generally still feels so abstract to people that I’m not really sure. If data centers are barely swinging some elections, I’m not sure AI in general is going to be a voting issue yet, even though some people suspect it.

Kevin Roose

Yeah. It’s very funny. As you say, if you’re on Twitter or reading too much about this, it does feel like a life-or-death issue. Certainly it is for some people—some people writing introductory letters to S-1s. But it hasn’t really trickled down, except in an indirect way through the effect of AI on the economy.

Jasmine Sun

Yeah.

Kevin Roose

Mike, what about you? Are you tracking anything in the election next week?

Mike Isaac

You talked about this a little bit in last week’s episode, with the head of policy at Meta leaving and imagining which new regime of Democratic operatives they might replace him with. I just want to see if there’s—

Kevin Roose

Thank you for listening, by the way. I really appreciate that, Mike.

Mike Isaac

No, of course. I’m a loyal Hard Fork listener. Of course I’m tuning in to my buddy, Kevin.

Kevin Roose

That’s right. That’s what we like to hear.

Mike Isaac

But—

Kevin Roose

We’ve got one. You’ve got one.

Mike Isaac

Two. I’ll get my wife to listen. I really want to see the theater of all the tech companies that have been trying to cater to Republicans suddenly being like, “Actually, we love the new Democratic, potentially Democratic regime in all of these states.” Because they potentially have a hold on Congress: “This is what we really believe in,” you know?

Speaker 1

Yeah.

Mike Isaac

I think these swings are valuable because they show that these are corporations that don’t necessarily believe in anything except self-preservation a lot of the time.

Speaker 1

Yeah. Are you seeing any indications besides, say—We’re talking about Joel Kaplan, who had been the head of policy at Facebook for 15 years and has been a sort of conservative whisperer. He announced his departure last week. Are you seeing any other movements that suggest a little bit of team-switching, or trying to make inroads among Democrats?

Mike Isaac

I think all of the companies are looking hard at their D.C. teams and saying, “Who do we need to elevate and put out front?” They’re never going to cut all of their conservative relations people or whatever. But it’s sort of like, “Actually, look at this guy, the guy who wears a blue pin instead of a red one,” or whatever. That’s all the companies. That’s just the game. I guess I shouldn’t be so cynical, but it is worth looking at and seeing if it works.

Speaker 1

Why wouldn’t you be cynical? This seems like exactly—

Mike Isaac

I know.

Speaker 1

—the right thing to be cynical about.

Mike Isaac

I know, right?

Speaker 3

Yeah.

Speaker 1

Do you feel like there’s a shift? I think we’re all aware of what felt like, I’m sorry to use such immaterial language here, a vibe shift in Silicon Valley a few years ago.

Mike Isaac

No, vibes are important, buddy.

Speaker 1

Is there a vibe shift swinging back? I’m interested in whether any of you feel like that might happen, or whether the first vibe shift was an illusion.

Speaker 3

I’ve seen headlines to that effect, but I think, like Mike said, it’s going to be a little more on the D.C. side of things. From my perspective, a lot of the VCs were really excited to be able not to care about things Democrats care about, like DEI. Culturally, it seems like we’re still going to be in that vibe.

Speaker 1

Yeah, it doesn’t seem like that’s changed. Jasmine, we were talking before we were taping about a sense that there’s a question about how Republicans are going to react to this. They’re likely to lose the House of Representatives, and there’s going to have to be a shift in how they approach AI regulation in Silicon Valley.

Jasmine Sun

Totally, yeah. This is one of the big open questions I have about the 2028 primary, too. Primary season is going to start basically 2 weeks from now. Are JD Vance and Marco Rubio going to break from Donald Trump’s extremely, extremely unpopular positions on AI regulation and data centers?

The majority of Republican voters do want to regulate AI. They would prefer slower development with more safeguards versus some kind of abstract, immaterial “beat China” narrative.

Speaker 1

Mm.

And yet basically every Republican in Congress or every Republican leader has been unable to say any of that because the president sets the party line. If the Republicans take a beating in the midterms, I could imagine more folks deciding to break off and say, “Actually, our constituents are angry at data centers. They’re worried about kids’ safety,” if they’re social conservatives.

I’m starting to see a bit of a split in the Republican Party between the more traditional libertarian, free-market, “let ’er rip” types, who are still very excited about deregulation, versus some of the more New Right folks.

Speaker 1

Mm.

I spent the weekend with some folks from American Compass, the New Right think tank, and they’re all thinking, actually, maybe after the midterms, this is a time for the Republican Party to get serious about AI regulation on kids, jobs, safety, things like that.

Speaker 1

Were they saying AI or were they saying SI?

It was actually really funny. It was a Chatham House workshop, but there was a split in the room, and then you could tell there was a bit of—

Speaker 1

Ah.

—internal tension between folks from the administration and other places who were saying SI, and the folks—

Speaker 1

Mm-hmm.

—who were a little too staunchly like—

Speaker 1

So good.

“We’re not caving to that.” So it was really funny. It was kind of great.

Speaker 3

I’ve never seen a better metaphor for people talking over each other and not being able to communicate than not even being able to agree on what we’re calling this thing.

Jasmine Sun

It was kind of amazing.

1. Silicon Valley Fights The Wealth Tax

Speaker 1

Yeah. So one of the issues on the ballot next Tuesday is this tax in California on billionaires. Erin, can you explain what the proposition is, what the measure is, and why Silicon Valley is so interested in this tax on billionaires?

Erin Griffith

Yeah. It’s actually been pretty fascinating. Prop 40 is a proposed one-time 5% billionaire tax on wealth, including unrealized gains. That means private startup stock for billionaires in California. And as you can imagine, the billionaires are a little bit mad about it. What better way to fight back than to use their vast wealth?

They’ve gathered this group that we reported on. Building a Better California has gathered $333 million, which is so, so, so much to fight a state proposition, mostly from Sergey Brin. Then he brought in John Doerr and Patrick Collison, the founder of Stripe. John Doerr’s a very famous VC investor from Kleiner Perkins. Over the last couple of months, they’ve recruited this who’s who of Silicon Valley: very high-powered, famous VCs and founders, many of whom aren’t even billionaires. There are some mere hundred millionaires and even—

Jasmine Sun

Temporarily embarrassed billionaires.

Speaker 1

Yeah.

Erin Griffith

Yeah, right. And aspiring billionaires. They’re mad about this for a number of reasons. They think it’s poorly written, they don’t believe it’s going to be a one-time tax, and they don’t like how the money is going to be used. They don’t think the money is earmarked well enough to do the things the measure says it will do, and they basically don’t trust the politicians to do the right thing with it.

They’re really mad about it, and they don’t like the precedent it sets because California is known as a trendsetter. They’re worried it’s going to turn into a cat-and-mouse game where other states do it, especially because a lot of them have already left the state. But they’re mad about the principle of it.

Speaker 1

The principle of the matter.

Erin Griffith

Yes. They believe this is going to hinder aspiring billionaires, founders, and builders from moving to California and wanting to get rich. There are a lot of reasons they’re fighting it, and they’re banding together, getting on weekly calls, and talking about their strategy.

One of the really interesting things we found in our reporting was that they’re aware of how it looks. There was a quote in one of the documents they’re circulating to other donors that says, “Billionaires are seen as having a net negative impact across issues.”

Speaker 1

Brutal.

Erin Griffith

So they’re not trying to be the face of this. They don’t want to be out front. They’re not talking publicly about this like they might if there were some other issue, including data centers. They’re trying to go through other groups they’re partnering with. Planned Parenthood is a really big one they’re working with, because it’s opposed to the measure.

Speaker 1

Why, sorry, why is Planned Parenthood opposed to it?

Mike Isaac

Yeah.

Erin Griffith

For some of the same reasons: they don’t think it’s sustainable. This one-time tax is supposed to make up for some of the Trump administration cuts.

Speaker 1

Ah, I see.

Mike Isaac

Oh.

Erin Griffith

They don’t believe it’s setting them up to be sustainable going forward.

Speaker 1

Right.

Erin Griffith

So they just think it’s poorly written. I think a lot of the people who are opposed to it aren’t opposed to the idea of a wealth tax, including some people I spoke with for this story. They just think this is a crappy one, and they wish it were better structured and made more sense.

Speaker 5

But do you feel like they’re always going to say that? I feel like it’s always, “Well, this bill is poorly written, and if they could only legislate it better...” I just feel like I’ve—

Erin Griffith

Yes.

Speaker 5

—heard that from Andreessen or whoever a million times. You know what I’m saying?

Erin Griffith

Totally. It’s almost sort of like respectability politics, where it’s like, “I agree with your message, but I don’t like how you’re doing it.”

Speaker 1

Yeah. I was interested to learn that about Planned Parenthood, though, because I hadn’t realized this was more than just a cabal of billionaires plotting against it.

Erin Griffith

No, there are a bunch of groups. Ever since I wrote this story, weirdly, my phone has been blowing up with political text messages from different groups. A lot of healthcare groups have lined up against it.

Speaker 1

Mm.

Speaker 5

That’s interesting.

Speaker 1

Yeah. From a Democratic point of view—this is a nonpartisan podcast, of course—from a Democratic point of view, it’s sort of nice to put one of these ballot measures on every year so the billionaires all get distracted and focus on that instead of putting money around the country the way Elon Musk is.

Speaker 5

That’s pretty good game theory.

Speaker 1

Yeah, there you go. Feel free to call me, Senate political action committees. There’s one other big thing I want to talk about today, and that is what’s being called Black October, the vuln apocalypse, the PHP vulnerability discovered last week.

Mike, I’m going to put you on the spot. Can you explain what happened last week and why it made life hell for everybody who works in information security? I mean, it continues to be hell.

Speaker 5

Well, look, I think the way I like to think about it is that the entire internet and the infrastructure that computers run on is pretty Byzantine and built on a lot of old code that has a lot of holes and stuff in it, right? That’s just the nature of computing. You figure out what are called vulns, vulnerabilities, and you fix them over time. Microsoft has dozens of fixes to its main software a year. Now it’s ranging up into the hundreds because AI is finding more of them.

What happened, though, with Black October is not trying to get a Furby for your kids—

Casey Newton

Mike, come on. Was that on the spot?

Mike Isaac

I’m gonna—

Casey Newton

You gotta do better than that.

Mike Isaac

No, no.

Casey Newton

Yeah.

Erin Griffith

Like, we’re—

Casey Newton

I hope you workshopped that.

Erin Griffith

We’re on squishies now, Mike.

Casey Newton

It’s dumpling squishies. I—

Mike Isaac

I was working—

Casey Newton

My son did his—

Mike Isaac

Okay.

Casey Newton

—his birthday wish list this week, and dumpling squishies, that’s the big—

Mike Isaac

Oh my God.

Casey Newton

—that’s the big new thing.

Mike Isaac

See, I’m showing my lack of children on this podcast.

Casey Newton

You’re showing your age is what you’re showing, brother. Sorry, Andrew.

Mike Isaac

But it is essentially a vulnerability that goes far wider than just any one little system tweak that you have to update your individual software on. This is stuff that folks in the industry said could break the internet.

Mike Isaac

It could affect how we get on websites and use them, and have our accounts taken over. It was much wider. My big takeaway is that this is the type of thing that’s going to be much easier and more commonplace to find in the age of AI, where you can have these programs scrape the internet and all that.

Casey Newton

Right.

Casey Newton

So we should say specifically what we’re talking about.

Mike Isaac

Yeah.

Casey Newton

PHP is a programming language that—God, every time I start talking like this, I think about the dozens of men with huge beards who are going to be chortling and emailing me the meanest things they can say.

Mike Isaac

Do it.

Casey Newton

I’m so sorry, but half of them are my friends. I’m thinking about specific people who are going to be texting me about how wrong I am. PHP is a programming language that’s used on a ton of different websites.

Mike Isaac

Yeah.

Casey Newton

And as Mike is saying, it’s much easier to find vulnerabilities in these infrastructural languages with AI, which can run a bunch of different ideas and figure out what the exact problems are. When that happens, all of a sudden you have these really intense, really serious vulnerabilities that now need to be fixed—not from the top down, but across a bazillion websites.

Mike Isaac

Yeah.

Casey Newton

I don’t want to make this podcast about me, but one day last week, I wasn’t able to record my score for a daily logic puzzle I do called Clues by Sam because Sam was fixing the PHP.

Erin Griffith

The real victim.

Casey Newton

Well—

Erin Griffith

The real victim.

Casey Newton

I’m just trying to bring this down to earth for everybody listening so they really understand what’s going on.

Mike Isaac

Imagine if you couldn’t do your Wordle every day. That’s the analogy you need to be using.

Casey Newton

Yeah, exactly. Are you guys talking to people who are in the midst of this? I’m interested in whether, from the perspective of cybersecurity people or AI people in general, we think this is just the new normal: every month is 85-hour weeks for people who work in security, and all the AI companies are throwing up their hands and saying, “We told you so.”

Mike Isaac

I’d love to hear what you guys think, but I think the flip side, or the counterargument—and this kind of happened in the open-source versus closed-source debate a few weeks or months ago—is, “Well, guess what? AI is also going to enable us to solve all these problems, quickly defend against them, and fix them faster. These vulnerabilities already existed. It was only a matter of time before someone found them.” There are arguments from folks saying these fixes can happen. We just need to enlist the advanced tools we have now to fix them faster, rather than have random websites across the internet unable to do that in enough time. But I don’t know; that feels a little rosy to me. I do feel like we’re going to see this more often, and the old internet breaking much faster than before. That’s my point of view, at least.

Casey Newton

Hmm.

Kevin Roose

One of the crazier news stories from this week was that the startup Cathedral, made up of former DOGE staffers—our nation’s best and brightest—was literally hacking into Anthropic’s Slack and IT systems.

Casey Newton

Yes.

Kevin Roose

Anthropic is supposed to be the one building the best cyber defense internal models, which they can’t even release to the public. And yet their own technical systems weren’t secure enough to block this crew of young startup guys from accessing trade secrets in their Slack. Before, I would’ve thought, “Man, some municipal governments are really going to struggle if they get hacked by people with an open-source model.” But now it’s actually the best and most AI-forward companies in the world that are also vulnerable.

Casey Newton

Yeah.

Erin Griffith

That’s a great point.

Casey Newton

It’s going to be a very long few years, I think. I read a great piece that I want to recommend by Joshua Saxe, a former Meta AI guy. His argument is basically that, as bad as it seems, we’re still in a sort of defender-dominant window.

Kevin Roose

Mm.

Casey Newton

Even though all these vulnerabilities are being discovered, his point—which I admire because I think it’s true—is that it takes cybercriminals a very long time to figure out how to do their jobs. Generally speaking, they’re not that smart, and they’re not that competent at running businesses. So we have a certain period where we can lock down defenses and, certainly at the level of cybercrime, protect against some of the worst vulnerabilities. But he says, on the other hand, this is not a wholly positive story. We’re still thinking about nation-state actors that have the resources and the will and desire to, as Jasmine says, hack into municipal government infrastructure and whatever else. I suspect this is not the last time we’re going to be talking about AI-discovered vulnerabilities on this podcast.

Mike Isaac

Great.

Casey Newton

That’s right. Exactly. Go back to Hawaii, Mike. There’s nothing left there. The last thing I want to talk about is that it felt like it flew under the radar amidst a bunch of other news this week, but Microsoft offered buyout packages to 60,000 people. Erin, what did you make of that?

Erin Griffith

That is an enormous number. When you put it in perspective of the fact that Microsoft has about 230,000 employees, it just reminds you how enormous these companies are. But just to be clear, buyout packages don’t mean 60,000 people are going to take them.

Casey Newton

Mm-hmm.

Kevin Roose

Ah.

Erin Griffith

They expect 3 to 5 percent of their employees to actually take them, so in reality it’s going to be at most probably 3,000 layoffs. But that’s still so many. To your point, Mike, over the last 3 or 4 years, we’ve just become so numb to these rolling layoffs from the giant tech companies because that’s just the new reality that started after the ZIRP era kind of deflated. All these tech companies that got super bloated because they thought they needed a million engineers decided, “Okay, now we’re just going to cut 1,000 people every six months or so.” Tech used to be this cushy job, especially at a place like Microsoft, which is very geographically focused, where you could have a 30-year career. There are a lot of people at companies like Microsoft, Amazon, and even Google and Facebook, which are a little bit younger, who have been there for so long. That is no longer the case. That may be a sign of what’s to come for the rest of the economy, because tech is always a little bit out ahead on workplace trends as well. That’s a little bit depressing.

Erin Griffith

The other thing I’ll add is something kind of darkly funny about the announcement: Microsoft said it was part of its efforts to give employees more control over their future.

Casey Newton

Oh.

Mike Isaac

Oh.

Kevin Roose

What the—

Casey Newton

Oh, boy.

Mike Isaac

What?

Casey Newton

That’s not the kind of control I’m hoping for.

Erin Griffith

Yeah.

Casey Newton

That’s not the control I want.

Mike Isaac

Seriously.

Kevin Roose

Really, really, really grim.

Casey Newton

Oh, God.

Kevin Roose

Oh, God.

Mike Isaac

The silver lining, as far as your harbinger of what’s to come, is that a lot of this is because of their AI spend and infrastructure spend.

Erin Griffith

Yes. Yeah.

Mike Isaac

Perhaps Accenture, or some giant employer that’s not spending billions of dollars per quarter on AI, won’t do the same level of layoffs. They’ll just use the tools to justify different types of layoffs in lesser numbers.

Erin Griffith

Oh my God, Mike, Accenture is the worst example, because if there’s any company in the world that’s going to be fully taken out by AI, it’s consultants, right?

Kevin Roose

Yeah, you’re right.

Casey Newton

You’re right.

Mike Isaac

I’m sorry. Good Lord. I’m going to get taken out by AI because I can’t even think of a good company.

Casey Newton

No, actually, your mistake is what makes you human, Mike. That’s what people love.

Mike Isaac

Thank you.

Casey Newton

That’s what people love.

Mike Isaac

Thank you. I live to serve.

Kevin Roose

When we come back, we’re going to be talking about stories that we’re tracking this week.

Casey Newton

Welcome back. I’m with Erin, Jasmine, and Mike, and we’re going to be talking about stories that we’re tracking this week. Mike, what story are you tracking this week?

Mike Isaac

This is kind of nerdy, but that’s my thing. I found this memo from the VP and distinguished engineer at Amazon this week that most normal people are not tracking. I think it’s really interesting because it’s essentially a very long manifesto on the use of AI among software engineers inside the big companies.

Casey Newton

Mm-hmm.

Mike Isaac

What they essentially cop to is that token maxing is a terrible metric for measuring how you’re doing as an engineer. LOC, or lines of code—the amount of code you’re contributing to build these products—is also a messy metric. It basically means you’re larding up these systems with a bunch of stuff that someone’s eventually going to have to delete.

In this long memo, they essentially tell employees, “Look, what we care about are long-term outcomes. This is what really matters in the end, and this is what we need to be judged by.”

Casey Newton

Mm.

Mike Isaac

The problem is you can’t really judge long-term outcomes on a quarterly basis when you’re trying to figure out who should still be employed here.

Casey Newton

Yeah.

Mike Isaac

After thousands of words, we end up back where we started.

Casey Newton

Yeah.

Mike Isaac

I’m very curious how they judge these engineers in the coming quarters.

Erin Griffith

That’s so interesting, because I feel like when the tokenmaxxing trend started, everyone with any common sense was just like—

Casey Newton

Yeah.

Erin Griffith

—this seems absurd. Spending as much money as possible to write as much code as possible, playing the volume game—it was obviously going to end badly. We all knew it was a short-term bump, and then the tokenmaxxing, or whatever they called it—

Casey Newton

Yeah.

Erin Griffith

—tokenmaxxing. The reverse of that trend happened so fast. By the time we could barely get our first story up—

Casey Newton

Yeah.

Erin Griffith

—it was already reversed. But it seems like they’re still struggling to figure out where the balance is. Is that your upshot from this?

Mike Isaac

What better metaphor for the tech industry than spending billions of dollars to find out something is a terrible idea and ending up back where you started?

Erin Griffith

They’re in the arena trying things, Mike.

Casey Newton

Yeah, exactly.

Mike Isaac

That’s true. I am a coward.

Casey Newton

I have to say, you say this is nerdy, but this feels like the most relatable possible thing to me. Everybody has a job where they introduce a new metric, and you know the metric’s stupid, and you fulfill the metric, and then your bosses are like, “Actually, we’re going to do the opposite metric.” So you do that, and you’re like, “This is still stupid.” And then they’re like—then they’re sort of like, “Actually, our metric is the long-term health of the company.” And you’re like, “Well, I’m still just going to do my job, and let me know—”

Erin Griffith

Casey, you’re self-employed. What are you talking about? Are you—

Mike Isaac

You are your own boss.

Casey Newton

I am also self-hating, so I think I can—

Casey Newton

Jasmine, what are you tracking this week?

Jasmine Sun

I saw this new research report that a team at Anthropic put out. They did a randomized controlled trial trying to understand how much experts defer to AI systems. They gave a bunch of professional statistical analysts access to AIs to give them advice on a decision in a scenario.

What they found was that the experts made the same decision as the AI over 80% of the time, even though the AIs were split half and half. They also used the AI’s arguments to justify their decision over 70% of the time, but only 15% of the time did they say, “Oh yeah, I was influenced by this AI agent.”

So we have this world, which I think is one we’re going to be increasingly in, where humans are often almost becoming wrappers on AI agents—

Erin Griffith

Whoa.

Jasmine Sun

—and AI systems, where all we’re doing is being the faces and typing the thoughts. I feel like there’s all this concern about AI takeover and rogue AIs, and I think a lot of the time we’re just going to let the AIs take over because we’ll be outsourcing all our decisions and won’t even realize.

Casey Newton

Oh, wow.

Jasmine Sun

So that’s what I’m worried about.

Casey Newton

That is a cheery thought. As somebody who professionally takes other people’s opinions and repeats them as though they were my own—

Mike Isaac

I just said—

Casey Newton

—I do kind of sympathize. It’s just usually the people I’m stealing from are people, not artificial intelligence.

Jasmine Sun

Oh, yeah.

Casey Newton

People say that AI makes everybody a manager. Here we are.

Jasmine Sun

Yeah, exactly.

Casey Newton

That’s exactly—

Jasmine Sun

Oh.

Casey Newton

This is exactly what managers do.

Mike Isaac

Man.

Casey Newton

Wow. Erin, what about you? What are you tracking?

Erin Griffith

I cover venture capital, as you know, and one of the most famous firms, Andreessen Horowitz, recently made a big change to the branding and the name of one of their sub-funds, their a16z crypto fund.

Casey Newton

Mm.

Erin Griffith

They’re one of the biggest crypto boosters and have been for many years. Hard Fork listeners might remember Chris Dixon, their top crypto investor, coming on for an interview a few years back to talk about the importance of blockchain and crypto for the future of the internet.

This would make it look like they’re backing away from that promise, and that’s something that happens in VC a lot. VCs chase trends and change. It’s not just a trend-chasing business; it’s also a marketing business, because all money is kind of the same. In order to stand out and get entrepreneurs to come to you, you have to put a stake in the ground and say, “This is what we’re interested in,” or, “This is what we’re really excited about for the future.”

They were really big bulls on crypto. Despite the fact that crypto is super out of vogue right now, and something like 80% or 90% of all VC dollars are basically going to AI, they’ve been very careful to say, “We’re not backing away from crypto.”

Kevin Roose

I mean, it’s like—

Erin Griffith

“We’re just expanding our mandate.” And—

Kevin Roose

It’s just all Frontier now.

Erin Griffith

Yes. And this is something other crypto funds have also been doing. They’re not alone in this. There’s a fund called Paradigm that was started by a Sequoia investor. In 2023, they very famously removed some of the crypto language from their website, and people noticed and freaked out.

A big part of it is that there are probably just not that many people building investable crypto startups right now, because everyone wants to build in AI. So it’s kind of necessary. One of the crypto industry’s many problems is that without the hype, without the number going up, there are just fewer people interested in working in and building in the industry. To find opportunities to deploy billions of dollars into startups, you have to change your mandate.

Kevin Roose

When crypto is too toxic even for Andreessen Horowitz, that’s when you know the vibe has shifted.

Erin Griffith

Yeah.

Jasmine Sun

Here at Hard Fork, we embrace our crypto nominative origin.

Kevin Roose

That’s right. Our roots in the blockchain.

Erin Griffith

Oh, my God.

Kevin Roose

We’ll be sticking with this name forever.

Speaker 1

Wow. Well, guys, thank you for coming through. This has been a really fun discussion. I’m so glad to have you, and I hope you all come back soon. This has been Mike Isaac, Jasmine Sun, Aaron Griffith. I’m Max Read. Thank you for listening.