[BidClub_]
All-In · · 62 分钟

Databricks CEO:AGI 已经到来,企业为何落后,以及超级智能之争

Ali Ghodsi

AI与软件企业经营技术
YouTube ↗
TL;DR
  • Ghodsi 认为 AGI 已经到来,但企业要补上上下文缺口还需 10–15 年。 现有智能已经足以“彻底改变地球”;瓶颈在于如何把它接入实际工作流程,并提供必要信息。一家拒绝录下会议的银行,无法让 AI 获得这些上下文;他预计 GDP 效应将在数十年间逐步显现。
  • Databricks 的商业押注是,智能体会增加受治理企业数据的使用量。 Ghodsi 指出部署面临 4 道障碍:上下文、安全、成本和知识产权归属。他称,公司业务规模已超过 70 亿美元,增速为 70–80%;外部智能体会带来更多查询,未必会取代平台:“我们是受治理的数据仓库。”
  • 工程生产力的前沿是自动化工厂,而不是单纯多写代码。 在 Databricks 的 2,000 名工程师中,主持人认为产出最高的人交付量约为其他人的 10 倍;Ghodsi 说,他们运行着别人没有的工厂。一些高产者用的 token 更少,这也印证了他主张把简单任务路由给更便宜的模型,而非把花钱多少当作生产力。
  • Genie 的演示表明,理解公司上下文是改善管理决策的基础。 它持续维护一套本体,连接员工、汇报关系、会议、文件和决策。一份超过 10,000 人参与的员工调查,最终转化为部门层面的行动停滞诊断;主持人则看到更广阔的“管理 Moneyball”机会。
  • 按 Ghodsi 的框架,AI 写出 98% 的代码,并不能证明递归式自我改进已经发生。 他要求训练速度持续加快、资源消耗不断减少、整体准确率持续提升,而且这 3 项改善能够形成循环。如今训练仍耗费大量资源,也依赖人类针对具体领域介入,因此不符合这一标准:“这个飞轮现在还不存在。”
  • Ghodsi 认为灭绝风险“接近于零”,但把网络攻击视为实质性威胁。 防御方必须阻止每一次入侵,攻击方只需成功一次。他的乐观判断建立在两个前提上:扫描新代码,并逐步清理有限存量的遗留漏洞;这具体指向他对安全风险最终走势的判断。
  • Databricks 会上市,但 Ghodsi 没给时间表,并希望公司免受 AI 时代市场波动的干扰。 年度要约收购提供流动性,认购金额一直未满,也支持了数十亿美元级别的收购。公开市场能提供资本和每季度讲述公司故事的机会,但他不希望股价波动让员工薪酬坐上“过山车”。
  • 医疗领域已有具体案例证明 AI 有用,但这并不能验证“10 年内治愈癌症”的期限判断。 Ghodsi 提到 Regeneron 对慢性肝病的研究,以及 Merck 用于药物发现的 TEDDY 模型。人体试验仍是约束,至于时间表,他的回答依然没有定论:“可能 10 年,也可能不是 10 年。”
摘要 · 为研究而整理的核心内容

1. Databricks 起步时押注了 3 件行业不看好的事

  • Ghodsi 回溯称,Databricks 于 2013 年创立时,团队来自 UC Berkeley 的 AMPLab,约有 20 名研究人员。Netflix 的推荐系统项目让他们意识到,未来每家机构都可能需要数据科学团队,AI 不会只属于广告技术行业。但行业迟迟没有跟上,创始人自己也曾争论市场潜力:创办 Databricks“某种程度上是出于绝望”。
  • 把研究推向商业化后,他们才发现实验室忽略了安全、治理,以及企业积累了 30–50 年的软件和流程。云基础设施将存储与算力分开,企业因此可以保留数据,不必不断购买软硬件一体的设备。Ghodsi 强调的是核心产品数据——播客本身、保险或药物——而不仅是 CRM、HR 系统里的信息。
  • Databricks 押注云、AI 应用和开源。一家颇有影响力的分析机构曾称,转向云是“战略失误”;Ghodsi 将公司的先发优势归功于这些不受欢迎的选择。主持人开场提到,据报公司 2015 年营收为 150 万美元,2026 年 8 月年化营收达到 70 亿美元;Ghodsi 随后称业务规模已超过 70 亿美元,增速为 70–80%。

2. Ghodsi 将已实现的 AGI 与假设中的超级智能区分开来

  • 按照他在 Berkeley 的同事约于 2009–2010 年采用的定义,Ghodsi 认为 AGI 在“去年”已经到来。他向几位前实验室成员求证,对方认同这一判断,但表示“我们的目标线已经往后移了”。他的主张针对的是能力已经足够:即使进展就此停止,“我们也已经拥有改变地球所需的全部智能”。
  • 他将此与 Bostrom 2014 年著作中描述的超级智能区分开来:一种能在 1 分钟内完成相当于人类 1,000 年的思考,或瞬间写出原创博士论文的智能。现在的 AI“有点慢”;要获得更高吞吐量,需要多个智能体并行协作。因此,前沿实验室攻克高难度数学问题,与 Databricks 推动企业部署,是不同的项目。
  • 客户谈话仍围绕“更高级的 Google 搜索”以及编程工具可能带来的 20–30% 提速展开。Ghodsi 会问企业,是否有数千个智能体在承担核心工作;通常并没有。主持人则质疑,在人类仍需纠正偏离和低质量输出的情况下,这种规模是否实际。Ghodsi 说 Databricks 走得更远,同时承认整体部署仍有缺口。

3. 智能要转化为企业产出,仍有 4 道障碍

  • 首要问题是上下文。设想捕捉一家拥有 200,000 名员工的组织里的全部信息,包括会议内容。一位银行 CEO 曾告诉 Ghodsi,录下会议“想都别想”,因为会带来责任风险。他打比方说,这就像不让一位杰出的数学家参与讨论:即便是 Terence Tao,也无法帮助处理自己从未听说过的决策。
  • 一旦智能体获得广泛权限,安全就成了下一道障碍。把类似 OpenClaw 的工具连接到公司全部数据,会在外部攻击风险之外引入“内部威胁”。主持人指出,大型组织的暴露面会因此大幅扩大。让信息可用,与愿意授权智能体访问,是两个不同的问题。
  • 接下来是经济性:“如果 token 成本呈指数级上升,你所在公司的收入也在呈指数级增长吗?”Ghodsi 说,他不知道哪家公司能让 AI 带来的收入加速赶上成本曲线。CEO 最初的热情,最终会遇上 CFO 对更高运营支出、可能增加的销售成本,以及即将到来的财报电话会的考量。
  • 最后还要避免被供应商锁定,并保有知识产权。主持人补充了一层竞争压力:模型供应商正推出应用,侵入已有软件市场,并以 Anthropic 对 Excel 和 Photoshop 的动作举例。Ghodsi 肯定实验室的贡献,同时坚持认为企业必须解决这 4 项约束,才能实现更广泛的机会。

4. Genie 把组织上下文转化为可审查的分析

  • Genie 持续维护一套本体——由人员、汇报关系、工作、邮件、Slack 消息、会议记录、决策和文件构成的关系图。它持续运行,并准备好一份后台工作的收件箱。Ghodsi 将积累起来的知识与每次从头搜索所有内容区分开来:演示中的一项分析引用了 5 人提供的 19 条信息,定义和作者均可查验。
  • 一项超过 10,000 人参与的员工调查,是演示中的第一个实质案例。管理层支持度为 88%,工作与生活的融合度为 60%。Ghodsi 尤其对约 60% 的“行动”评分感到不满:员工是否相信反馈能带来改变。“每年我都向公司承诺会解决这个问题,但每年都没有做到。”
  • 他的 CFO 认为,工作与生活融合度低导致行动评分低。Ghodsi 起初不同意,看到相关性后短暂地重新考虑,随后表示 Genie 否定了这种因果解释。一位经理的工作与生活融合度评分为 44,行动评分却是 77。主持人的解读是:这位领导给团队施压很重,但也会回应他们的关切。
  • 对最初的解释仍不满意,Ghodsi 要求按部门分析。产品管理团队认为决策参与者太多;工程团队不喜欢现有工具和系统;销售运营则提到职业发展。他说,以前要数据团队做出同类分析,大约需要一周。演示从公司整体平均值深入到具体问题,而不同问题需要不同应对方式。

5. 智能体带来数据使用需求,工程师的收益则不均衡

  • 主持人问 Anthropic 的仪表板是否威胁 Databricks,Ghodsi 回答,Databricks 不对仪表板收费;收费点是客户访问其下方受治理数据时产生的数据使用量。外部智能体可以接入数据仓库,发起更多查询。他认为,这是公司业务加速的原因之一,尽管整体采用仍处于早期。
  • 一张展示 2,000 名工程师生产环境代码合并请求数量的图表,呈现出 L 形分布。主持人认为,产出最高的人贡献量约为其他人的 10 倍。Ghodsi 的解释是:“他们在运行自动化工厂,其他人没有。”他的组织目标是让整条分布曲线向右移动。
  • 加入 token 成本后,图表显示一些高产者花得比别人少。Ghodsi 提到,使用开源模型,以及把简单问题路由给更简单的模型,都有助于降本。他希望生产力提升能带来更多产品、更高市场份额和“远超 100”的增长,而不是满足于 70–80%。这是目标,不是业绩指引。

6. 管理重点转向发现阻碍,并检验企业文化

  • Ghodsi 将层级式组织架构与跨越产品管理、工程、市场和销售的实际工作作比较。人数超过邓巴数 150 后,协调会更困难。Genie 还会识别管理层级异常深、管理跨度却很小的情况。他希望 AI 理解全公司的职责分工,缩短工作推进所需经过的链条。
  • 客户会议分析可以从“会议开得很糟”开始,接着精准指出说了什么、客户要哪些功能。Ghodsi 说,他们会把需求汇总起来,交由工程工厂处理。剩下的延误往往来自“人为阻碍”:法务许可、财务审批,或团队之间意见不合而反复开会。Databricks 会衡量这些阻碍,以便减少它们。
  • 主持人平行展示了自己的实验“Major Decisions”:它读取 Slack、Notion 和邮件,找出重要决策、参与者、结论和未解问题。分析能呈现谁实际参与了决策、谁回应迅速。他将其称为“管理 Moneyball”:让组织贡献变得更清晰可见,而不是依赖创始人亲自侦查。
  • Ghodsi 会问领导者是否践行求真的原则,以及团队实际奉行什么样的文化——包括数百名他不会说其语言的日本同事。两者不一致,不代表当地领导一定有问题:“也可能他们是对的”,错的是他。他会把分析分享给员工,并用它来建立共同方向。

7. IPO 时间取决于公开市场能否助力未来十年发展

  • Ghodsi 评估 IPO 时,考虑的是它能否让 Databricks 在未来 10 或 20 年持续成功,包括拓展安全和营销业务。公开市场能提供资本、知名度,以及每季度重新讲述公司故事的机会;也提供成熟的流动性市场,免去安排私人融资和年度要约收购的“繁重工作”。
  • 年度流动性安排尚未用完分配给要约收购的资金;Ghodsi 将此解读为员工看好公司。稳定可预期的流动性也支持了数十亿美元级别的收购。公司增速为 70–80%,员工想到股权每年以 1.7 倍复利增长、持续几年后,会重新考虑卖出多少;有时最终只卖 5%。
  • 他反对的是公开市场波动传导到员工对薪酬的判断。一名员工原本预计拿到 100 万美元,之后或许能达到 200 万美元,却可能看到股权只值 20 万美元,并在 3 个月后情绪反转前离职。“我们会上市,”他说,但当前 AI 转型期的“过山车”令人分心。他没有给出时间表。

8. 递归式自我改进需要 4 项条件同时成立

  • Ghodsi 理解为什么程序员会觉得 AI 编写软件事关生死:编程定义了他人生的大部分。但模型参与开发后继模型,并不能证明改进会失控。“AI 写了 98% 的代码,不代表我们就有了 RSI。”自动化剩下的 2%,也无法消除物理和经济约束。
  • 第一项条件是后续模型的训练速度必须显著加快;他把所需的加速称为“超线性”。第二项是每次改进所需的资源都要减少。不断购买 10 倍硬件无法让循环无限延续,因为硬件乃至原子终究会耗尽。他指出,当前主流缩放定律要求算力呈指数级增加,才能换来相对线性的提升。
  • 第三项是准确率必须在各项任务上普遍提升,而不能只在数学或其他强化学习目标上提高。第四项是这一过程要反复实现前三项改进。他举例描绘这个循环:训练时间从 3 个月缩短到 1 个月、2 周,再到 1 周;成本则从 100 美元——或许是 1 亿美元——降到 100 万美元。这些是设想中的飞轮所需条件,不是预测。
  • “这个飞轮现在还不存在。”Ghodsi 看到的现状仍是训练时间更长、资源消耗更多、需要清理数据、依靠 Mercor 等公司提供专业人力,并在具体领域的强化学习上“打地鼠”。即便 4 项条件全部满足,也不代表有意识的实体一定会接管一切。他把这些视为前提,而能否采取物理行动则是另一个问题。

9. 网络风险真实存在,但 Ghodsi 预计漏洞存量最终可以清理完

  • 主持人将高超智能与攻击用“admin、admin”保护的冰箱区分开来。Ghodsi 认同网络安全确实构成风险,并提到 Databricks 用于发现入侵、监控智能体的产品 Lakewatch。随后他把后果说得更具体:医院停摆,比冰箱出问题更让人担忧。
  • 主持人反驳说,防守方拥有更多算力,理应先发现漏洞。Ghodsi 则强调攻防不对称:数千个攻击智能体可以失败,但只要一次入侵成功,攻击方就可能得手。防守方即便守住所有边界,只有一处失守也可能酿成灾难:“我必须始终做到 100% 安全。”
  • Ghodsi 认为,扫描新生成的代码就能防住讨论中的漏洞:“所有这些代码都会是安全的。”他还预测,未来不到 12 个月内产生的代码,将超过人类此前历史上写出的全部代码。在他的判断中,主要需要修复的漏洞存量将来自遗留软件。
  • 他用果园作比:智能体能触及过去人类够不到的漏洞,但“果实”总量有限。重写遗留系统或采用“影子补丁”,都可以消除这些攻击机会。他预测最终会进入稳态,漏洞数量甚至可能少于以往;主持人则强调,人类仍会持续造成安全失守。

10. 医疗进展不足以支撑确定的治愈期限

  • 主持人质疑 Dario 所称“癌症和阿尔茨海默病可能在不到 10 年内消失”,认为即便出于真心,这类说法也可能给患者家庭带来虚假希望。Ghodsi 不愿认同具体期限。他认为进展会加快,但人体试验仍不可或缺;时间可能是 6 个月,也可能是 30 年或 50 年:“我不知道。”
  • Ghodsi 提到,Regeneron 的研究人员使用 Databricks 找到慢性肝病的遗传驱动因素并研发药物,当时使用的是更早一代 AI。他还介绍了与 Merck 合作的 TEDDY,即 Transformer Enabled Drug Discovery:它是一种处理基因调控网络(GRN)的 Transformer,处理对象不是英语 token。它的目标是区分致病因素与疾病反应,帮助研究人员避免把只是做出反应的对象当成治疗靶点。
  • 他的例子也不止药物发现:Crisis Text Line 使用 Databricks、语言模型和智能体识别自残风险并协助预防。Zipline 用这个平台管理无人机运营,包括航线和电池;主持人补充说还包括血液运输。Ghodsi 将这些视为已经发挥作用的应用,而不是要等超级智能出现才可能实现的用途。

11. 双方争论的是证据,以及技术扩散的速度

  • Ghodsi 认为,安全研究群体的担忧出于真诚:人都是“自己故事里的英雄”,Bostrom 的论述也曾让他感到害怕。他质疑的是,从模型变强到超级智能失控之间的推理跳跃:“中间有几个‘点点点’,说不清楚。”他也承认可能存在自己尚未掌握的信息:“我不知道自己不知道什么。”
  • 他对灭绝风险的估计是“接近于零”,但认为网络风险真实存在且可控。主持人补充了部署层面的担忧,包括儿童与 AI 形成拟社会关系、获得有害建议,以及新闻算法操纵信息。双方共同区分了需要认真应对的具体伤害与回形针最大化者式场景。
  • Ghodsi 预计,企业弥补上下文缺口需要 10–15 年;GDP 将在数十年间“非常缓慢地变化”。他将此与实验室预期的 6 个月、12 个月或 2 年内实现变革相对照。那家拒绝录下会议的银行,仍是他最简洁的解释:如果无法了解组织知道什么、做过什么决定,AI 就无法完成 Genie 演示的工作。
完整逐字稿

本集逐字稿暂无译文,当前显示原文。

Ali Ghodsi

It was out of despair that we started Databricks because no one else was listening. At that time, there was zero interest in AI. Now I think we have all the intelligence we need to completely transform the planet.

Speaker 1

It’s not possible to have 1,000 agents doing stuff realistically. Am I correct?

Ali Ghodsi

They’re just using AI in very rudimentary ways. They’re using it as a glorified Google search.

Speaker 1

We’re actually getting into management Moneyball, aren’t we?

Ali Ghodsi

If the token cost is going up exponentially, is your company’s revenue going up exponentially? But I actually think GDP will move very slowly, and it’s going to take decades.

Speaker 1

Are they a little drunk on their own success?

Ali Ghodsi

Just because 98% of the code is being written by AI, we don’t have RSI. If it automates the last 2%, who cares?

Speaker 1

All right, everybody. Welcome back to the All-In Interview. Ali Ghodsi is one of those amazing leaders in the world—CEOs, politicians, scientists—who watch the show and are part of the community. He’s the CEO of Databricks, a private company that has been doing incredibly well. I don’t know why it’s not public yet. I think a lot of people are asking that question, and we’ll talk about it today.

In 2015, the company was doing $1.5 million in revenue. The rumor I heard is that by August 2026, Ali, you’ll be at a $7 billion run rate, growing 80% year over year. Obviously, you have a lot of competition—the Snowflakes of the world, et cetera—but this is a tremendous business. We’re going to talk about how you’re using AI to run it and about recursive self-improvement. Welcome to the program. Maybe you could tell the audience a little about what you do at Databricks and how it became so successful.

1. Databricks Began in Despair

Ali Ghodsi

Yeah, happy to do that. Thanks for having me on. I’m excited for this. We started the business in 2013, but if you rewind a little bit before that, we were all at UC Berkeley. There were about 20 of us, and we were part of a lab called AMPLab, which I think was the largest AI research lab in the world at that time. We were trying to figure out how to combine data processing with AI. We came up with really interesting things, but the industry just wasn’t ready for it.

Speaker 1

Mm.

Ali Ghodsi

We were trying to get the industry to adopt this technology, and they weren’t. So it was out of despair that we started Databricks. We thought, “If we don’t start a company around this, no one else is listening to it.” At that time, there was zero interest in AI. It was actually called machine learning, and AI was just robotics. That’s the beginning of the story.

Speaker 1

For people who don’t use the product day in and day out, or aren’t in the industry, what’s the goal of the Databricks product suite? What do you do? I know you released some new products today, so we can talk about those as well. Conceptually, you got there so early. Obviously, machine learning was used at Google, Facebook and its ad network, and a lot of interesting services, like Uber’s routing algorithms. Could you talk a little about where Databricks started, what it’s become, and how it’s generating billions of dollars in revenue?

Ali Ghodsi

The first use case—actually, the first use case ever—was at UC Berkeley, when we wanted to help Netflix recommend better movies so that people would watch more movies.

Speaker 1

Ah, yes.

Ali Ghodsi

It was a recommendation algorithm, an AI use case, that started the whole thing. We thought more organizations would probably need this. Probably every organization would need a data science team that could do this kind of AI work, and that was a bold idea at the time. A lot of people said, “No, no, AI is just for ad tech. The ad companies need it.”

Speaker 1

Mm.

Ali Ghodsi

But we thought, “No, this is going to be a bigger market.” We had a lot of internal debates and weren’t sure it was going to explode. Then, when we started the company, we realized why organizations weren’t doing it and why it was so hard. Organizations around the world are bogged down by legacy software they’ve had for 30, 40 or 50 years. Some companies have been around for 100 years. Things move slowly. They have a lot of processes, compliance, regulation and security. All these things have gotten worse with generative AI in recent years.

What was missing from our research at UC Berkeley was security and governance. In the first few years, we figured out how to take this technology and let you process all your data in an enterprise. Organizations have a lot of data. The most important data any company has—and people don’t talk about it—is the data on its core product. For you, it’s this podcast: the data on that. Someone else might be selling insurance; someone else might have a drug. It’s the data that comes out of that. That data doesn’t sit in CRM or human resource management.

Speaker 1

In fact, it probably wasn’t even tracked. I remember in the early days of the internet, they’d say, “Hey, would you like this log file?” I’d say, “Okay, yeah, keep everything.” They’d say, “Well, you’ve got an $8,000 storage bill a month.”

Ali Ghodsi

Exactly.

Speaker 1

I’d say, “Okay, delete it.” They’d say, “Well, we could roll it up and keep some of it.” I’d ask, “Who’s ever using the open rate on our emails? Who cares about that? We send the emails. That’s it.” But then that changed. Was storage and compute, and cloud computing, a major accelerant to the big data movement and then eventually machine learning? Were those the waypoints in this movement?

2. Betting on the Cloud

Ali Ghodsi

Before we started in 2013, people were running their own data centers. When you ran your own data center, you had to buy machines, and the machines came with storage and compute combined. If you ran out of storage, you had to buy more machines, and IT departments at every organization were busy with that.

The cloud enabled you to completely decentralize this and separate compute and storage. You could imagine having infinite storage and dumping everything there. If the data gets old, it knows how to archive it so it becomes almost free to store. Then you could get the illusion of as much compute as you wanted, and, of course, you could start running machine learning on it. Eventually, GPUs showed up.

We bet everything—the whole farm—on being a cloud company. We bet everything on AI use cases, and we bet on open source. At the time, all three of these bets were controversial. People said—I had a standing bet with one of the most important analyst firms out there—“It’s a strategic blunder. You’re going to go under because you’re betting on the cloud.” It turned out that the only reason we succeeded was because of these bets: they were contrarian, and other people didn’t agree with them. We got a head start for many years. Eventually, when we happened to be right, we were so far along and had gotten too big that there was too much momentum to stop it.

Speaker 1

It’s so funny you mention this Netflix algorithm. Netflix started in the Bay Area as DVDs mailed to you in an envelope, and then you had this queue. The Netflix Prize was in the 2008–2009 time period. They offered a million-dollar prize to any computer science team that could make the algorithm, I think, 10% better at predicting which movie you’d give four or five stars to. They released all their data and probably got $50 million worth of work from computer scientists around the world.

It was the first time there was an XPRIZE. I think the XPRIZE and this were around the same time, and they were all inspired by those old prizes: Who could circumnavigate the globe? Who could solo-fly over the Atlantic or the Pacific? It was a very interesting moment in time. And that hit AMPLab, right? AMPLab stood for Algorithms, Machine Learning, and People. I don’t know what the P stands for.

Ali Ghodsi

It was for people, actually, because we thought the AI wasn’t good enough yet.

Speaker 1

Mm.

Ali Ghodsi

So it needed a little human nudging.

Speaker 1

Got it.

Ali Ghodsi

Human feedback was already there. We thought we needed it because this last mile is too hard for AI to figure out by itself, so we had people there as well.

Speaker 1

Putting the people in there makes sense because Berkeley’s a little hippy-dippy—Friedberg’s alma mater, obviously. They were like, “We need some people in the middle of this.”

We had Ben Horowitz on the other week, and he said the best explanation he’d ever heard for why we’re going to be able to control the rollout of superintelligence—and the jump between artificial intelligence or artificial general intelligence and superintelligence that gets recursive, runs off with it, dooms us all, and means we’re all going to die—came from you. So please explain your thesis here. Then I’d like you to go one step further and talk specifically about the culture in the Bay Area, perhaps even the East Bay, and this group of people.

3. AGI Has Already Arrived

Ali Ghodsi

I’m happy to get into it. I think there are 2 different things happening at the same time. On the one hand, I actually think we already have artificial general intelligence. I’ve been saying it since last year, and I base that on the kind of consensus we had in that AMPLab, which I think was the largest AI lab at the time, in 2009 and 2010.

By the definition of AI that most of us had in that lab, we already achieved AGI last year. I wasn’t actually sure about this, so I checked with some of the people who were in the lab. I asked, “Hey, is it just me? Am I hallucinating?” And they said, “No, no, no. That definition, for sure, but we’ve moved the goalpost.” So I actually think we have all the intelligence we need. If you stop all progress right now, I think we have all the intelligence we need to completely transform the planet. But that’s AGI.

Speaker 1

That can do all the intelligence work humans do, right? If it solves this latest cohort of math problems, and we’re just starting to build harnesses and build out the infrastructure, I guess your statement would be correct. I’m kind of in line with you. We’ve hit artificial general intelligence; it just hasn’t been distributed equally yet.

Ali Ghodsi

Yeah. The labs and a lot of researchers are kind of obsessed with superintelligence. When I say superintelligence, I mean it the way it was defined by Bostrom in his 2014 book, Superintelligence. He’s talking about something completely different: something that can do a millennium’s worth of thought—1,000 years of human thought—in a minute. All of mankind in a minute. It thinks in 11 dimensions. It’s so much faster. A single agent is many orders of magnitude faster. Imagine 1,000 times faster than any of us.

That’s just a different thing. It can write a novel PhD thesis instantaneously, and so on. I think the labs are on a quest for that.

Speaker 1

Okay. So, just to summarize: the ability to write an entire, unique PhD thesis instantly. Do we even have enough compute to do something like that today? If everybody got together and said, “Today, we’re going to give all our compute—or, for the next hour, just as a thought experiment, give it to this incredible mega-prompt”—do you think it would actually happen? Is it a compute issue, or a model issue?

Ali Ghodsi

The AIs are kind of slow. What we have to do is parallelize them and have many of them, and then have them collaborate with each other. So it’s not really the way he wrote it. He also had intelligence in the book that could be communities of intelligence, but I’m just saying the labs and many of the other companies are focused on this.

Speaker 1

Yes.

Ali Ghodsi

That’s why they’re so obsessed with the math problems, the Clay problems, the 7 Millennium Prize Problems, and so on. But I argue that the biggest challenge facing us is how we actually make this AI applicable inside organizations. That’s what Databricks is focused on. We just want to help all these organizations.

When I talk to enterprises, I see that they’re using AI in very rudimentary ways. They’re using it as a glorified Google search. They’re using chatbots all day. Instead of typing into Google Search, getting 10 blue links, and looking at them, the AI just does that for them.

The second thing they’re doing is coding. With coding, they’re not seeing enough speed-ups. They’re seeing maybe 20% or 30%. I ask them this question every day. I’m in meetings with customers every day, and I ask them these questions. That’s kind of what reality looks like. I always ask them, “How many of you have thousands of agents running around, automating all of your work and doing core work for you?” It just hasn’t happened yet.

Speaker 1

They might be running half a dozen agents, or a dozen agents. Somebody at the forefront might actually be coordinating that many, but a human still needs to be in the loop, just like AMP. There’s a person who still needs to be in there because it will return slop, return weirdness, and drift off course. It’s not possible to have 1,000 agents doing stuff realistically. Am I correct?

Ali Ghodsi

Yeah. Somewhat further along, I’m actually using this all throughout Databricks, and I’m happy to show you. But the reality is that they’re not. You have to ask the question: why is that? If it can solve Navier–Stokes, very difficult math problems, how come enterprises and organizations are so far behind?

Speaker 1

Why is that?

Ali Ghodsi

There are many reasons, but the main reason—or maybe one way to look at it—is this: if we could gather all the information inside a large organization with 200,000 employees and record all the meetings—which, by the way, one of the big bank CEOs told me the other day, “No way. We’re never recording the meetings. Not in a million years”—but assume you had that.

Speaker 1

Because of liability.

Ali Ghodsi

Liability. I was already kind of shocked, because if you can’t do that, how can AI ever help you? The AI simply isn’t in the meeting. If it’s not in the meeting, it’s useless. It doesn’t matter if you have Terence Tao or the greatest mathematician in the world. If they’re in the dark and don’t know what decisions you’re making or what you’re doing, and you’re meeting with hundreds of thousands of employees, there’s no way they can help you.

If you capture all that context and feed it to the AI, it would nail the problems. It could help us right now. That’s really the context problem. You might say, “Okay, let’s figure that out and do that,” and we’re doing that at Databricks. But that’s not enough.

Speaker 1

Hmm.

Ali Ghodsi

Even if you do that, you have a second problem: you could unleash something like OpenClaw and have it access all your data everywhere. Then you get into the problem that you’re going to get hacked. Cyber is real, and all the big organizations with successful businesses are terrified right now of getting attacked. That’s a big concern, a top concern.

Speaker 1

It certainly creates a lot of surface area when you embrace this. If a CEO at a small company wants to connect everything, that’s a certain amount of surface area. But for a 200,000-person organization, or 10,000 people, my Lord, the surface area has now gone up 1,000 times.

Ali Ghodsi

Yes, exactly. That’s the second problem you run into. We can access all the data, but we might not want agents to access all of it because now we have an insider threat, and we might get hacked. So what do we do about that?

Let’s say we solve that too. We’ve solved the cyber problem, which, by the way, we have ways to do at Databricks, and I’m happy to show you. Then you still have another problem: the token cost is going up exponentially. If the token cost is going up exponentially, is your company’s revenue going up exponentially? I don’t know any company that started using AI and then saw its revenue accelerate exponentially to match its cost curve.

First, CEOs say, “Go get the AI. Get more AI. Get it in there.”

Speaker 1

Yeah.

Ali Ghodsi

“We need to move faster.”

Speaker 1

Token matching.

Ali Ghodsi

“We’ve got to…”

Speaker 1

Yeah.

Ali Ghodsi

Exactly. But then at some point the CFO shows up and says, “Our OPEX is going up significantly here, and even the COGS. What are we doing about it? And we have an earnings call soon.” Then they freak out. So how do we fix that? You also need to do this efficiently, which we have ways to do at Databricks.

Now you’ve done all 3 of these, and there’s still a strategic last question that remains: okay, fine, we figured it out.

Ali Ghodsi

We access all the data, secure it, and figure out the cost situation. How do we avoid getting locked in, and how do we own our own IP? Otherwise, there’s no business to be made in the future.

Speaker 1

Data sovereignty is what you’re referring to: intelligence sovereignty. If you use Anthropic, OpenAI, or any of these platforms, there’s a risk that your data will leak and get incorporated into their next version. As we’ve seen, Anthropic seems to be releasing half a dozen products every two weeks. Now they’re competing against Microsoft, one of their giant partners, I think.

Ali Ghodsi

Yeah.

Speaker 1

They just came out with basically an Excel killer. They’re killing Photoshop. They’re going after everybody wholesale.

Ali Ghodsi

Yeah, so these four—

Speaker 1

For free. For free.

Ali Ghodsi

Yeah. By the way, these companies are amazing. They’re doing amazing work, and without them, we probably wouldn’t even have this intelligence. I’m thankful. This is awesome. I’m just pointing out why—

Speaker 1

Yes.

Ali Ghodsi

—when you look around at all these successful organizations, all the Global 2000, all the Fortune 500s, NASDAQ, and so on, how come it’s just a glorified chatbot and a little bit of coding? This is the reason. You need to tackle all four of those. Only then can you start getting something out of it.

Speaker 1

One of those issues as well, I believe, is the autonomy in an organization to come up with a groundbreaking idea. You may have captured a large portion of your market. You may be getting incremental benefits. If I tell you, “We can put another 500 horsepower into your Ford Taurus,” it’s like, “Okay, my Ford Explorer now has 500 extra horsepower. It’s going to rip the chassis off. This thing is not capable of going 500 miles an hour.” So who decides we’re launching three more product lines? At Anthropic—

Ali Ghodsi

Yeah.

Speaker 1

—somebody is deciding, “Why don’t we just go after every single business in the world?” And they started doing dashboards. That’s a little close to your business, is it not?

Ali Ghodsi

Well, we don’t have a product where we charge for dashboards.

Speaker 1

Mm.

Ali Ghodsi

Dashboards are usually backed by data, and you typically want that data to be governed. You don’t want just numbers that are incorrect. This is a big problem in organizations. That gets back to the second thing I said—

Speaker 1

Yeah.

Ali Ghodsi

—the governance and security aspect. Maybe we can get access to all the data and get all the context, but we have to make it secure. You can connect all of these agents from outside to Databricks, but we are the governed data repository. When you access that data, we charge consumption rates. That’s one of the reasons you see acceleration in our business: all these companies have agents, and when they use them, they send us more queries. I think we’re just at the beginning. As I said, I still think it’s mostly Google search and coding, but the agents will start using that.

Speaker 1

How does behavior change when people actually embrace agentic technology and start working with agents every hour, every other hour of the day, like you and I do?

Ali Ghodsi

I think the organization and the org charts are built this way. It’s a tree structure, with the CEO at the top, and decision-making going up and down these org charts. You have all these old processes, and getting agreement across the org chart is very hard inside an enterprise or any sizable organization. It’s somewhat easy up until Dunbar’s number, which is 150. You can know everyone. Small startups are a different story, but above 150, this becomes a coordination problem.

If you look at how any organization sells a product or service to its customers, it’s not this hierarchical thing. It cuts across the org chart. Here at Databricks, we have customers who give us feedback. That feedback goes to product management, which hands it to engineering. Engineering builds products, which go to marketing. Marketing markets them, then gives them to sales, which sells them to customers again. You want to go across the organization and cut out that latency so you can be really fast. That requires an AI that understands your whole business and your IP. It needs to understand your org chart and know who’s who and who’s responsible for what.

Speaker 1

What percentage of companies understand what you just described? Would you say 10% of organizations understand this? 5%?

Ali Ghodsi

At scale, I don’t know the answer to that. I know Databricks is doing it. I’m doing it.

Speaker 1

Yeah.

Ali Ghodsi

I haven’t seen anyone else do it at this kind of scale. I think probably Block and Square—

Speaker 1

Mm-hmm.

Ali Ghodsi

—with Jack Dorsey, since he’s pushing it. He calls it the company world model. He describes the same thing I did, I think in a different way. So I think they’re probably pretty far ahead. In general, I think digital natives are further ahead. Digital natives are companies that have only existed for 10 or 15 years.

Speaker 1

Yeah.

Ali Ghodsi

If you’ve been around for 20, 30, 40, or 50 years, that means you’re an amazing company. Maybe you’re a Fortune 500 company, one of the best in the United States, with 100,000 employees. They’re loyal, they love your product, and you know what? You’re the best in the world at that. You have so much software, so much regulation, and so many processes around security that it’s very hard for you to adopt this. That’s the very problem Databricks wants to solve for them.

Speaker 1

Yeah.

Ali Ghodsi

We want them to adopt the technologies so the AI can help them do what I do at Databricks.

Speaker 1

Let’s see it. You said you’d be willing to show us how you run Databricks with agents and AI. I’ve been looking forward to this all day because I’m taking my entire life in podcasting and early-stage investing, looking at each component as a service or an agent, defining the goal, and working backward to the signs of success that show you’re heading toward the goal. Achieving the goal is binary: you made the sale or you didn’t. But what are the precursor signals? Then you try to have each of these bots hand things off back and forth. You have to be a real systems thinker. It’s like playing five chess games at once while riding a horse. I find it intellectually super stimulating. I can tell you do, too. You can share your screen.

Ali Ghodsi

Yeah. Let’s jump in. The key thing here is that we have a product called Genie. There are so many chatbots, assistants, co-work products, and agents running in the background. The key thing is that Genie has an ontology. The ontology is a graph that it’s constantly constructing for your company. That graph understands all the people, who reports to whom, what they’re working on, what emails are coming in, what meetings have happened, the transcripts of those meetings, the decisions being made, and what’s on Slack and being communicated.

It has access to all of those things, and also all the documents you’re creating, all the Excel sheets, and all the PowerPoint presentations. That’s what we call Genie here. You can see here: I wake up, and it has an inbox. In the morning when I come in, it has done a bunch of background work for me. It’s running 24/7. As you can see, it has access to my calendar. In fact, I could just ask it, “Hey—”

Speaker 1

Which I’m going to tell Jason on All-In today. Here it goes.

Ali Ghodsi

Let’s see what it’s going to say. But let’s look at some of the stuff I’ve done. The other day, one interesting thing was that our HR department came back—

Speaker 1

Mm.

Ali Ghodsi

—and they were saying, “Hey, we’ve done a survey across all of Databricks.” We had over 10,000 employees respond to the survey. I looked at the results while she was going through them, and I said, “Hey, make me a dashboard of the results.” Nothing magical here yet. It told me, “Look, here’s how you’re doing.”

Ali Ghodsi

You’re doing great on some things, but not so good on others.

Speaker 1

Executive leadership, 88%. You’re doing okay.

Ali Ghodsi

Yeah.

Speaker 1

Work-life blend, 60%. You’re working people pretty hard over there.

Ali Ghodsi

Yeah.

Speaker 1

But maybe everybody says that, right?

Ali Ghodsi

Yeah. No, but we want to know that this has been… We wanted to improve these two.

Speaker 1

Okay.

Ali Ghodsi

And this action one really bothers me because, you know, “action” means that when we ask them for feedback, they give us feedback about what to improve, and they feel like we’re not listening to them. And this one, I think—

Speaker 1

Ah. So two out of three feel you are, and one out of three feels you’re not, just to… You’re doing okay. It’s not terrible, by the way. This could be 30%.

Ali Ghodsi

Yeah, yeah. But then again, 60% is not great.

Speaker 1

No.

Ali Ghodsi

And especially not great if you take into account that every year it’s low. Every year I promise the company we’re going to fix this, and every year it doesn’t happen.

Speaker 1

Hmm.

Ali Ghodsi

So we’re going through the results and discussing them with the staff. While they’re discussing it, they’re speculating. My CFO says, “Hey, I think it’s because of work-life blend. Work-life blend is bad, and that’s causing action to go down.” So work-life blend is causing low action. I’m like, “That doesn’t make any sense.” But I entered it here immediately as we were discussing, and it immediately pulled up the correlation between these two and showed how it’s looking.

Speaker 1

Hmm.

Ali Ghodsi

I was like, “Okay, wow, maybe he’s right.” But then it says, “No, actually, it’s not causal. It’s not causing it.” And here’s the exact proof points. We probably have to anonymize these folks.

Speaker 1

Yeah.

Ali Ghodsi

Here’s a manager with a work-life blend score of 44, which is pretty bad, and an action score of 77%. Things like this—

Speaker 1

They’re working hard, and he’s recognizing and taking action on their concerns.

Ali Ghodsi

Exactly. So then I said, “Okay, well—”

Speaker 1

That’s your guy right there. He’s pushing people hard, and he’s listening to them. I like that guy.

Ali Ghodsi

Exactly. So now I’m learning stuff about the organization. This is amazing. It would’ve taken me a week to get the data team to do this analysis for me. That’s useful information. We’re cutting these latencies up and down the org chart a little bit. But then I’m like, “Okay, why is it low?” So I looked through all of the comments.

Speaker 1

Ah.

Ali Ghodsi

It gives me some reasons. I didn’t like the reasons, so I clarified the question and said, “Hey, can you slice it by department for me?”

Speaker 1

Hmm.

Ali Ghodsi

Then it figured it out. It said, “Look, product management has low action because they don’t like decision-making. There are too many stakeholders.” Engineering doesn’t like the tools and systems. There’s too much. For sales operations, it’s career growth, and so on and so forth.

Speaker 1

That makes sense because salespeople always think they should get a promotion because they’re salespeople, and they should get their commissions raised. Product people think you should just listen to them instead of having six people trying to design a piece of art, you know?

Ali Ghodsi

Exactly.

Speaker 1

This all starts to track now with the data and the AI. I love it.

Ali Ghodsi

Yeah. So how did it do this? It has access to this ontology.

Speaker 1

Mm.

Ali Ghodsi

It’s not just searching live. It found that these people were already in its graph. Five people had already contributed to this, and there are 19 pieces of information here that you can see it’s leveraging. It already had them; it didn’t search for them live. These are in the ontology. We can look at this particular one. If you click on it, it has a definition, it’s a metric, and there’s a graph.

Speaker 1

Mm.

Ali Ghodsi

You can see the graph here. There’s a favorability score, and this is the author. You can click on the author, and because it understands the org chart, it understands who this person is. This person actually has 29 snippets. They have lots of different assets that it’s learned from them. So it’s constantly learning the intelligence, or ontology, of your organization. That’s a typical example. Here’s another one that might be interesting. I wanted to know about these new results from the last 59 minutes. I haven’t actually looked at all of those.

Speaker 1

Hmm.

Ali Ghodsi

I wanted to understand the org chart, what’s going on with it, and span of control. I asked it, and right out of the box, I was shocked by this. It immediately told me, “Hey, there is an org inside Databricks that is very deep.” This person reports to this person, who reports to this person, and so on. They have three people reporting to them, five people reporting to them, four people reporting to them, and five people reporting to them. So that’s not a flat organization. Then you can look at what we can do about that. Again, since it understands all the people, it can understand that right out of the box. Engineering cost is something we look at all the time, and that’s another thing we wanted to see if we could understand.

Speaker 1

What’s great about this, too, is that instead of you as the leader saying, “Hey, listen, if we’re going to have an opinion, let’s go with mine,” you’ve created a forum where people can put data first and test theories. You don’t have to be dogmatic about who came up with the theory. You just have to be intellectually curious and open to possibilities. Eventually, if this is where we are today, can you imagine where we’ll be in a year or two? It’s going to be giving you these insights. Instead of a culture report, it’ll be like a temperature gauge in your company. You’ll be looking at the nest in your company and thinking, “Oh, wow, looks a little hot today. What’s going on?” And it’ll be like, “Oh, yeah, we made people come in this weekend.”

Ali Ghodsi

Yeah.

Speaker 1

“Yeah, maybe we should buy some pizzas or give people a comp day during Thanksgiving.” Yeah.

Ali Ghodsi

Yeah. This is my favorite. This one actually came out of Genie.

Speaker 1

Ooh.

Ali Ghodsi

This is our 2,000 engineers and how many pull requests, or how much code, they’ve actually shipped into production. We look at the middle here, which is roughly per week. But it has this L shape. When you look at this L shape, the top people are committing way more.

Speaker 1

Yes. Ten times.

Ali Ghodsi

Yeah.

Speaker 1

Yeah.

Ali Ghodsi

So what the hell is going on? We looked into this, and it turns out they’re running automated factories; the rest are not.

Speaker 1

Mm-hmm. Wow.

Ali Ghodsi

So we pushed them. An interesting thing: I asked it, “Hey, can you add the cost to this line?” One of the things we found is that cost isn’t necessarily higher for those people. Look at the top. Some of the top folks are actually not spending as much as some of the other folks. That goes back to the fact that there’s a way to spend tokens smartly. You can use open source, route simpler questions to simpler models, and we actually have a product for this. You can cut your costs down significantly. This is the kind of stuff… By the way, recording the meetings is really important.

Speaker 1

Mm.

Ali Ghodsi

One of the things I heard was that there had been a customer meeting, and I wanted to understand how it went. I asked it, “Hey, was there a meeting with this customer recently? How did it go?” It literally started by saying, “The meeting went poorly.” It listed exactly who said what and what features they need. These are just some of the things you can do with AI. In the background, when I wake up, it has all these deep dives for me. Instead of waking up, calling people, and doing meetings, it’s doing the work for me. It’s pinging them and sending whatever material is needed for the company. It just compresses the time it takes to do things.

Speaker 1

Well, a lot of being in management and being a founder is detective work.

Speaker 1

I call it being Columbo, if you remember that TV show.

Ali Ghodsi

Yeah.

Speaker 1

I think it might show our age, but you're kind of like, “Oh, you know, one more thing there. Can you tell me about the client meeting? How'd that go? Who talked most on the phone? What percentage of the time did they talk, and what did the customer actually think?” And then you, as the founder, are getting spun.

Ali Ghodsi

Yeah.

Speaker 1

You're getting spun.

Ali Ghodsi

Yeah.

Speaker 1

It's not that an employee necessarily wants to spin you. A team member isn't necessarily looking to spin you. That can happen, but it's not the majority. Most people are good people. But they're human, right? They're the people in the org.

Ali Ghodsi

Yeah.

Speaker 1

Here, you take the people out of that discussion and say, “Here's, transparently, what happened from first principles.” Now we have ground truth, and we can start the discussion without you, as the CEO, having to be Mr. Detective. I don't know how frustrating it was for you two years ago to spend two hours being a detective. You get three meetings into this, and it's like, if people had just told you what happened, or if you had that report on culture, the problem would've been solved. You wouldn't have had three weeks of hand-wringing, yeah?

Ali Ghodsi

Yeah. Or the customer feedback, right? I can immediately find out what all the customers think. I have some cases where I'm having it automatically look at features requested by all our customers across all the transcripts of our customer meetings. It's gathering those, and they're immediately going to engineering. Then we have factories in engineering that can build features automatically. So it's a game changer. It's just that game of whispers we played when we were kids.

Speaker 1

Yeah.

Ali Ghodsi

Right? When people have to meet, they have to tell each other. One of our main goals is to reduce the number of human blockers. We measure that throughout the organization, and we see—

Speaker 1

Blockers. Explain a blocker in this context, please. What's something I can learn from?

Ali Ghodsi

Well, look, AI is very fast, right? It's iterating in the background, doing its work, preparing material, and so on. But at some point, it's like, okay, now we need to go to legal and make sure we're allowed to do this thing. Or we need to go to finance to get approval for this budget. Or we need to make sure marketing is okay with this. Or even within the same organization, we need to talk to a sibling organization, get a meeting with them, see what they think, and get an agreement. If we can't reach an agreement, we'll schedule another meeting to look at this again.

Speaker 1

Yeah.

Ali Ghodsi

Then if that meeting goes down, maybe we escalate it to the managers, and so on. These are the blockers that slow down organizations.

Speaker 1

Ah. So it's a blocker finder, which is great if you're the CEO, because here's the next thing: one, you have to play detective; the other one is the blame game.

Ali Ghodsi

Yeah.

Speaker 1

“Why isn't this done?” is what we always ask. When you're a leader, whatever your group is, and another group is involved, it's, “Hey, we were supposed to do this by today. We were supposed to hit this target. Who's responsible?” And then you get three Spider-Mans pointing at each other, if you know the meme.

Ali Ghodsi

Yeah.

Speaker 1

I had a similar thing. I came up with a bot, and I was going to share it with the whole company. Thank God I didn't. I came up with a bot called Major Decisions, and I said, “Go into Slack, join every room as me. Just join every channel as me.” Some people were like, “Wait a second. How did you even know we had a room?” I was like, “Join every room, read every Notion page, even if I was invited to it or not. Get every email, and find the most important decisions for me for the month. Every couple of days, give me a report on who participated in them, what the resolution was, and what's not resolved.”

Then I said, “Give me the people who participate the most in these kinds of discussions.” I realized, oh wow, these are the people who are actually making decisions in the organization. These are the people who are quickest. My next report is going to show who's quickest to contribute to those discussions. Now, in a venture firm, that's a discussion like, should we invest or not? Should we take our pro rata or not? Should we sell our shares if we got a secondary offer? On the podcast, it's like, should we book this guest or not? Should we use this clip or that one?

Then it picked up employment discussions, and it was like, “Should we fire this person or not?” Or, “Do we do PIPs?” I'm like, “We don't do PIPs.” I just think PIPs are ridiculous. If the performance isn't there, that's like the person didn't show up for—

Ali Ghodsi

Let's torture them for two quarters.

Speaker 1

Yeah. You miss practice and you show up late for the game. That's table stakes. You can't be on the team if you can't do those things. Now we're going to torture you to try to make you come into work on time or do a workout you don't want to do. So maybe you could speak to what this is going to do for you as a founder and CEO in terms of figuring out who your all-stars on the team are, who are the ones who are actually contributing. Now we're getting to essentially business Moneyball, like that movie Moneyball.

Ali Ghodsi

Mm-hmm.

Speaker 1

It's fantastic. Brad Pitt. It's such a good movie and such a good book. We're actually getting into management Moneyball, aren't we?

Ali Ghodsi

Yeah, absolutely. One of my favorite questions is to look at different orgs, because we have certain culture principles: truth-seeking, first principles, and so on. I say, “Hey, which of these leaders follow these principles? Look in their whole orgs, look at all the meetings,” and it can derive that from those. By the way, you could even ask, “Hey, this leader, what is the actual culture they're implementing?” It'll come up with different things. It'll tell you, “No, actually, the culture there is this, not the company culture,” which is essential, I think.

Speaker 1

So they're deviating from the core principles. That drift is cancerous for you as a founder, or it could be something you need to change and could be an early warning sign.

Ali Ghodsi

Yeah. We need to be consistent, whatever it is, right? Maybe they're right and the rest of the organization, including me, are wrong. But then we need to know. At least it tells me there's a divergence.

Speaker 1

Wow. Yeah.

Ali Ghodsi

Those kinds of things were nearly impossible to do. You could have done many of the other things, but a question like that—get the culture of this subgroup in a 12,000-person organization; figure out the culture of the Japan organization at Databricks. I don't even speak Japanese, and we have hundreds of people over there working. What's the culture like? How do we make decisions? How is it different from EMEA or the LatAm region that we have? Those are game changers.

For us, I share all this information with the employees. They have access to all of it themselves. Then I tell them, “This is what we want. That L-curve, we wanted to shift it to the right. So everybody, let's change that. Let's move toward this North Star that we have together.” That helps us be more competitive. Then we can build more products, take market share, and accelerate our growth further. I'd like not to be at 70 or 80% growth year over year. I'd like to be at 100%, way over 100%. That's how I see it.

In this era, this is a competitive advantage: whoever can do this best. At some point, maybe it all becomes fully diffused and everyone is using it. But right now, this is big alpha. If you can do this really, really well, better than any other organization—

Speaker 1

Interesting. Speaking of big alpha, a lot of people have been very patiently on your cap table, and we have a big debate between founders and capital right now: stay private longer. What's the point of going public if we have secondary markets that are quite efficient? Stripe has been private closer to 20 years, I think, than 10. They seem to have given the indication they're going to stay private longer. SpaceX took a little while. Uber took a little while. I felt that one, but luckily Masayoshi Son was splashy cashy. When are you going public? When, when, when? How do you make that decision? I know you've got a lot of pressure on you to do it, but you also have a lot of pressure relief valves in the vibrant secondary market.

Ali Ghodsi

Yeah. Look, my goal is to make Databricks as successful as possible in the next decade or two. That's how I'm thinking about it. What's the right strategy to get there? I mentioned this alpha of what we're doing here, the products we're building. But we're getting into new markets. We got into the security market.

Ali Ghodsi

We got into the marketing market. I’m focused on those. Then the question is: are the paths to get there better and faster if we’re public or private?

Speaker 1

Hmm.

Ali Ghodsi

And I actually think that—

Speaker 1

Take me through that. What’s on each side of the ledger for you?

Ali Ghodsi

I actually think you get access to capital and much better marketing. Everybody knows about you. Every quarter, you have this big marketing event, and you can tell your story again and again. Those are huge advantages. We have to organize our own tenders every year. Finance has to go through this big process every year.

Speaker 1

Yeah.

Ali Ghodsi

We raise $20 billion, $30 billion, and then we have to arrange that. It’s a heavy lift. There’s a marketplace that just does that.

Speaker 1

It’s also probably pretty emotional and distracting, I would think, right? People have to decide. Then you might lose people who take $10 million off the table and think, “Maybe I don’t want to come to practice anymore.”

Ali Ghodsi

I think the liquidity is a good thing because people know they’re going to get it every year. It’s predictable, and it’s the one time they have. In the past, since we started doing these a few years ago, the money we set aside for tenders has never been fully used. So most employees—

Speaker 1

Oh, that’s good.

Ali Ghodsi

Most employees are bullish. They’re like, “No, this is…” I mean—

Speaker 1

That’s actually good for you. Do you get a signal from that about who’s selling and who’s not? It’s a little bit of signal. It could be for personal reasons. But acquiring companies is a great reason to have equity, yeah?

Ali Ghodsi

We haven’t had any problem doing billion-dollar acquisitions because people know we’ll provide liquidity. Most people do the calculation. If the business is at $7 billion plus and growing 70% or 80%, they do the math. Most people say, “I want liquidity,” but when you ask them how much they want to sell, and remind them, “We’re growing 70% or 80% plus”—

Speaker 1

Yeah.

Ali Ghodsi

It’s a different story. Can you do compounded growth of 1.7 to the power of 3 or 4? Then they start scratching their heads and say, “Maybe I’ll sell 5%.”

Speaker 1

Yeah.

Ali Ghodsi

No, for real.

Speaker 1

Sitting on your hands is a very important skill to learn as an investor and an employee with this kind of stock. You do have to protect the downside when you get into that space. Who do you see as your competition right now? Everybody says something like Snowflake, but I’m watching a market where, as I said earlier, Anthropic is launching feature after feature. Cloudflare is looking at features next to them. Replit is looking at features next to them. Everybody seems to be looking in their peripheral vision. Because you can build software fast and you have a lot of developers, if those developers keep going up that ramp you showed, you only had 10% of people at the peak. As the other 90% climb up there, your developer resources are going to go through the roof. So you have a decision to make: do you have fewer developers at the low end of the tail and become more profitable, or do you invest all that developer time as they move up the ramp? How do you think about both of those issues? What do you do with the massive resources this efficiency is creating? And who is the competitor? Do you need to keep making peripheral product moves?

Ali Ghodsi

Yeah, we will make peripheral product moves. But maybe I should start by saying those were the upsides of going public. The downsides are the reason why, to answer your specific question—

Speaker 1

Yeah.

Ali Ghodsi

Why do we compete with whom we compete with? Why do we build these products? I don’t want the market to force me into a situation where sentiment is terrible this week and our stock is down. When the stock is down, the employees are literally getting a pay cut.

Speaker 1

Mm.

Ali Ghodsi

They say, “You promised me I was going to make a million dollars. Actually, you said it was going to be $2 million in a couple of years.”

Speaker 1

Yeah.

Ali Ghodsi

“But I’m looking at it right now, and it’s actually worth—”

Speaker 1

It’s underwater.

Ali Ghodsi

“—$200K. So you lied to me. I’m leaving.” Then, 3 months later, it’s, “Oh, no, no, no. Actually, revenue is accelerating. We were totally wrong. It’s up to the right now.” And they’re like, “Oh, okay. Wow, it’s great.” This back and forth—

Speaker 1

A little bit of a roller coaster can get frustrating.

Ali Ghodsi

A roller coaster. That’s what I want to avoid, so we can focus on building the company toward our long-term vision without being distracted. We will go public; we are going to be public. But right now, during this transition period of AI, there’s just too much up and down. I think it’s distracting to companies and CEOs, and it’s demoralizing to CEOs. They call me depressed because the stock is down and they don’t even understand why, and then the stock is up. That’s what we’re trying to avoid.

Speaker 1

I think it’s an issue people are starting to have with their sleep scores. You get a WHOOP, and I love it. But I got my wife a WHOOP, and then we’re comparing sleep scores. It’s kind of like looking at your Uber stock every day. You get a little bit of volatility in your relationship; it can be challenging.

Ali Ghodsi

Yeah, exactly.

Speaker 1

In other ways, it’s interesting. We didn’t circle around to what Ben Horowitz said. He said your formulation of superintelligence is some combination of the model, the power, and the time it takes to train and be accurate. Can you walk us through it? Do you have it off the top of your head?

Ali Ghodsi

Yeah, I have to do it. It’s pretty simple. I think the main problem is the context problem. We’re solving that with Genie and the ontology. The labs are focused on superintelligence. That’s what Bostrom talked about. In his book, Bostrom also asked how we get there. In 2014, I believe, he defined RSI, recursive self-improvement, which means the AI starts improving itself and gets better and better and better. Then we get this takeoff, maybe a fast takeoff, and reach the singularity. We’re no longer in control. At that point, let’s hope the AIs are well aligned, because if they’re not, we’re all going to be made into pets. That’s where the 10% risk—

Speaker 1

The paperclips. Yeah.

Ali Ghodsi

Yeah, paperclip maximizers and the 10% risk to humanity and all of that come from there. But I think a lot of this is coming from the fact that most of the people building AI have seen that AI has become really good at coding.

Speaker 1

Hmm.

Ali Ghodsi

Almost at every company, as I said earlier, coding is being done by coding agents. I think this is causing a big existential crisis in Silicon Valley. For most of us who grew up coding our whole lives, it’s a big deal. I spent 10 or 12 hours a day, 7 days a week, from third grade until my 30s, just coding all the time. I was really good at it, and I knew all these languages. Then suddenly, the AI is doing that. If it’s doing it—

Speaker 1

Right. And how much better than you is the AI?

Ali Ghodsi

Exactly.

Speaker 1

That’s the other part. It’s like—

Ali Ghodsi

Now it’s writing itself, and the next version it wrote itself. Wait a minute, isn’t that recursive self-improvement? But then this is going to speed up, and we’re going to get into this loop. The book called it superintelligence and the paperclip maximizer, so it might go off and all these bad things happen. Actually, Bostrom has changed his view now.

Speaker 1

Hmm.

Ali Ghodsi

If you follow him now, he’s not saying that anymore. He says we should do this. There are risks, of course, with cyber. But I think you need to think this through further. Just because 98% of the code is being written by AI, we don’t have RSI. If it automates the last 2%, who cares? It doesn’t matter if it’s 98% or 100%. Why does it matter? It doesn’t.

We really need 4 conditions to be true. The first is that the next model needs to be trained in a much shorter amount of time. The labs still don’t do that many big pretraining runs per year, and they’re still following what’s called the scaling laws, which means you need exponentially more hardware to get that improvement.

Ali Ghodsi

So exponentially more—like 10× more compute—to get a little linear improvement. They’re scrambling to get all the GPUs and put together the biggest data center they possibly can, with the networking, and do all the engineering. They’re having humans do all of this because they really don’t want to screw up the next run. If the next run gets screwed up, the whole thing falls apart.

We’d like that next training run to be faster. That’s condition number one. It can’t just be a little bit faster. If you’re halving the distance every time, you’ll never get there. In some sense, it has to be superlinear. Secondly, we also want it to use fewer resources, because you could say it’s getting faster and faster, but that’s because we’re 10×-ing the hardware all the time.

Speaker 1

Yes.

Ali Ghodsi

You can’t do that trick because we run out of hardware and we run out of atoms.

Speaker 1

Yes.

Ali Ghodsi

That’s the second requirement. The third requirement is that accuracy is also improving, at least linearly, or we’re getting better accuracy across the board in a generalized manner. It can’t just be getting better at this one dimension we did reinforcement learning on, or just math. It needs to be across the board on all of its tasks.

Even if you do all 3, it’s not enough. Let’s say you do that 5, 6, 7 times. That’s awesome. You get really awesome models. That’s not that kind of superintelligence. The fourth condition is that you can actually put this in a loop, and all the previous 3 conditions need to be continuously happening. Then we end up in a world where the next model takes 3 months, then 1 month, then 2 weeks, then 1 week, and it’s getting smarter and smarter and smarter. It’s costing us $100—or maybe it costs us $100 million, then $50 million, $25 million, $10 million, $5 million, $2 million, $1 million, and then it goes down and down. That’s the kind of scenario we have.

Speaker 1

Yes.

Ali Ghodsi

If you have to look at it—

Speaker 1

That’s the flywheel.

Ali Ghodsi

That’s the flywheel. That flywheel doesn’t exist right now.

Speaker 1

Mm-hmm.

Ali Ghodsi

The models are taking longer to train, and there’s more data cleaning. There’s more manual whack-a-mole happening, where you have vendors like Mercor that have to go get the data from very skilled labor. Then you have to do reinforcement learning in these gyms, and you have to whack-a-mole in each domain.

Speaker 1

Mm-hmm.

Ali Ghodsi

So it’s very domain-specific. And then, of course, pre-training requires more resources. That doesn’t look like we’re getting into this loop. By the way, even if you satisfy all 4 conditions I’m saying, that doesn’t guarantee you’ll have a conscious being that’s taking over everything.

Speaker 1

It’s the precondition for that happening, and there’s no guarantee that it actually happens.

Ali Ghodsi

It’s a precondition. But even if you had that—which we don’t have—to threaten me right now, you would have to have a killer robot come into this room right now and wrestle me down.

Speaker 1

Right.

Ali Ghodsi

Or something. Those don’t exist yet.

Speaker 1

Yeah. Right now, you can have a bunch of hackers take a really capable model, and you can find out that the refrigerators in grocery stores in France have the password “admin, admin.” You can remotely script-kiddie into them, turn them into defrost mode, and make a bunch of butter go bad, and milk.

Ali Ghodsi

Yeah.

Speaker 1

Which is a tragedy for the French, I understand.

Ali Ghodsi

Yes.

Speaker 1

But it is not superintelligence, I can assure you.

Ali Ghodsi

Yeah.

Speaker 1

I mean, did you see that hack and how people were losing their minds over it? I’m like, “Guys.” You know how, when you buy a new router now, it has the serial number and then a random password?

Ali Ghodsi

Yeah, admin, admin, yeah.

Speaker 1

If they’d done that on the refrigerators, they wouldn’t have been able to hack one of them unless they got into the place, took screenshots of 20 different refrigerators, and physically compromised some supermarket in the 8th arrondissement. That supermarket would have lost, I don’t know, 10 pounds of butter. It wouldn’t have been a big deal.

Ali Ghodsi

So look, cyber, I do think, is a real thing.

Speaker 1

Yes.

Ali Ghodsi

And I think it’s a real risk. We actually have a whole product in the cyber space called Lakewatch, built on all this data, that has automated agents that detect these kinds of intrusions and monitor your agents. This is a real problem, and I do think bad things will happen here, but then we will adjust. Bad things happened when the internet came out as well.

Speaker 1

Shouldn’t we be able to solve for this? You tell me if I’m right or wrong here. One theory I heard, which resonated with me for a certain type of hacking—not for script-kiddie hacking, but real hacking—is that you need a lot of compute to execute certain hacks, like the Hugging Face one: 1,000 agents, whatever. The bad guys don’t have that much compute. The good guys have massively more compute, and so if you did your basic job as a white hat, defended properly, and looked for these exploits, let’s say you have 1,000 times the resources, you should be able to get to these problems long before the hackers. Does that make good sense to you? They’re just—

Ali Ghodsi

Yeah.

Speaker 1

Yeah, it’s a good argument, right?

Ali Ghodsi

Yeah. But there’s an issue: you have to weigh that against the following asymmetric scenario that we have—

Speaker 1

Yes, yes, yes.

Ali Ghodsi

If I’m an attacker, I can launch thousands and thousands and thousands of agents, and all of them can fail except for one. If one of them gets through, I’m completely successful. The asymmetry is that if I’m a defender, I have to protect my boundaries all the time. If one gets through, then it’s a complete disaster.

Speaker 1

This is a suicide bomber—not to be too graphic—but you only need to get one 9/11 to make your point. You can try 1,000 times and not get there.

Ali Ghodsi

Yeah, yeah. So I need to be 100% safe all the time.

Speaker 1

Yeah.

Ali Ghodsi

They need to just get one thing through.

Speaker 1

Get lucky once.

Ali Ghodsi

So that risk is very asymmetric. But the way I would look at it, the reason I think we’re actually going to overcome this and it’s going to be totally fine, is that these are latent bugs that exist in the source code. By the way, we’re not creating more of them now, because almost all of us are scanning it. We all have products. We actually sell a product where you can scan the vulnerabilities in new code. New code that’s being produced isn’t going to have these vulnerabilities.

That might sound silly, but think about it this way: In the next 12 months, we’re going to write more code than ever in the history of mankind. Actually, in less than the next 12 months. So all that code is going to be secure. And, by the way—

Speaker 1

Because right now the AI is sophisticated enough not to make human errors, and to look for them, and it’s more dogged.

Ali Ghodsi

Yeah, and you just scan those things. So what remains is all the legacy code, which we can rewrite. That’s what we have to go through, and there are—

Speaker 1

And people are doing that, right? That’s part of what Chamath’s doing at 8090, yeah?

Ali Ghodsi

Yeah. There are other ways to protect things, like doing shadow patching without touching the existing legacy code. What’s happening is that you can think of it like a fruit garden, and there are bugs that attackers are leveraging. They’re picking the low-hanging fruit. Before, humans could pick a certain low-hanging fruit. Now agents can reach higher and pick higher-hanging fruit. But we’re going to clean those up, and then they can maybe reach a little bit higher. There are only a finite number of vulnerabilities in the code. Once we’ve secured that code base, there are no more. It’s not an infinite thing that’s going to go on forever. Then it stops, and we’re at the steady state. Vulnerabilities might actually be fewer than what we had in the past.

Speaker 1

I think that eventually, back to AMP, where you went at Berkeley, it's the people in the loop who are the vulnerability. It's just going to be somebody getting compromised, as we saw over the last week or so. The humans do have vulnerabilities. I'll leave it at that.

Hey, I want to end on this one thing. You spent a lot of time in Berkeley, in the hippie-dippy EA community, among the accelerationists and decelerationists. What's the nature of this group, of the EA faction, and how they look at the world? How confounding are they to the rest of American society? Who are these people? What do they believe? Are they a little drunk on their own success, or do they actually have really important insights, and we need to focus on what they're saying and take them at their word? It's a big controversy.

Dario, during the roadshow, is saying, “Cancer and Alzheimer's, I believe, will be gone in under 10 years.” That's very beautiful to say, except—

Ali Ghodsi

Not because everybody's dead, right?

Speaker 1

Yeah, except if your mom or dad are dying from cancer and you think, “Oh, I have a window here where I could save them,” or your grandmother has Alzheimer's. Now you're talking about giving people false hope, and you maybe shouldn't make claims like that. But I don't doubt Dario believes it. I actually think he does. Unpack these people, because you've been around them for two or three decades.

Ali Ghodsi

Yeah. Well, I think that most people on both sides—actually, on all sides—they're the heroes in their own book, right? We all wake up thinking, “I'm the good guy, and I'm doing the right thing.” So I think it comes from a good place.

I think they are seriously nervous about this kind of superintelligence taking over. If you read Bostrom's books—actually, if you read those books and internalize what he wrote before any of this, then you get kind of freaked out, right? I was certainly freaked out when I read it.

I think they're starting with those assumptions and then looking at, “Okay, if it's getting smarter this fast, and look at the cyberattacks that are happening... Dot, dot, dot, we're going to get this kind of superintelligence that's described in the book.”

Speaker 1

Mm.

Ali Ghodsi

But there are a few dot, dot, dots there that are not clear. Then they would say, “Well, look, shouldn't we be cautious?” So I think we should look at safety. Cyber, I think, is a big deal that we should look at.

But the reality is that I think we know how to handle this. We will be able to manage through this. I think we'll be... The biggest risk right now is cyber—

Speaker 1

Mm.

Ali Ghodsi

—and I think it's manageable. This RSI, I don't see any evidence of it. If there's data that others have that I don't have, I don't know what I don't know. But based on what I'm hearing here in San Francisco, where all the labs are, and all the people I meet, I don't see those four criteria I mentioned even being fulfilled. So I don't see any risk that would make me worried about what's happening.

And the second thing I said: even if we got there, I don't see the means in society. It's just digital. We can just shut down the computers right now, you know? I do think cyber is real. If a hospital went down—

Speaker 1

Absolutely.

Ali Ghodsi

—instead of a refrigerator, that is concerning. And they—

Speaker 1

Kids using it, their kids using it and developing parasocial relationships with Character.AI, or it giving you bad information if you're suicidal or something. There are concerns about how the technology gets deployed.

We just went through this with social media, and the profound impact that had on society. We're going through it now with truth and news, and the manipulation of news via algorithms. So there are things to be concerned about.

Ali Ghodsi

Yeah.

Speaker 1

Being turned into paperclips, maybe not.

Ali Ghodsi

But I think the healthcare stuff is absolutely real. At Databricks, we were involved with Regeneron, where their researchers found the genome responsible for chronic liver disease using Databricks, and actually came up with drugs for that—

Speaker 1

Best-case scenario, in under a decade—

Ali Ghodsi

—using AI.

Speaker 1

—if you were to take the claim we had Dario make. Any chance that we cure cancer in the next 10 years? That's a pretty bold statement.

Ali Ghodsi

It's very hard for me to say. I don't know exactly what's needed. I think progress will be faster, but a lot of these things also have to go through—

Speaker 1

FDA and trials and—

Ali Ghodsi

—you know, human trials. We can't just test stuff on humans willy-nilly, right? And just because you tested it on animals, that's not enough either. So I don't know. Maybe in 10 years, maybe not in 10 years. Maybe it takes 30 years, maybe it takes 50 years. I don't know. Maybe it takes 6 months. Maybe it's already more or less solved. But it is helping already.

The use case I gave you with chronic liver disease is super important. By the way, that was the previous generation of AI that we used at Databricks. We trained a new one now with Merck, and it's called TEDDY, Transformer-Enabled Drug Discovery. It's a transformer model, but instead of the next token being English, it's the gene regulatory network, or GRN. So it can say, “Okay, this genome is actually causing this disease. This genome is just reacting to it, so don't target it for a drug.” So this will accelerate drug discovery. It's a game changer.

Drug discovery aside, I'll give you another example. Crisis Text Line uses Databricks and large language models and these agents. They detect if kids want to self-harm, and that helps prevent it. Virtue Foundation uses Databricks. Zipline—this was a use case reported before—used Databricks to deliver food. They had these drones, right?

Speaker 1

And blood.

Ali Ghodsi

The drones would deliver everything. All the data about those drones—their path, the battery, all of that—was running on Databricks. So we see these use cases all the time with AI, and it is going to make the world a better place. There are risks. We will deal with those as well.

People are nervous because things are changing. I think there are a lot of researchers at AI companies who maybe understand the research very well, but they haven't looked at how the economy works or how these things are going to evolve.

Speaker 1

And they've watched a lot of sci-fi, let's be honest. They are being informed by a certain narrative. The idea that there's a 10% chance that 7 billion people die because of AI seems so farcical and out there that when you pick a number, it makes you seem credible to an average Joe who's like, “Well, these are smart people who make a lot of money, and if they think it, maybe they're right.”

Ali Ghodsi

Yeah, if they're saying it themselves, right?

Speaker 1

Yes.

Ali Ghodsi

That's how people think. But for me, that risk is close to zero. I think the cyber risk is real, and really bad things can happen with that. That's why we're focused on it.

And then, to solve this context gap that I mentioned in enterprises—the thing we're focused on to actually get value everywhere—I think it's going to take 10 years. I think this is something that's going to take 10 or 15 years. The labs think this will happen in the next 6 months, 12 months, or 2 years. But I actually think GDP will move very slowly, and it's going to take decades for us to get through it.

Why? As I said, just go back to the anecdote at the beginning: the CEO of the bank who said, “We can't even record the meetings.” If you can't record the meetings, the AI doesn't even know what's happening in the meeting. How could it possibly do the kinds of things we discussed when I showed you Genie and the ontology?

Speaker 1

Yeah.

Speaker 1

It's going to be a paced rollout, to be sure, and there are some of us who are running ahead around the corners, doing really cool stuff. That's exactly what we both experienced with the internet. When the internet first came out, the people who were using it to its fullest extent were like, “Okay, this is going to change everything.” Then 99% of people were on dial-up and had never seen a high-speed connection, so their brains couldn't conceive of YouTube or unlimited free photo storage. It didn't make any sense.

Ali Ghodsi

Yeah, there was a kid called Robert Morris—

Speaker 1

Yeah.

Ali Ghodsi

—who took down 10% of the internet with a worm. It's called the Morris worm.

Speaker 1

Yeah.

Ali Ghodsi

He almost got a jail sentence for it. Then he went on to become a famous MIT professor in computer science, and he's a very famous guy.

Speaker 1

Right. Yeah.

Ali Ghodsi

But that took down a whole 10% of the internet back in the day.

Speaker 1

Which is completely possible. At some point today, I saw somebody say they may have cracked Signal to a certain extent. Okay, sure. Let’s see what happens. Ali, thank you so much for your time.

Ali Ghodsi

Thank you so much.

Speaker 1

Great job, Ali. You were awesome. I’m going all in. I’m going all in.