[BidClub_]
The a16z Show · · 46 分钟

如何防御 AI 黑客:专访 Wiz 的 Ami Luttwak

Ami LuttwakZane LackeySarah Wang

AI与软件技术
YouTube ↗
TL;DR
  • Ami Luttwak 表示,AI 如今能在约 20 分钟内完成过去顶尖黑客要花数周甚至数月才能完成的攻击。开源模型追赶的速度快于他的预期;在漏洞发现能力上,他认为前沿模型的领先优势“不会超过 3 个月”。眼下的目标包括手握客户 AI 密钥的初创公司:凭证一旦被盗,攻击者就能“劫持大模型”(LLM jacking)。
  • 攻击利用提速之际,补丁体系却跟不上机器的速度。Luttwak 称,在 Wiz 的客户中,PHP 漏洞爆出后的两三天内,约 50% 已完成修补;但旧版本没有补丁,补丁分发也可能拖上数周甚至数月。他认为,采用自动化开发、测试、CI/CD 和运维的新公司有机会实现自动化修补;老牌企业转型则困难得多。
  • 安全 AI 的能力提升伴随着不小的成本压力。一次全面代码扫描可能要花 500 万美元,Luttwak 称一些客户在扫描上的支出已达数千万美元。要让服务持续运转,就得先用确定性检查和更便宜的模型筛选,再交给昂贵模型深入分析;否则“销售越多,亏得越多”。
  • Luttwak 认为,持续测试外部暴露面比再做一次全面代码扫描更优先。新模型能力提升后,昨天有效的防御今天可能就不够用了,因此测试也要随能力变化持续进行。他称,Wiz 多数客户已经在使用其红队 Agent,但整个行业的普及程度仍然不足:“最好的防御就是攻击。”
  • 手握高价值凭证的创始人,应更早投入安全建设和自动化。Luttwak 称,Wiz 统计的遭攻击 AI 开发服务商名单在 10 月从 9 家增至 15 家。他建议限制 AI 密钥的使用额度,控制密钥被盗后的费用;Zane Lackey 则主张,创始人赶发布进度时,也应同步持续测试和修补。
  • Luttwak 认为,增加预算无法取代安全架构。Sarah Wang 提到,一位 CISO 预计明年预算将增加 80%;Luttwak 则强调隔离、锁定,并为国家级攻击者做准备。他直言,清单式产品和以报告为中心的工作流程存在根本问题:“安全团队做的大多数事都不是安全。”
  • 这场讨论的预测范围已超出软件公司,但对未来两年的走向仍有很大不确定性。Lackey 称,不意外的话,互联网蠕虫可能会卷土重来;Luttwak 认为 10 月“可能只是个开端”,但无法预见两年后的情况。制冷系统攻击等联网基础设施风险,促使 Wiz 发起 Scan for Good 项目,为公共服务机构提供初步扫描,而非完整解决方案。
摘要 · 为研究而整理的核心内容

1. “黑色十月”将攻击周期压缩至 20 分钟

  • Luttwak 将 10 月称为“黑天鹅事件”:漏洞数量和严重程度前所未有,AI 攻击也已从可能性变成现实。在“黑色十月”之前,Mythos 时刻表明模型能够发现漏洞;OpenAI 涉及 Hugging Face 的事件则暴露了 AI 攻击风险,不过当时的攻击是意外发生的。如今,模型已经能发现并利用复杂漏洞。过去顶尖人类攻击者要花数周甚至数月才能完成的攻击,现在“约 20 分钟”就能跑完,连普通的 API 错误也可能被利用。

  • Lackey 转述称,进攻安全从业者认为开源模型落后 6 到 9 个月。Luttwak 则认为,开源模型在漏洞发现上的差距“不会超过 3 个月”,同时强调,发现漏洞和执行攻击是两回事。对于后者,开源模型已经足够强。他此前希望开源模型落后 1 年,如今看来过于乐观。

  • 初创公司已经成为攻击目标,因为它们持有的凭证有价值。Luttwak 称,Wiz 统计的 10 月遭攻击 AI 开发服务商名单从 9 家增至 15 家,而且还在增加。攻击者可以先窃取客户的 AI 密钥,等初创公司发现并响应时,损失可能已经发生。他给出的实际建议是:给密钥设置使用额度上限,避免失窃后产生巨额账单。

  • 独立发现漏洞的情况正在增多:Wiz 和另一支团队 Caliph 分别发现了 PHP to Shell 漏洞。Luttwak 将漏洞发现比作“比特币挖矿”:新模型会带来更多发现。Wiz 的零日漏洞竞赛也收到多份关于另一处严重漏洞的报告,他认为该漏洞将对互联网造成重大影响。防御方要做的,是趁前沿模型领先的短暂窗口,在攻击者之前检查关键基础设施。

2. 补丁速度仍受制于周边系统

  • Luttwak 称 PHP 漏洞“可能是 AI 发现过的最严重漏洞”。Wiz 客户中几乎 100% 都在运行某种 PHP;他表示,漏洞披露后的头两三天内,约 50% 的客户完成了修补。Sarah Wang 估计,互联网约 70% 依赖 PHP;Luttwak 则称,光是修复这一处漏洞就可能要花数年。旧版本甚至没有补丁可用。

  • Wang 提出的核心矛盾是:编写漏洞利用代码的时间缩短了,而过去 20 到 25 年里,修补所需时间似乎反而变长。Luttwak 称,CVE 公布前,漏洞信息就可能泄露;即便 CVE 已经公布,补丁也未必准备就绪。Wiz 与 PHP 团队合作数月,试图为行业预作准备,但信息还是提前泄露。客户即便想尽快响应,当时也无补丁可用。

  • 分发补丁又带来一重客户无法控制的延迟。已披露的 Linux 内核漏洞,可能需要数周甚至数月才能覆盖所有发行版;AI 几分钟内就能利用漏洞。Luttwak 说:“世界还没准备好。”谈到自动修补时,他坦言:“我们还不知道该如何准确地自动修补”,也“坦白说,看不到通往这一步的路径”。

  • 但他也补充说,新公司可以从创立之初就按自动修补来设计。整条流水线都得搭起来:Agent 把工单转成补丁,自动化测试验证补丁,再由自动化 CI/CD 和 DevOps 完成部署。多数老牌企业缺少这条链路,Luttwak 认为,要在大量现有代码上补齐并不现实。初创公司则应把这项工作列为明确任务。

3. 模型编排决定安全 AI 能否规模化

  • Wiz 的 Atlas harness 会调用不同模型检测漏洞,因为各家模型、不同版本和专用网络安全模型的能力并不相同。Luttwak 将其形容为一张由能力、速度和成本构成的“复杂矩阵”。即使 Wiz 现在已成为 Google 的一部分,他给独立公司的建议仍是“始终尝试所有模型”,找到最合适的组合。

  • 蓝队 Agent 展示了背后的成本逻辑:先做确定性检测,再交给便宜模型筛查,最后由更先进的模型复核。如果前几层判断事件具有恶意,最先进的模型才会做最终评估,然后通知客户。每个事件都直接调用最贵的模型,行不通。对 Luttwak 来说,这种流水线设计是 AI 服务要实现规模化所面临的核心工程挑战之一。

  • 持续扫描会进一步推高成本。假设 4 月做了一次代码全面扫描,可能白花 500 万美元;之后“Mythos 1.2”来了,还要不要重扫?一些客户在扫描上的支出已达数千万美元。随着模型和应用变化,预算必须覆盖外部和内部测试、代码、磁盘及运行时。Luttwak 明确不愿宣称问题已经解决:“我不会告诉你我们已经搞定了。”

4. 持续测试外部暴露面优先于全面代码扫描

  • 红队 Agent 的出发点是:即使应用没有变化,安全形势也在变。Luttwak 打了个比方:门底下藏着一把钥匙;攻击者“每周都在获得超能力”,上周看似安全的系统今天就可能失守。持续用最新模型发起攻击,目的是在对手之前发现变化,并结合内部环境信息指导外部测试。

  • 他对工作顺序的要求很明确:先用确定性方法梳理暴露面,再测试所有未认证且能从互联网访问的目标,之后才做更深层的渗透测试和代码分析。他以“谁在乎你的代码?”强调紧迫性。一个具体例子是近期某事件:移动应用里硬编码的密钥导致用户数据暴露。攻击者利用的是触手可及的错误,不只是复杂的软件漏洞。

  • 测试投入应按目标调整。针对 100 万个端点,暴露面 Agent 可以给每个端点花几分钟;关键应用则可能值得投入 10 小时尝试利用漏洞。红队和蓝队工作流也应该打通:如果工程团队认为某个漏洞修复成本过高,蓝队 Agent 可以围绕它布置检测。“一切都会变成流水线。”

  • Luttwak 称,Wiz 多数客户已经在用红队 Agent,这是增长最快的功能之一;他表示,覆盖率正迅速迈向几乎全面普及。但在整个行业,他认为采用程度仍然不足,行业注意力也放错了地方,过于看重代码扫描的宣传。“没有什么比持续从外部扫描你的环境更重要。”

5. 安全团队需要架构、上下文和机器级响应速度

  • Wang 问,安全工作积压的创始人该如何应对即将发布的产品,并提到 Lackey 和同事 Joel 的备忘录建议增加安全投入,必要时推迟发布。Lackey 的回答强调两件事并行推进:开发期间由 Agent 持续测试;新公司从一开始就在软件和基础设施开发中构建自动修补能力。“安全这场游戏已经变了。”

  • Wang 提到的预算增加 80%,来自一位预计明年增加预算的 CISO。Luttwak 质疑,光靠预算能否解决问题:公司必须做好准备,应对拥有顶尖专业能力和速度的攻击者。他列出的优先事项包括沙箱、隔离,以及锁定网络、进程和镜像。仅仅把工作负载放进 Kubernetes 并不够,内核漏洞仍可能让攻击者逃出容器。“准备好应对国家级攻击者。”

  • Luttwak 对现有工作流程的批评相当直接:“安全团队做的大多数事都不是安全。”他对比了攻击系统和做合规、写报告所花的时间,并点名批评传统 CSPM 配置检查清单。他认为,团队应把精力放在发现重大风险、降低风险或增加检测、准备响应,以及建立可持续的隔离策略上。

  • 客户越来越希望安全团队能提供修复方案和 Pull Request,也希望看到调查、取证和根因分析。下一步是自动化响应,Luttwak 称这“非常可怕”。老牌企业仍受困于数千名开发者、资源归属不清和大量未写下来的知识;Agent 不会凭空获得这些上下文。运营的考验依然严苛:“如果我不能在几分钟内响应,”他问,“那我还能有什么用?”

6. 下一波数据泄露可能波及联网实体基础设施

  • 展望未来 2 到 3 年,Lackey 预测,网络安全可能回到 1990 年代和 2000 年代的状态:未认证的远程漏洞和数据泄露频繁出现。他说,看到蠕虫再次出现“我不会感到意外”。他以 Windows XP 为例:机器连上互联网后,可能在安装和更新期间就感染病毒;由于失陷速度快过打补丁,用户不得不先断网安装。

  • Wang 提到,Luttwak 4 月曾预警,未来 12 到 18 个月可能迎来 Y2K 时刻。他如今说,10 月“可能只是个开端”,但不愿预测两年后的情况。他明确表示,AI 攻击已经“胜过任何人类”;他举例说,当天就发生了针对内核驱动的零日漏洞攻击。他认为,要在这种攻击者面前生存下来,就必须重新设计面向互联网的系统,并迅速让尚未准备好的系统下线。

  • Wang 将讨论引向欧洲的制冷系统攻击及其对食品供应的影响。Luttwak 担忧任何联网的老旧系统,包括交通基础设施。Scan for Good 为公共服务机构提供扫描,帮助发现问题并推动持续测试。他也限定了项目能做到的程度:“这不可能解决他们所有的问题。”他希望,扫描发现的具体问题能说明为什么有必要开展更大规模的安全项目。

完整逐字稿
Zane Lackey

We’re going back to the ’90s and 2000s again. We’re going to see breaches popping out all the time again. It’s going to look very different from the last 15 years of security.

Ami Luttwak

AI attackers are actually going after companies and startups at a scale and speed we’ve never seen.

Sarah Wang

Elon Musk tweeted that recently: “Every day is zero day.” What is AI doing to make this happen?

Ami Luttwak

Models are good enough now to find and exploit complex vulnerabilities. The other thing is open source models. That’s the scary bit. A few months ago, we said we had a few months until open source models caught up.

Sarah Wang

Yeah.

Ami Luttwak

So now they’re catching up.

Zane Lackey

The security game has just changed. You need to be thinking about how you can automate so much of both the blue side and the red side right now.

Ami Luttwak

Most of what security teams do is not security. We should stop doing most of what we do—

Sarah Wang

Yeah.

Ami Luttwak

—and focus on finding critical risk, figuring out how we mitigate it, or at least put detections in, and also preparing to respond.

Zane Lackey

What do you think the next several years look like?

Ami Luttwak

AI attacks are prevalent and easy, but also better than any human. That’s the problem. The only companies that will be able to survive are companies that are—

Sarah Wang

Ami, thank you so much for joining us. Security professionals are calling October Black October, and it’s clear that we’re entering a new era of agentic attacks. To start off, can you walk us through what the heck is going on right now, and how do we get through this critical moment?

Ami Luttwak

Yes. First of all, great to be here. We’re calling this Black October since, in my view, it’s a black swan event. We’ve never seen so many security incidents happen in a single month. We’re talking about multiple different types of security incidents: both the number of vulnerabilities found in October and their severity, including the PHP vulnerability, probably the most severe vulnerability ever found by AI. Vulnerabilities are coming at a rate we’ve never seen. But even worse, we’re seeing the rise of AI attacks: attackers using completely new speed and expertise, actually going after companies, startups, and refrigerators at a scale and speed we’ve never seen.

Sarah Wang

Yeah. The scary thing about that, to your point, is the speed. You’ve said to us privately, and probably publicly as well, that every day is zero day, right? Elon Musk tweeted that recently. Say more: what is AI doing to make this happen? What’s the mechanism that lets it speed up writing exploits? I think you did some work around this, where you found it collapsed the timing from months to weeks. Say more about how that works. And, for the audience of this podcast, what should founders be thinking about and doing?

Ami Luttwak

If we think about how we got here, there were 2 major moments before Black October. One was the Mythos moment, when Mythos came out and said, “Oh my God, we can find vulnerabilities.” That was one moment. But again, nothing happened. We said, “Oh my God, it’s coming,” but we were still at a point where people said, “Okay, what? The world is still turning; the sun is still rising.”

The other big moment we had was the Hugging Face incident with OpenAI, right?

Zane Lackey

Yeah.

Sarah Wang

Yep.

Ami Luttwak

That was another major incident where we saw the risk of AI attacks, but again, they were accidental attacks.

Sarah Wang

Yep.

Ami Luttwak

What happened now in Black October is that all of those potential theories, the things we said were coming, came and crashed upon us. It’s happening right now. One thing is that the models are good enough now to find—

Sarah Wang

Yeah.

Ami Luttwak

—and exploit complex vulnerabilities. This is not a theory anymore. It’s happening. There’s an explosion of vulnerabilities. The other thing is open source models. That’s the scary bit. We said it when we spoke about Mythos a few months ago: we had a few months until open source models caught up.

Sarah Wang

Yeah. Yeah.

Ami Luttwak

So now they’re catching up. It means it’s not just about vulnerabilities. They’re able to find ways to run code in your environment. It doesn’t have to be a complex PHP vulnerability. It can just be a mistake in your API. They can find and use those zero days in your code, and basically run an entire attack that usually took the best attackers weeks or months in around 20 minutes. That’s what we’re seeing now. So—

Sarah Wang

Yeah.

Ami Luttwak

—your entire—

Zane Lackey

How far behind are we seeing the open source models? When we’re chatting with folks on the offensive capability side, it tends to be about 6 to 9 months or so, but that’s close enough at this point. I’m curious what you’ve seen.

Ami Luttwak

There are 2 different questions. On the offensive side, are we better than the open source models at finding a vulnerability? Maybe we have 3 months. It’s not more than 3 months.

The problem is the offensive side of attacking. Because—

Zane Lackey

Yeah.

Ami Luttwak

—I’m a company. It doesn’t matter. Let’s say it’s a startup. Again, we’re talking about a wave of attacks. If we just look at AI development providers, we had a blog about how we initially saw 9 companies attacked in October, and the list is growing every day. We’re now at 15.

Sarah Wang

Wow.

Ami Luttwak

That’s—

Sarah Wang

Jesus.

Ami Luttwak

—just one example of one market: AI development platforms. These are getting targeted specifically now because they have AI keys. The fact that an attacker doesn’t have to be sophisticated and can use AI—open source models are good enough to find problems in your code—is a big problem. They can also use those problems in 20 minutes. Think about which startup is ready to detect those attacks, find them, and respond in time. You need a 24/7 SOC in every small startup.

Zane Lackey

Yeah.

Sarah Wang

Right.

Zane Lackey

Why don’t we talk for a second about PHP to Shell as an example, a case study of one of the many things that came out during Black October? Can you talk a little about how prevalent you saw this across your customer base? Now that we’re a couple of weeks out, I’m curious about how patching has actually been across your customer base, and what the state of things is a few weeks after it came out.

Ami Luttwak

PHP is one of the most prevalent technologies as an external-facing technology, right?

Zane Lackey

Oh, yeah.

Ami Luttwak

The—

Zane Lackey

As a former CISO of a PHP e-commerce company, yes, I—

Sarah Wang

What did I think? It’s like 70% of the internet or something.

Zane Lackey

Yeah.

Sarah Wang

Yeah.

Zane Lackey

Yeah, exactly.

Ami Luttwak

Exactly. The impact is that basically almost 100% of our customers had some PHP running. We saw a major drop very quickly. I wouldn’t say customers have automated patching yet, but they’re very aware of the importance of patching. I’m talking about 50% patching within the first 2 or 3 days.

Zane Lackey

Mm-hmm.

Ami Luttwak

So, almost immediate reduction. But the problem is that this is 70% of the internet.

Zane Lackey

Yeah, exactly.

Ami Luttwak

So even just this single vulnerability is going to take years to resolve. There are many cases we see, both on the internet and in customer environments, where they don’t have any way to patch.

Zane Lackey

Yeah.

Ami Luttwak

Older versions of PHP aren’t even getting a patch.

Zane Lackey

Yeah.

Sarah Wang

Can I ask a meta question here? Two of our partners wrote this great piece on time to write exploits versus time to patching. There’s a lot of dialogue out there about how AI has made it cheaper and easier to turn a patch diff into a working exploit, and there’s some data showing that time falling. On the other hand, the data seems to show that time to patch actually hasn’t gone down. In fact, it’s gone up if you look at the data over the last 20 or 25 years. Can AI help with that side as well, Ami, or is it still early days?

Ami Luttwak

First of all, you’re right. The time to get an exploit has gone down dramatically. It’s even worse because many times the information leaks before the CVE is out, okay?

Zane Lackey

Right, yep.

Ami Luttwak

Many times, even when the CVE is out, the patch is not ready.

Zane Lackey

Yep.

Sarah Wang

Mm.

Ami Luttwak

In the PHP case, we worked for months with PHP to get the entire industry ready, and it leaked before time. So the customer doesn’t have anything to do. The patch isn’t ready. In Linux right now, even if a vulnerability is reported to the Linux kernel, it might take weeks or even months until it reaches all of the distributions.

Sarah Wang

Right.

Ami Luttwak

The industry in general isn’t ready for this. Even if you can patch internally quickly, sometimes a patch isn’t ready until it gets to your distribution. The industry isn’t ready for AI.

Zane Lackey

Right.

Ami Luttwak

AI can exploit things in minutes. The answer is that the world isn’t ready for this. In terms of patching, you’re right: we don’t yet know exactly how to patch automatically, and I honestly don’t see a path toward that. It’s easy to say, “Yes, let’s automate everything.” In reality, if you’re building a new company now, you can do it. If you’re building a new company and you have automated engineering, automated CI/CD, and automated testing, you can get to a position where I tell you, “Patch this,” and your entire system can do it automatically. I think new companies should design their systems to be able to patch automatically.

Speaker 2

Mm-hmm.

Ami Luttwak

To do that, you need an entire agentic pipeline for everything. You need automated development, so you need the ability to take a ticket and have an automated developer create the patch. Then you need automated testing, automated CI/CD, and automated DevOps. There aren’t a lot of legacy companies that have all of that, and it’s not even realistic for most of their code. But for startups, maybe it’s possible, and I would consider this a task for startups.

Speaker 2

Yeah.

Ami Luttwak

If you’re starting, plan for this.

Speaker 0

Yeah, absolutely. I’m curious to dive a little deeper on the offensive side. Going through the discovery of this, it was funny—a bit of a footnote here—but this was a vulnerability independently discovered by 2 groups, Wiz and Caliph, around the details of the PHP-to-shell vulnerability, which used to happen a lot back in the day.

Ami Luttwak

Yeah.

Speaker 0

For your research team, how were they leveraging AI to discover this? Could you go a little deeper on how it’s unlocking vulnerability research teams?

Ami Luttwak

A few things. First of all, I think this will happen much more now.

Speaker 0

Okay.

Speaker 2

Mm.

Ami Luttwak

Every time there’s a new model, there are new capabilities.

Speaker 0

Yeah.

Ami Luttwak

Again, I look at it like Bitcoin mining. The number of vulnerabilities will go down, but because it’s like Bitcoin, there are always more. The new models can uncover more vulnerabilities, so it’s not surprising that there’s a new model and then multiple teams find new vulnerabilities.

Speaker 0

Exactly, yeah.

Ami Luttwak

By the way, right now we’re getting ready for ZTC, the zero-day competition of Wiz, and we’re getting multiple reports on a very critical vulnerability that I believe is going to have a major impact on the internet. This vulnerability is being reported by multiple teams.

Speaker 0

Yeah.

Speaker 2

Wow, yeah. Mm.

Ami Luttwak

It’s never—

Speaker 0

It’s amazing how everything old is kind of new again in the security industry right now.

Ami Luttwak

Yes, you’re right. Internally, our vulnerability team built something for the Wiz product that we call Atlas. It’s a harness for vulnerability detection, and we’re using it with different models all the time, because every model has its own unique capabilities. OpenAI, Google, and Carbon each have their own capabilities, so we’re trying to use all of them and find whatever we can. But everyone is doing it, so you’d expect a lot of teams to find vulnerabilities at the same time. That’s the important thing: we have to focus on critical infrastructure using frontier AI models that have a few months of advantage, and continuously do that in those areas to make sure we find vulnerabilities before attackers. But there’s so much code in the world that it doesn’t solve everything, because attackers will still find vulnerabilities in areas we didn’t look into.

Speaker 2

I don’t want to take us down a frontier-model rabbit hole too much, but I want to probe a little on what you said about using multiple models, with each one being good at different things. To the extent you can share, Ami, I’m curious about 2 points. First, what are different models better at, at a high level? Second, how do you see the relationship between frontier labs and independent cyber companies these days? Obviously, Wiz is part of the Google family now, so you have the DeepMind team and their models at your fingertips, but it sounds like you’re using multiple models.

Ami Luttwak

I think every model, and every version of every model, is different. Now it’s getting complicated because you have the frontier models and the cyber versions of those models.

Speaker 0

Right.

Speaker 2

Right.

Ami Luttwak

Each of them has its own capabilities. It’s a complicated matrix.

Speaker 2

Yeah, that’s—

Ami Luttwak

The point is that each of them behaves differently, and—

Speaker 2

Mm.

Ami Luttwak

—it has different speed and cost. There’s no single answer. If you want to do a task, that’s true for cyber, but it’s true for other things as well.

Speaker 2

Mm-hmm.

Ami Luttwak

The only thing you can do as an independent company is try all the models all the time and find the best combination.

Speaker 2

Yeah.

Ami Luttwak

The way I see it is, people say, “Oh, now it’s easy to develop using AI.” It’s not true. For most founders right now, the key is going to be the cost of the service.

Speaker 2

Yes.

Ami Luttwak

Right?

Speaker 2

Absolutely.

Ami Luttwak

The only way to create a scalable service is by creating a very intelligent pipeline, where you do some tasks with specific models and some of the more complicated tasks with other models, and mesh all of them together in a very efficient way. Otherwise, you’re going to lose money on your sales.

Speaker 2

Mm-hmm.

Ami Luttwak

As an example, we have what we call the Blue Agent, which investigates attacks. I cannot run the most advanced, expensive model on every event. But I can create a pipeline where you start from a deterministic detection, then go through a cheap-model detection, then go through a more advanced model.

Speaker 0

That’s right.

Ami Luttwak

If all of them think it’s malicious, I’ll send it to the most advanced model to determine whether it’s really malicious before I tell the customer. You see?

Speaker 0

Yeah.

Ami Luttwak

So you need multiple models, multiple types of models, and you have to design pipelines. I think that’s really the new engineering challenge for founders and for companies building AI systems at scale.

Speaker 2

Yeah.

Speaker 0

Absolutely.

Speaker 2

Absolutely. On this cost point, you talk about a paradigm shift in a blog post you wrote, around continuous testing, with the focus being on “continuous” versus “static.” Cost plays a big role in whether every company can do that, not just the most profitable and sophisticated ones. How far are we from getting there from a cost perspective, and what else needs to happen? Maybe it’s a cultural shift or a tooling shift. Where do you think companies need to go, and how far along are we today?

Ami Luttwak

It’s a big question. Let’s take security, for example. Go back to the Mythos moment. People say, “Oh my God, there’s Mythos. I have to scan all of my code.”

Speaker 2

Right.

Ami Luttwak

Fine. Let’s say you did it in April. You might have wasted $5 million.

Speaker 0

Yeah.

Ami Luttwak

If you have a lot of code. These are real numbers that you—

Speaker 0

Yeah.

Ami Luttwak

—you’ve wasted a lot of money. It’s very expensive. Now there’s Mythos 1.2. Do you do it again?

Speaker 2

Right.

Ami Luttwak

This isn’t a small budget. I’m talking about some customers spending tens of millions of dollars on scanning code.

Ami Luttwak

You have to think about a scalable, continuous system that scans intelligently. There are going to be new models, new capabilities, and new code. We see this as a major challenge for the industry. We’re trying to figure it out, and I’m not going to tell you that we’ve solved it. The challenge is: how do I use the budget wisely, in a way that scans from the inside and from the outside? We have active attacks, passive attacks, and code analysis. We can scan the disk itself and look at runtime. How do I use the budget in the most efficient way for the customer—not as a single scan, but as a continuous scan?

Speaker 2

Yeah.

Ami Luttwak

That’s the challenge of security scanning right now. If I tell you, “Just run Mythos on your code,” great, you can do that. But does that actually solve your problem continuously? No. It’s just going to create a big hole in your budget.

Speaker 0

I know it feels like a lifetime ago that we all used to talk about just cloud security, pre-AI security. But for security teams and practitioners—CISOs, security engineers, and others—new problems appearing doesn’t mean old problems go away. A lot of Fortune 500 and Global 2000 companies are still dealing with cloud security challenges. For the first part of this question, let’s set AI aside: can you talk about the state of cloud adoption and security in 2026? Then let’s layer AI in and talk about how it’s really changing cloud security specifically.

Ami Luttwak

When we talk about cloud security, an application that’s running is always in the cloud, right?

Speaker 0

Yeah.

Ami Luttwak

When AI attackers come after my application, they’ll start with the same vulnerabilities, problems, and mistakes as before. Nothing changes about the fact that, in cloud security, you have to focus on critical risk and fix it.

If you have a PHP vulnerability you haven’t fixed, attackers are going to come through there. We’ve just added more vulnerabilities and more types of attacks. That doesn’t mean you don’t have to fix the old ways of attacking.

In terms of cloud security, what we’re seeing is that everyone understands they need a system of record that gives them visibility into everything. What we’re starting to see change, of course, is that companies are trying to create more agentic workflows, and they also expect more from Wiz.

For example, before, we would provide a vulnerability with prioritization. Now they expect us to go back to the code, find it, create the fix, and create the pull request. They expect us to help automate more of the processes that take time. That’s also true for detections. They don’t want just a detection; they expect a full investigation and forensics: find the root cause, tell me how the attacker got in, and push them out.

The way I see it, AI is making companies do every step we hadn’t solved with Wiz automatically on their own, and they also expect us to get better. For example, we’re not just finding threats anymore. We have to do a full investigation and forensics. I think the next step for us, now that we see AI attackers, is to start thinking about automated response—

Speaker 0

Yeah.

Ami Luttwak

—which is very scary. But I don’t think we have any—

Speaker 2

Yeah, absolutely.

Speaker 0

Yeah, completely agree.

Speaker 2

Maybe on the topic of what you’re automating and how Wiz has evolved: you talked about Blue Agent. Can you share a little more about Red Agent? I think that’s where you’re really simulating an adversarial point of view. Is Wiz’s response to AI shifting risk? Going back to this speed idea—the speed of the defender and the speed of the attacker—are you thinking of ways to give machine speed to your customers, if you will?

1. Continuous Self Attack

Ami Luttwak

Exactly. There are eventually 2 forces here: red and blue. Blue tries to find attacks and stop them. Red says the best defense is attack. You have to attack yourself with AI continuously because, unlike before, when we had static defenses, defenses now have to be dynamic. Every new model has new capabilities.

Maybe your application was considered secure yesterday, but it isn’t secure today. Think about it this way: you have a door, and you hide your key under the mat. That’s considered secure, right? But your attackers are getting superpowers every week.

Maybe next week they’ll be able to get through your door. Whatever was considered secure last week isn’t secure anymore if every AI model can get through the door. The bar keeps going up. The only way to know you have a problem is to continuously attack yourself with the latest models. Before the attackers can open the door, you figure it out—

Sarah Wang

Yep.

Ami Luttwak

—you fix it. You don’t have a lot of time, and that’s the speed we’re talking about when we talk about the speed of defense. It’s crucial. Red Agent tries to do that: it tries to launch an offensive AI attack against your applications from the outside, using the context we have from the inside to find problems before attackers actually use them.

Zane Lackey

Are you doing a similar pipeline on the red team side? I’m asking from the perspective of teams that understand this and want to get started. Let’s help them avoid a bunch of the mistakes everyone else has had to learn. On the blue team side, you start with deterministic approaches, then layer in cheap models and the pipeline you talked about, progressively getting more expensive. Are you taking a similar approach on the red team side, starting with deterministic methods and then layering in cheap models? Or are you layering a whole bunch of different models, all starting from scratch and running simultaneously?

Ami Luttwak

Everything.

Zane Lackey

Yeah, exactly.

Ami Luttwak

First, let’s compare this to having a budget: you can just give it to Mythos and run it on code. That’s not very efficient.

Zane Lackey

Yeah.

Ami Luttwak

What’s more efficient is analyzing all the exposure. That’s what we do deterministically in Wiz.

Zane Lackey

Yep.

Ami Luttwak

Then we layer on top of that what we call the Exposure Red Agent, which looks at everything that’s unauthenticated and exposed on the internet from your environment. That’s an immediate analysis of every exposure you have. It’s the most urgent thing to do. It’s even more important than scanning your code. Who cares about your code? I’m talking about your actual unauthenticated, exposed attack surface. That’s more urgent.

The next step is to start doing deeper pen test analysis and deeper code analysis. There are definitely layers here, both in terms of the models and the investigation time. From the outside, what we call the Exposure Agent might take a few minutes for every endpoint, because you have a million endpoints. For a critical application, I might take 10 hours to try to hack it. It’s all a pipeline. Everything is going to be a pipeline now.

Zane Lackey

Right.

Ami Luttwak

You can’t throw money at code scanning and think you’re done. It’s all about managing the budget. That’s the whole point.

Zane Lackey

Right.

Ami Luttwak

They’re all connected, because if I find a problem and engineering says, “Oh my God, this is too expensive to fix,” then I can say, “Okay, let me tell the Blue Agent to put some detections there.”

Zane Lackey

Yeah, yeah.

Ami Luttwak

You see? This is all working together.

Sarah Wang

Right. I was going to ask—it’s really interesting to hear your point of view on this, because we had an internal discussion at work the other day about how it feels like the state of the art is essentially what Red Agent is doing: you have agent swarms constantly attacking your own systems so you know how to protect against them. You’re working with some of the top enterprise customers—over 50% of the Fortune 100—and you also have leading-edge startups in your customer base.

How many people are actually doing this?

Ami Luttwak

In Wiz, the majority of customers are already using the Red Agent.

Sarah Wang

Okay. Wow.

Ami Luttwak

Across the industry, not enough. Everyone should do it right now. There’s nothing more important than continuously scanning your environment from the outside. There’s nothing more important than that. The best defense is attack. When they come, it might be too late.

The best thing you can do is continuously attack your environments. In my view, on the Wiz customer side, we’re getting very quickly to almost full coverage. Everyone understands it, and it’s one of the fastest-growing features we’ve ever released.

In the world, I don’t think people understand. Mythos got a lot of PR. Good. But the PR went to the wrong place. I actually don’t think scanning code is the most efficient thing you can do, and it’s important to understand that because people can say, “Oh yeah, I invested so much in scanning code.” That’s not what you should do. You should focus on scanning your external exposure first.

There was a big incident just 2 days ago: a key hard-coded in a mobile application exposed a lot of people’s data. That’s where attackers get their attacks: unauthenticated surfaces. That’s what you have to run scans for, and you have to do it continuously. That’s the gap, and the world needs to know that.

Sarah Wang

Yeah. Maybe on this thread of what founders should be doing: Zane and our colleague Joel actually wrote a note in the midst of Black October to our founders about spending more on security and potentially considering delaying product releases. I want both of you to say a little more about that, maybe Zane first. Say I’m a founder with a release coming up and a backlog of security issues. How should I think about what needs to happen before I ship?

2. Rethinking Security Priorities

Zane Lackey

Sure, I can kick off. I think you and I are very aligned on this: the security game has just changed. You need to think about how you can automate so much of both the blue side and the red side right now, and really leverage a variety of agents for those automations. Historically, in the old models, you had a release and then you delayed it for security and all of that. I think the new model is: how can you be doing all these things in parallel?

Sarah Wang

Mm.

Zane Lackey

How can you really leverage a variety of agents to be continuously testing? If you’re building a new company today, you should be patching from the beginning and building a lot of automation into your software development and infrastructure development.

Sarah Wang

Mm-hmm.

Ami Luttwak

Yes. I don’t want to scare people, but let’s just put ourselves in the shoes of the CEOs of startups that are getting attacked. You wake up, and your security team says, “Something bad happened overnight. We tried to stop it, but they got in. We woke up after an hour.” And that’s in the good situation—

Zane Lackey

Yeah, you’re being very nice there with an hour.

Ami Luttwak

They didn’t even have a security team, after a round.

Zane Lackey

Yeah.

Ami Luttwak

I don’t even know if they have someone dedicated, right?

Zane Lackey

Yeah.

Ami Luttwak

And we found out that the attacker got in. The entire attack takes 20 minutes from the time they get in until they take all the secrets, all the AI keys of all the customers. Now you have to figure out what you’re going to say to all the customers and what you’re going to do.

This is what companies are going through right now. The point is that AI attacks are something we’ve never seen before. We have to understand it’s a new threat.

Zane Lackey

Yeah.

Ami Luttwak

It’s a threat to everyone. But if I’m a startup, especially if I have anything attackers want—especially API keys or anything related to something they can use—I’m a target. It doesn’t have to be a big company. Startups are actually a key target now for LLM jacking.

What do you need to do? If you have API keys, it’s probably better to put a limit on them because if attackers steal them, you don’t want to get a lot of charges, which we see happen a lot. It’s really sad. But also make sure that if you have a target on your back, you put a lot of focus on security. This was never the case, but it’s now true that if they want to get in, it will happen faster. You do have to invest in this. There’s just no other way to put it.

Zane Lackey

Yeah, I think that’s exactly correct. The level of security investment, whether that’s dollars, time, or any of these things, just needs to go up over the next several years as we’re going into this new era of security.

Sarah Wang

Yeah. On that topic, a CISO recently told one of the partners on our team that he expects his security budget to go up 80% next year.

Zane Lackey

Yeah.

Sarah Wang

We all anticipated it would go up, but that’s probably on the higher end. I’m curious what you’re seeing people spend more money on. On the flip side, what should CISOs be spending less money on? You’ve written publicly about a class of security products that may become somewhat obsolete. Talk through where budgets should go up, but also where they should come down.

Ami Luttwak

First of all, let’s assume you have a house, and you know that an elite group of the most trained hackers are going to hack your house. They might not come through the door. They might come through the window or the roof.

Honestly, how many houses are even ready for that? Most houses would say, “Fine, I’m not going to secure the roof. Obviously, there’s no way for me to. I mean, it’s impossible,” right?

The point is that most companies are not ready for attackers with the speed and expertise of the best attackers in the world. This is why it’s a hard problem. Even before we talk about budgets, I don’t even know if budgets are going to solve the problem.

It’s not about security budgets.

Sarah Wang

Yeah.

Ami Luttwak

It is about focus, but honestly, it’s about security architecture and security design. A budget is not even going to solve anything.

Sarah Wang

Yeah.

Ami Luttwak

It’s not like there’s a security tool in the world you can buy and then everything is fine. Obviously.

Sarah Wang

Dang it.

Ami Luttwak

I’m not just, you know—

Zane Lackey

That would have made a lot of our jobs easier if that were true.

Sarah Wang

I know.

Ami Luttwak

Yeah, exactly. I don’t think it’s true.

Zane Lackey

Yeah, exactly.

Ami Luttwak

Obviously, most of the latest security tools aren’t even relevant anymore.

Sarah Wang

Yeah.

Zane Lackey

Yep.

Ami Luttwak

But even if you get security tools that are AI-native, that understand how attacks in the AI world and cloud attacks work, even then, honestly, it’s more about security design than just security budget. Is the security budget going up? Maybe. Should we review the existing stack we have? Yes.

Zane Lackey

Yeah.

Ami Luttwak

But more than that, it’s about having a dev team that focuses on scanning the code and applications all the time. It’s about thinking about sandboxes and isolation, secure design, network lockdown, process lockdown, and image lockdown. If you’re building stuff now, get ready for a nation-state attacker. Get ready for that.

Imagine there’s going to be a vulnerability. Don’t assume, “Let’s run everything in a Kubernetes cluster.” There are zero-day vulnerabilities in the Linux kernel all the time. Anyone can get out of a container. Secure design is much more than just the budget. Obviously, security budgets are great, but they’re not going to solve the problem.

Zane Lackey

Yeah.

Sarah Wang

Yeah.

Zane Lackey

I mean—

Sarah Wang

That’s a great point.

Zane Lackey

To that point, it definitely feels a lot like cloud, in the sense that this is a real stairstep. I’m seeing so many CISOs take a look at their existing vendor stack and really reboot that to see—

Sarah Wang

What are the AI-native ones? You need AI-native technologies when you’re focused on secure architectures, exactly what you’re talking about, Ami: really thinking through the problem and understanding that there are vulnerabilities at every stage of the stack. This is the old CISO saying, “Don’t let a good crisis go to waste,” which is absolutely happening here as people reboot so much of their security product landscape to become AI-native and help them enter this new era, whether they want to or not.

Zane Lackey

Yeah. Maybe to be explicit, and not to dunk on any particular company: What’s a type of security software that CISOs have in place now that they no longer need?

Ami Luttwak

If I view it this way—and this might be a hard thing to say—most of what security teams do is not security. A small subset of their time is actually spent on security. The way to check is to ask yourself: How much time are you spending with red teams, and how much time are you spending on compliance and creating reports?

To be honest, most security teams are not focused on security. In my view, security is either getting ready for the attacker, attacking yourself, or putting guardrails in place for when an attack comes. We have to be much more efficient now. We should stop doing most of what we do and focus on finding critical risks, figuring out how to mitigate them or at least put detections in place, and being ready to respond. We have to be good at that, so we don’t have time to spend on anything that isn’t focused on it.

If you do a task and ask, “Is this report really helping us?” that was always my point against classic CSPM in the cloud, which was just how you did cloud security before: a list of configuration checks. I don’t care about that. You have to care about where the attacker is going to come from. Am I doing everything I can to stop them? If there’s a strategic barrier I can build, let’s build it. Focus on understanding the actual risks in the environment and creating a sustainable, long-term isolation strategy. Those are the things you should do.

Sarah Wang

And, on this point of time management, maybe shifting a little to how AI is helping security teams: As agents take on more routine investigations and testing, how should the most experienced security professionals spend their time? You’ve answered this a little, but maybe you could go deeper.

Ami Luttwak

It’s much easier for a security team starting from scratch today. If you’re building a company right now, you’re lucky, and you should try to build everything to be fully automated: security, patching, investigations. If you have enough context and knowledge about your environment, there’s definitely a way to build everything completely automated.

The problem is that, for most security teams, that’s just not the case. They have a lot of legacy software and thousands of developers. You don’t even know who owns what. It’s not as if everything changes because there’s an AI agent. It still comes back to finding the context: Who actually owns every resource? How do I get them to patch things? It’s complicated.

It’s going to take time for most security teams in the industry to figure out how to become really efficient. It’s not as easy and simple as it sounds, because a lot of the organization’s knowledge is obscure. It isn’t written down anywhere. But that’s the challenge for all security teams. If I cannot respond in minutes, what am I relevant for?

Sarah Wang

Exactly.

Ami Luttwak

Yeah.

Sarah Wang

To that point, I’ll round us out with a question about connecting the through line of what we’ve talked about: What do you think the next several years look like? The next 2 to 3 years? I’ll start with my own prediction: We’re going back to the ’90s and 2000s again. There are going to be fully remote, unauthenticated zero-days popping up all the time. We’re going to see breaches all the time again. Security is going to look very different from how it has over the last 15 years. I think we’re going back to an era that looked very different, and I’ll throw out one wild prediction: I wouldn’t be surprised if we see worms on the internet again, like we did in the Windows XP days.

We were chatting about this internally on the infrastructure team, and Martine brought up a funny point. For those of us who were in broader tech and IT at the time, there was a period when you couldn’t install and update Windows XP fast enough. From the time you installed it to when you started the update, a worm could hit and infect your system. You literally had to install everything offline, because if you installed it online, the system would be compromised faster than you could patch it. So much of what feels new with AI is something plenty of us experienced 20 or 25 years ago, in the Wild West days of the internet.

Building on that, I’m curious what you think the next few years look like. Ami, I’ll add a quick question to tag on to Zane’s: You wrote a great blog post in April saying there was a Y2K moment coming in 12 to 18 months. Given everything that’s happened in the last six months, would you pull that moment forward, in light of Zane’s point about the next 2 to 3 years?

Ami Luttwak

Yeah. First of all, I think October might be the beginning. We didn’t want to scare people too much, and we were hoping there’d be more time, but open-source models are catching up much faster than we thought. The hope was that open-source models were a year behind, but they’re not.

I think it’s happening. We’ve never seen this level of attacks across customers. It’s happening. And if you compare this to the ’90s, our dependence on technology is much, much higher than it was then.

Sarah Wang

Oh, absolutely.

Ami Luttwak

It’s also important to understand that this is almost the only area in humanity right now where AI is better than humans. That’s the problem. That wasn’t the problem in the ’90s. AI attacks are prevalent and easy, but they’re also better than any human’s attacks. That’s the problem.

I’m talking about very complex attacks using zero-days. Today we had an attack using a zero-day on a kernel driver. My God, that should be very rare. It’s happening every day now. Human attackers cannot do it. We’re in an era where AI is better than humans, and I cannot foresee what things will look like 2 years from now.

I think the only companies that will be able to survive are companies that are building security automation, security design, and security reviews now. They’re designing their systems that are exposed to the internet in a new way. Whatever isn’t ready should be taken off the internet quickly. On the internet, you need to be ready for the crazy attackers. You have to design for this. I think that’s the only way.

Zane Lackey

A lot of this podcast has focused on enterprises, tech companies, and so on. I want to bring up Scan for Good, an initiative you recently launched, and talk about it in the context of some of the attacks we’ve been discussing, including attacks on AI infrastructure companies.

If we look at the recent attacks on refrigeration units in Europe, and think about the food supply chain, an attack at mass scale could have dire consequences for humanity. I don’t want to fearmonger, but I think there’s an appropriate line you’re walking, Ami, in making sure people are prepared and taking things seriously. I have 2 questions.

Sarah Wang

One is, how worried should we be about what’s happening to public infrastructure and entities that don’t have huge cyber budgets? And two, could you talk a little about Scan for Good and why you’re doing it? How are you helping nonprofits and public services get prepared for what’s already happening?

Ami Luttwak

I am worried. Legacy software can be in refrigerators that are actually in the real world. It can be traffic. It can be anything. Anything we know is connected to the internet is at risk. That’s exactly the reason we started Scan for Good. We’re trying to help any public service that wants help. We try to scan them and find problems. It’s not going to solve all their issues, but we’re trying to give them a bit of a push. Our hope is that if we find things, they’ll understand it’s a bigger project, and then they’ll start doing red teaming on their own. This is about getting them to push into that.

Sarah Wang

This is awesome. Thank you so much.

Zane Lackey

This was super fun, man.

Sarah Wang

This was incredible.

Ami Luttwak

It’s really great to see you both. This is a crazy time.

Zane Lackey

Oh, absolutely.

Sarah Wang

It’s a crazy time. Thank you for—

Zane Lackey

Who—

Sarah Wang

…what you’re doing right now.

Zane Lackey

Absolutely. Who would’ve thought we’d go from OWASP conferences to here, buddy? Good to see you.

Sarah Wang

Yeah.

Ami Luttwak

Yes, yes. I remember. It was in Panama.