[BidClub_]
Invest Like the Best · · 57 分钟

Christina Cacioppo——AI时代如何打造一家历久弥新的软件公司——[Invest Like the Best,第496期]

Patrick O'ShaughnessyChristina Cacioppo

AI与软件企业经营技术
播客 ↗
TL;DR
  • Cacioppo认为,Vanta能赢得品类竞争,靠的是执行力:“你真正的实力,取决于你最近交付的东西”——如今别人一个周末就能用 vibe coding 复刻你的产品。 Vanta的结构性优势是“信任图谱”:由400个集成接入的数据构成的安全数据湖,她说这让Vanta能更快开发新软件和 agent。公司成立约8年,全球客户约16,000家,产品约5款。
  • “SaaSpocalypse”是她最害怕的时刻,而亲历估值重定价让她感到“认知失调”。 拉长时间看,她认为80%增长、80%利润率的企业最终能带来比160%增长、30%利润率的企业更多现金;“但今天,后者的估值是前者的3倍、4倍……倍数甚至是前者的10倍。”AI至上派投资人告诉她,他们只愿意投“实验室,还有……基本上就是爱荷华州的机器人拖拉机,中间什么都不投”。
  • Vanta目前选择自行承担 token 成本,而不是把费用转嫁给客户。 客户看到 Cloud token 被加价,就会问这个应用是否“比 Claude 好4倍”;按 token 定价会让应用直接与模型竞争,改用额度也掩盖不了这一点。目前25%的客户已使用 agent 流程;若Vanta能把这一比例提高到75%,她预计留存率和体验都会改善。“现在是使用阶段……把这件事做好,之后再想怎么商业化。”
  • 她认为,token 定价、为了低毛利而追求低毛利、为营销效应做 post-training(“说到底,主要是为了投资人”)以及 FDE 都被过度炒作。 她说,有些情况下 post-training 确实能降成本,某些企业部署也可能适合专属模型,但她怀疑把模型交给客户就是正确的最终形态。FDE往往只是换了个时髦标签的专业服务;八位数合同或许能支撑其商业模式,五位数和六位数合同的经济账则可能完全算不过来。被低估的是公司和客户背景,相比之下,她宁愿选一个销售能力稍弱、但了解Vanta的销售人员。
  • Vanta最高层员工的总薪酬,可能已是5年前的约10倍。 她说顶尖人才的价值正在加速上升,Vanta应拉大薪酬差距,而且“顶尖人才永远拿得不够”。股权要约交易已经常态化,也被视为薪酬的一部分;她认为这种局面不健康,但自己的看法并不能改变现实。
  • 安全威胁格局正在变化:AI模型可以持续尝试海量操作,并把看似无害的发现串联起来。 Patrick描绘的未来,是一个持续运行的白帽渗透测试 agent,再配一个负责修补漏洞的“伙伴 agent”;Cacioppo认为,Vanta的一些业务有可能做到这一点,尤其是那些可能不愿支付Wiz企业级价格的客户。
  • 她对更广泛趋势的判断是:AI开启了一个“高热情、低信任”的时代,人们对科技公司的不信任还在加深。 她预计,企业、政府和监管机构会越来越看重软件是否达到工业级标准。随着Vanta从合规拓展到更多安全产品,她设想公司可以成为这类交易的枢纽。一个来自一线的观察是:法国软件公司告诉她,他们主要是出于业务连续性担忧转向中国模型,而非民族主义。
摘要 · 为研究而整理的核心内容

1. 执行力赢得品类,信任图谱构成优势

  • Vanta成立约8年,全球客户约16,000家,产品约5款。公司从一开始就致力于帮助企业“建立并赢得信任”:协助企业启动或完善安全与合规项目,再通过 SOC 2、ISO 2701、HIPAA 等审计、问卷和信任中心,帮助企业获得客户认可。被问到如何在拥挤的赛道里胜出,她回答:“执行力……你可以先行,也可以开创这个品类,但这些其实没那么重要。现在更是如此,因为别人一个周末就能用 vibe coding 复刻你的产品。”
  • 结构性优势来自集成能力:Vanta连接400种工具,把数据汇入“信任图谱”。她将其概括为“一个安全数据湖”,并称其数据基础比其他供应商更广,甚至超过一些安全服务商;这让Vanta能更快开发新软件和 agent。
  • 她最害怕的时刻是过去12个月。“SaaSpocalypse。你会想,‘好吧,系统记录做得不错。现在你完蛋了。’”这种说法有些部分是对的,有些不是;关键问题是:“很好,那 agent 是什么?你有这么多数据,也有记录系统。然后呢?你到底打算拿它做什么?”

2. 好生意遭遇估值重定价:接受认知失调

  • Patrick提到,Vanta增长很快、利润率也很高——4年前,这些特征可能会被视为最理想的商业模式——但估值倍数如今只有过去的三分之一或四分之一。她的回答是,得同时接受两件事:“拉长时间看,80%增长、80%利润率的企业,最终确实会比160%增长、30%利润率的企业更好;但今天,后者的估值是前者的3倍、4倍……倍数甚至是前者的10倍。”
  • 现实的竞争环境是,融资掌握在AI至上派手中:“我们会投实验室,还会投爱荷华州的机器人拖拉机,中间什么都不投”;而有抱负的员工“如果觉得自己上错了船,就会换船”。她的应对是继续做符合商业逻辑的事——“这可能包括,也可能不包括 token 定价模式”——并“着眼长远”。

3. Agent已成为产品核心,她称还没见过走得更远的公司

  • 如果拿Vanta agent和人们熟悉的“AI应用”对标,她说“我们还没找到比我们走得更远的公司”,但也承认,最直接的批评当然是“我们找得不够认真”。产品层的“Vanta agent”背后,是数百个配有工具和计算机的任务型 agent;前端则是长期运行的 agent,可以即时生成 UI,“因为有时你想用聊天,有时你想要界面”。
  • 一个具体例子是员工离职后,账号权限没有被全部撤销。Agent会说:“我刚为你写了一个定制 agent,它会去处理这件事。要我现在启用吗?……你还要我撤销这3个人的访问权限吗?”它借鉴了实验室常见的 UI 交互:“这次要我做吗?以后都要我做吗?”
  • 如今25%的客户已经在使用这类 agent 流程。如果Vanta能把比例提高到75%,她预计留存率和客户体验都会更好;定价问题可以之后再解决。
  • 她正在权衡的是:优先打造 agent,而不是堆砌 SaaS 界面——“我们不会把 Tableau 塞进Vanta”,尽管Vanta在2021年或2022年可能会这么做——同时又要面对企业采购的现实。一家美国企业曾询问能否关闭Vanta的 AI 功能,因为非AI工具更容易通过采购流程。Patrick把这种扩散风险概括为“判断是对的,但来得太早,所以结果就是错的”。她表示,Vanta不会做关闭开关。

4. 定价:别让自己和 Claude 正面竞争

  • token 定价为什么行不通?客户“非常聪明”,可能会问:“你只是把一个 Cloud token 加价4倍。你的产品真比 Claude 好4倍吗?”这会让应用直接和模型竞争——“没有哪个应用真想陷入这种竞争”——而把 token 换算成额度也骗不过用户。“我们现在自己承担 token 成本”,接受更低的利润率。
  • 人人都想做结果定价;她曾教微观经济学,很喜欢它的激励机制。但她区分结果和产出:关闭一张客服工单是产出,“真正的结果是我的 Sonos 现在能用了”。要为工作量找到各方都认可的计价单位并不容易:“我刚才举了3个例子,还能再举47个。”这会增加用户比较 agent 代劳和自己动手时的认知负担。
  • 模型选择依靠按任务或 agent 编写的评测,评测者是相关领域专家,包括曾负责安全和合规项目的人。专家也会评估这些评测本身;切换模型“主要是为了质量,而不是成本”。Vanta的决策和行动类任务比编程 agent 消耗更少 token;法律和文件起草任务可能消耗更多。

5. 在一家成立8年的公司里用AI重塑工作方式

  • 被问到AI对建公司的影响有多大,按1到10分打分,她回答:“8分或9分。原则还是一样……那些老生常谈的道理也还是那些,但做事的方式应该很不一样。”
  • 遗留代码库的问题在于,agent的上下文窗口不够理解8年的代码,“会做出一些蠢事”,还需要“高上下文的工程师在旁边盯着”,这可能让使用 agent 的初衷落空。她认为解决办法是模块化,让 agent 能完整理解更小的代码单元;她说Notion在这方面大约领先9个月。公司一直都要解决新工程师上手时的摩擦,“agent让问题变成了:太好了,现在我们明天就想让9,000名新工程师入职”。她认为Vanta在这方面做得不够好。
  • AI应用入门第一步:自己用AI,给公司做点东西;至少每两周检查一次,因为变化很快。亲自上手能让人直观理解什么有效,也更容易质疑“我做了一个 agent,所以我们要开掉所有 SDR”这样的说法。她现在也更能体谅还没深入接触AI的优秀员工:找到阻碍他们的因素,帮他们开始做起来。
  • 一个关于入职向导的例子:一支有才华、积极性很高的团队,反复提交 SaaS 入职向导方案,而不是 LLM 流程。真正的阻碍是:“我们不知道能不能让拖拽文件的功能跑起来……我们基本上觉得这个项目不允许失败。”她的回应是押注 LLM 流程,“破釜沉舟”。最终上线的是 Claude 风格的大画布:拖入杂乱的文件和截图,让系统理解内容并提出问题;效果很好。

6. 人才争夺战:万亿级故事与10倍薪酬

  • 员工在其他公司听到的说辞是:“我们现在值60亿美元,但Sequoia一个月后会开出100亿美元的支票,明年还会有人把估值抬到250亿美元;不过你现在可以按60亿美元的估值加入。”她也考虑过跟着抬高承诺,“真正的问题是……你能不能带我们走到比如2,500亿美元?”“大概不能,但也不能说一定不行。”她实际采用的做法是“名副其实”:把指标给候选人看,用数据和可信的表达去对冲空泛的氛围和 YOLO 式承诺。
  • Vanta最高层员工的总薪酬,“可能是5年前的10倍”。她说Vanta应该拉大薪酬差距,顶尖人才的价值正在加速上升。他们凭什么拿到高薪?“高主动性,把事情做成。听起来很平淡,但这价值数百万美元。”她认为顶尖人才永远拿得不够,不过也有人拿得远超其贡献。可能打破现状的力量,是投资人重新讨论股权稀释和股权薪酬(SBC)——“现在我们肯定不会谈这个。”
  • 一个留人案例:一位强势的领导者考虑了一份承诺“完整决策权”的工作。她的回应是扫清障碍:“你需要什么,才能觉得自己可以做这些决定?那就去做。”谈到要约交易,她说Vanta过去没有常规开展,但“现实情况是,每次都在做要约交易”。它们已成为常态,也被视为薪酬的一部分;不提供要约交易,公司就得拿出其他东西。她认同这种情况不健康,但自己的看法改变不了大家对它的预期。
  • 对她而言,IPO只是实现目标的手段,不是个人愿望清单上的一项。目标是打造一家“规模庞大、独立、独自发展的公司”。

7. 被过度炒作的是 post-training 和 FDE;被低估的是背景

  • 被过度炒作的包括“按 token 定价、为了低毛利而追求低毛利,以及为了营销价值训练定制模型”。她说,推理服务商常把 post-training 的理由说成降成本,而不是提升质量;有些企业确实有降本需求,为企业用例训练专属模型也可能合理。她更大的疑问是,客户未必想要一个模型:“可以合理迭代,但这不是正确的解决方案。”
  • 对于前线部署工程师(FDE),她说这是一种“很好的人才套利方式,和幕僚长类似”,但这个岗位往往只是换了标签的专业服务。她怀疑一个高主动性的哈佛计算机科学毕业生会愿意做传统专业服务。她认为Palantir很擅长这一套,尤其是八位数合同;但遇到五位数和六位数合同,商业模式的账可能就完全算不过来。
  • 被低估的是公司和客户背景,相比之下,职能技能没那么重要。她会“选一个销售技巧差一点、但了解Vanta各方面情况的销售人员”,也认为实验室通过招优秀销售人员来组建 go-to-market 团队,可能低估了背景知识的重要性。
  • 一条来自法国的一线观察:Cacioppo说,她接触的许多巴黎软件公司主要使用中国模型。她起初以为是民族主义或反美情绪,后来发现自己判断错了:客户说,他们是在所描述的美国模型访问限制出现后转用中国模型,原因是业务连续性,而非民族主义。访谈中提到的具体模型或服务名称并不清楚。

8. 安全攻防进入机器速度,以及她看好的方向

  • 模型“比人有耐心得多。它们会尝试9,000万亿种方法,而人试到9,000次就会放弃”。变化不只在零日漏洞:她说,模型能把“17个看起来无害的东西”串联起来。她提到OpenAI在RSA的一场演讲,谈到Hugging Face,以及如何处理那些过去可能被视为低危、留待之后修复的发现。“如果你能以机器速度修复问题,就不必优先排序”——不过“走到那一步的过程会很颠簸”。
  • Patrick设想,一个白帽渗透测试 agent 持续运行,旁边再配一个负责修补其发现问题的“伙伴 agent”。Cacioppo说,Vanta的部分业务、尤其是面向现有客户的部分,有可能做到这一点;她预计CrowdStrike在企业市场会做得更好。谈到云配置错误,她对比了Wiz:其客户多为员工数达数千人的企业,起步价约15万美元;Vanta则聚焦已经深度使用其产品的客户,他们可能愿意为适合自己的方案支付“40或50”。
  • Vanta认为自己是一家从合规起步的安全公司:“最好的合规,就是证明你具备怎样的安全能力。”公司计划基于现有数据和 agent 智能,继续开发更偏安全的产品。随着企业面对越来越大的压力,要向企业客户、政府、监管机构等证明软件达到工业级标准,Vanta希望成为连接交易双方的平台。
  • 以她过去的投资人视角来看(“我一点也不羡慕这份工作”),围绕开源模型的确定性判断,与其周边生态尚未充分建设的现实脱节;“实验室的一些打法似乎也应该适用于开源模型”。她看到的早期机会包括网络安全创始人、营收科技(rev tech)——一些在位公司选择了偏私募股权、由投资方主导的打法,而不是继续建设业务——机器人;机器人虽然有些热门,但她认为配置仍然不足;以及政府现代化。与AI相关的风险,也正帮助CISO为企业风险预算争取支持。

9. 广告牌风波,以及重建信任

  • 广告牌的故事是这样的:她原本不看好广告牌,觉得“创始人的自我膨胀才会让人想做广告牌”。后来,PMM Sarah绕过上司来找她,提出文案“少说话的合规”。Cacioppo笑了笑,向投资人Andrew Reid确认后拍板。广告牌最终设在Burning Man附近,相关推文迅速走红,这句文案也在 r/accounting 上传播开来。她说它之所以有效,是因为体现了Vanta的幽默感:认真对待工作,但不把自己看得太严肃。
  • 2022年市场崩盘后,广告牌位置变得更容易拿到,Vanta在101/280交叉口找到了一个好位置。尽管她曾在播客上说合同已经锁定好几年,实际上那只是一份刊登订单。后来一家初创公司拿下了这个位置;她提出支付300万美元,是对方约150万美元支出的两倍,但对方创始人说:“其实我们现金流为正。”她原本说“我在这里是个极不弹性的买家”,最后却变成“我真的是个极不弹性的卖家”。她半开玩笑地说,失去这个位置让Vanta损失了市值。
  • 她的核心判断是:“我们已经不像以前那样信任软件公司和科技公司了,而且这种情况一年比一年严重。”她认同Patrick对“高热情、低信任”(high-excitement-but-low-trust)时代的概括。她认为Vanta的任务,是“真正地重建信任,而不是只靠氛围”。在B2B领域,她更看重具体数据、改善曲线,以及可能由合同背书的承诺;消费领域的信任则更依赖感觉,而且“似乎很难扭转”。被问到大型公司是否会使用个人 agent,她回答不会:她更愿意把邮件或聊天交给Google、Apple或其他自己选择的公司保管。她设想,Vanta可以成为交易的枢纽,帮助证明软件值得信赖、达到工业级标准;2,500亿美元只是她表达愿景时提到的数字,不是预测。
  • 她的动力从“你觉得我连起跑线都迈不过去?那我就证明给你看”转向“看看我们能把这件事做到多远”;前一种心态“仍有一点阴暗的劲头,但少了些”。被问到Vanta未来5年的一个关键词,她回答:“拓展。”公司已拥有稳定的客户和数据基础,她认为还有空间继续向上构建。
完整逐字稿
Patrick O'Shaughnessy

So, Christina, I’ve been so excited to do this with you. I think it’s been 5 years since we last did it. A lot has happened.

Christina Cacioppo

A lifetime ago.

Patrick O'Shaughnessy

A lifetime ago. You’ve been very successful in the intervening 5 years, so I’m excited to catch up. Can you give us the 1-minute history of Vanta? I know we’ve done this before, but just to level-set for people: when you started it, why, what it did then, and how it’s evolved—

Christina Cacioppo

Yeah.

Patrick O'Shaughnessy

—what it does now. Quick overview.

Christina Cacioppo

Started Vanta about 8 years ago, which feels about—

Patrick O'Shaughnessy

Whoa.

Christina Cacioppo

—8,000. Yeah, exactly, or 17 centuries ago. The premise was: Can we help companies build and earn trust? That means starting security and compliance programs, or maturing them, and then getting credit with their customers through audits like SOC 2, ISO 2701, HIPAA, security questionnaires, trust centers, and so on. Basically, the idea was: Can we build a security company by helping companies implement security because it’s what their customers are asking for?

We were initially known for SOC 2 billboards. We do have a billboard on the 101, and I joke that we’re mostly known for making billboards. But it started very compliance- and audit-centric. The idea was always, “Hey, that’s just one way to get a company started on this.” Since then, we’ve gone into different areas of security and different ways of earning trust with your customers. Today, we have about 16,000 customers globally and about 5 products.

Patrick O'Shaughnessy

How did you win? This was a new category when you started, and I remember having to get SOC 2 compliant and certified at my old business in order to win certain accounts. It became an important thing in the software era. There were many companies—I could probably name a handful—that were trying to do what you were trying to do.

Christina Cacioppo

Yes.

Patrick O'Shaughnessy

You’ve emerged as the only major winner. What would you attribute that to? Since we last talked, how did you win?

Christina Cacioppo

Execution. Software is a blessing and a curse, and that’s even more true now than it was 5 years ago. You’re really only as good as the last thing you shipped. You can be first and start it, but that doesn’t really matter. It’s even more true now because someone can vibe-code your thing in a weekend. You’ve just got to constantly ship new products and features that make the experience better for customers, building on that differentiation.

There’s some feature-level differentiation. I think the other thing we really invested in when it got competitive, which was very good, was integrations—pulling in data from other tools. Now you can connect Vanta to 400 tools. We pull a ton of data out of those tools, and that’s what powers the automation, the agent, the AI, all of that. We call it our trust graph. It’s really just a security data lake, and it’s bigger and broader than any other provider’s, including some security providers’, because we touch areas they don’t. In retrospect, that data foundation has let us build new things faster, in software and with agents.

There’s that piece. Then I think on the go-to-market side, it’s just—

Patrick O'Shaughnessy

Good billboards.

Christina Cacioppo

—keep pushing. Good billboards. Shockingly good. “Compliance that doesn’t suck” got really popular on r/accounting, which none of us knew was a bucket-list item in our lives. When r/accounting likes your things, you’re like, “Okay, something worked.” The lived experience is that you feel like you’re going as fast as you can, and you should, in fact, lean in further and push harder.

Patrick O'Shaughnessy

What was the scariest moment?

Christina Cacioppo

The last 12 months. SaaSpocalypse. You’re like, “Okay, great job building a system of record. You’re now screwed.”

Patrick O'Shaughnessy

You’re now worthless.

Christina Cacioppo

Yeah, exactly. You’re worth, like, “Good job playing the game. Here’s some steak knives.” Parts of that are true, and parts of it aren’t. In the vein of “you’re only as good as the last thing you shipped,” you’re like, “Great, what is the agent?” You have all this data and a system of record. Fine. What the heck are you doing with it?

Patrick O'Shaughnessy

Say more about what that’s felt like. Roughly, Vanta is a business that’s growing very fast by historical standards, with very high margins—

Christina Cacioppo

Yes.

Patrick O'Shaughnessy

—which 4 years ago would have been considered the best business model ever. Nothing changed about that. I think you’re probably growing faster—

Christina Cacioppo

Yes.

Patrick O'Shaughnessy

—and the margins are still really high, and yet the market has decided that the multiple for a business like yours is a third or a quarter of what it used to be. What has it been like to live through that as one of those entrepreneurs?

Christina Cacioppo

Cognitive dissonance. You’ve got to hold 2 things in your head, right? One is, I think in the fullness of time, an 80% growth business with 80% margins will actually be better than a 160% growth business with 30% margins over the same time period, if you run it out long enough. One of these will return more cash in the fullness of time. But today, the latter is valued at 3X or 4X the multiple of the former. It’s 10X the multiple of the former, right?

There’s a part where you’re like, “Hey, guys, everyone’s being irrational here. This is a good business.” You have to keep doing the things that make business sense and the things customers want, which may or may not be token-pricing models that put you more in the latter category than the former profile.

Then there’s a very clear, game-on-the-field piece. If you need to be financed again, you’re looking at investors today, many of whom are AI maximalists. I’ve talked to firms that are like, “Yeah, we’ll invest in the labs, and we’ll basically invest in tractors in Iowa, nothing in between.” Robot tractors in Iowa and labs and everything else. You’re like, “Oh, interesting point of view.”

From a talent perspective, you hire ambitious people who want to do things, and if it feels like they’re not in the right boat, they’re going to change boats. The talent-war part is very real, too. You’ve just got to live with the fullness of time. I think this will all sort itself out, and you have to live for the fullness of time.

Patrick O'Shaughnessy

So there’s this funny fear that now Bending Spoons is the grim reaper in the hallway meme or whatever.

Christina Cacioppo

Yeah, yeah, yeah.

Patrick O'Shaughnessy

The grim reaper in the hallway—

Christina Cacioppo

Totally.

Patrick O'Shaughnessy

—you know, meme or whatever.

Christina Cacioppo

No one wants to be that spoon.

Patrick O'Shaughnessy

No one wants to be a bent spoon. Love Bending Spoons, by the way. I think it’s an interesting question. The siren song right now is selling tokens via agents—

Christina Cacioppo

Yeah.

Patrick O'Shaughnessy

—for security and compliance, I’m sure—

Christina Cacioppo

Yeah.

Patrick O'Shaughnessy

—or something like this.

Christina Cacioppo

Lots of thoughts on this.

Patrick O'Shaughnessy

I’m just so interested by companies like yours that were winners of this last era and now have to make a set of decisions. Look at the 10-year rate. The cost of capital’s going up because, for the time being, you can deploy lots of money at really high returns in AI stuff. Someone looking at your business is like, “Well, I want higher returns or the same returns, and I get that through agents or something.” Talk me through what it’s been like to make the decisions. What are you thinking today? Do you think of yourself as an AI business? What’s that like?

Christina Cacioppo

When we benchmark where we are from an agent and product perspective against, quote-unquote, “AI applications,” we have yet to find someone who’s further along. You could say we’re doing a bad job looking—that’s the obvious critique there. We’re constantly going to the set of names you imagine when you think of AI applications, and generally finding they’re not yet where we are, where an agent is doing most of the work.

It’s chat-based, but there are long-running agents. Our agent is auto-generating UI on the fly, because sometimes you want chat, and sometimes you want UI. We have an agent that’s building UI.

Christina Cacioppo

A user can do something, come back in the flow, and keep it going. It’s very much optimized around keeping the user going in the flow loops.

Patrick O'Shaughnessy

So, to make sure I understand: you’re like a watchdog that’s always on, watching the security and compliance programs?

Christina Cacioppo

We are definitely that, but in some ways you could do that in the past with just monitoring and alerting.

Patrick O'Shaughnessy

Uh-huh.

Christina Cacioppo

The Vanta product experience is now oriented around an agent that brings you things and often says, “Hey, I went and did this for you. Are you good with it? Then I’ll go do it.” Okay, great. The next thing I think I should go do is this.

Patrick O'Shaughnessy

What’s an example? Just ground that in an example.

Christina Cacioppo

Someone just left your company, and you didn’t get them out of all their accounts. I just wrote a custom agent for you that will go do that. Do you want me to turn this on? Great. Do you also want me to remove access from these 3 people? Great.

Patrick O'Shaughnessy

So it’s not just, “Here’s a red alert that someone didn’t meet the monitoring stack.”

Christina Cacioppo

Didn’t, right.

Patrick O'Shaughnessy

It’s like, “Do you want me to remedy this?”

Christina Cacioppo

It’s like, “Would you like me to go do this?” We’re taking a lot from the AI labs and their UI. It’s like, “You want me to do this once? You want me to do this always?” Great. The idea is that the agent will just be doing more of this work with the user’s permission. If they tell us to go do it, we’re just going to go.

In the course of that, we end up using a lot of tokens. We’ve talked to our customers a lot about token-based pricing, and what we’ve generally heard is that people are really smart. If you try to charge them based on tokens, they’re very quick to say, “Oh, you’ve just marked up a Cloud token 4X.”

Patrick O'Shaughnessy

Hmm.

Christina Cacioppo

“Are you 4X as good as Claude? I don’t know. Let me try it out.” You actually put yourselves in a competitive position against the models that probably no application really wants to be in. We’re going to talk about harnesses. You don’t want to get there.

What we’ve seen on token pricing is that if you’re trying to mark up at all, users are very smart, and you’ll lose on that comparison. You can not mark up, and this gets to the margin question, but anyone who is marking up Cloud tokens 4X and trying to pass that off to their users, I think, is just saying that.

Patrick O'Shaughnessy

So what are you doing?

Christina Cacioppo

We’re eating the token cost right now.

Patrick O'Shaughnessy

You’re just taking a lower margin.

Christina Cacioppo

We’re taking a lower margin and really concentrating on usage. That experience I just talked through, where the agent is going off and doing things, is something we fundamentally believe is a much better user experience. We’ve got 25% of all our customers in that sort of flow right now.

If we can get that to 75%, I think we’ll have much better retention and a much better customer experience. Then, if we need to sort out pricing later, we should sort out pricing later. This is a usage phase and a deployment phase for this technology. Just go nail that, and you can figure out commercialization after.

Patrick O'Shaughnessy

I’m also curious: you said marking up a Cloud token, but what about marking up a Kimi token or something that’s much cheaper? What’s it been like deciding what to use, what’s good enough, and what the cost is?

Christina Cacioppo

This was something we started concentrating on at the beginning of the year: basically, evals, task-specific or agent-specific evals. From a product perspective, we call it all the Vanta agent, and it’s one thing. Of course, behind the scenes, it’s hundreds of agents that all have specific tasks and use tools and have computers and that whole setup I think everyone’s converging on.

At the beginning of the year, we really invested in using our subject matter experts—the folks who ran security and compliance programs at other companies—to write the eval frameworks, evaluate their evals, and use tooling for that. When we think about model swapping, it’s mostly about quality, not cost.

I also think some of that is because we don’t use as many tokens as coding. Coding and coding agents use lots of tokens, maybe legal and document drafting next. When you get to more of the decision-action world, which is where we are, we just don’t use that many tokens relative to coding. That lets us optimize for quality rather than being as concerned about cost as some other companies.

Patrick O'Shaughnessy

When you talk to other founders, both from your era and this new era, what are they doing here? Are they also eating the cost and just charging a software fee? What do you think the end state’s going to be?

Christina Cacioppo

I think everyone wants to get to outcome pricing. Everyone wants to get to that. In another life, I was a microeconomics professor. I love this conceptually. You would get paid for outcomes, and the incentives would be aligned. Love it.

The hard part is: what are the outcomes? A support ticket closed makes a lot of sense. To that point, maybe I should differentiate outcome and output as I understand them. In support, the ticket closed is an output. The outcome is actually that my Sonos now works.

Even the ticket closed is relatively unobjectionable. I think a lot of companies, Vanta included, are trying to figure out what that neat unit of work is that we can all agree on. You can say it’s a document drafted, an alert closed, or an account offboarded. You can kind of do that, but then there’s so much cognitive overhead, because you’re like, “I just named 3 things. I could name another 47.”

Then our user has to be like, “Well, if I do this with the agent, I pay this, but if I do it on my own…” No one wants that. Everyone I talk to wants to get to outcome-output pricing, but it’s really not clear how you get there. Charging tokens puts you up against Claude. Some people try to obscure that by charging credits and having some credit-token exchange-rate-y thing. Again, users are smart, and they’re like, “I see what you’re doing, and I see you’ve obscured it. Fine.”

Patrick O'Shaughnessy

Are you similarly far along if you compare yourself, as you just did, to companies in how you’re building the product and the business using these tools? What are you doing that’s interesting there?

1. AI Inside Vanta

Christina Cacioppo

For an 8-year-old company with an 8-year-old code base, it’s so much easier to throw coding agents at a small code base than a large one. That’s a token-input thing, and they’re getting better and better.

One thing we’ve spent a lot of time investing in over the last year, and I know Notion has spent a bunch of time on—they’re about 9 months ahead of us on—is modularizing parts of the code base so the agent can understand smaller parts of it fully and then be really effective. If you chuck it at an 8-year-old code base sight unseen, it just doesn’t have the context window to understand everything and will do silly things. Then you need a high-context engineer to babysit it, which is helpful but sort of invalidates some of the point.

Companies have always had this problem. They’ve just talked about it as, “When we onboard a new engineer, it takes them a while to figure out the code base.” Agents have made it, “Well, great, now we want to onboard 9,000 new engineers tomorrow.” It’s heightened that problem. I’d give ourselves a lower grade on that. We’re in the process of using agents and people to make the code base easier to understand, too.

Patrick O'Shaughnessy

If you had to grade yourself from 1 to 10 on “Wow, this changes everything. Building this company from this point forward is going to be totally different,” is it a 10?

Christina Cacioppo

Oh, yeah. Nine. Yeah.

Patrick O'Shaughnessy

You’re a nine?

Christina Cacioppo

Eight or nine. The principles are still the same. Everything is hard. People matter. All the tropes are still the tropes, but the way you do stuff should be quite different.

Patrick O'Shaughnessy

Do you feel like there’s a separation happening? Again, if I took your cohort of successful companies from a year ago, do you feel there’s a bifurcation where some have gotten the memo and are doing really well—

Christina Cacioppo

Yes.

Patrick O'Shaughnessy

—and some are just going—

Christina Cacioppo

Yeah.

Patrick O'Shaughnessy

—belly up?

Christina Cacioppo

Kind of. I think there are structural parts of some markets, and I think that makes me very good at identifying them, where you can put any entrepreneur in the world into that structure. This is kind of the “Does the market or founder win?” Andreessen Horowitz thing, and you’re like, “The market wins.” I think that’s still true, and I think this AI technology shift has made some markets that used to look really good look really bad.

The best person in the world can run into that and will still run into a brick wall. I think there’s also a founder motivation piece: you’ve got to be in it and push in this era. If you don’t want to do that, totally fine, but the rest of the company will not self-organize to do so.

Patrick O'Shaughnessy

So given that you’ve been at the edge, what’s the AI adoption 101 if you’re back to being a professor? What have been the most important things that have been hard to do but have proven fruitful?

Christina Cacioppo

Just getting people to use it, which sounds obvious, but definitely use it yourself. Build for your company personally; it doesn’t matter what. Understand where the models are, where they’re good, where they’re bad, and what a harness means. Do that at least every 2 weeks because it changes so quickly. You have to have a visceral understanding of what works and what doesn’t, so that when somebody comes and says, “We’re going to fire all of our SDRs because I built one agent,” you can be like, “Did you now? Where is that true, and where is that false?” So there’s a “be in the muck” aspect to it. You want to get as many other people into that as possible.

Broadly generalized, it’s very black and white. Some people just go do that, and some people don’t. If you’d asked me a year ago, I’d have said, “Oh, well, there’s some intrinsic motivation, and the people who aren’t doing it have separate problems. Go deal with them.” I think I’m slightly more empathetic now, in that we’ve seen very strong people not dive in, and you have to nudge them more. Try to figure out what’s blocking them. Something can be blocking them, and you can get people into the muck even if they don’t dive in initially.

If you’re a small company starting out on Vanta, great. We’ve got this set of controls for you. You adopt them, maybe mess with them on the edges, and you’re off to the races. If you’re a larger company, you clearly run a security and compliance program, and you come to Vanta because you want that visualized. You want the automation, the monitoring, and the real-time dashboards. You don’t want the Jira ticket thing. Fine. The hard part is that you’ve got to get all that existing stuff—the controls, the risks, the data, the policies, the procedures—into Vanta.

Classically, the way you’d do that as a SaaS company is you’d say, “Oh, we’re going to make an onboarding wizard. It has 4 steps and a progress bar, and we’ll give you confetti.” You’re going to do that whole thing. We were setting out to build better onboarding this year, and in the first couple of product reviews, the team kept bringing onboarding wizards. I kept saying, “Stop with the onboarding. No, go use an LLM. Stop.” But they kept bringing onboarding wizards, and this was a motivated team of talented people. They cared, and they kept bringing them.

We finally have the experience now. They shipped it, and it’s working. It’s basically Claude: a big canvas. Drag all your messy files in, drag in all your screenshots. We’ll make sense of it, ask you questions, and then you’re set up and off to the races. It works really well. Why were these smart, motivated people building onboarding wizards? When I finally went out and asked, they said, “Well, we don’t know if we can get the ‘drag your files’ thing to work. It might not work, and we know the onboarding wizard will work because we’ve built those before. We basically don’t think we’re allowed to fail on this project.”

“Oh, that’s the thing? Great. We’re just going to bet that the LLM flow is going to work, and we’ll make it work. We’ll hill-climb all we need to, but burn the boats and just make this thing work.” Then they were like, “Oh, okay, great. Do you want a product review tomorrow?” It was this funny thing where I thought, “I would not have guessed that was their blocker.” And you saw that, and they were going.

Patrick O'Shaughnessy

You mentioned the talent war thing before. There’s this big trend, the low-margin, high-growth thing, where, from an investor’s perspective, the funny example you gave of a lab or a tractor: everyone wants something that can be that thing. Tell me about how you’re going to be a $100 billion business or a trillion-dollar business. Somehow, now every business needs to be that big. What’s that like to face down where—

Christina Cacioppo

Oh, it’s so bizarre.

Patrick O'Shaughnessy

—you may not be building a business that should be a $100 billion business. There are, like, 100 of those in the world. There aren’t that many.

Christina Cacioppo

Yeah, and it’s not to say Vanta won’t be. For me, it’s like, “Oh, should I adjust the pitch and be like, ‘Well, inevitably, the baseline here is Vanta’s $50 billion. The real question you should be considering if you join: can you take us on a journey to, like, $250 billion?’” Should I just start saying that? Probably not, but the answer is not definitely not.

Patrick O'Shaughnessy

You’ve thought about it.

Christina Cacioppo

Totally, because you’re like, “Well, that is the pitch that people who work at Vanta are getting from other companies.” The market is saying that so much, you do seem unambitious.

Patrick O'Shaughnessy

So what do you do?

Christina Cacioppo

There’s a Vanta principle of “do what it says on the tin.” Do what you say you’re going to do. Look, you can put ambitious things on a tin. It’s not that. Don’t overpromise and underdeliver. What we do is give some of the context—“Here’s what we do as a company, good, bad, indifferent”—and then talk about the business metrics. We’ll generally just show a candidate everything. It’s fine. The metrics are good. We don’t really want them to leak, but if they leak, it’s not the worst. We walk them through that and what we’re doing and how it grows over time. We try to root it in all of the facts and all of the data. In some ways, it’s countering the vibes with data and trustworthy vibes versus YOLO vibes.

Patrick O'Shaughnessy

So what is it like in those talent wars? If the most talented people are being told this thing’s going to a trillion, basically every other company that’s trying to hire them—

Christina Cacioppo

Well, the better one is, “Well, we’re $6 billion today, but Sequoia’s going to do a $10 billion check in a month, and then somebody’s going to write it up to $25 billion next year. But we can get you in at $6 billion today.” That’s a good one. That one’s tough.

Patrick O'Shaughnessy

So you’re faced with that. What do you do? Do you not want those people? Maybe it’s a filter.

Christina Cacioppo

Sometimes. I think if you go to the person and ask, “What are you optimizing for? Why did you entertain this?”—but not in a pokey way. Just, “What’s annoying you at Vanta?” One of these specifically was a very strong leader, still at Vanta. This person felt like they couldn’t make decisions that would put Vanta on a similar trajectory, and that would be their preference. But they were like, “Oh, but this new place is promising me full decision-making authority on this trajectory.” Totally fair feedback. “What do you need to feel like you can make these decisions? Just go make these decisions. Go.”

There’s a money part and a FOMO part, for sure. We’ve definitely gone up on comp, and comp bands are kind of a joke now. The comp band is whatever; the data you have is wrong. It’s what’s being offered to these people in the market.

Patrick O'Shaughnessy

How much more do you pay the top person at Vanta than you did, as a multiple?

Christina Cacioppo

Oh, I think we should have way more comp dispersion than we do.

Patrick O'Shaughnessy

So that’s interesting, but if I go 5 years back and that person made X dollars, what multiple of X does the person make now?

Christina Cacioppo

Total comp. It’s probably a factor of 10.

Patrick O'Shaughnessy

Wow.

Christina Cacioppo

I think it actually should be higher. My comp philosophy is that you never pay the top people—

Patrick O'Shaughnessy

Enough.

Christina Cacioppo

—enough. You should always try, and you will never hit it. And there are a bunch of people you pay much more than their contribution.

Patrick O'Shaughnessy

Say a bit more about what those top people are doing that’s so valuable, typically.

Christina Cacioppo

High agency, get shit done. That sounds so milquetoast, and that’s worth millions of dollars. But yes, actually, it is. A high-context person who understands the company, the customers, and the domain, making generally reasonable decisions and sometimes bad ones, then iterating on their bad ones and just moving, is so valuable.

Patrick O'Shaughnessy

Do you think it’ll be 10X again in 5 more years, or is that starting to get too crazy? Is the rate at which the most valuable people are getting more valuable staying the same, or accelerating?

Christina Cacioppo

Accelerating. The counterforce is: at what point will investors get more concerned about dilution and stock-based comp? They weren’t throughout the 2010s, the late 2010s. We had more of a stock-based comp conversation as an industry in 2020, 2022, and 2023. Now we’re definitely not talking about it. That’s the counter side. Without that push on dilution, I think people just get paid more and more. That’s what they probably should.

Patrick O'Shaughnessy

How much do you care about your valuation and multiple and the engineering of those things?

Christina Cacioppo

I’ve historically not cared, and sometimes even done things to demonstrate my not caring.

I care about ARR and ARR growth. I pay a ton of attention to those; those are the metrics. I think I've now been through enough valuation environments—the 2010s, 2021, 2022—and seen the multiple roller coaster that I just don't put a bunch of stock in that. Or I used not to.

I think the thing I care a bunch about, which would then get me to care about these multiples, is the sentiment of people who work at Vanta. Do they feel like they're at a company that is growing, and growing both in general and relative to their other opportunities in the market? There's a part of the market that's raising money every 6 months at 5 times the prior valuation, and that's a real talent competitor.

Patrick O'Shaughnessy

And what about things like tenders? Have you done this historically?

Christina Cacioppo

We have not done them historically, but the game on the field is that you're doing a tender every time, and you gotta do them.

Patrick O'Shaughnessy

Does this feel unhealthy?

Christina Cacioppo

Totally. My opinions about it don't matter. I can have all the feelings I want in whatever direction about tenders. They are normalized, and people expect them as part of their comp. If you're not giving it to them, you gotta give them a bunch of other stuff to make it up.

Patrick O'Shaughnessy

How does all of this affect your exit ambitions—to go public, to be sold, or realize some endgame for Vanta? Not at all?

Christina Cacioppo

Not really, which is, again, a very founder-privileged statement. The endgame is: How long can we keep this going for? Ninety-nine percent of the big independent software companies in the United States are public. Yes, an IPO in that sense. I don't have it as a bucket-list item myself. It's more of a means to an end. Lots of people join companies and want the bucket-list item, so, founder-privilege caveat here again. But the goal is a big, independent, standalone company.

Patrick O'Shaughnessy

On all this stuff—tools for building, ways of building, all these kinds of things I'm asking about—what do you think is overhyped and underhyped?

2. What AI Hype Misses

Christina Cacioppo

Underhyped is knowing the company and the customers, relative to knowing the skill set. It's still really hard to hire, train, onboard, and make people who join a company effective. The company can make this better and easier and put information at people's fingertips, but there's still totally something to be said about someone who's been at a company, knows how to navigate it, knows the customers, all of that.

I'm at a phase right now where we value that skill set more than the functional skill set of, “You're good at sales” or “You're good at customer success.” We'd take a worse salesperson on sales skill who knows the Vanta pieces more. There's something in that. Especially as a lot of the labs and fast-growing AI companies are building out go-to-market teams, I think they're very much valuing that you're a good salesperson. That's slightly off. As we think about building agents for all of this, the company-context piece and the customer-context piece are probably being relatively undervalued compared to “You're a good salesperson.” I think that skill is slightly less valuable today than it was 4 years ago.

Patrick O'Shaughnessy

What about overhyped?

Christina Cacioppo

Token-based pricing, low margins for the sake of having low margins, and custom training models for the marketing value.

Patrick O'Shaughnessy

Being able to say, “We post-trained a model on our stuff.”

Christina Cacioppo

Exactly.

Patrick O'Shaughnessy

Explain why.

Christina Cacioppo

Go talk to the inference providers, and sometimes, depending on the provider, give them your CRM. They'll say, “Look, the reason to post-train a model is cost.” Some businesses have that need, but there's not a quality reason to do it. There's kind of a marketing reason to do it right now, and I think there's a lot of post-training for marketing reasons—for investors and for customers. Mostly for investors, actually.

Patrick O'Shaughnessy

If one of those people were pitching the other side of this—the value of post-training—what's the pitch to you?

Christina Cacioppo

Yeah.

Patrick O'Shaughnessy

One of these companies comes to you and is like, “We'll do XYZ for you.” What are they saying, and what do they say the benefits are?

Christina Cacioppo

“You are putting a stake in the ground of being a real AI company. Customers will notice.” I think that's the primary one. I do think there's a secondary one in some use cases, a form-factor thing. Especially with large enterprises, you want to deploy this piece of software wall to wall, and that requires integrations and 17 people to sign off. Oof. That's a whole thing. Why don't you just give them a model specific to them for this use case? I think that's semi-reasonable.

Patrick O'Shaughnessy

So if I was one of these people and I came into Vanta, what does post-training literally mean? What would it mean in your context? What are you doing? What are the steps that you would go through?

Christina Cacioppo

We would need a bunch of data from that specific customer, then go write a bunch of evals and change model weights based on that customer's specific data.

Patrick O'Shaughnessy

The process would be: they're trying to achieve something, they've got some data, you tune a model to achieve the thing—

Christina Cacioppo

Exactly. Yeah.

Patrick O'Shaughnessy

—increase the eval. And then sell them that—

Christina Cacioppo

Exactly. Yes.

Patrick O'Shaughnessy

—on an ongoing basis. And your point is that that's overrated because it doesn't actually improve their—

Christina Cacioppo

It can. I think I'm skeptical in a couple of ways. Does everyone really want to be handed a model? There's so much around that from a user-experience perspective, from a deployment perspective, and from a form-factor perspective. It feels a little like—you know on social media, with our mobile apps, when we hadn't figured out pull to refresh yet? There's something here. I don't think anyone actually wants to be handed a model, the same way it's like hitting a refresh button. I don't know, that sounds silly, but that's what we did in 2011. There's some version of that here. We haven't figured out how this actually works, and handing models, I think, is not the right solution. It's a reasonable iteration, but not the right solution.

Patrick O'Shaughnessy

Is there anything else in the popular discourse that you think is crazy?

Christina Cacioppo

Yeah, FDEs.

Patrick O'Shaughnessy

FDEs?

Christina Cacioppo

I kind of think FDEs are crazy. I think it's a great talent arbitrage, the same way a chief of staff is. What an FDE often is is professional services, but I think if you call it a professional services role, that's a very different talent profile than FDE in the current discourse. I don't think you're gonna get the Harvard CS grad who's high-agency and wants to go do things and learn how to build a business to sign up to be a pro serve person number 4 or number 12 at a company.

I think there's a real job there, but I think this FDE wrapper around it probably isn't going to stay. The company that we all think does this well is Palantir, which I think they probably do. They have eight-figure contracts. There are some companies that have eight-figure contracts. I think we're using FDEs at a place where there are five- and six-figure contracts, and those economics are probably upside down. We're in, again, an era of 30% growth, margin better, and so that sort of works. That doesn't feel sustainable.

Patrick O'Shaughnessy

When you're at a dinner in San Francisco with other founders, what are you talking about? Are you talking about models and which ones to use? What are the actual topics of conversation between founders right now?

Christina Cacioppo

There's definitely the talent-war pieces. There was a time—this is more 9 months ago—but it was a joy to go around the table and complain about Cursor, their taking of everyone. There's definitely that piece. There's a bit of an FDE conversation: “Do you actually do this? Is it working? Where are you on this right now?” Personal agents: which ones do you have, and what are actually useful?

Patrick O'Shaughnessy

When you think about the open-source stuff, Chinese models, this, that, and the other—

Christina Cacioppo

Yeah.

Patrick O'Shaughnessy

—what have you learned talking to people around the world who are grappling with these same questions?

Christina Cacioppo

I was with our customers in France a couple of weeks ago, which was lovely. One of the things I was very surprised to learn is that a lot of the French software companies in Paris are using Chinese models predominantly. I initially thought it was nationalism, maybe anti-America, just something there, and stupidly suggested that. Someone very quickly corrected me and said, “Absolutely not. We basically all switched to Chinese models when Trump closed Fable[?] off to non-Americans, and we just kind of realized there's a huge business continuity risk. We can't trust that if we build a business on one of these American models, it'll always be available, so we stopped doing that.”

Patrick O'Shaughnessy

If you dream the most about where the business could go over the next several years, what's the version of Vanta that could look like?

3. Vanta’s Security Expansion

Christina Cacioppo

We think of Vanta as a security company. We started with compliance. The best version of compliance is proving the security you have. You've got to have good security. We think we can, and are, moving into a bunch of security domains as sort of a platform pitch: Look, we've already got the data. We've already got the intelligence via the agent. We can start stacking products on top of that, more security-focused products.

As we understand the security of all these companies, the pressure on them to go prove they're legitimate and industrial-grade is just gonna go up. That's one of the founding theses of Vanta 8 years ago, but it feels even more true now. Whether they're working with enterprises, governments, regulators, or lawmakers, you just have to prove your software is industrial-grade in lots of ways. That will happen more and more, in more and more ways, in the future, and Vanta is the thing that connects both sides of that marketplace.

Patrick O'Shaughnessy

So what’s the direction of security? This is, of course, an incredibly interesting topic. In the early internet, everything broke; everything got hacked. This will probably be that times 10 or 100. Does security mean you compete with CrowdStrike and places like that? What does security mean, and what’s its trajectory in this crazy era?

Christina Cacioppo

These models are just so much more persistent than people. They’ll try nine quadrillion things, where a person would give up after 9,000. In the course of that, they find things and chain things together. A lot of the discourse is around zero-days, and there’s definitely some of that: these models are finding things we didn’t find before, or didn’t publicly find before.

I think what’s happening more is that these models are able to chain 17 benign-ish—or benign on their own—things together and then really find something. If you watch the OpenAI talk at RSA about Hugging Face, it’s basically that: persistence, putting together things that people on their own would’ve said, “That’s low severity. I’ll fix it in 90 days.”

I think that update is tough, and we have to fight with machines, because it takes what was, “Oh, that’s important, but low severity. I’ll get to it in 90 days. I’m going to fix this other stuff first,” and turns the prioritization on its head. Saying it makes everything critical isn’t helpful, because then you’re like, “Well, what do you do?” I think what that ends up looking like is that you’ve just got to fix stuff as fast as you find it, and some of the prioritization does need to go out the window. But if you’re fixing things at machine speed, you don’t have to prioritize. That’s where I think we’re going to get to, but I think it’ll be rocky as we get there.

Patrick O'Shaughnessy

So, as I visualize that, what it feels like to me is a constant penetration test—

Christina Cacioppo

Yes. Yeah.

Patrick O'Shaughnessy

—where an agent is trying to break in, like a white-hat hacker agent—

Christina Cacioppo

Yep.

Patrick O'Shaughnessy

—all the time.

Christina Cacioppo

Yep.

Patrick O'Shaughnessy

And then every time they find something, it’s got a buddy agent that’s a patch—

Christina Cacioppo

Goes fix it, yeah.

Patrick O'Shaughnessy

Is that the ultimate product vision, then?

Christina Cacioppo

For some parts of Vanta, yes. I think we can do that in very compelling ways for the bulk of our customers. I think CrowdStrike will do it better for an enterprise. This is where choosing where you play and what market segment is most important.

Patrick O'Shaughnessy

Is there a firm that’s doing something now that you start to encroach on, among the traditional security firms?

Christina Cacioppo

It’s a different market segment. Take an ongoing penetration tester and remediator, a fixer. We think we can do that for the cloud providers, like AWS or Azure—misconfigurations there. Classically, Wiz does that. Wiz will do it for its customers. Wiz’s customer base starts at a multi-thousand-person company, and its price point starts at a multi-thousand-person company.

We’re thinking about the platform in terms of where we’re already embedded with customers. Where are they unlikely to pay $150,000 for Wiz, but very well could pay 40 or 50 for something suited to them? We’re thinking through where we’re already strong and where the competitors are focused elsewhere, probably on a more upmarket segment.

Patrick O'Shaughnessy

How has your personal motivation changed? You set out to build this thing. I remember talking to you the first time about this very charming way you built the original product, building it in Excel first.

Christina Cacioppo

Yeah.

Patrick O'Shaughnessy

It seems very old school. Looking back on it, there’s always the “dog that caught the car” thing where—

Christina Cacioppo

Yeah.

Patrick O'Shaughnessy

—all right, you built this huge software business.

Christina Cacioppo

Yeah.

Patrick O'Shaughnessy

Amazing. How has your own motivation evolved or changed through all this? Why keep going?

Christina Cacioppo

It’s interesting and challenging, and it changes all the time. I really like my job. Sometimes I feel like I’m good at it. Often, I feel like I’m bad at it. That’s fine. In some ways, that’s not the point.

It changes, and it’s different. When I feel like I’ve gotten good at it, usually something happens, and then I feel bad at it again. I really like that dynamic. In the beginning, I had a lot more of a feeling of, “People think I can’t do this. I think I can, and I’m going to show them.” I still have that. We even did the, “You don’t think Vanta’s going to be $250 billion? Let me show you.” I still have it, but, as you can probably tell, there’s less of a dark edge to it. Still a little dark edge, but less of it.

It’s, “Oh, cool. We got here. Now we’re just going to see how far we can run,” in a way that feels a little more fun and joyful. My day-to-day is not always joyful. I don’t mean that. But it feels more like, “Oh, cool. Let’s see how far we can go with this.” I think we can go pretty damn far. Whereas in the beginning, I think it was more like, “You don’t think I can get off the starting line? Let me show you.”

Patrick O'Shaughnessy

How surprised would the 8-year-old version of you be at some specific skill that you’ve developed?

Christina Cacioppo

Oh, probably pretty surprised. Yeah.

Patrick O'Shaughnessy

What’s the most surprising one that you’re now good at that old you would’ve said, “No way”?

Christina Cacioppo

I like go-to-market more than I ever would’ve guessed. You get to talk to personable, friendly people all the time, and I was a terrible public speaker. I would get the most nervous in front of my own team because I cared the most about what they thought. I was like, “Oh my God, I’m representing you. I want to do this so well.”

Exposure therapy was helpful on that one. You just do it, and you do get better at it. But I think the thought of being at kickoff or an all-company get-together, in front of 1,000 people on a stage, would’ve made me think, “Oh, shit. I’m going to be bad at that.” I think the people around me would’ve been like, “Yeah, yeah, she’ll be bad at that. How much coaching can she get?” But it’s like anything else. If you work hard at developing a skill, you tend to get better at it. You just have to put in the work.

Patrick O'Shaughnessy

In that one in particular, I’m very interested in that. It always seems high leverage. What matters? You’ve given however many hundreds of these things. What makes one good?

Christina Cacioppo

The trope that no one remembers what you say, but they remember how you felt, is so annoying, but it is so true. I do have to believe in the content. If I just get up and feel like it’s contentless, I’ll also feel that way, and it’ll be obvious to everyone.

You kind of have to figure out your version of it. For me, I try to put real content in and also hold in my head, “No one’s going to remember any of these facts.”

Patrick O'Shaughnessy

So heart—

Christina Cacioppo

That’s not the point.

Patrick O'Shaughnessy

—matters more than mind.

Christina Cacioppo

So much more, yeah.

Patrick O'Shaughnessy

And the key to good heart is what?

Christina Cacioppo

Believing in it yourself. Authenticity. One-on-one or on a stage, people are pretty good at reading one another. When you feel like the person you’re talking to is going through the motions, doesn’t really feel like it, or is misleading you—maybe they’re also misleading themselves—people can tell. They can’t entirely articulate what’s happening. Something seems off. Versus someone who’s authentically into it, even if they’re into something kooky, that just comes off.

Patrick O'Shaughnessy

What are the big trade-offs that you struggle with right now? You can’t do everything. You’ve got to make decisions. The stakes are higher than ever. It’s easier to build than ever. It seems like a cool time to be doing what you’re doing, but there must be big trade-offs that you struggle with. What are those for Vanta?

Christina Cacioppo

One conversation we’ve had and have is that we’ve tried over the last year to build in such an agent-forward way.

Patrick O'Shaughnessy

What does agent mean?

Christina Cacioppo

I don’t know. You get 2 extra revenue multiples if you say “agent.” It’s like 3× if you say “harness.” I have to… I could say “harness” more. “Prompt file,” like, minus 3×, you know?

We’ve tried to build such a great harness for our customers, but actually not build a bunch of SaaS UI. You want reporting? We’ll have our agent go make charts for you on demand based on all of our data. We’re not going to put Tableau inside of Vanta, which is probably what we would’ve done in 2021 or 2022 if we had been building it then.

We believe in this in the short-term customer-outcome sense, but also in the medium- to long-term sense: this is what software will look like, and no one is going to be putting Tableau inside their products.

Patrick O'Shaughnessy

So there’s an aspect of this diffusion thing that’s just scary: maybe the tractor company takes 10 years, and in the meantime, you were right, but early, and therefore wrong.

Christina Cacioppo

And therefore wrong. You’re kind of betting on the time horizon there. The other version of this is big enterprises. We’re working with a U.S. enterprise, trying to close them, and they were basically like, “Hey, maybe we want your AI features, maybe we won’t, but can you turn them off for now?” And I’m like, “Ugh, why?” The answer is, it’s way easier to get a non-AI tool through procurement, and we want your tool.

Patrick O'Shaughnessy

Turn it on after we’re in.

Christina Cacioppo

Right? We don’t really have an off switch on it. You’re like, “Oh, can we go build that?” But you’re also like, “Gross. We don’t want to build that. We’d so much rather take that time and effort and build something actually useful.” Anyway, we’re not going to build this off switch, but it’s just one of those trade-offs.

Patrick O'Shaughnessy

If you were an investor, which you used to be, where would you be focused right now?

Christina Cacioppo

Oof. I do not envy the job at all right now.

Patrick O'Shaughnessy

Why? Why don’t you envy it?

Christina Cacioppo

As much as I can critique and make fun of some of these businesses on the company side, and say, “Oh, I think people are thinking about them in a very short-term way,” I think the FOMO and the question of “What are your returns?” are more acute on the investor side than the company side. I saw this tweet: “If you haven’t invested in a lab or an inference provider in the last 4 years, you should just shut down your firm, because what are you doing?” It feels more acute on the investor side than the company side. However hard I think my life is, my life’s not hard, to be clear. Whatever trade-offs we’re facing, it feels more echo-chamber-y, more judged on incremental returns and paper returns on the VC side than on the company side.

Patrick O'Shaughnessy

So what would you do? Where would you hunt?

Christina Cacioppo

The labs and the inference providers, apparently. No, those feel a little… Well, we can debate whether they’re played out, but they have high entry prices. The discourse and the certainty around the open-source model providers, and then the tooling and companies around them, feel sort of disconnected. It’s, “Oh, we’ve all decided the open-source model will be very real,” and then the ecosystem around them is so much less built out than the big labs. That just feels off to me. You probably have a better diagnosis of that.

Patrick O'Shaughnessy

What do you mean by the ecosystem around them?

Christina Cacioppo

If you think that a lab—or is it Longlight[?]? Is that what it’s called?—like, these are basically going to go deploy this technology—

Patrick O'Shaughnessy

Put AI on it, basically.

Christina Cacioppo

—and put AI in these businesses. Can you build one of those around the open-source providers? Of course, yes. But can you really grab one of those models the way OpenAI is grabbing its own stuff and just replicate that playbook? A bunch of the lab playbooks seem like they should apply to the open-source models.

Patrick O'Shaughnessy

And it’s just less mature, so there’s more to do there.

Christina Cacioppo

Exactly.

Patrick O'Shaughnessy

Yeah.

Christina Cacioppo

What am I missing on that?

Patrick O'Shaughnessy

I think it’s just a pace thing. Anything where these things can go… It’s kind of like, ironically, private equity or something—what private equity promised to do, which was to shape businesses up. Now they can do that much more easily, so probably everything will get way more efficient if it can, and the return will come from higher margins, more efficient operations, whatever. That’s an efficiency thing, not a generative thing. I guess what I’m more curious about, as you watch your peers and people around you, is where the green shoots are on the generative side.

Christina Cacioppo

A bunch of people are starting cybersecurity companies, both because of the environment and because I see proportionally more of those than other things. A bunch of people are attacking rev tech, like go-to-market technology, which I think makes a ton of sense. Some of the old SaaS rev tech providers should be building all this stuff, but it doesn’t seem like they are. Instead, they’re running more PE-bent, sponsor-sort-of playbooks, which is, again, a choice. It may be a reasonable choice. Robotics is probably underplayed, though it’s somewhat hot and hypey. That’s not a novel area, but it’s still definitely underweighted compared to all the software stuff. The models are also getting real damn good there, to state the obvious, so I’d probably spend time there.

Patrick O'Shaughnessy

What else do you feel like you know because of your unique path that others don’t yet fully appreciate?

Christina Cacioppo

Over the past couple of years, Vanta has spent more time with government, at the federal, state, and local levels inside the U.S., and outside the U.S. There’s an appetite for modernization. It’s a big stated priority of the current U.S. administration, but it exists outside of the U.S. too. The AI piece has created more FOMO among government officials. They may have always known they didn’t have modern processes or modern software, but it feels more imperative now than it used to.

Here’s a broader answer: all of the conversation around AI and the technology has changed the priority and increased the priority of a lot of modernization. Sometimes it’s within governments, sometimes it’s within enterprises. You see this with a lot of the cyber stuff and the CISOs we talk to. Their jobs are changing because of AI, and they’re saying, “Given AI and the risks from the agents, I’d like to overhaul my enterprise risk program, and I’d like budget for that.” If they’d said, “I want budget for my enterprise risk program,” 3 years ago, people would’ve been like, “Eh, we’ll talk about an ALP. Maybe.” Because it’s attached to AI, they’re much more likely to get that budget today, so there’s more of a buying motion.

Patrick O'Shaughnessy

What would be your big pitch to come work at Vanta right now?

Christina Cacioppo

Oh, it’s a fun stage. You get 16,000 customers using a product, using agents. When you ship things, they’re in use by real people, getting real feedback instantly. It has product-market fit. You’re just going and experimenting with fast iteration loops.

Patrick O'Shaughnessy

But early enough that you could still—

Christina Cacioppo

You can move, yeah.

Patrick O'Shaughnessy

—be a part of—

Christina Cacioppo

We will let you move.

Patrick O'Shaughnessy

Yeah.

Christina Cacioppo

Yes.

Patrick O'Shaughnessy

Because it’s such an amazing Silicon Valley microcosm, can you tell the most detailed version of the billboard war story that you’ve ever told?

Christina Cacioppo

I was always very much a billboard skeptic because it seemed like, who knows if they work? The tracking’s terrible. Founder ego is why someone would do a billboard, because they feel cool having a billboard for their company. So I was always very anti-billboard.

In mid-summer 2021, at the SaaStr Conference, which felt like a big deal at the time—thank God we’re almost beyond that—our marketing team decided to try out-of-home advertising. I was super skeptical, but I was like, “Fine, whatever. Try it.” We were going to put something on the billboard, and Sarah, who was our PMM at the time, came up with “Compliance that doesn’t talk too much.” She pitched it to our head of marketing, who didn’t like it because they thought we were negging our users. They were basically like, “No, don’t. Think harder.” Much nicer, but, like, think harder.

Sarah kind of believed in it, so she went to me, which she usually doesn’t do. She’s not someone who goes around her boss, but she really believed in “Compliance that doesn’t talk too much,” so she took it to me. I read it and immediately laughed. I texted Andrew Reid, our investor, and asked, “What do you think? You have good internet meme taste.” He loved it, so I was like, “Okay. Let’s try it. Let’s run it.” What’s the worst that’s going to happen? People will think we’re obnoxious and then probably forget in 6 months.

We put the billboard up somewhere near Burning Man. It went over so well. We tweeted it, and the tweet went viral. It kept circulating over the next couple of months and ended up on r/accounting and all these places. You’re like, “Oh, this is a gem.” I think it really worked because it was our brand and our marketing at their best. Our attribute is a wink: we take our work seriously, but we don’t always take ourselves seriously. I think there was something about that that resonated. It was a little obscure, but sufficiently obscure that if you got it, you felt like you got a secret. Anyway, “Compliance that doesn’t talk too much” just worked.

In 2022, the market crashed. It turned out there was a lot of billboard inventory available on 101. We got this great spot where 101 and 280 intersect, and it was a great spot for not that much money, especially in retrospect. We joked, “Oh yeah, we’ve locked it up for years.” We were known for that billboard in that spot. I think I even said on podcasts that the contract was locked up for years. It was not locked up for years. But that billboard got famous, and people would contact us and Sarah all the time and ask, “How do you do billboards? How do you do your billboard?” We’d say, “Oh, we work with this agency. We work with this guy.” We referred this guy all this business, and he’d be like, “It’s him, it’s him, it’s him.” Millions of dollars of business. Great.

It turns out we did not have a multi-year contract in the background, which I should’ve known, certainly if I was going to say that on a podcast. It didn’t really do what it said on the tin. The contract was basically, “You’ve put the billboard up.” That’s it. This was not a contract at all.

Multiple years go by. Sarah’s having dinner with one of her friends, who works at a startup, and her friend says, “Oh, it’s so sad you guys gave up that billboard spot. Why’d you do that?” Sarah says, “Pardon?” Her friend says, “Oh yeah, we just signed for your spot.”

Sarah says, “What?” We go back and look at the contract. The contract’s written in crayon. There’s no contract, basically. It’s a placement order. We call the guy, and he says, “Yeah, you know, it was a placement order. They paid more.” So he swapped it out from under us.

I go to the founder of said company and say, “Hello. How much can I pay you?” I’m an extremely inelastic buyer here. What can I pay you for this spot? He says, “Nothing.” I say, “How about I double?” I think he was paying about $1.5 million. I say, “How about I give you $3 million just to get this spot?” And he says, “We’re actually cash flow positive.” So, literally, I’m an inelastic seller. And we lost the spot.

Patrick O'Shaughnessy

Good punchline.

Christina Cacioppo

Things that made me think, “Oh no, Vanta’s screwed.” Honestly, losing that billboard, I thought we probably just lost a bit of market cap.

Patrick O'Shaughnessy

Bad, bad, bad omen.

Christina Cacioppo

Yeah, yeah. You’re both bad omens. There’s some 5% market cap decrease that just happened here. Yes.

Patrick O'Shaughnessy

Is there anything I’ve missed that has your curiosity, your attention, that you think is really important right now?

Christina Cacioppo

You see it in the data center conversations, and to some extent in the personal agent stuff. We just don’t trust software companies and tech companies the way we used to, and that’s getting worse year over year. It’s kind of hard to imagine that inflecting back up and getting to the useful optimism of 15 years ago.

In that environment, companies showing that they’re trustworthy, industrial-grade, and secure through lots of metrics and actual definitions is more important than ever, and will just get more and more important. And again, to a host of customers, regulators, lawmakers, auditors, et cetera, Vanta at $250 billion is in the center of all of those transactions. We help companies meet those high bars, or wherever those bars are set, and then convey that, helping them go convey that and accelerate their businesses.

Patrick O'Shaughnessy

Is there a way of saying that AI has ushered in this extremely high-excitement-but-low-trust—

Christina Cacioppo

Yeah, that’s good.

Patrick O'Shaughnessy

—era?

Christina Cacioppo

Yes.

Patrick O'Shaughnessy

And Vanta’s job is—

Christina Cacioppo

Rebuild some of that trust.

Patrick O'Shaughnessy

—preserve the excitement, but increase—

Christina Cacioppo

And, yeah, increase the trust. Legitimately so, not just on vibes.

Patrick O'Shaughnessy

What will satisfy the market to trust again?

Christina Cacioppo

In a B2B context, with businesses, I do think there’s the vibes piece, but there’s a very real data piece. I’d like to see specific things or specific improvement curves, or make promises with maybe contracts behind them. That one’s, quote-unquote, logical and rational, the way enterprise markets often are.

On the consumer side, it is vibes. That one seems very hard to turn. I do not envy that.

Patrick O'Shaughnessy

Do you trust them to use Instinct, et cetera?

Christina Cacioppo

Big companies? No.

Patrick O'Shaughnessy

Why not?

Christina Cacioppo

It’s not that there’s anything particularly interesting in my email or chats or whatever. My life’s not that interesting. But I would rather just Google or just Apple or just insert company here have that information.

Patrick O'Shaughnessy

What’s security like five years from now? If you wrap it up with, “Okay, here’s where we’re going, and we want to be the person at the center of this,” describe that state for us.

Christina Cacioppo

Security five years from now is faster, even more intense, more offensive. Hopefully, yes, we’ll have more attacks, but I think you need more white hats pushing back on all of that, and at a speed that we haven’t had before.

I think you’ve got to get humans to that speed. You’ve got to get some amount of the human decision-making out, where humans are architecting systems and writing rules, but not making every single decision. It’s like falling from that. Writing emails, maybe that’s all we’re doing in the future. We’ll all write emails all day long.

Patrick O'Shaughnessy

If you had to define what the next five years of Vanta will be in one word, what word do you pick?

Christina Cacioppo

Expansive. I think we have this incredible base of customers, of data, and now we get to go build things on top of that. Eight years to get here. We could go just build stuff on top of it for the next five or eight.

Patrick O'Shaughnessy

It’s so cool that we did this five years ago. Here we are again. Thanks so much for your time.

Christina Cacioppo

Thanks.