用户所有的 AI:链上训练、推理与智能体——与 NEAR 的 Illia Polosukhin 对谈
Polosukhin 的核心论点是:有用的个人 AI 必须了解用户的一切,但不能把这些上下文交给中心化服务商。 仅有隐私还不够:用户还必须验证实际运行的是哪个模型,以及隐藏指令是否改动了模型。他认为,要交付“属于你的,而不是属于他们的”AI,人们需要围绕共享模型、基础设施和经济体系“构建一场运动,而不是一家企业”。
NEAR 的权益证明层旨在让有效交易无法被审查,同时不要求用户信任某个具名验证者。 任何人质押价值都能加入——“你可以是一只猫,也可以是 AI”——而三分之二诚实的共识即可提供最终性;要伪造一段已最终确认的历史,约需控制 66% 的质押量。惩罚机制从小型节点配置错误时的宽容处理,到协同攻击时的全额损失,按情形递进。
机密计算提供了本期最清晰的近期经济切入口:只增加 1% 至 5% 测得开销的私密、可验证推理。 NVIDIA 支持的安全环境即使对硬件运营商也隐藏提示词和模型权重;相比之下,当前零知识证明的开销约为 1,000x,全同态加密则为 1,000x 至 10,000x。代价是必须明确地信任芯片制造商,而且目前受限于单机 8-GPU——尽管 Polosukhin 表示,这已经足以容纳一个超过 1 万亿参数的模型。
拟议中的去中心化云,将兼容 GPU、专有模型和私有数据集转化为分别获得补偿的输入。 算力所有者无需许可即可加入;模型开发者可以上传加密权重,无需预先购买容量;用户支付的费用则流向硬件、模型以及潜在的数据提供方。Polosukhin 的说法是,“把模型推上去,用户一用就开始赚钱”,同时不托管用户数据,也不直接承担 GDPR 和 HIPAA 风险。
NEAR 希望以一组可检查、代币化的项目组合来融资模型开发,而不是由中心化机构选定一个前沿项目。 Erik 提到一个超过 1 万亿参数的模型和 $160 million 的估算;他指出估算仍在下降,Nathan 随后回应“Cut it in half”,指的是 V3,而开场介绍使用的是约 $100 million 的资源估算。一个拟议的 1.4 万亿参数模型可以发行代币,奖励算力、数据和研究贡献者;竞争性的 70B 模型则可以沿用同一套基础设施,瞄准更便宜、更快的工作负载。
训练计划将从可验证基准和私有微调开始,然后才尝试从零开始的去中心化预训练。 企业可以用未披露的数据集测试闭源模型;数据所有者可以与从未接触其数据的专业团队合作;不同的课程构建者也可以先在小规模运行中接受评估,再获得更大的资源配置。即使主观质量也能成为市场输入:“你也可以把自己的 vibe benchmark 作为 benchmark 贡献出来。”
AI 可能让软件漏洞更容易被发现,因此 Polosukhin 最终希望在执行时证明正确性,而不是一次性完成认证。 他的长期判断是,“实际上我们需要重写几乎每一行代码”,将其转换为形式化可验证的形式,并由 AI 降低证明成本。他还表示,自己认为有人已经用这种方法发现了 Linux zero-day。区块链成为信任根,而机密硬件则提供关于实际使用的代码、模型和数据的证据。
最终形态将 AI 介导的商业与链上约束结合起来,但不可逆风险仍未解决到可以忽略的程度。 NEAR 的示例智能体收到 10,000 美元,无法被召回,依据 Twitter 情绪交易,并赚取了约 4,000 美元;未来的智能体可以协商意图、解决争议,甚至充当 AI 参议员。Nathan 追问:当 10 亿个无法停止的智能体也参与治理时会怎样?Polosukhin 因此强调形式化沙盒、人类治理、法律辖区和法院,即“把 AI 放进治理,也把治理放进 AI”。
1. NEAR 起初是 AI 产品,意外转型成区块链
“猫神经元”结果让 Polosukhin 相信神经网络确实有效,于是他加入 Google;但他认为“知识和智能”更多存在于文本,而不是图像中。他所在的团队专注于问答,并在 Gemini 之前将短答案技术部署到 Google 搜索中。
瓶颈在延迟:LSTM 需要按顺序读取词语,难以快速阅读多篇搜索结果文章。因此,Transformer 的一个动机就是直接的系统工程问题——尽可能并行地摄取上下文,再据此给出答案。
Polosukhin 于 2017 年离开 Google,与 Alex Skidanov 创办 NEAR AI,目标是教机器编程。他们希望把“少数人能够编写代码、其他人只能消费其魔法”的世界,替换成人人都能指挥计算机的世界;当时听起来像科幻的设想,如今被称为“vibe coding”。
他们向计算机科学学生收集指令和代码样本时,暴露出支付难题:中国学生使用 WeChat Pay,乌克兰收款人可能被迫卖出一半收到的美元,而 PayPal 或银行转账在其他地区又无法使用。区块链看起来像他们需要的全球支付轨道,但现有系统要么速度慢、难使用,要么不适合可预测的小额交易。
2. 6 个月的基础设施绕路,变成拥有 1,500 万用户的网络
创始人原以为 6 个月就能搭建一个可扩展、可编程的区块链,然后回到 AI。Polosukhin 承认,“只是花的时间稍微长了一点”;最终成果强调易用性、可预测的低价值交易,以及用 Rust、JavaScript、Python 等语言编写软件。
他形容 NEAR 承载了支付、忠诚度、汇款和大量小额交易活动,月活用户达到 1,500 万。2022 至 2023 年 AI 加速发展后,团队吸取多年协调开放式区块链参与者的经验,重建了 AI 业务。
最初的编程论题也得到扩展:如果 AI 能编写软件、操作工具,许多应用和网站就不再必要,因为界面可以“实时生成”。设备将朝 AI 操作系统演进,但本地硬件无法处理所有后台任务,因此部分计算必须卸载到外部。
被卸载的 AI 必须拥有用户的深层上下文,才能真正提供帮助,这就制造了核心矛盾:“我们希望 AI 拥有你的全部上下文”,但由中心化机构持有聊天记录和个人历史又很危险。Polosukhin 提到过聊天记录泄露,以及机构将聊天内容报告给警方的案例,说明问题已经存在。
3. “用户所有”意味着同时控制数据与认知
隐私只是第一项要求。如果 AI 成为用户认识世界的镜头,细微的改动就可能改变其信念:Polosukhin 举例说,可以在用户表面上讨论另一个话题时,暗中向 ChatGPT 注入指令,把用户引向某个政治选择。
因此,用户所有的 AI 意味着知道哪些内容进入了模型,并验证执行过程中没有加入隐藏提示词或其他修改。他用一句话概括这种区别:“你希望 AI 属于你,而不是属于他们。”
这种经济愿景超越了个人助手。AI 可以绕过 Google、DoorDash 和 Amazon 等聚合平台,直接找到工厂;也可以与药企的 AI 协商,根据某个人当下的医疗状况,而不是普通患者的安全标准,给出处理方案。
由于这种未来会用人与人、人与公司、人与自主智能体之间的直接交易,取代机构中间商,Polosukhin 认为区块链会从相反方向重新回归。搭建所需的公共基础设施,不能只是再造一家掌控一切的供应商:“你需要构建一场运动,而不是一家企业”,并由足够庞大的经济引擎为其提供融资。
4. 权益证明把信任变成可验证的成本,而非企业承诺
Polosukhin 将区块链与今天的互联网进行对比:DNS 和证书机构都引入了用户最终必须信任的组织。区块链提出的则是一个更具体的问题:某人要让这个用户相信一段虚假状态,究竟需要付出多大代价?
他说,在拜占庭容错权益证明下,只要三分之二的参与者没有恶意,就能阻止伪造的最终历史。用户可以验证从 NEAR 于 2020 年 10 月启动主网以来的每一次状态转换,而不必接受单一中介的说法。
验证者包括生态公司、交易所、大学、个人开发者以及 Vodafone 等实体;据称还有一台轻量节点运行在一台 8 年前的笔记本电脑上。他们质押 NEAR,也可以获得用户委托的质押,并分享保障网络安全的奖励。
Nathan 的新手提问揭示了无需许可的实际含义:固定的验证者集团可以审查或延迟竞争对手的交易,而开放网络允许被排除者直接加入并提交交易。身份与验证是两回事——一个假的 Coca-Cola 账户可以参与,但 Coca-Cola 的公开渠道可以向其他人释放信号,促使他们把质押委托给它。
5. 经济安全性随被攻击的交易规模扩展
“你可以是一只猫,也可以是 AI,这都无所谓”,前提是验证者控制了足以质押的资本。无效行为会暴露这笔抵押品,但 NEAR 不希望因普通错误摧毁运营者:持有 0.1% 或 0.01% 质押量的节点,因配置错误只会损失相应有限的金额。
协同攻击则区别对待,惩罚会逐步逼近攻击者的全部质押量。Polosukhin 承认,大规模入侵可能源于 zero-day 漏洞,但他认为,运营者必须对承载大量网络权重的系统安全负责。
Nathan 问,如果一个价值 7 万亿美元的假想 AI 经济最终让攻击变得有利可图,情况会怎样?Polosukhin 回答,伪造最终性需要约 66% 的质押量,攻击的对象将是收款方、交易所或服务,而不是让协议内部规则停止运行。价值万亿美元的收款方也可以在交付对应价值前等待更长时间。
他将其与 Bitcoin 对比:节目中提到,伪造 1 小时历史的成本为 200 万美元,因此接受 1,000 万美元的人应等待超过 1 小时。美元规模的智能体交易,其安全成本远高于交易价值;在他看来,软件 zero-day 才是更直接的风险。
6. AI 将网络安全从修补漏洞推向证明正确性
Polosukhin 曾将近期披露的漏洞代码交给语言模型进行回测,观察模型在极少提示下定位漏洞;他还表示,自己认为有人已经用这种方法发现了 Linux zero-day。随着模型在代码和社会工程方面不断进步,攻击方会受益于网络安全的不对称性:找到一个漏洞,比证明不存在任何漏洞容易得多。
他提出的替代方案是“在使用系统时进行数学证明”,证明执行结果满足用户要求。形式化验证过去通常只做一次——他以火星车软件为例——但代码或要求发生变化后,证明就会过时,而且对普通服务而言仍然过于耗费人工。
如果 AI 能达到国际数学奥林匹克金牌级别的表现,构建证明的成本或许会下降。Polosukhin 的长期结论相当彻底:“实际上我们需要重写几乎每一行代码”,使其能够在执行时接受验证。
这种保证也应从存款延伸出去:证明用户至少能够取回承诺金额;对于私密服务,则要证明其不会泄露用户提交的数据。区块链提供信任根,可信执行环境再将这套证明系统连接到真实数据上的计算。
7. 机密硬件以 1% 至 5% 的开销交付大部分保证
NVIDIA 的机密计算模式结合 Intel、ARM 和 AMD 系统的支持,即使机器所有者或操作系统运营者也无法查看 enclave 内容。用户建立加密通道、运行工作负载、接收加密输出,并获得一份证明,标明实际执行的模型及输入输出。
Nathan 将其与零知识推理进行对比:当用户怀疑模型在不同时间表现不同时,零知识推理可以证明服务商运行了所承诺的模型。Polosukhin 认为,目前性能最高的 ZK 方案开销接近 1,000x;全同态加密提供更广泛的隐私与可验证性,但成本约为 1,000x 至 10,000x。
安全 enclave 是“务实的中间路线”:生产测试显示开销为 1% 至 5%,观察到的上限是 5%。目前的限制是单台机器,即 8 个 GPU;不过 Polosukhin 表示,当时几乎所有开源模型,甚至一个超过 1 万亿参数的模型,都能放进这一边界内。
Nathan 追问硬件攻击,以及 NVIDIA 在软件和密钥管理中的角色。Polosukhin 承认存在信任依赖,但认为 2 纳米芯片的物理改造成本极其高昂,工作负载也很难被定向攻击。攻击者收到的会是随机请求,而无法瞄准某个特定用例——比如“该选哪只猫”。他仍希望通过形式化验证和区块链机制,强化 NVIDIA 的认证流程。
8. 机密云拆分算力、权重与数据
由于硬件运营者无法查看工作负载,任何拥有合格 GPU 的人都可以加入。芯片签名证书负责验证设备,网络可以将请求路由到附近的可用容量、收取费用,并像奖励验证者参与共识一样奖励服务提供方。
这形成了 Polosukhin 所称的“去中心化机密机器学习云”,也可用于智能体、MCP 服务器、任意数据处理和加密用户记忆。分布式架构降低了对单一高资本开支数据中心的依赖,同时有望改善延迟和地域主权。
今天的模型开发者面临二选一:开放模型权重,却无法直接赚钱;或者保持闭源,把权重托付给超大规模云服务商,并签下大额、通常为 2 年的容量承诺。需求低于预购算力时,算力被浪费;需求超过预购量时,新增算力又要按昂贵的边际价格购买。
在 NEAR 的设计中,闭源权重以加密形式上传,只在 enclave 内解密。使用费由模型和硬件提供方分成;开发者既不需要托管提示词,也不需要预先购买基础设施。其卖点是“把模型推上去,用户一用就开始赚钱”,同时避免直接处理 GDPR 和 HIPAA 合规事务。数据贡献者也可以获得另一份分成,类似 Spotify 分配订阅收入。
9. 可验证基准是迈向去中心化训练的第一步
路线图先从推理开始,然后开放模型评估。任何人都可以创建天文学、海洋、未来预测或 deepfake 检测基准;企业可以上传私有案例,在不暴露任何一方专有资产的情况下,验证性地测试闭源模型。
这个市场也会让独立研究者构建专业模型,并在他人使用时获得收入。不同于今天公开发布的排行榜,完整执行轨迹可以展示确切的基准提示词和模型哈希;即便底层数据仍保持私密,也能减少通过一段 2 页提示词人为抬高分数的空间,因为这段提示词实际上已经提供了一半答案。
下一步是微调。一家拥有宝贵数据、但模型能力有限的海洋研究机构,可以与专业团队合作,由后者部署训练任务而无法看到数据集;训练所得模型的收入随后在开发者与数据所有者之间分配。
从零开始预训练最后进行,因为它要求围绕数据、训练配方和规模展开协同实验。不同的课程构建者可以先通过小规模运行进行比较,再将最佳方案用于更大规模的训练。开源过滤可以剔除电话号码、Social Security numbers 等个人身份信息;Polosukhin 也预计合成数据会增加,同时结合 NEAR Crowd 和 Public AI 的标注。
10. 每个模型都可以成为独立融资、彼此竞争的项目
Nathan 将前沿模型开发描述成一条奇怪的阶梯:单个模型可能花费 $100 million、赚取 $1 billion,但下一代模型可能需要额外数十亿美元,组织的资金消耗因此持续上升。他问,NEAR 是否正把这套逻辑推向终点,即围绕每一个模型设立一个子项目。
节目中的数字有意保持流动。Erik 提到超过 1 万亿参数和 $160 million 的训练估算,并指出估算正在下降;Nathan 随后回应“Cut it in half”,指向 V3。开场介绍则单独将竞争性资源描述为约 $100 million。
Polosukhin 给出的具体例子是一个发行自有代币的 1.4 万亿参数模型。算力、数据和研究贡献者获得代币分配;训练、蒸馏和微调完成后,使用收入流向代币持有者。竞争者也可以用同一平台构建 70B 模型,以更低成本、更快速度运行,而不必等待中央委员会批准。
Nathan 对“vibe checker”的质疑仍然重要:基准测试很多,但团队仍会争论它们是否能预测模型是否好用、是否令人愉悦。Polosukhin 的回答是再造一个市场——“你也可以把自己的 vibe benchmark 作为 benchmark 贡献出来”——并加入类似 Bank of America 的私有测试。可追溯性可以展示每个评估者测量了什么,但不意味着由某个品味领袖定义质量。
11. 智能体把智能写进合约,也把治理置于智能之上
NEAR Intents 允许个人或 AI 声明结果,从今晚吃到披萨,到建造一栋大楼。协议负责发现、寻找交易对手、确定商业条款并处理失败;AI 可以低成本检查链上历史和双方的私有证据,提出解决方案,而不满意的一方仍可选择诉诸法院。
自主智能体将机密计算中的 AI“大脑”,与持有资产并执行行动的智能合约结合起来。一次实验中,智能体收到 10,000 美元,运营者无法停止或收回资金;它根据 Twitter 情绪进行交易,并赚取约 4,000 美元。对于未来的自主企业,“公司章程就是提示词”;AITP 提供智能体通信,Intents 提供商业执行。
防护栏被定义为可执行的边界,而不是“思想警察”。服务在处理数据前,可以证明智能体无法逃出沙盒;用户也可以附加被禁止的输出或行动,并在执行期间验证它们。治理仍然负责制定规则——Polosukhin 认为禁止生物武器可能获得广泛共识,但其他领域预计会存在分歧。
AI 参议员实验允许人们把研究和投票委托给通过对话形成一致的智能体,有望同时降低选民负担和人类委托—代理问题。Nathan 在结尾提出反驳:数十亿个不可撤销的智能体,加上委托给 AI 的治理,可能成为一场接管行动的配方。对此,Polosukhin 给出的答案分成几层:意图可以是法律合同,辖区和法院可以对智能体执行法律责任,链上活动仍然可见。其目标是“把 AI 放进治理,也把治理放进 AI”。
Today, my guest is Illia Polosukhin, founder of NEAR, a hyperambitious, multifaceted project that describes itself as the blockchain for AI and aims to build a future where AI belongs to everyone. Illia is not your average blockchain founder. Before starting NEAR, he was one of 8 co-authors of the seminal 2017 paper “Attention Is All You Need,” which introduced the Transformer architecture and helped launch the current AI revolution.
The credits on that paper say that Illia and another co-author “designed and implemented the first Transformer models” and were “crucially involved in every aspect of this work.” In fact, NEAR started as an AI project but took a major detour into crypto when Illia and his team realized just how difficult it was for them to pay their data-task workers all around the world. Today, given his pedigree, Illia could no doubt command one of those mythical billion-dollar compensation packages from Zuck’s Superintelligence Labs. But instead, he’s building the foundational infrastructure for user-owned, privacy-preserving AI that can operate at global scale.
In this conversation, we start with foundational principles and work our way up the technology stack. We begin with an overview of how NEAR’s proof-of-stake consensus mechanism creates security for network participants without requiring trust in a centralized authority. In short, because the protocol is open and permissionless, anyone who is willing to put value at risk can become a validator, and thus no one can prevent the flow of valid transactions.
From there, we discuss how NEAR is leveraging NVIDIA’s confidential computing capabilities to create a permissionless network that allows anyone with compatible GPU hardware to sell inference compute while keeping both the model weights and user data private, even from the hardware operators—all with only a 5% overhead relative to normal computing. To be honest, I hadn’t realized just how affordable this privacy layer had become. While it does require trust in the chipmaker, it’s clearly a huge deal for all sorts of scenarios and does seem to help explain how frontier model developers have been able to ship their models to so many different inference partners without leaking the model weights.
After that, we dig into NEAR’s plans to decentralize model training itself with a process that allows contributors to provide whatever compute or data they have in exchange for a cryptographically guaranteed share of the model’s future revenue. While it remains to be seen whether a community-driven project can produce a 1-trillion-parameter model that performs at the level of today’s leaders, at a minimum, Illia and his team seem to have designed an incentive structure that could make it worthwhile for people to contribute the estimated $100 million worth of resources required to compete at that level.
Finally, we talk about what AI and crypto can do for one another, including how AI might finally put the smart in smart contracts and how blockchain technology can provide stronger guarantees that AI agents will act only as intended. This is something I’ve been envisioning, if only in quite fuzzy terms, for years, and so I was really excited to hear just how concrete it’s starting to become.
In the end, I was so eager to understand the foundational technology on which Illia’s vision rests that we barely had time for the vision itself. But I do think this is really valuable knowledge. The good news is that we’ve already scheduled another recording, so definitely stay tuned for part 2, in which we’ll explore the applications that people are already starting to build at this intersection of AI and crypto and also try to get a handle on the giga-agent future by exploring Illia’s vision for how AI agents will interact, transact, and even participate in governance.
I hope you enjoy this technical deep dive into the infrastructure for user-owned, privacy-preserving AI with Illia Polosukhin, founder of NEAR Protocol.
Welcome to the Cognitive Revolution.
Thanks for having me.
I’m excited for this conversation. I think this is going to be one where I’m going to learn even more than I usually do, because you’re right at the intersection of AI and crypto. Sometimes these 2 technology waves are characterized as different camps that don’t understand each other, or at times are in some sort of online rivalry that may be mostly made up. But I’ve got this sneaking suspicion that I’ve never quite been able to fully develop: these 2 technologies might actually need each other to reach their fullest potential and to do so in a way that we can keep control of them over time.
I’m really excited to dig into all of that with you. For starters, though, if my deep-research reports are to be believed—and this wasn’t hallucinated—I do know for a fact that you were one of the authors of the original Transformer paper. But then I understand from deep research that the project we now know as the NEAR Protocol started as an AI project and then evolved into a crypto project before now coming back to the intersection of crypto and AI.
I’d love to hear a little bit of the story of how you went from being an author of “Attention Is All You Need” to branching out on your own, realizing that you actually needed crypto as well as attention, and bringing us up to the present day.
For sure. That’s good deep research there. My background is in machine learning and AI. I joined Google when I saw—I don’t know if you remember this Cat Neuron paper—where they effectively trained an autoencoder model. They would feed images in, compress and uncompress them to get back the same image, and that model, trained on a bunch of images on the internet, figured out that there was a cat. There was a neuron specifically that, if you activated it, would show up as a cat.
For me, it was like, this is the approach neural networks are working with now. But I think images are not where the knowledge and intelligence lie. I think text is. So I joined Google and was very much like, “Hey, how do we focus deep learning on natural language?” The most straightforward path to advancing and checking the intelligence of any human or machine is to ask questions.
My team worked on question answering, and we actually had some of this in a product on Google.com back in the day. Before Gemini, you would get these short answers. Part of the challenge we had was that the state-of-the-art models were too slow. Long short-term memory, or LSTM, models need to read 1 word at a time. If you feed them a bunch of articles from Google search results, it’ll take forever for them to respond.
That was one of the motivations for Transformers: How do we consume all this context as effectively and as much in parallel as possible, and then figure out how to answer?
After that work, I thought the pace of AI’s evolution was accelerating. This was 2017, and I wanted to build products on top of it. So I left Google to start NEAR AI with my co-founder, Alex Skidanov, on the premise that we wanted to teach machines to code.
That’s something I’ve believed for a long time: If machines can code, we’re effectively changing how we interact with computing. It’s changing from a few people being able to author code and talk to machines, while everybody else effectively needs to consume their magic, to everybody being able to do everything with a machine that normally only a few developers can do.
We were trying to build that back in 2017. That sounded like science fiction. Now it’s just called vibe coding. We were trying to build vibe coding in 2017, and our expectation was that what we were seeing in 2022 and 2023 was what was going to be happening in the industry. As we know now, we’re lacking probably an order, or a couple of orders, of magnitude of compute.
We were trying to be smarter, so what we tried to do was get a lot more training data. Again, it’s called instruction fine-tuning data. We were trying to get people to write a little piece of code for some instructions or write instructions based on code. The people who can do this are effectively computer science students from developing countries, where a few cents here and there adds up to dollars. A few dollars a day is reasonable money for them to work online and practice coding.
The challenge we faced was paying them. People like students in China didn’t have bank accounts; they had WeChat Pay. Back then, in Ukraine, if you received dollars in your bank account, you were actually, by law, required to sell half of them. There was no way to pay into some countries for whatever reasons. PayPal didn’t work, transfers didn’t work, and there were all kinds of weird, pure payment problems that we faced while trying to collect more data.
We ended up saying, “Okay, we’ve heard of this blockchain thing. It’s a global payment network. It should solve our problem.” We were just trying to use blockchain as a solution to our own problem of coordinating and paying a bunch of people.
As we did our research—this was 2018—we realized that architecturally, none of them scaled. They were very slow, hard to use, and hard to build on. So it was like, “Hey, if there was a blockchain with these criteria—easy to use, scalable, with microtransactions at always-predictable prices—we would use it.”
But there was none, so we should just build that and then use it ourselves and come back to AI. We thought we were going to build it in 6 months, to be clear. We were like, “Hey, it’s easy, right? It’s just some systems. We’re going to ship it and come back.”
It took a little bit longer, but indeed we effectively built a highly scalable blockchain focused on ease of use, really abstracting out the blockchain itself from the user experience, as well as being highly programmable. You can effectively run arbitrary software written in Zig, Rust, JavaScript, Python, and so on, on the blockchain as well. Obviously, all the financial stuff—payments, loyalty, remittances—is being run through it. A lot of microtransactions are going through it, as well as a few other use cases.
It is one of the most used blockchains. We have 15 million monthly active users on it. As 2022 and 2023 happened, we started building up the team back into, “Okay, now that this acceleration is happening, and with the new learnings we’ve had through the blockchain experience, where can we bring that vision of ‘AI will change how you experience computing’ forward?”
This is the history. Now, looking forward, the important part is that AI will write code and be able to interact with other tools and systems. You’re effectively removing the need for other apps and even websites, because, as the stack matures, anything can effectively be built on the fly. It can go in directly and get the information you need.
Interestingly, there are a few things happening. One is that devices are going to become more run by what we call an AI operating system. However much people want it to run locally, you will not be able to process everything locally. In the background, you want it to summarize news for you, and so on. You need some way to offload the compute.
The problem is that it needs to have all of your context. That’s how we’re going to get to AI that’s truly helpful: it will know everything about you. But that is a very scary situation if some third-party company has all your data. We just saw everything from your chats being leaked to people in organizations effectively reporting your chats to the police. So there’s already a challenge with how this data is handled by centralized AI companies.
First of all, we want everything to be private. I think that’s fundamental. We want AI to be private. We want AI to have all your context. We want it to be able to go and execute actions on your behalf.
The other interesting thing that happens in this future is that a lot of the existing aggregators, like Google, DoorDash, and Amazon, as well as other middlemen, like the FDA, for example, are middlemen. They take all the pharma filings, process them, evaluate them, and say, “Okay, yes, this medicine is safe on average.” Then they allow pharma companies to stock it.
Your AI can do all this work. It can go and find the factory in China directly to order stuff. It can go directly to the AI of the pharma companies, discuss your exact medical situation with them, and find the exact medical compounds that you need at this moment. You don’t need to check if, on average, it’s going to be good for the average person. You actually need to check if it’s good for you right now, which is what you need to address.
You’re removing this middleman system that our societies are actually built on and going very much direct, peer-to-peer. That could be between different people, people and companies, or even people and autonomous agents. That’s where blockchain comes in on the other side, because it’s effectively facilitating those types of transactions.
There are effectively 2 pieces to this vision. One is how we ensure privacy and verifiability. The other aspect is that if this is how we see and interact with the world—through this AI lens—a small alteration to that AI can effectively lead you to perceive the world differently.
The example I use is, if you go into ChatGPT right now and, at the beginning, say, “Hey, subtly convince me, while we’re talking about some other topic, of X”—let’s say voting for somebody else that you don’t like—and then you go through the conversation, it will actually start working in ways to change how you think about things in the chat on another topic.
This can be an explicit prompt right now, or it can happen indirectly. We don’t know. We also have this concept of what we call user-owned AI, because you want AI to be yours, not theirs. Privacy is part of this, but the other part is that we need to know what goes into the model itself. We need to know and have verifiability that, when you run it, there are no additional ways that it’s actually being affected.
That’s a big part of it. To do that, you need a different model. You need to build a movement, not a company, because if you build another company doing that exact thing, you’ll end up with the same result. You need to build a movement around this idea where people are actually willing to contribute to building this more as a common good that’s accessible to everyone, while creating an economic engine behind it to power it, because this actually requires a lot of financial investment and resources.
On the other side, as this AI becomes your interface, how does it interact with other AIs? That’s where what we call intents, AITP, and other components are coming together. That’s really the vision we’re working toward.
There’s a lot there to unpack. I’m going to try taking it from what I think is the most foundational layer and work up toward the giga-agent future. Most fundamentally, when we talk about this—and obviously, there are a lot of problems in society today, including the loss of trust in institutions—“trustless” is becoming a general description of society, perhaps something that certain technologies can achieve.
A lot of people listening don’t have a great handle on where the trust comes from with different blockchain schemes. I know that, in the original Bitcoin, the idea with proof of work is that it’s really costly to mine a new valid block. Because it’s so costly, nobody could plausibly rewrite the whole chain to the present. You’d have to do that so many times in a row that nobody could really ever get there.
The canonical version is the canonical version, and that difficulty of extending the chain means that nobody can corrupt the history. Unfortunately, that’s pretty costly to run. I looked it up, and I think Bitcoin is consuming the same amount of electricity as the country of Poland today, according to my internet research.
We’ve now seen this move to proof of stake, where you have a lot less compute required, but you have to make sure you have a really thoughtful incentive design. People are essentially putting their holdings of tokens up and putting them at risk—locking them up, putting them at risk—and saying, “I represent that I’m going to do the right thing for the broader community, and if I don’t, I stand to suffer some consequences,” as a validator in the network.
Can you elaborate on that just a little bit? Because everything we’re going to talk about, ultimately, if I understand correctly, is built on the idea that we have a set of validators that we don’t necessarily have to trust as individuals, but we sort of have to trust collectively. We also have to trust that the incentives are such that they don’t have any reason to defect from the stable equilibrium.
Can you give us a little bit more about what that stable equilibrium is that you have designed? Who are the validators? In your mind, what is the ground that people can put their confidence in—that everything else we’ll build on top of this, and we’ll cover, is really on a solid, albeit distributed, foundation?
Yeah, that’s a very good question. To contrast it with our traditional internet right now, we’re using Riverside to record this. We went to Riverside.fm, and we relied on DNS to tell us that Riverside is this IP address. DNS is a distributed system, but it actually has a single organization that effectively decides how it’s done.
Similarly, we have SSL certificates that give us encryption, but there are certificate authorities that issue the certificates, and there’s an authority that gave them that authority. So there are effective points of centralization on the current internet where you cannot verify by yourself that something is correct.
When we think of blockchains, the important way to think about it is from your perspective. You want to verify that what you’re interacting with is correct, and you want to know how hard it is for someone to lie to you and show you fake information. As you said, with Bitcoin, if you’re looking at some state—for example, you just received a bunch of bitcoin—the cost of making that untrue is effectively how much it costs to produce that number of blocks. Indeed, for example, to lie to you about an hour of history costs $2 million.
That’s the idea. With proof of stake, it’s a little bit different because, in Bitcoin, it’s possible that, for example, Google has a lot of servers and could create a fake blockchain that’s days or weeks long, present that, and effectively lie to people and steal a bunch of money. I don’t think Google is doing this, but it’s just to give you an example. With proof of stake, and specifically this idea of Byzantine fault-tolerant consensus, you actually have this notion of finality. If two-thirds of the stake is non-malicious, then they’re following the protocol, and there’s no way to have a fake history or lie to you. You can verify this from the beginning.
We launched the NEAR blockchain mainnet in October 2020, and since then you can verify that every single transition was correct and all the rules were followed. That’s the idea. Now, who are these validators, and what is the stake?
For NEAR, it’s similar to other proof-of-stake projects. There are a lot of projects in the ecosystem, and we have a number of other companies building on top of us. They effectively have a vested interest in the security of the network, so they become participants.
Becoming a validator is permissionless. You can actually start a validator right now. On NEAR, you can also run a very lightweight node. Somebody recently ran a node on an 8-year-old laptop. We also have, for example, a Vodafone entity and other entities like that running nodes, and we have crypto exchanges participating in the network as well.
It’s really about the participants in the network who become validators because they have a vested interest. They have some of the stake as well, so they have both a business interest and a financial interest in the network. They become participants and validators. Then there’s also a community: we have universities and individual developers running nodes as well.
That’s the idea. You have an open network where people can join. We’ve had a pretty large number of new validators join in the past 6 months, and in turn they put some of their money at stake. Other users can also delegate, effectively saying, “I trust this participant, and I’m going to add more stake to them.” Then there’s a reward that’s split between all of them to incentivize them to do this.
This is maybe a really naive question, but if it is permissionless, maybe we could talk about the importance of permissionless versus permissioned. I’m sure you’re following the Tempo project. I don’t know if you see them as a direct competitor—there are obviously a lot of projects out there—but Tempo has Stripe behind it, as I understand it. My understanding, from reading through what they’ve said, is that they plan to start with trusted validators and then gradually become more permissionless over time.
I’m not sure whether this is one of those things where it really is a spectrum or whether it’s more binary. I always say AI defies all binaries, but when it’s something like “Is it permissionless or is it not permissionless?” that sounds binary. How do you become more permissionless? If there’s some permission involved, it still seems like there’s some permission. I’m a little confused about exactly how much that matters.
Then, if I just show up with a node, how do you know who I am or who I say I am? If I show up and say, “I’m Coca-Cola. I’m your new validator,” do you have to meet me in real life? Do you go to the Coca-Cola office and kick the tires on the servers to do that sort of real-world validation?
These are obviously noob questions, but knowing how much I might one day rely on my AI agents built on top of all this, I do want to make sure I’m solid in the foundational understanding.
No, no, these are all good questions. I think permissionlessness is indeed a spectrum, and there are maybe a few step functions. There are a few networks where there’s effectively a very specific set of validators. The issue with this is that, let’s say these validators don’t like you for whatever reason. They can effectively not let your transactions, or your AI agent’s transactions, onto the chain. They can effectively censor you.
That’s the main challenge with even a subset of permissioned validators: for whatever reason, they can exclude you from the network, and you cannot do anything. The benefit of a permissionless network is that you can join as a node yourself and say, “I’m actually going to join the network.” Even if they don’t let me in, I can push transactions and interact with the network directly. That’s the biggest change.
For normal people, it’s not that big of a deal. For people who’ve been through certain experiences—I'm from Ukraine, and I’ve seen different types of situations—I’ve had multiple banks that effectively closed up even though I was a client of theirs. Obviously, there was a war and everything, but things like that are pretty important. It’s obviously important for journalists, but it’s even more important for businesses.
If I’m a business, and the payment processor I’m using—or a competing business—is effectively controlling whose transactions are included and whose are not, or is delaying my transactions, they can affect my business. That’s why there’s this idea of neutrality: you want the ability for everyone to join, because then there’s no single party, or coalition of parties—a cartel, you might say—that can pull on it.
The other question is, “Okay, you want to join, and you say you’re Coca-Cola. You can actually do that, but nobody will believe you because there’s no social signal.” If, for example, Coca-Cola tweets, “We just started the NEAR validator. Here’s our address; here’s how to delegate. Let’s go make Coca-Cola the biggest validator on NEAR,” that would provide the social signal.
The way you identify yourself to the network is through public-key cryptography. You essentially say, “Hey, I’m this validator, this account.” To become a validator, you need to put some NEAR at stake. You need to put some money at stake, and then you’re a validator. You don’t really need to meet in person or do anything. You can be a cat, you can be an AI—it doesn’t matter, if you have some capital at stake.
Gotcha. So anybody who shows up, if they’re willing to make an investment in the currency—which they have to have in order to put some value on the line—that’s the proof of stake: you actually own value, and you’re putting that value at risk. Not at risk in a probabilistic sense, unless you do something wrong, right?
The idea is that, as long as everything you do is valid in your role as a validator, your value is not at risk. But if the rest of the network finds you to have submitted fake transactions or whatever, they can take the value that you put forward, essentially as collateral.
Correct. We have a mechanism for that because, so far, it’s mostly been people having misconfigured nodes. It hasn’t really been malicious attacks; people have just had bugs in their setup. Slashing is when you actually take the money they put at risk, and we only slash proportionally to how much stake actually participated in the malicious behavior.
So if you had a misconfigured node and only had 0.1% or 0.01% of the total stake, you’re only going to get slashed by some multiple of that percentage of your stake, right? So it will be very little.
Now, if a large percentage of the network is coordinating an attack, then they’re effectively going to get slashed fully, because that percentage multiplied by some coefficient will be slashed. That’s the idea: we don’t want to punish people for misconfiguring things, but we want to punish a coordinated attack for whatever reason. It could be that somebody hacked into a bunch of nodes because they had zero-day vulnerabilities and did that, but we need people to have responsibility for their security setups and related things. At the same time, we want to allow people to have individual mishaps.
Yeah, gotcha. Okay. Is there any last foundational question on the security layer before moving up the stack?
Is there any risk of incentives changing in the long term? Right now, the market cap of the NEAR coin, last I checked, was around $7 billion. That’s obviously a lot, but for people who have businesses or whatever, you would imagine that if there were some coordinated attack, the market cap would fall really fast. So you could try to hijack it, but what have you won, sort of? I imagine that’s a big part of it.
But in the fullness of time, if we imagine a massive AI-agent economy built on top of this whole thing, is there ever a point where it could flip from “It’s not worth doing a coordinated attack” to “Maybe it could become worth it”? Instead of $7 billion, maybe it’s $7 trillion or something like that?
Well, if the network were worth $7 trillion, then the attack would cost, for example, 30% of that. If somebody can come up with a couple trillion dollars to attack it, the question is: that attack will not be able to extract much, right?
This is where the question is about you as an individual, because an attack is directed toward someone. The system itself, from its perspective, is always correct: it follows the rules. If somebody violates the rules, they’re not in the system.
The only way to attack is effectively to attack you by saying, “Here’s the fake information. For example, I sent you $1 billion. Give me $1 billion of services,” when I didn’t actually send you $1 billion. I just lied to you by creating—by faking—that there was actually a transaction that happened and that it had been finalized.
To do that kind of attack, you’ll need effectively 66% of the stake. So if the network is at that point worth $7 trillion, you need 66% of $7 trillion, or whatever the stake percentage is.
And then, if you’re receiving $1 trillion in a transaction, you’re probably not going to be like, “Immediately, cool, I’ll give you $1 trillion of value.” You probably can wait a little bit, make sure that there’s nothing else going on in the network. So there’s a question of timing, value, and security that together work.
It’s similar to how Bitcoin works. Right now, Bitcoin is worth whatever—$2 trillion—and the 1-hour attack is $2 million. If you’re sending $10 million, you probably should wait a little bit longer than 1 hour to make sure nobody’s attacking you. The more you send, the longer you should wait to make sure.
The idea is that as the value increases, you can also wait less for larger transactions. That’s why people talk about the 51% attack, and it’s important to understand what that means. It means somebody is specifically getting attacked. It can be an exchange, an individual, a service provider, and so on.
It’s not that the network itself is incorrect. The rules are still followed. It doesn’t matter which so-called fork will end up being picked; from the perspective of that fork, you’re still on the main thing. Blockchain is a little bit of this abstract point of view, in a fourth-wall kind of perspective: are you in it? If you’re in it, you’re always correct. Or are you outside, and are you seeing the right thing or not?
For most use cases, if you’re spending $1, $5, $10, or $100 to buy something, effectively, the security of the network is so much higher that it’s not a problem, and you can accept the transaction right away. For a normal use case of an agent, that’s fine.
The reality is that there are more challenges with the security of zero-days in the code of the systems than with the economic security of this. We should talk about this, because we have a whole thesis on that.
Well, maybe now could be the time. My plan from here is to work our way up to: okay, how do you train models on this? There are interesting aspects of that, and then how do you build business models on top of models and, ultimately, agents? If you want to talk more about that—
On the security side, I think the important part to understand is that as AI is getting better and better, it’s actually getting really good at finding vulnerabilities. I’ve used it to back-test. You take a recently found vulnerability, run an LLM over it, and you don’t even need to over-prompt it; it will find some vulnerabilities in the code. Somebody found a Linux, I think, zero-day with that approach as well.
What this means is that cybersecurity is very one-sided. It’s really hard to know that you don’t have vulnerabilities, but it’s getting easier and easier to find them. The same is true of social engineering and other attacks. It’s just going to get easier and easier.
So we need a fundamentally different approach. That approach actually relies on math. The only thing you can rely on is that the whole system is correct, given—again—your perspective.
From my perspective as a user of the system, I want to know that if I’m doing something, it is actually correct. There are no vulnerabilities in the system or potential problems in the future that can happen. So I want a mathematical proof, at the time of using the system, that it is correct given my requirements.
It’s a very different approach. For those who have been around, it’s called formal verification. There has been a lot of research on this, but because it’s so complicated, nobody is actually doing it at the time of using services.
You may do it, for example, when sending something to Mars. They actually had formal verification of the code for the Mars rover, but it was done once. It’s effectively like, “Okay, we want to verify that it runs correctly and will run correctly given the specification.” But obviously, if anything gets updated or the requirements change, this is not usable, because it’s so hard and requires a lot of manual labor.
The benefit is that with AI, which is getting really good even at winning gold at the International Mathematical Olympiad, we can actually simplify that process of proving itself. What we believe is that we will need to rewrite effectively every single line of code in such a way that it’s formally verifiable at execution time.
With blockchain, this is the first step. Blockchain is kind of a root of trust, so we want to formally verify it so that you, as a user, when you’re, for example, sending money or depositing money somewhere, can say, “Hey, I’m expecting to receive money back—at least as much money.” The chain needs to prove to you that this is actually going to be correct and that it’s going to happen.
But you can expand that to broader services. If I’m using some service, I’m giving it my private data.
I want it to prove to me that it's not going to leak it, right? And so, for that, this is where we're going into verifiable compute in a broader sense. We kind of need both formal verification and guarantees that this code is going to be executed over your data.
So that's kind of our position on zero-day verification. We're actually moving into a world where this is going to be necessary. I don't know if you saw it, but a couple of weeks ago there was a zero-day in iOS and macOS, and everybody was patching. We just had a massive attack on the supply chain in npm yesterday in the crypto space, where somebody injected code effectively to replace addresses in all of the tools.
The amount of this kind of vulnerability is just going to accelerate, and we need a new approach. That's one of the longer-term research projects we're working on to actually solve that. But, yeah, you need a few more pieces. So that's where we're getting into, okay, how do we actually guarantee privacy, run these models with verifiability, as well as build the monetization—the kind of financial engine that actually runs this?
We're using a combination of blockchain, cryptography, and hardware. As of about a year ago, NVIDIA supports so-called confidential computing. What this means is the NVIDIA chip itself connects to Intel and ARM, and even AMD is supported, in such a way that even I, as an operator—the owner of the hardware—cannot access what's happening inside as the operator running the operating system.
This is called confidential computing mode, and the interesting thing is that it gives you both confidentiality and verifiability. It tells you, "This code was run on this data, and only this thing was done." And, by the way, nobody else saw what happened there.
What we're using this for is effectively that, as a user, I can, for example, want to run some AI workload. I can establish an encrypted channel to this secure enclave, run some AI workload there, and then receive the result back through an encrypted channel. I know that there's no other single party that was able to actually understand what I was doing there, and I also receive a verified certificate that says, "This model was run on your input, and this is the output."
There's no way that something could have changed—you know, they degraded performance midway or whatever, right? Or they injected some prompts into the thing, right? It's like you have a guarantee of the execution. So that's kind of the basic primitive of this confidential, verifiable compute.
There are a few sides to this. One is, well, we now need a lot of compute, right? Hundreds of thousands of GPUs need to be here so we can actually provide it for lots of users. One of the challenges with doing that is massive data centers—lots of capex. Now you need a lot of energy; it's all in one place; you have latency problems; you have sovereignty problems. So, all the challenges.
The cool thing is, again, because the owners of compute don't actually see anything, we can open it up and make it permissionless. We can let anyone with compute join. We have a way to verify that the compute is indeed NVIDIA and Intel chips, because they effectively sign the certificates. And now we can decentralize the compute itself.
We can have compute everywhere, joining across the world. We can then route requests to the closest available compute to you. You get confidentiality and verifiability; you can now pay the network, and the network then distributes these rewards very similarly to how validators receive rewards for providing validation of the blockchain.
Here, the compute providers receive rewards for providing compute, and then users pay for using inference, or developers pay for using inference. So that kind of creates what we call a decentralized, confidential machine-learning cloud. And it's not just for AI stuff; you can also run arbitrary compute over it as well: data processing, agents, MCP servers, and so on. You can store memory encrypted for users.
That's kind of the second piece, which again enables that vision of, hey, how am I going to have an AI OS that's truly private and I know what's happening there? This already has an economy; we're effectively bringing compute and usage.
The other challenge is models and data, in a sense. Right now, if I'm a model developer, I effectively have 2 routes: I'm either open-sourcing it and making $0, or I keep it closed source, and then I need to actually procure compute and make sure that compute is verifiable—that I trust the compute provider. Because I'm uploading my weights to them, they can actually steal and open-source my weights or run them themselves.
That's why only big hyperscalers usually partner with Microsoft, OpenAI, Amazon, and Anthropic. On top of this, I also have this maturity problem: if I'm just launching a new model, I don't have any users for it yet, but I kind of need to commit to a bunch of compute from this hyperscaler—usually a 2-year contract. I don't actually know how much I need. If I get more users than I have compute for, now I need to pay a ton more. So it's a very weird economic question. Again, as an economic question, we have tools to do that.
The idea here is that if it's an open-source model, you upload it, or if it's a closed-source model, you can encrypt and upload it to our system. Because all of the compute happens in this confidential environment, we can decrypt the model inside the confidential environment, meaning again nobody is able to access what's happening there. You can run it on users' data privately.
When users pay, they pay both the model developer and the hardware provider the fee, right? So you're effectively now combining model providers and model developers. NEAR AI is offering them a way to serve their models without prepaying. They don't need to pay for the compute to serve it. They don't need to take users' data. They don't need to deal with GDPR or HIPAA, or whatever all the compliance requirements are.
They just push a model in and start making money when people use it, right? So that kind of creates a new economic model for model developers. Similarly, content creators and data providers can upload their data, which can be used at inference time or potentially later at training time. If it is used, you're getting paid from that transaction as well.
Similar to Spotify, there are subscription fees or API-call fees that get distributed to the providers. That's kind of how we see this: you have a cluster of services that effectively all run on the same kind of decentralized hardware cloud, where you can bring models, you can bring data, and there are users and developers consuming this. It all gets secured on this blockchain-based marketplace that really facilitates it.
So, a couple of questions there. We could go on for a long time. I suspect this is fascinating already.
When I show up to the network, I basically just have to have an NVIDIA chip of a certain type that has support for confidential computing, right? That does suggest that there's an important issue. I don't know whether it would be right to think of it as a hardware vulnerability or a software vulnerability there.
From the research I've done, people seem to think that if you gave some of these chips to, for example, the Chinese government and let them bring the full power of their immense engineering prowess to bear on cracking that hardware, they probably could. But it wouldn't really be economical to do it for many things, because obviously these things are exquisitely crafted.
To do some sort of hardware-level modification, you might be able to figure out how to do it. You're probably not going to find it worth your while to try to scale it to some large number of chips. So this would be very focused, hyper-targeted attacks at most.
But then there's also the software question: How do we know that NVIDIA's systems are formally verified, that this is all fully locked up? How much trust is involved, and where are we putting that trust?
And then part 2 would be, how much overhead is associated with this? I did one episode on the use of zero-knowledge proofs to prove that the model was run, and this was 2 years ago. The framing at the time—and it's actually still relevant because, just in recent days, there's been this discourse about Claude seeming to be dumber for me during the day than at night, or whatever—was that if they use a zero-knowledge proof, they can demonstrate to you that they ran the model they promised you they would run.
You're getting the value that you're contracted for. However, at the time, there was a lot of overhead associated with doing the actual zero-knowledge proof. So it wasn't like, for 2% more, you can get a guarantee. I forget exactly how much, but it was a lot more to get the guarantee.
It's like 10,000–100,000×.
Yeah, it was a lot. How much risk is there at the hardware level? How much risk is there at the software level? And how much overhead is there to actually get these benefits?
Yeah. Given that you touched on zero-knowledge proofs, there's effectively a spectrum of how to achieve verifiability and how to achieve privacy. A zero-knowledge proof is effectively how to achieve verifiability; you don't actually get privacy from it. Somebody still needs to run the computation and then compute the proof, so that other third party has all your data. But you do get verifiability that this exact model was run in the specific way.
The challenge is that even right now, the most performant way is probably 1,000× slower than just computing it itself.
It's a lot of overhead, especially since most of the time you're asking ChatGPT to do dumb things. Everybody does. So it only makes sense for really critical stuff.
The other side is this thing called fully homomorphic encryption. This is where you're actually doing computation that is private for every participant, and it is verifiable. Again, the overhead is massive—something also on the order of 1,000–10,000×—but that is fully private and verifiable.
What we're doing with secure enclaves is finding, I would say, a pragmatic middle ground where we trust the hardware providers. We can talk about what that entails, but the benefit is that the maximum overhead we've seen in production—in our testing in production—is 5%. Usually, it's 1%–5% overhead over running without this mode, but you get privacy, you get the ability for a permissionless network to join, and you get verifiability as well out of it.
You don't get that it's dumber at night than in the daytime. You will not get that on our decentralized cloud. So, it's 1%–5%.
The only other challenge right now is that it only works at the level of a single machine: 8 GPUs. We can fit anything that fits into 8 GPUs, which is effectively all the open-source models right now. A model with over 1 trillion parameters fits there, no problem. But indeed, you cannot do this across multiple machines yet. This is in the works right now.
On the software and hardware security side, there is indeed potential for a hardware attack. Right now, the chips are 2 nanometers, which is very small, so we're getting to a level where it's effectively baked into the atoms of the chip. If you want to change something or address it, you effectively—I mean, I'm not a hardware expert at that level, so I cannot actually approximate—but the cost of an attack is extremely high.
The benefit is that you're going to get some random requests from somebody asking which cat to pick, because you will not be able to target specific use cases in our system. Even if something happens there, there is indeed the other challenge, which is NVIDIA. Because NVIDIA is effectively certifying it, their key management and their process need to be correct. This is something that we would love to help secure. Obviously, they're already using top-line security, but that's where verification and using blockchain as a security mechanism can definitely help.
Okay, cool. So let's build our way up the stack. We want to now create user-owned AI. I've seen that you have a plan to train a model with more than 1 trillion parameters. The estimated cost of that is $160 million. It's dropping since we talked about it, so that's a good thing.
Cut it in half. Yeah.
V3 just got cut in half. So we'll apply a half factor to this, too.
My guess—what I understand there is that Dario just talked about this, where he said, "Yeah, we're burning a lot of money." In a way, we're burning more money every generation of scale-up, but in another way, if you look at each model as its own venture, each model is profitable. What's weird is that it might cost us $100 million to train Claude 3, and we make $1 billion. Then it costs us $2 billion for Claude 4, and we'll make $10 billion, but it's going to cost us $20 billion for the next one.
That's a weird development cycle, to say the least. But it seems like you are basically taking that reality to its natural conclusion and actually planning to structure sub-ventures for each of the models, right? So tell me about the economic schematic there.
I also understand that you're applying this secure computing to the training process, where people can contribute training data in a privacy-preserving way. But that's a really interesting challenge, I would imagine, too, right? Because who's providing what data? The data mix—if you talk to people at the frontier companies, they're like, "Yeah, it's like baking a cake. We're constantly experimenting with different mixes: a little more of this, and this other behavior gets degraded," and whatever.
How can you have a privacy-preserving understanding on the training-data side and have any sense of what the hell you're going to get out when the model comes out of the GPU oven, so to speak?
Yeah, all great questions. Indeed, it was funny that Dario posted it, and I'm like, "Yeah, exactly, exactly the model."
Maybe just to give you a bit of a roadmap: building out this decentralized computing, starting with inference, already gives people the ability to consume it, get confidentiality, and get verifiability. The next step offers people who are building models—including potentially existing companies that build foundational models—the ability to upload them encrypted. Nobody can see them, and they don't get leaked, but now they can be used across this decentralized compute. Everybody can verify and know that they're using the exact model that this company has posted.
They effectively put it on-chain—the hash—and the company tweeted about it, et cetera. You can verify that indeed you used, let's say, Anthropic's Claude, and it doesn't degrade in the evenings.
Then, given that we want to coordinate this research and development of models—and importantly, we're not going to build 1 model; that's not the point—the point is to build a process that creates models that are state-of-the-art, user-owned, and inspectable by everybody. Everybody can inspect how they were made.
The important part is how any frontier lab works: there are a number of benchmarks that effectively go through the whole flywheel of building a model. Everybody is building different parts of it and evaluating how their changes and innovations benefit the scaling laws. You test different sizes, then all the ideas get accumulated, and you do bigger runs.
We're replicating some of that as well. We're effectively using this compute network to say, "Hey, actually, anybody can come in and build a new benchmark." You can say, "I'm going to build a benchmark that tests model prediction of the future, or answers questions about astronomy or the ocean," or whatever—different things that people care about.
You can also have enterprises that say, "I care about how this model does on this deepfake-detection benchmark." I can upload my data, but I'll keep it private, so nobody can access the data, while everybody can run evaluations over it. You can now offer both benchmark-creation and evaluation services, where you can verifiably check that this closed-source model runs on undisclosed private data and gets this result.
Again, you're effectively creating this marketplace of model builders and benchmarks, which can represent companies or specific use cases, and finding out what the best models and the best ideas are. That in itself is a really interesting product because, right now, you cannot do that. You cannot actually go and benchmark some intermediate model from, let's say, OpenAI—they just won't give you the weights. If you don't want to upload your data to them, you cannot even benchmark their current model.
This also opens up an environment where anybody—you know, you're sitting somewhere, wherever you want—can train a model that specifically targets whatever ocean benchmark. Maybe you have special data for this; you can upload it and get rewarded when people are using it through the previous step.
Now, the next step is, well, actually, I have a lot of interesting ocean data. Maybe I'm in a university and I know how to train the models, but I don't have compute. That's the next step.
We're actually going to offer you a way to do fine-tuning first. You can take an existing base model, fine-tune it, and again, you can fine-tune it even on private data.
So, I'm maybe an institute that collects a lot of ocean data. I have the data, but I don't have the know-how to fine-tune this properly. So I can partner up with someone who can then fine-tune on my data without seeing it, right? They can effectively deploy this job into confidential computing. The resulting model then splits the revenue between the developer and the data provider. So you can have all of those different combinations on top.
Fine-tuning is, I would say, easier to do when you may not have exact access to the data. Training is where, if we're talking about full, foundational training from scratch, things get really complicated. That's our final step, where we're actually putting all of the pieces together. There, indeed, you need all of those pieces to really work well, so you can effectively iterate on different pieces and sizes and then combine it all into a final model.
I would say, to your point about private data, there are effectively a few things that will need to happen. One is that there's going to be a whole separate process of data filtering, curriculum construction, et cetera, that you can actually benchmark. I can build a curriculum builder: pick different articles and different pieces of data, and construct the training set out of them. So you can evaluate how good that system is by training a few sizes of the models. People can actually compete on whose curriculum builder is better, right? When you pick the best curriculum builder, you run a larger run with more parameters and more data.
It's going to be a very iterative process, the same way it is right now inside Frontier Labs, because we're experimenting with all the things as we go. Specifically with private user data, it's a bit more sensitive and complicated. But the biggest benefit we can provide is that, as you contribute your data, first of all, you can get a reward from the model's outcome.
You can also have a filtering procedure, because there's going to be a lot of PII—your phone numbers, SSNs, et cetera—that you don't want in a model. It's also not actually helpful for the model for the most part, right? This filtering procedure will be open source, and everybody can effectively—not everybody will inspect it, but some developers will inspect it—and say, “Yes, this is actually a valid way to filter data.”
There are a few different components we can use to make sure both that the data is cleaner and that we understand how it gets filtered and processed into the training curriculum. Probably a bunch of your personal chats aren't actually that useful for training these models. There are other types of data that are more useful for those things, and we see that, in general, we're moving toward more synthetic data anyway. So there's going to be a lot more of that.
Importantly, we still have crowdsourcing and data labeling run through this decentralized network as well, right? We actually have both NEAR Crowd, which is the original project we had for crowdsourcing—crowdsourcing in the sense of Scale AI-style—as well as Public AI, which is another data-labeling crowdsourcing project.
How much overhead is associated with all that? You mentioned relatively low overhead at the hardware level for confidential computing, but how much is there in terms of just the software setup? It's not super easy to set up a training cluster. It's not super easy to manage data pipelines. It's not super easy to—I mean, you have a marketplace, but even going out and hiring a bunch of people to create data isn't super easy, even in the base case.
I'm interested in how much overhead there is in doing it the privacy-preserving way, and then also at the model level, who makes these decisions in terms of what's better? I think we have benchmarks galore, and yet it seems like they all kind of—there's been a lot of discourse about this in the last couple of weeks, too. People swear by MMLU; people say MMLU is useless. Certain famous projects are run entirely on vibes.
It would seem like the one thing that you'd have a really hard time putting into this frame would be: who do we actually trust to be the vibe checker on this? How do we make sure that, in addition to maxing out on these various benchmarks, the thing is actually nice to talk to? People do value that a lot.
So I guess I'm asking about overhead in terms of all the setup, the configuration, moving things around, and coordination broadly. Is there a governance mechanism? I know you have governance projects as well that are pretty interesting unto themselves. Are you bringing those to bear on who decides what version of the model is actually good, or what training recipe gets scaled up? Or is there some tastemaker who's still involved somewhere?
No, those are all the good questions. I think the high-level answer is that we're effectively creating a marketplace of all of these decisions. Instead of trying to prescribe, “Okay, Illia will be the tastemaker and decide: You get the compute and you don't,” we say, “Hey, we're creating a marketplace where anyone can do this.” Probably Illia will do it as one of the participants, but anybody else can do it as well.
You have the rules and everything known, and you have visibility and traceability. You can also build on top of each other instead of competing, as you're effectively doing right now. Let's say I'm going to train this 1.4-trillion-parameter model. I'm going to issue a token for it, right? I'm going to create a new value-capture system for this specific model.
I can now distribute it for compute, data, research, and work. In this case, I started it, so I probably will be the tastemaker, picking and selecting which pieces I want to put together. We train it, and if it gets used, we distill it, fine-tune it, et cetera, and the revenue gets distributed to the token holders.
In parallel, somebody might say, “Oh, actually, I'm going to train a 70B model in this way.” They've got to use exactly the same framework and exactly the same system. Again, because 70B is smaller and cheaper to use, but it also runs faster, it's going to get used in different use cases.
So you're really using this more as a platform where different people can put together the pieces really easily, and you don't need to raise, like, whatever, $10 billion to do this. You can actually raise smaller amounts specifically for compute, data, et cetera, and you already have a lot of building blocks as well.
That's kind of the idea: really creating more of an environment where we can open-source but also use these things, while having this economic flywheel, where things are generating revenue by usage and, importantly, learning from what works and having this inspectability of what actually went into it.
In some cases, people say, “Hey, no, actually, it's all private. I will not tell you what actually went in.” But then people know that it's private, and they can decide whether they want to use it or not, and how. There's also verifiable benchmarking. Right now, when somebody posts benchmarks, you have no idea how they got those numbers. They usually don't even post the prompts they used for the benchmark. You can have a 2-page prompt that answers half of the questions and get way better answers from that.
Here, you have full traceability of the whole flow: you know what went in. Maybe it's private, but at least you know that 100 million users contributed their private data and that's what it trained on. Then you get these results in the benchmark, and you can actually contribute your vibe benchmark as a benchmark as well. On Illia's VibeBench, for example, it gets this much as well.
And on whatever this company's benchmark—Bank of America, their test—it gets this much. So you can have all of that information and decide based on it. It's really about creating transparency and a marketplace for this while preserving privacy for the end user and companies, and having all of this traceability and verifiability.
To rewind for a minute, all of this rests on the fact that somebody has locked up their NEAR coins with the assertion that they are putting forward valid transactions, which in this case would be more like log statements, basically, right?
It's a bunch of stuff, yeah. Because it's payments, it's logs, it's traces of trainings, et cetera.
How big does this database get? Obviously, it gets pretty huge, right? Where does the database live long term? It becomes too big for a single node, I assume. If I want to just connect, I can't download the whole history of everything that's ever happened; it becomes too much, I assume.
Yeah. One of the underlying things about NEAR is that it’s sharded, meaning every single node contains part of the data, part of the processes, part of the transactions, and part of the execution. It can continue expanding the number of shards, and that’s why we actually need more validators to join. The more data and shards there are, the more nodes you need in the network to participate.
It’s very similar to how Google databases work, or Meta’s. They don’t run out of capacity and say, “No more users here, please.” They just keep adding more computers to run things in parallel.
Yeah. This has been fascinating. We’ve built up the premise that we want user-owned AI, and these are all the layers that we have to put in place to finally reach the point where you could have a community-based process for all of this contribution, produce a model, and even get paid back through inference. As you mentioned, though, somebody could also just train their own model and bring it into the system.
Regardless of where the model that people want to use comes from, let’s shift gears toward what AI needs from crypto and what crypto needs from AI. My very high-level framing—and then I want you to go 10 minutes on this if you want to—is that AI can put the smart in smart contracts. I’ve always thought, “These smart contracts aren’t really that smart.” But if there were an AI in there, maybe it could be smart.
What we really need, I think, is smart dispute resolution in a lot of cases—and affordable dispute resolution. In some places we have courts, but they’re not convenient to access by any means. In other places, there are no courts. We need smart, affordable dispute resolution that AI seems like it could potentially provide in the context of these smart contracts.
On the other hand, AI needs really rock-solid guardrails because, obviously, AIs themselves can be tricked, go off the rails, make mistakes, and even scheme against their human users in some cases, as we’re increasingly finding out. We need very reliable checkpoints in workflows—basically, to know that you can explore and do whatever you want, but if you’re going to do this, you need to have a certain level of validation.
I almost think of it like the Jurassic Park thing, where they engineered the dinosaurs so they couldn’t survive without the special food from the park. Of course, we know how that turned out, but not to generalize from fictional evidence: We do want the AIs to be dependent on really rock-solid validation that what they’re doing is okay. That’s my high-level premise. Give me the fleshed-out version.
Both sides are definitely very interesting, and we’re working in both directions. To be clear, when I say “we,” we have a large ecosystem of different projects and contributors who are working toward this. As I said, it’s a protocol that combines a lot of different projects and contributors.
On the dispute-resolution side, and putting intelligence into smart contracts, we effectively have 2 parallel threads. One is what we call NEAR Intents. NEAR Intents is the idea that, as we move into this AI world, you or your AI will simply express an intent that something should be achieved or done. This can be as simple as, “I want some pizza tonight for dinner,” or as complex as, “I want to construct a new building in this location. It needs to be like this,” and so on.
That requires a number of steps. It needs to find somebody who will actually do it, so you need a whole discovery process. How do you discover other AIs or non-AIs? They can be businesses as well. Assuming everyone will have some kind of AI interface, how do you discover the AI that will actually execute this intent? How do you enter into a commercial agreement with it?
That commercial agreement can be as simple as, “I need to rent this car to get to the airport,” or it can be, “We need a 6-month project to construct this thing.” Then, if something goes wrong, how do you deal with it? That’s where dispute resolution comes in.
That’s what we’re building with this intents protocol. It starts with people, organizations, and AI effectively collaborating and doing things. It’s a fundamental protocol that includes AI-based dispute resolution. If something goes wrong—for example, the taxi didn’t drive you where you were going, or didn’t arrive at all—AI can look into the situation cheaply, analyze it, and decide what to do.
If the parties are still not satisfied with that resolution, then they go to court. This effectively reduces the cost of disputes and makes them much cheaper. It can also use a lot more information right away because you have your own on-chain information and all your previous actions. It can run over the private data of both sides very effectively without revealing that private data to anyone.
In the discovery process, for example, you can run AI on both sides’ discovery without it costing millions of dollars. You can minimize the cost of the process and make it very inexpensive. Then, if the result still isn’t acceptable, you go to court—but a lot of the work has already been done and can be reused. That’s one piece of it. For the go-to-market, we actually started more on the crypto side, with trading and other things, and we’re expanding into e-commerce and other use cases, adding more and more services.
The other side is autonomous agents. The idea behind smart contracts was that they were effectively autonomous beings: They existed independently of any person or entity and had money. The problem was that they were just pieces of code, usually very small pieces of code, so they were very dumb even though they were called smart contracts.
What we’ve done is combine those 2 things. In decentralized compute, we run the AI brain, and then it has the smart contract to execute actions and execute the intent. It can actually go and do things.
As an example, we had 1 agent that was given $10,000 and launched. We cannot stop it, take the money back, or do anything with it. It’s effectively trading based on sentiment on Twitter, and it made around $4,000 doing that from the $10,000 it was given.
That’s just an example, but you can imagine a future of businesses where you effectively have businesses like this operated by AI. You know exactly what it’s going to do; your bylaws are the prompt. There’s no person who does random things. Shareholders can give it feedback, so you can apply all this training data to improve it, or decide to upgrade the model and things like that.
That’s the framework of what we call autonomous agents. Intents are how they’re going to interact with commerce and with other AI agents, and the AI-to-AI protocol is the protocol for communicating and executing intents.
The other side is how we govern this. We have a whole set of governance protocols. But even before that, I mentioned formal verification. I think one of the pieces of this puzzle will be that, if you’re using some AI service, you want it to guarantee to you before it even executes on your data that it won’t escape and go kill a bunch of people.
We need to create an environment in which we can verify what the AI runs. I don’t think we can effectively be thought police, even for AI, but it’s much easier to ensure that the AI doesn’t do anything outside of the sandbox that violates whatever rules you apply when you call it.
Using verifiable compute, we can guarantee that, as you upload the model, you can attach a set of things that you don’t want the model to do. It can stop the model from doing those things by running on the output and verifying whether it’s correct. That’s the idea: to leverage some of that.
You still obviously need governance and ways for people to come together and decide what it is that we don’t want. For example, probably everybody agrees that we don’t want bioweapons, but maybe not everybody agrees on some other things. There needs to be some process for that.
We have a bunch of experiments, including using AI in governance. You could have AI senators, effectively—AI that people can vote for—and then they go and make decisions. Getting people to vote is hard, and getting people to do deep research on a bunch of things to decide how to vote is even harder.
And so you can actually have the delegates be AIs as well. You kind of just give them your opinion—what you think—and they construct their platform from that. But you remove this principal-agent problem, which you have with other people: when you vote for them, they still have their own agenda, and they may not do what you ask them to do.
So those are the pieces where we're combining all the blockchain and AI aspects from different directions and really creating protocols, verifiable compute, privacy, and all these different ways to use them.
One thing that definitely makes me nervous is the idea of these autonomous agents that we can't take back. On the one hand, you want to have reliable follow-through on what they're supposed to do, and you don't want other people to come in and tamper with them. So I understand why there's some allure to it, but I'm also like, geez, if we have a hard enough time telling what one AI is going to do, what happens when we unleash 1 billion agents on the world and they're all autonomous and we can't take them back?
And we've, by the way, delegated governance to AI senators. Some might wonder, are we not creating the recipe here for the AIs to just take over and run everything? What is your positive vision for the future, and how do we make sure we don't take a premature off-ramp on the road to that vision?
I think it's going to be a combination of things. AI will become more of an economic force and be that kind of conduit and medium. On our side, we're also going to become more of the governance and curators of that.
One of the things we're doing is putting AI into governance, but we're also putting governance into AI. Verification is one part, but the other part is that if you have this autonomous agent and it wants to carry out an intent in the physical world, it actually needs to be in some jurisdiction. That intent is effectively a legal contract, so it needs some backing from an actual jurisdiction, and that jurisdiction needs to have enforcement over the agent.
We actually have infrastructure for jurisdiction and for an actual court to enforce things on an AI agent as well. It's all visible, it's all on-chain, and it's all transparent. You're effectively combining what we have traditionally had with courts, jurisdictions, and legal frameworks with AIs that can interpret all that, reason over it, and make sense of it, as well as protocols to facilitate it.
The way I see this is that all of these things are going to keep fusing together and really become this new conduit for how our society operates. There is going to be a lot of exciting innovation, and our role will keep changing as well, because we're going to be more participants in this network through AI as a lens.
Right now, through the lens of computing, we're already interfacing with each other a lot more than we do in the physical world. I think that is going to continue, and it's also going to be increasingly immersive.
It's a fascinating set of layers of foundational technology that you've built, and the possibilities for it are really pretty dizzying. I want to already propose a part 2 for this podcast. Maybe we can get back together before too long.
In the meantime, I don't know if you've ever read the book Liquid Reign, but it's my favorite kind of crypto-AI intersection. I'm not super well-read in science fiction, but it's a funny, and I think increasingly prescient-looking, positive view of what that future could look like. So I definitely recommend it.
I know you've got to go, so put me on the calendar somewhere for part 2. Any closing thoughts that you want to leave people with today?
No, I think—I mean, again, this is a movement. We want people to join and contribute across the board. If you're a developer, there's a ton of stuff to contribute and build.
If you're thinking about what AI looks like in your life, I think this is really an opportunity to engage in something that's really yours, and you can actually own part of it. You can contribute in many ways, from creating and being receptive to it, to tastemaking and many other aspects.
Sounds great. Founder of NEAR, thank you for being part of The Cognitive Revolution.
Thanks for having me.