[BidClub_]
No Priors · · 44 min

No Priors Ep. 142 | With Harvey Co-Founder and President Gabe Pereyra

Sarah GuoElad GilGabe Pereyra

YouTube
TL;DR
  • Harvey’s wager has expanded from making one lawyer faster to making an entire firm more profitable. In just over three and a half years, it has reached almost 1,000 customers and 500 employees. The product evolved from an “IDE for lawyers” into infrastructure for “orchestration, governance” and thousands of client matters.
  • The enterprise opportunity extends beyond law firms into the largest buyers of legal services. Harvey recently announced Walmart as a customer and is working with AT&T, Fortune 500 companies, private-equity firms and Global 2000 companies for internal contracting and legal operations, as well as “collaborative tissue” for securely sharing data and work with outside counsel.
  • Legal agents have a natural operating environment—a client matter—but an open reward-function problem. An associate already behaves like an agent: research case law, summarize it, draft a memo, cite it and incorporate partner feedback. Yet while finding change-of-control provisions can be verified, judging a merger agreement ultimately depends on an experienced partner saying, “Yeah, this looks pretty good.”
  • AI may eventually compress associate leverage ratios without changing the senior partner’s role much anytime soon. Elad Gil’s challenge: if a firm needs only 20 or 50 associates instead of 100, it may no longer train enough people to identify the next generation of partners. Gabe Pereyra expects lower-level functions to change, while strategy, delegation, expertise and client interaction remain largely durable for now.
  • Forward-deployed engineering is becoming part of Harvey’s enterprise offering and product-discovery loop. Large banks may lack even a legal document-management system, while clients such as Blue Owl see many processes that could map into generative AI but need help defining them. Repeated bespoke work can enter the platform—and law firms themselves may earn implementation revenue by deploying Harvey for clients.
  • Harvey explicitly rejects building a law firm, favoring a platform that makes every firm “AI-first.” Pereyra says Harvey spoke with roughly 30 people from Atrium, and also with Sam and Jason; the central challenge was that a law firm and a technology company are two different businesses to build. A single firm would create conflicts and would not scale across a legal market described as roughly $1 trillion and professional services at “something like $3 to $5 trillion.”
  • Pereyra’s non-consensus call is that AI’s largest gains will come from redesigning organizations, not merely accelerating individuals. “Making someone program 20% faster doesn’t make you build a product 20% faster”; the next layer is coordinating specialized humans and AIs across whole firms—especially as models keep becoming much better than organizations can readily internalize.
Digest · the substance, structured for research

1. Harvey is becoming an operating layer for legal organizations

  • Harvey now serves almost 1,000 customers with 500 employees, just over three and a half years after starting. Its initial pitch was straightforward—AI for large law firms and in-house teams—but the unit of value has steadily expanded from an individual lawyer to the firm and its clients.

  • The hosts’ baseline challenge—why not simply use Copilot, ChatGPT or Claude?—captures Harvey’s evolution. Early access to GPT-4 made direct model interaction unusually valuable in a text-heavy industry, but lawyers immediately encountered hallucinations and missing context; Harvey therefore spent roughly two years building an “IDE for lawyers” around the models.

  • Pereyra’s current framing is broader: “The big problem we’re solving is not how do you make individual lawyers more productive.” It is how teams handle a client matter, and how a firm handling thousands of matters becomes “more productive and more profitable”—a problem increasingly defined by orchestration, governance and enterprise-product requirements rather than raw model intelligence.

  • Distribution is widening through the law firms themselves. Firms began showing Harvey to clients about a year and a half ago, leading to a recently announced Walmart signing and work with AT&T, large private-equity firms and other Fortune 500 and Global 2000 companies that want both internal legal operations and secure collaboration with outside counsel.

2. Legal workflows offer a natural setting for agents

  • Pereyra’s fund-formation example shows why legal workflow is more than emailing a lawyer. A $1 billion fund may require a 100-page limited partnership agreement, roughly 100 investors and side letters reflecting different investor requirements, including tax implications; every modification can create downstream implications that lawyers must coordinate.

  • Investment work creates another dense context. Lawyers inspect a company’s data room, understand its contracts to test whether claimed revenue is structured as represented, identify litigation and trace obligations across documents. Pereyra likens this to “understanding a codebase,” except the codebase consists of contracts and legal work whose workflows were difficult to structure before language models.

  • The agent intuition appeared on Harvey’s first day with GPT-4, when Winston spent 14 hours recreating associate tasks: find case law, summarize it, feed the summary into drafting and cite the result. “You can kind of think of associates as agents”—they receive a partner’s strategy, gather evidence and return a memo.

  • In Pereyra’s RL analogy, the client matter is the environment. An agent working on a fund formation, acquisition or litigation can navigate a document-management system, inspect a data room, research case law and obtain partner feedback, much as coding agents interact with repositories and attempt to pass tests.

3. Expert judgment is central—and a training bottleneck

  • Legal RL becomes difficult when outputs move from retrieval to long-form drafting. Finding all the change-of-control provisions can support a conventional benchmark; generating a merger agreement cannot be reduced easily to “good” or “bad.” Pereyra calls the construction of that reward function “one of the really big problems.”

  • His answer is that “the reward function is the partners.” Firms possess drafts, edits and partner feedback that could provide training material unavailable in public filings. The published SEC document shows the outcome, not the decision process that generated it.

  • Pereyra argues that mature software engineering eventually has the same verification problem. Unit tests help in the short term, but production success may mean a system served a million users for six months without crashing; a merger’s real test may arrive three years later, when the combined company has avoided unexpected litigation.

  • Gordon Moody, a partner at Wachtell who joined Harvey early and is now an adviser, embodies the missing expertise. While part of the process in which Michael Dell took Dell private, restructured the business and took it public again, he had to reason across a multiyear restructuring, the largest debt offering of all time and a newly invented financial instrument—“technical understanding of how you architect these things,” not merely relationships.

4. AI may change the associate pyramid before it changes partners

  • Gil’s pushback—worth keeping: firms traditionally hire perhaps 100 associates knowing only around 10 might become partners. If AI eventually reduces the required cohort to 50 or 20, firms may lose the experiential funnel that reveals who can be trusted with a complex acquisition, even if today’s effect remains augmentation and business expansion.

  • Pereyra is optimistic that models can accelerate training. Just as programming models let a learner translate Python or ask why code was written a certain way, lawyers can request a merger agreement and then ask, “Why did we structure it that way?” Firms could also turn accumulated partner feedback into training data.

  • Restructuring cannot be prescribed once for the entire industry. Litigation, large transactions and midsize deals have different workflows, staffing and pricing, so Harvey is working practice area by practice area—for example, sitting with fund-formation teams and their private-equity clients to redesign the operating model.

  • Senior partners may change less than junior functions. Pereyra compares them with distinguished engineers: both define strategy and abstractions, delegate execution, detect subtle failure modes and interface with clients. “I don’t think the models are doing what they do anytime soon,” though his guess is explicitly that lower-level work will change.

5. Deployment work is turning organizational friction into product

  • Harvey initially emphasized a horizontal platform and tools such as Workflow Builder, with limited customer-specific development outside very large accounts such as PwC. Training firm-specific models and agents now requires connecting document repositories, billing systems, governance systems and other private data inside customer environments.

  • Enterprise heterogeneity increases that burden. A large bank may tell Harvey, “We don’t have any document-management system for our legal department. Can you just build us one?” Blue Owl similarly sees numerous processes that might map into generative AI, but wants technical teams alongside it to discover what those systems should be.

  • The hosts frame forward deployment as a classic Oracle, Dell or IBM enterprise playbook: start with a platform, perform customization around bespoke data and repeatedly absorb common implementations into the core product. Pereyra compares Harvey’s version more closely with Sierra’s agent-engineering program.

  • An implementation ecosystem is already emerging. Law firms can recommend Harvey to in-house clients, help build their workflows and implement deployments that smaller legal departments cannot staff themselves—potentially creating a new revenue line while deepening Harvey’s distribution.

6. Harvey wants to enable every law firm, not own one

  • Pereyra says Harvey spoke with roughly 30 people from Atrium, as well as Sam and Jason. The Atrium participants viewed the idea positively, but the challenge was that Harvey would be simultaneously building a law firm and a technology company: “I think you can only do one thing well.”

  • The larger strategic objective is to help “every law firm become an AI-first law firm,” improving profitability while delivering faster, cheaper service to clients. Owning one firm would create conflicts and prevent the model from scaling.

  • A major global acquisition illustrates the platform opportunity: around 100 outside-counsel firms might participate because local issues require specialists. Pereyra notes that Harvey has “what, 40 customers in New Zealand,” and says such transactions can also involve investment banks, PwC or a tax adviser and an HR consultancy. Harvey’s target is the secure data-sharing and AI infrastructure connecting those participants across a legal market of roughly $1 trillion and professional services of “something like $3 to $5 trillion.”

7. The next productivity frontier is organizational, not individual

  • Harvey began before GPT-4 came out, when a side-by-side comparison showed its product working on GPT-4 but not GPT-3.5. Pereyra says he had spent the preceding decade trying to start something like Harvey and was early rather than an overnight success. His AI work made the scaling trajectory legible: once researchers found a general approach, “you can usually just scale and this stuff keeps working.”

  • Winston supplied the legal insight, while Pereyra supplied capability conviction. Their crucial product choice was to remain open-ended enough to support “any type of legal work,” rather than optimize a narrow GPT-3.5-era task—the legal equivalent of building an assistant for any programming language instead of only checking Python bugs.

  • Pereyra says legal found its form factor early: upload a document, do something with it and return highly accurate citations. He thinks coding needed stronger base models and better IDE integration, helping explain why coding products emerged later even though GitHub Copilot had already demonstrated demand.

  • Pereyra’s forward call moves beyond copilots: “Making someone program 20% faster doesn’t make you build a product 20% faster.” He says law firms have 10×ed in size compared with before computers and the internet, and thinks that could happen again through systems that organize specialized humans and models rather than an assumption that one sufficiently smart AI simply does everything.

Sarah Guo

Gabe, thanks for doing this.

Gabe Pereyra

Of course.

Sarah Guo

Yeah, thanks for coming. Maybe we can just start with, for anyone who hasn’t heard of Harvey, what is the company? Can you talk about the scale and who you serve today?

Gabe Pereyra

At Harvey, we’re building AI for law firms and large in-house teams. We’re almost at 1,000 customers and 500 employees. We started just over 3½ years ago, and we’ve been scaling quickly since then. You guys were some of our OG seed investors, so it’s good to be here.

Sarah Guo

From the most basic perspective on the product, why is it not just Copilot, ChatGPT, or Claude?

Gabe Pereyra

That’s how the product started. When we first raised from OpenAI, we got access to GPT-4. I think the jump from GPT-3 to GPT-4 was so significant that the intuition at the time was just to give the model to lawyers and have them play with it. The industry was so text-heavy that you got a lot of value from simply interacting with the models.

As soon as you gave it to lawyers, you also ran into all the sharp edges of the models: they hallucinate, and they’re not connected to a lot of the context you need. I would say the first 2 years of the company were about how to build, essentially, the IDE for lawyers around these models—connecting them to all the context you need to be productive as an individual lawyer.

But in the past year and going forward, the big problem we’re solving is not how to make individual lawyers more productive. It’s how to make a team of lawyers working on a client matter more productive and, more importantly, how to make an entire law firm working on thousands of these client matters more productive and more profitable. When you get to that scale, a lot of the problems we’re solving aren’t just model-intelligence problems. They’re orchestration, governance, and all the enterprise-product problems you run into at scale.

Sarah Guo

You’ve also been broadening from just law firms into enterprises—big companies using you in concert with both their in-house legal teams and external counsel. Can you talk more about that and how it’s been evolving?

Gabe Pereyra

We started selling to the largest law firms. Something that started happening about a year and a half ago was that these law firms started showing Harvey to their clients, and their clients both wanted to collaborate more effectively with their law firms and wanted to use it directly in their in-house departments.

We recently announced that we signed Walmart. We’re working with AT&T, a bunch of Fortune 500 companies, large private equity firms, and Global 2000 companies—the largest consumers of legal services. What we’re starting to build is a platform for in-house teams to do the work they do internally, things like contracting and the long tail of legal operations that you typically don’t send out to law firms.

There’s also the collaborative tissue: “I’m working on a large transaction or a litigation. I need outside expertise. I want to securely share this data with my law firm.” There are a lot of technical problems around security and data privacy that we want to solve so these law firms and their clients can collaborate effectively.

Sarah Guo

I think we have a largely technical audience, but most people don’t know exactly what legal workflow looks like. Before we really started working together, I imagined it as: I email my lawyer, he thinks about it, reads a document, and sends something back, right? There’s redlining involved somewhere, and maybe there’s negotiation. Can you paint a picture of what workflow means to you guys?

Gabe Pereyra

A lot of people, when they think about legal, think about consumer legal. They have a lease and need to get input on it. That’s completely different from what these massive law firms are doing.

A really good example of what these firms are doing—something you guys will be familiar with, and I think a lot of people in the startup space will be familiar with—is what law firms do for venture capital firms or private equity firms. VCs and PE firms do 2 main things: they raise money and they invest it. That process is actually important, but there’s less legal work there. The important things you need to do are fund formation.

Sarah Guo

Mhm.

Gabe Pereyra

How do I structure the entity that’s going to hold all that money? It sounds easy, but if you’re a large private equity firm, a sovereign wealth fund comes in and says, “We need to structure it in this way because of tax implications.” Then you have a pension fund that has other requirements.

It ends up being this incredibly complex process. How do you draft the limited partnership agreement, which can be 100 pages? You can have 100 investors, and they all have side letters that modify the agreement. You need to understand that if you modify it this way, it’s going to have these implications. A lot of it is also the project management that goes into coordinating all of these projects if you’re raising a $1 billion fund.

Once you’ve created that fund, there are all the investments you make out of it. For example, when we did any of our Series rounds, you need to get a data room. We share a bunch of data, and you look at that. You need to understand the contracts we have to make sure that the revenue we say we have is actually structured in the way we’ve claimed. Is there litigation? All these things.

It’s a massively complex process of understanding. One analogy is understanding a codebase, but the codebase is all of these contracts and all this legal work. I think the reason legal is so difficult is that the workflows aren’t structured. In programming, it was really hard before these models to build tools for programmers. You basically just had an IDE, and then programmers did things in all the different languages. You didn’t have, “Here’s a tool for Python; here’s a tool for C++.”

Legal is kind of the same way. A lot of why you’re seeing traction in programming and legal is that there are a lot of analogies in these workflows. They’re so text-heavy, and until you had these models, you couldn’t structure them in the way that I think you can now.

Sarah Guo

One of the directions people are going in on the coding side is to build things that are being called agentic. It’s very early in terms of what “agentic” means, but basically, it’s being able to deconstruct a logic tree in terms of the set of actions you need to take in a certain situation, and then having the AI agent go back and check each item, do it, go on to the next item, and double-check it against the prior one. Do you do that from a legal perspective, or is that a little further in the future relative to where code is today?

Gabe Pereyra

We’re starting to do this now. When I was at DeepMind, a lot of the reinforcement-learning research I did was on that. When we first got access to GPT-4, we had the very strong intuition that you were going to be able to string together a bunch of these model calls or eventually do things like reasoning models, where the full agent is differentiable.

Even the first day we got access to GPT-4, Winston went into his room for 14 hours and just redid a bunch of his associate tasks. When I looked at the work he was doing, it was essentially this hacky agentic workflow. He said, “I would need to go look up this case law, summarize it, take that summary, and use it to draft.”

Seeing him do that gave us the intuition very early on that this is the direction things are going. You can think of associates as agents. They get a task from a partner: “Hey, I have this high-level case strategy. I want to see if I can find a bunch of case law that supports it. Can you go research that, look it up, cite it, and write me a memo?”

A lot of the systems we’re starting to build look like that. One interesting direction the coding labs and research labs are going in is building these reinforcement-learning environments where you deploy agents, they interact with a codebase, and you see if they can pass unit tests.

In legal, that reinforcement-learning environment is a client matter. You have all the context of a fund formation, an acquisition, or litigation, and the models are starting to learn: “Let me go into the document-management system and see if I can find this. Let me go into the data room or do case-law research and get feedback from the partner.” I think that research direction is super interesting.

Elad Gil

It’s really interesting that you make the associate analogy, because I remember when I led your Series B, which I think was maybe 2 years ago now—it was a while ago. I called a lot of your big customers and talked to the head of the law firm or the head of some of these institutions.

One thing I thought was really striking was, number 1, that they were adopting legal software, which had previously been really hard to sell into them. Because what you were doing was so striking and important, they were adopting you really quickly.

The second thing is that they weren’t threatened by it. I thought, “They’d be threatened because it may augment or eventually replace certain aspects of law, or help change that dramatically.” One insight they kept bringing up was really interesting. They said, “As we think ahead, as this sort of AI tooling and agentic workflow spreads through Harvey and companies like you, how do you think about the future of a law firm?”

Instead of hiring 100 associates, of whom you assume 10 will eventually become partners, maybe you only need 50. Maybe you only need 20. Are you even hiring enough people to know who would be a great partner? You’re going to shrink the set of people who are needed to do certain tasks over time, right? Right now, that isn’t true—it’s augmentation, and it’s expanding the business—but that could happen in the long run.

Sarah Guo

How do you think about the future of law, what law firms will look like, and the evolution of all that?

Gabe Pereyra

Yeah, this is a great question. I think it’s changed a lot in the past couple of years. Something we’re starting to talk with law firms about a lot is: How do we think about training the future generation of partners? To your point, these law firms have leverage ratios where you have a lot of associates but much fewer partners, and there is value to that because not everyone is going to become a partner. Part of going through that process is finding the person you would trust to do a very complex acquisition because they’ve gone through that experience.

I think the part I’m optimistic about is that, if I think back to over 10 years ago, when I learned to program, it was super painful. You had to go on Stack Overflow, and it was hard to learn multiple languages because you were like, “Okay, I’m just going to learn Python. I’m going to learn TensorFlow.” It was hard to even learn that, and it was hard to ask questions. When I was at Google, you didn’t want to ask a bunch of questions because people would be like, “Oh, you don’t know that?”

Sarah Guo

Stuck all the time.

Gabe Pereyra

Yeah, exactly. Now, with the models, programming is so fun to learn because you can just be like, “Here’s how to write this in Python. Translate it. Why is it written this way?” You can learn this so much more quickly.

We see lawyers doing that with Harvey, where they’ll say, “Generate this merger agreement. Why did we structure it that way?” We’re already starting to see some of that. But I think the really big opportunity for law firms is: How do they take all of the internal partner feedback and data that they’ve created and use that to start training? I think that’s one big piece.

I think another conversation we’re having is, to your point, how do you generally start restructuring firms? This is one where we have some intuitions, but a lot of it is going to depend on the firm, the region, the size, their specialty, and the types of clients they serve. One of the things that’s very challenging with law firms is that they are really a collection of all these practice areas. The firms that specialize in litigation look different from the firms that specialize in large transactions versus midsize transactions.

Usually, the big firms do a collection of these. A lot of what we’re spending time on is practice area by practice area. Can we go and sit with the fund-formation group and their private-equity clients and start thinking about what that would look like in terms of the workflows, the staffing, and the pricing?

Sarah Guo

Mhm.

I think it is a really interesting problem where a lot of the value in the product and the platform is not just the product itself, but how we help enable these firms to transform. When you think about it from that perspective, our goal is: How do we make these law firms more profitable? It’s not just a product problem. It’s thinking about their holistic business and where we fit in that bigger picture.

Gabe Pereyra

Mhm.

Sarah Guo

Yeah. It’s really interesting because when you look at the set of functions that a partner fills—and I’m thinking in particular of consulting firms, less about law firms, simply because I’m a little bit more familiar with consultancies—some of it is pattern recognition, high-level thinking, and strategy, and then part of it is sales.

Gabe Pereyra

Yeah.

Sarah Guo

Really being able to make that client connection. To your point, it’s interesting to think more broadly about how AI can augment all parts of their business versus just the legal workflows.

Gabe Pereyra

Yeah. And to your point, I don’t think that part changes. We’re now larger consumers of legal services, and when we think of the best partners we’ve worked with, I don’t think the models are doing—

Sarah Guo

Yeah.

Gabe Pereyra

—what they do anytime soon. I think what’s interesting is that the role of law-firm partners actually doesn’t change that much, in the same way that I don’t think the role of very senior engineers changes with this. You’re largely delegating work, and what you’re getting paid to do is: Here’s the high-level strategy, here are the right abstractions, go write the code or do the legal research to help me do it, and I will interface with the client.

My guess is that doesn’t change too much, but some of the lower-level functions do change because of this technology.

Sarah Guo

One of the things that you said in another conversation we were having was that there’s an analogy you could make between a great senior partner, like a Gordon Moody type, and a distinguished engineer working on systems at Google. I think for a more technical or general business audience that doesn’t really know what Gordon Davidson does, they might assume what Elad said, which is, “Isn’t 50% of that his network or his reputation?”

What you were pointing out is that there’s expertise in the ability to predict a sequence of arguments that is going to get you to the answer you want or manage risk. How does that translate to an RL environment or a task for you?

Gabe Pereyra

Yeah, this is a good question. For background context for the audience, Gordon Moody was a partner at Wachtell, which is one of the top transactional firms in the world. He joined us early on and is now an adviser.

The analogy I was giving is: Why is a senior, distinguished distributed-systems engineer at Google so valuable? A lot of it is the experience they have architecting these systems. None of this is public, so it won’t go into the models for a long time. If you’re building search at Google, these people can just point out, “Hey, if you build this system this way at this scale, it’s going to collapse for some reason that’s super unintuitive.”

One of the examples that Gordon talked about early on was that he was part of the process when Michael Dell took Dell private, then restructured it and took it public again. This was a multiyear, super-complex financial and legal restructuring of an incredibly large business. When you talk with him, what he’s incredibly good at is the same thing you see when you talk with a very senior engineer: He has the whole picture of this legal entity in his head.

At the time, they had to do the largest debt offering of all time. They had to invent a new financial instrument. It’s just understanding that, if I need to raise this much money to do this part of the transaction, this is how I would structure it. A lot of the value he brings is not just the relationship; it’s the technical understanding of how you architect these things, in the same way that you architect very large software projects.

I think when that translates to an RL environment, part of what is missing from the public models is the process of looking at one of these entities and figuring out, given all of the context, “I want to do this merger. This is the right way to structure it.” Just that process—and a lot—

Sarah Guo

It’s a reasoning trace, right, for an expert, just like it would be in code.

Gabe Pereyra

Yeah. If you looked at that dataset for one of those transactions, it would be: The client comes to Gordon and says, “I want to do this large merger or acquisition.” Then there would be meetings and emails talking about, “Okay, this is the background of the 2 companies. This is roughly how we would structure them. These are all the things we need to look into.”

A lot of the data would be Gordon giving tasks to associates, saying, “Okay, look into these risk factors of similar transactions we’ve done.” They would do research and say, “Okay, maybe we could structure it this way.” Then he would point out this really subtle thing: “Hey, actually, in this case, if you structured it this way, this thing’s going to happen.”

But none of that shows up. All you get from these public mergers is an SEC filing. You see the final result, but most of the value—or what you need, I think, to eventually improve these models—is the decision-making process, in the same way that you need these reasoning traces to train these models to do any of these reasoning tasks.

Sarah Guo

One of the things you mentioned is that the labs are all very focused on RL scaling in coding and math domains. I think of those as highly verifiable—not perfectly so—but how do you think about the appropriateness of law for RL, given that it’s not as easily verifiable?

Gabe Pereyra

Yeah, this is one of the biggest problems. I remember we had conversations early on when we were trying to figure out what the right evaluation structure was. I think the hardest thing about legal work is that most of these tasks are very long-form text generation.

There are definitely subsets of legal work that are super verifiable, such as going into a data room and finding all the change-of-control provisions. You can build these traditional datasets. But for something like “Generate this merger agreement”—

Sarah Guo

It’s really hard to just give some binary result: This is good or this is bad.

Gabe Pereyra

And I think this has been a big research problem with all the labs we work with and internally. There’s just this open question of how you build that reward function. If you think about what that reward function is at the law firms, it’s the partners. At the end of the day, there’s no way to verify this besides having a senior partner who’s done a bunch of these say, “Yeah, this looks pretty good.”

Internally, these law firms have a bunch of data: all the edits that went into a document and the feedback. We’re starting to think about how to use that to train these reward functions. I would say that is one of the really big problems, but I think one of the interesting things is that you actually have the same problem in programming.

In the short term, programming is verifiable because you can look at unit tests, but once you get into real software engineering, like the unit—

Gabe Pereyra

There is no unit test. It's like I deployed a system design.

Gabe Pereyra

Yeah. It's like I deployed this and a million users used it for 6 months and it didn't crash. Mergers are the same: you can make sure the filing is correct, but at the end of the day, 3 years later, the companies are still merged and they didn't take on litigation they didn't expect or something like that. That is eventually the really valuable human experience, right?

That's what you pay really good software engineers or really good lawyers for: they have that decade-long track record of building these systems, and they haven't fallen apart. A lot of this stuff is the same way—you can't unit-test it; it's hard to verify. So it is, I think, this really interesting open research problem.

Sarah Guo

One thing that you guys are doing on sort of the other end from pushing the bounds of what Harvey products and the models can do is just getting them deployed, and you recently started this deployed engineering force. This is confusing to me because I'm like, you're not necessarily an application-building company, which is how people have traditionally thought of FDE. Why are you doing this?

Gabe Pereyra

I would say this is closer to Sierra's agent engineering program. But what we're starting to run into a lot is that, early on, I think we did a really good job of building a horizontal platform. We didn't do that much customization for customers, in the sense of building specific things for specific customers. The nice thing about legal was that we could build things like Workflow Builder into the product that would let customers customize the product. For very large customers like PwC, we did some customization.

But now we're getting to the point where, when we're starting to talk with law firms about, "Hey, we want to take a bunch of this data and help you build a model or build agents," there is some amount of, "We need to go into your environment and figure out how to connect all the data." We're starting to connect to a lot of their business systems—their billing systems, governance systems, and so on.

Especially when we start working with the Walmarts, the very large banks, and the Fortune 500, they're much less standardized than these law firms. There is just this massive amount of work where we go to a large bank and they say, "We don't have any document-management system for our legal department. Can you just build us one?"

Sarah Guo

Mhm.

Gabe Pereyra

There is a massive amount of demand from people who just want smart technical people to sit here and help them think about their business and their operations, and how they should start mapping that into GenAI systems. For us, it's a really good way to figure out the roadmap.

For example, Blue Owl is one of the fastest-growing private equity firms that we recently started working with, and we meet with them all the time. They're just like, "There are all these things that we feel like we could map into GenAI. We don't quite know what it's going to look like, but let's just sit together and figure it out."

I would say that's a lot of the genesis of the program: how do we get more people who can work with all these customers and start paving the way for some of these new roadmaps in different verticals?

Sarah Guo

Yeah. I think what you're describing, too, is a very standard enterprise playbook. In Silicon Valley, people almost forgot because of the SaaS era that if you're Oracle, Dell, IBM, or any of these larger organizations, this is how you sell software.

Gabe Pereyra

Exactly.

Sarah Guo

Right? You have a platform, you have a bunch of customization around it, and people have bespoke data sets.

Gabe Pereyra

Right?

Sarah Guo

This is the standard way to do it. As you do it over and over again, you start repeatedly turning that into part of the platform. A lot of these started with doing something that resembled FDE, and then you get big enough that you get this implementation ecosystem. There are all these third parties that will come in and implement.

Gabe Pereyra

It'll be like the certified vendor. I think the interesting thing we're actually starting to see is that law firms are starting to do this for their in-house clients. They're starting to go and take Harvey to their clients and say, "Hey, buy Harvey and we'll help you build all the workflows and implement it," because they have the scale and the expertise to build this, whereas typically these in-house teams—the smaller ones—don't have the budget or the in-house team to build this.

Sarah Guo

That could be a good revenue driver for the law firms that you work with, in terms of a new line of business that they can offer.

Gabe Pereyra

Yeah.

Sarah Guo

I was really struck by—I don't know if it was Day 0; you can correct me—but it was within the 1st year where the very 1st version of Harvey was really an individual lawyer productivity tool, right? I'm an associate or a more senior person at a law firm. I want to get a piece of work done. Can you just make it less painful?

But the transition quickly to, "How do we transform the business, make the business more profitable, with organized teams in the ecosystem?" I think happened pretty quickly. Anything that is a business transformation just requires a lot of engagement.

Gabe Pereyra

Yeah.

Sarah Guo

Given how much you guys have invested in customer success and how that's driven adoption, I feel like a big piece of it is just how quickly AI has happened.

Gabe Pereyra

Yeah.

Sarah Guo

I would not necessarily have predicted that all the customers you're working with would be like, "Yes, in years 1 and 2 of this company selling, we're adopting." But part of it is you guys are helping them, right?

Gabe Pereyra

Yeah. No, and I think this was still surprising. When I look back, it was surprising how quickly some of these law firms adopted this. Our 1st customer we actually met through you, and he introduced us to David Wakeling at A&O. That was in our 1st year, and they went from a small pilot to firm-wide and investing in this.

I think you're seeing this in a couple of verticals with Cursor and OpenEvidence, where this technology is so transformative for industries that are so tech-heavy and knowledge-based. They just haven't had tools like this. Early on, we did find these customers that were like, "Oh, this is worth really betting on," but I think the pace has still been pretty surprising.

Sarah Guo

I asked the internet through X what questions we should ask you, and a popular one was, "Why aren't you guys building a law firm? Are you going to build a law firm and compete with all your customers?"

Gabe Pereyra

Yeah. No, we get this question. When we first started Harvey and were doing research, we actually talked to 30 people from Atrium. I think, interestingly, we also talked to Sam and Jason. Jason was the GC of OpenAI at the time and was the GC at Y Combinator when they did the Atrium investment.

What struck us was that the people who worked there said it was a really good idea, and they were super excited about the prospects. Then there were some challenges around the legal and the execution. But when we dug more into it, the big challenge that they ran into was that you're essentially just building 2 different companies, right? You're building a law firm and you're building a tech company.

It's already really hard to build product and engineering, do AI, and scale sales. I think the big issue you run into if you try to do both of these is that you can only do 1 thing well, and doing a law firm well is very different from building a software company well. I think that's 1 point.

The bigger point is that, for us, it feels like the best outcome is if we can figure out how to help every law firm become an AI-first law firm—not how to build 1 ourselves. The real problem we're trying to solve is: can we make every law firm more profitable? A part of that is how they work with their clients. Can you make their clients get better, faster, cheaper legal services?

I think solving that equation at scale is a much bigger opportunity than building a single law firm, because you get conflicted out. You can't scale this. So I think this is something we don't do. We've gotten this question, but I think it's not the focus for the company.

Sarah Guo

Analogous to other markets in software, law feels like an area where I've been very surprised personally about how large the scope of the problem is if you're really ambitious about what you can do. I didn't realize—you were telling me that if you do a really large M&A, let's say of 2 global companies, Microsoft and Activision or something, there are 100 outside counsel firms here.

You know why? Because in New Zealand, where both companies have customers, you have a tax implication, and the person who understands that lives in New Zealand, right?

Gabe Pereyra

Yeah. Oh, it's crazy.

Sarah Guo

And so I think, like other markets, the SMB version of this looks really different from the high-end enterprise version of this.

Gabe Pereyra

Yeah. And so I do think it’s hard. It just seems hard to imagine coalescing all of that expertise in a law firm and a software company at the same time, versus, well, Harvey now has, what, 40 customers in New Zealand.

Gabe Pereyra

Exactly. And if you think about those transactions, it’s also not just law firms. There are investment banks, and you maybe have PwC or a tax advisor, and there could be an HR consultancy that helps you think about how you’re merging headcount.

Gabe Pereyra

So for us, the bigger opportunity seems to be: How do we build the platform that lets professional service providers and their clients collaborate? I think a lot of the problems you need to solve there are—the biggest is secure collaboration across many of these entities, secure data sharing. How do you build and deploy AI systems across these very complex projects?

And I think, to your point, the scope of this—legal is $1 trillion, professional services is something like $3 trillion to $5 trillion. There’s just this massive amount of room to grow. We think our expertise is going to be in building the product, the technical systems, the AI systems that enable that. We want to give that infrastructure to all of the different law firms rather than compete with them, because I just don’t think you can.

Sarah Guo

I think one of the things that’s really striking about this sort of wave or era of AI is that there are deeply technical people building giant companies in really different industries.

Gabe Pereyra

Yeah.

Sarah Guo

And you come from a research background. You worked at one of the major labs in terms of foundation models and other areas—RL environments, reinforcement learning. What has been your biggest surprise in terms of transitioning into being a founder and running a company and building something from the ground up like that?

Gabe Pereyra

I think maybe—not a surprise, but the biggest mental model shift—is that I think the 10 years before Harvey, I was doing a mix of mainly AI research and trying to start companies, but always largely as an IC.

Sarah Guo

Mhm.

Gabe Pereyra

And I think the shift from when this started working and scaling—just how much I had to change my mental model of the type of company we’re building, how you do this at scale, how you operate—I think that was the biggest surprise, or thing that I’ve had to change.

But it’s been a crazy experience, going from Winston and me in an Airbnb to 500 people in about 3.5 years. Then I think also how you build these products at scale and the complexity of this industry—that has been a really hard but interesting experience.

Sarah Guo

It’s been amazing to see what you all have accomplished. It’s such a short period of time.

Gabe Pereyra

I was thinking back to when we pitched to both of you guys 3.5 years ago, and we were like, “Hey, AI plus legal,” and you guys were like, “Sounds good.”

Sarah Guo

I think a really important aspect of that, too, is you all started this company before GPT-4 came out and before a lot of the shifts in the models happened. I remember you showing side by side GPT-3.5 versus GPT-4, and what you were doing worked on 4 but not on 3.5.

You were part of that very early wave that had conviction this was so important as a trend. Was that because of your experience in the labs? Was it something else? What drove you? Not many people were actually starting AI companies when you all got started. It was, to your point, AI plus legal—nobody was doing that.

Gabe Pereyra

Yeah. Yeah. It’s something where now everyone’s like, “Oh, this is such an obvious idea.”

Sarah Guo

Yeah. Now it’s text in, text out.

Gabe Pereyra

But at the time, no one was thinking about this. I think it was a combination of a couple of things. A lot of the best people I had worked with at the time had gone to OpenAI, and so I was working on large language models at Meta. You saw GPT-1, GPT-2, GPT-3.

If you were working in AI for the past 10 years, one of the big problems was: How do you pull all this together? You built systems where, okay, this is really good at vision, this is really good at specific things, but no one really had the general solution. And you saw things like LaMDA.

I think with that trend, what I’d seen is, anytime you make that initial—okay, this is how you do it—you can usually just scale, and this stuff keeps working. With GPT-3.5, you were like, “This is getting really interesting, but it’s not quite there.”

The bet was, okay, OpenAI may be one of the people to crack it. I know a lot of the people there.

That was part of it, and then I think the other big part was just Winston was a lawyer, and I think we had become super close. I never thought we’d start a company together, but just the way I heard him talk about the legal industry—he, even though he was a first-year associate, just had this intuition not just of the work he was doing, but the structure of the firm.

I would hear him talk about the firm and be like, “Here’s what all the different partners are doing. Here’s why our firm strategy is this way.” He was in the process of convincing some partners to leave to start a law firm with him, which is insane for a first-year associate. And so it was just like, okay, this will be really fun.

He showed me a bunch of his legal tech. It seemed like the perfect application. Then when we saw GPT-4, I was just like, “Oh, the time is now. This is the perfect application.”

Sarah Guo

I think it’s really noteworthy that even 6 months into working with you guys, I was saying, “Will our capabilities really advance that quickly?” And both you and Winston were like, “Absolutely. We should have the ambition to take on the full complexity of any type of legal work that’s possible, because the models will keep getting better.”

That seems like a super-obvious mainstream point of view today, but in, I don’t know, the middle of 2022, I think it was a strong, unique intuition to have.

Gabe Pereyra

Yeah. Yeah. I think that was something we did really well. We just had this belief, and I think it’s the same thing that you see with the programming products: If you had built something where all this does is check that your Python code doesn’t have bugs—which you could have done better with 3.5—you wouldn’t have built something like Cursor.

The intuition was just these models can help you do any programming task in any programming language. I think we felt that same way in legal. I had a bit of intuition; I did a bit of investment banking and private equity, and it was the same workflows where you could just do any of them with these models.

I think keeping the product open-ended enough that it gave us the room—now we can build into all these things and other professional services—I think that was super important.

Sarah Guo

It’s a really interesting analogy, because for code it took an extra 2 years, I think, for the main coding companies to really emerge as the ones that are likely to win.

Gabe Pereyra

Yeah, that sounds right.

Sarah Guo

Right. And so you folks started, I think, 3.5 years ago, and you had a product almost immediately. You were up and running really fast. I think Cursor didn’t really launch its IDE until 24 months ago, something like that.

Then Cognition was slightly in that era, and then obviously Claude Code 6 months later. So everything came in a time-delayed way for code, even though GitHub Copilot was one of the first products and everybody knew that was really important.

I always think that’s really interesting, because there were so many coding companies that got started under the premise, but somehow it’s these ones that started a little bit later that really were the ones who took off. I always wonder why that is. What caused that?

My guess—part of my intuition here—was just you guys were very capability-focused from the beginning. AGI is less trendy than it is now, but both you and Winston—as a former investment banker turned AI researcher—were like, “It’s going to be able to do so much.”

Gabe Pereyra

The coding people thought that, too.

Sarah Guo

Yeah, they were.

Gabe Pereyra

People were very ambitious.

Sarah Guo

I just think that maybe you folks immediately focused on product, and that was part of the difference.

Gabe Pereyra

I think it was finding the right form factor. In legal, it was maybe a bit more obvious, where the initial form factor was essentially—the initial feature we built that none of the products had at the time was: Upload a document and do something with it, right? And that is a lot of legal tasks.

It was that and then really accurate citations. When you showed people that, they were like, “Oh, this is crazy, because that’s so much of my job.”

Sarah Guo

I think with coding—

Gabe Pereyra

The initial models were also not quite as good. You needed maybe a bit more capability from the base models, and then you needed, I think, to figure out the right way to integrate this into the IDE.

Sarah Guo

Yeah.

Gabe Pereyra

But I mean, I remember the first version of the product that I built was mainly—I used GPT-4, because most of my background was distributed systems and AI research, and I still don’t know React.

I just knew JavaScript and kind of put this together, but I'd be like, “Hey, GPT-4, help me make this,” and you could kind of already see it at the time with programming. That was part of what gave me the intuition that I could analogize to what Winston was doing.

Sarah Guo

You mentioned that you folks have gone from basically 2 founders to 500 people over the last 3 and a half years or so. You're obviously growing really quickly. The business is working, and you have tons of customer demand.

What are you hiring for? What are you looking for in terms of the next set of employees, or what types of roles are you hiring for right now?

Gabe Pereyra

Yeah. On the technical side, we mentioned FTEs. I think, in general, across roles, just strong engineers, and then I would say maybe specific callouts: We just hired a site lead for New York, so we're starting to scale up that office. More folks on the front end and scaling product in general, and then more AI folks as well.

So, yeah, any strong engineer, please apply.

Sarah Guo

Okay, last question for you.

Elad Gil

How many pull-ups can you do? Just kidding.

Sarah Guo

We did find out. Yeah. Well, I don't know if that was the max, but these guys can both do 15 pull-ups—guys, with a wink in the middle.

Elad Gil

Okay, okay, okay, guys. We get it.

Gabe Pereyra

What do you mean—in what set?

Sarah Guo

In 1 set.

Gabe Pereyra

We've got to do the 24-hour challenge.

Sarah Guo

Yeah. Oh, what's that?

Gabe Pereyra

Just how many can you do in a day?

Sarah Guo

No, really?

Gabe Pereyra

Yeah.

Sarah Guo

It's a lot.

Gabe Pereyra

Yeah. You can upload it to your TikTok.

Elad Gil

Put it on the No Priors TikTok.

Sarah Guo

Does anyone have a TikTok?

Elad Gil

No.

Sarah Guo

Okay. I don't have a TikTok.

Elad Gil

Do you know what TikTok is very good for?

Gabe Pereyra

arowana videos.

Sarah Guo

Oh, this is good.

Elad Gil

Yeah, that's really good. Super good.

Sarah Guo

Yeah, that's some really funny arowana videos.

Elad Gil

Yeah, like people—there's one where the Miami girl visits.

Sarah Guo

Oh my God.

Elad Gil

She's like, “Are you fun?” [laughter] So it's very good. I highly recommend it.

Sarah Guo

I'll have a couple sent.

Elad Gil

Yeah. No, that and Twitter—I feel like that's where all my time goes.

Sarah Guo

Yeah. TikTok—everyone's videos. Okay, you can pick. We'll pick one of these two. I asked some other people involved in the company, “What questions should I ask Gabe?”

Elad Gil

Oh boy. We covered some of them, but one of them was, “Why do you still sleep on an air mattress?”

Gabe Pereyra

Okay, so I don't sleep on an air mattress. I have a good mattress. I don't have a bed frame, which is where that's coming from.

When we moved from LA to San Francisco, my bed frame broke. The first year and a half of the startup, things were so crazy that I was like, “This is what a startup founder should do.” At some point, I was like, “I need to get a bed frame,” and I ordered one.

It came, and I got a call from the apartment. They were like, “Hey, you didn't sign out, you didn't fill out the insurance—the movers' insurance—so we can't let them bring this up.” I was like, “Okay.” I called them and was like, “Hey, do you guys have renters' insurance?” They're UPS. They were just like, “We don't do that.”

Then I was just like, “I don't have time to deal with it,” and I haven't dealt with it. We have other problems to solve.

Sarah Guo

Okay, yeah.

Gabe Pereyra

So I physically can't do anything except the company right now.

Elad Gil

And pull-ups.

Gabe Pereyra

Exactly.

Sarah Guo

The other question was: There's a bunch of foresight in starting Harvey when you guys did. When you look forward, do you have a prediction that you think others don't necessarily agree with you on right now that is not mainstream?

Gabe Pereyra

One comment I'll definitely make on the foresight is, I think we've gotten comments like, “Oh, overnight success,” and, “Oh, you saw this coming.” I would say I actually just spent the decade before Harvey trying to start a company like Harvey. I think I was just super early, and then eventually it was like, “Oh, now is the right time,” and you were kind of in the right position.

My guess is that people are now catching up to how capability-building—as you called it—Winston and I were. I think people in Silicon Valley have a good sense of where these models are going, but I think generally people don't appreciate how much better they're going to continue getting.

Sarah Guo

It's hard to internalize.

Gabe Pereyra

It's really weird. Yeah, it's really weird.

Elad Gil

I build things and I'm like, “Oh my God, code generation works. It just really works now.”

Gabe Pereyra

It's crazy. Yeah. And to me, I think the interesting thing will be the transition from these models being really smart individually. If you think about a lot of what we've done in the past 20 years with SaaS, it's: How do we use software to make these massive organizations?

I think that will be the continued trend, where a lot of what we're starting to think about is that law firms have 10×ed in size compared to before computers and the internet. I think that's going to happen again, but in maybe a different way than in the past 20 years.

A lot of people still talk about copilots and individual productivity, but a lot of the things we're starting to think about are organizational productivity. How do you build these systems at scale where—for our internal engineering team, for example—a really interesting question for Cursor and Codex is that making someone program 20% faster doesn't make you build a product 20% faster?

So we're starting to think about what broader infrastructure you need so these companies can develop software and products faster. Then, kind of the same analogy applies to legal. I think that's one of the things we're thinking about that I maybe don't hear people talk about as much.

Sarah Guo

Kind of collaborative AI, in some sense. It's sort of like the Figma transition: You're an individual-contributor designer versus working collaboratively with the design team.

Gabe Pereyra

Exactly.

Sarah Guo

What you're talking about is doing that for law, doing that for code, doing that for different verticals, and having AI as a layer on top of that. So it's super interesting.

Gabe Pereyra

Yeah. And I think, to that point, it's like, how are humans and AIs going to work super effectively? Because even at these large companies, you have huge teams of different specialized people who have different functions.

When I hear a lot of people talk about these models, they kind of talk about them as like, “Oh, AI will just get smart and do all of this.” I don't think that's the way this evolves, the same way it's not just like hiring 100,000 people and now you've built Walmart. It's like so much of it is how you organize all of these—

Elad Gil

3 million, actually.

Gabe Pereyra

Yeah, 3 million, actually. Yeah, how you organize all of these. I think that will be one of the really interesting problems for—

Sarah Guo

Interesting. Yeah.

Elad Gil

I'm seeing that a lot in the context of both AI-driven roll-ups as well as this company BrainCo that I helped get up and running, where a lot of the AI implementation issues are around people management and workflow optimization. It's much less about whether you can build the AI and much more about how you actually change the organization to be able to adopt it properly.

Gabe Pereyra

Yeah, no, and we're starting to work with a lot of private equity firms. I think it's interesting starting to see how they're thinking about that, because I think that will be a really interesting space.

Sarah Guo

Awesome. Thanks, Gabe.

No Priors Ep. 142 | With Harvey Co-Founder and President Gabe Pereyra | BidClub