Dylan Patel, SemiAnalysis
- Permitting is already pushing AI capacity beyond promised delivery dates. SemiAnalysis has shifted multiple gigawatts from 2027 into 2028, with further 2028 capacity slipping because “permits are just not available.” Patel sees space providing no meaningful relief over the next three or four years; even his tentative gigawatt-scale forecast around the decade’s end carries substantial engineering uncertainty.
- Product quality can redirect AI spending even when underlying models lag. Persistent agents now account for 45% of his company’s $15 million annual AI spend, mostly through Perplexity Computer using Claude and OpenAI: “It’s just a better harness.” Developers can switch easily, he argues, while enterprise discounts tied to having 70% of AI spend with a provider can create stickiness.
- Application revenue growth does not settle who keeps the economics. Patel sees ROI at companies such as Sierra and Harvey, while allowing that acquisition costs may be high and valuations remain debatable. Some applications are “pure pass through”; Harvey’s fluctuating margins and his uncertainty about Perplexity’s take illustrate why usage growth alone cannot establish durable profitability.
- Patel’s $500 million fund extends his infrastructure research into seed and Series A investing. The solo-GP vehicle spans robotics, silicon, optics, manufacturing, networking and related software. His boundary is competence—“I don’t know shit about applications”—and he thinks hardware generally requires both a strong founder and a strong idea, rather than relying on founders to discover the business.
- Citrini’s bearish AI stance survives under a long-term bullish owner. Patel says the acquired research company retains its editorial voice and separate identity: “Dude, do whatever you want.” Its experimental approach complements SemiAnalysis’s numerical supply-chain work; ownership does not require agreement about AI’s investment outlook.
- Research credibility is the asset Patel says he will not trade for investment promotion. He distinguishes IREN’s weak cloud technology from the value of its powered land, and says SemiAnalysis disclosed Fluidstack delays despite his large investment. His governing principle: “we criticize the things that we love the most,” with the fund separate from the research businesses and consulting information subject to compliance.
- Patel expects AI to accelerate hardware development over the next year despite weak technical benchmark performance today. SemiAnalysis’s GDPX tests domains including chip design, materials science, biology and cyber, where models currently “suck at most of these benchmarks.” He expects the number of companies making hardware—and doing it well—to “skyrocket” as capabilities improve.
1. Permits are pushing gigawatts beyond 2027
SemiAnalysis has moved multiple gigawatts of expected capacity from 2027 into 2028, with “quite a few gigawatts” scheduled for 2028 also slipping. Patel’s explanation is specific: construction capability, labor and equipment are not the binding constraints on those projects; “permits are just not available.” Most jurisdictions imposing bans or moratoriums, he adds, have little existing or prospective capacity.
In Texas, Patel considers electricity-price and water concerns manageable; union-labor requirements are less straightforward where union membership is scarce and some electricians and industrial plumbers already earn $200,000 or more. Officials can obstruct projects through water, wastewater, stormwater and air permits. Even an off-grid facility using little water can be blocked through air permitting, making the administration’s implementation consequential.
Space offers little near-term relief. Patel would “take the over” on Elon Musk’s ambitious 2028 timing and guesses there could be roughly a gigawatt in space sometime this decade, “maybe 2030.” He explicitly leaves room for a much longer wait: engineering is difficult, and orbital capacity will not meaningfully solve the next three or four years’ constraints.
2. Local economics explain both the backlash and a possible bargain
Patel’s polling covered counties with existing, under-construction or planned 100 MW-plus facilities. Among people in counties with an existing 100-megawatt data center, 49% did not know it was there; in counties with a 100-megawatt facility planned within three years, only 40% knew it was coming. O’Shea’s explanation is that data centers give AI opponents “a physical thing you can actually protest.” Patel agrees that dislike of AI spills into infrastructure opposition.
His striking water comparison comes with O’Shea’s immediate challenge. Patel says all Musk’s data centers consume less water than three In-N-Outs; she responds, “You’ve got an asterisk.” His comparison includes embedded water on both sides—cattle for restaurants, and chips, materials and energy for data centers. He nevertheless concedes that poorly designed facilities can consume substantial water.
The legitimate community downside, in Patel’s account, includes nearby noise, possible electricity-price increases and property-tax concessions. Construction creates a temporary employment boom, but “almost no one works in a data center” afterward. A grid-connected facility receiving generous tax breaks can therefore leave residents with limited lasting benefits. He also cautions that headline investment includes chips and equipment purchased outside the state.
A better bargain shares the gains. Patel cites a Louisiana county where a tax windfall enabled roughly $20,000 payments to teachers. He also proposes subsidizing electricity bills within a 30-mile radius, arguing the expense would be small relative to the project. His practical answer is blunt: “you can subsidize things and just give people money and it’ll be fine.”
3. Better products are capturing spending from better models
O’Shea asks how investors should follow rotating AI leadership. Patel says valuations move more smoothly than online narratives: Anthropic excelled in Q2, OpenAI in Q3, and Anthropic is back to “crushing it” with Opus 5.5 and Fable 5.2 while OpenAI delays model releases. He initially calls Anthropic’s Q3 poor, then revises that to “okay.” He expects Google to get back in too. The danger is over-indexing on individual releases.
Patel calls Instinct and Meta’s Muse “way better products” than OpenAI Dots despite weaker underlying models. He blames overly restrictive safeguards, including Guardian. O’Shea pushes back: what if an agent cancels something important or sends an inappropriate message? His first response—“let me roll the dice”—gives way to conceding those errors are wrong; he argues competitors are not visibly suffering them constantly.
His own spending supplies the concrete example. After Claude Code dominated much of the year, persistent agents went from zero to 45% of a $15 million annual AI bill within a few months. Most of that allocation runs through Perplexity Computer, whose backend still uses Claude and OpenAI. “It’s just a better harness,” he says, while questioning its long-term hold on a nimble customer.
Stickiness depends on the buyer. Patel expects consumer products such as Muse and Instinct to retain users more readily than Claude Code or Codex retain developers. Enterprise contracts can change that: he has seen Anthropic discounts conditional on directing 70% of AI spending its way. O’Shea also challenges his interface critique, suggesting most users simply log in without discovering model controls.
4. Application adoption leaves margins and valuations unresolved
“Most startups will fail,” Patel says, alongside confidence that some will become extremely successful. Instinct appears to have staying power, although he does not endorse its valuation. Sierra and Harvey show fast revenue growth and, in his view, ROI, potentially alongside high acquisition costs. On inference-provider multiples, he offers both possibilities: valuations may be excessive, or rapid growth and good margins may justify them.
Revenue can also conceal pass-through economics. Patel points to Harvey’s margins having “seesawed all over the place” and admits he does not know Perplexity’s margin on his spending, though he doubts it is large. His willingness to route Claude usage through another provider depends partly on the economics. A better interface wins usage; the provider’s resulting profit remains a separate question.
5. A $500 million fund follows the limits of Patel’s expertise
Patel has raised $500 million as a solo GP for seed and Series A investing across infrastructure: robotics, silicon, optics, manufacturing, hardware and networking, plus related software. He declines to disclose check sizes because doing so “removes optionality for me to do something different.” Friends and the roughly 115 people across his businesses provide potential deal referrals.
His application-investing restraint is explicit: “I don’t know shit about applications.” He might help an application company with infrastructure costs, but cannot confidently judge product execution or scaling to a billion users. Even within familiar domains, he says he is continually learning. His criticism of investors is their willingness to act authoritative about businesses they do not understand.
SemiAnalysis’s team supplies the relevant depth: experience at ASML, Applied Materials, Lam Research, TSMC, Intel and NVIDIA, alongside cloud infrastructure, kernels, compilers, model training, data centers and power plants. In hardware, he thinks a great founder generally needs a great idea as well; application software may give talented founders more room to find their way.
Patel contrasts the abstract investment decision with the burdens of operating a company: firing someone, potentially being sued by them, negotiating contracts and keeping a team motivated. He says these are hard decisions, and that even after doing things a few times, “you just fly blind.” Running the businesses also means sacrificing sleep, health and time with people he loves.
6. Citrini keeps its bearish voice and experimental research
Patel describes acquiring Citrini as an opportunity to improve the company’s operations without changing its research identity. James and the team retain their approach; research director Kyle has the most say over what gets published. When employees asked whether they could remain bearish, Patel’s answer was, “Dude, do whatever you want.”
The methods differ. SemiAnalysis tracks individual facilities, chips, cables, servers, semiconductor tools and memory prices, while testing hardware, models and clusters. Citrini investigates through direct experiments: to understand AI drug design, it developed a scorpion antivenom with AI. Patel carefully limits the result—it “works okay”—rather than presenting it as a breakthrough. The team also sent someone to the Strait of Hormuz to investigate whether oil shipments would stop.
O’Shea recalls the Citrini paper around February that shook markets. Patel stresses that its authors called it “a thought exercise,” rather than a forecast they necessarily believed. Separately, Citrini shifted from bullish to strongly bearish on AI a few months earlier; his reaction was, “That’s crazy.” He remains “super bullish on AI in the long term,” while accepting that their jobs differ.
7. Selling useful information depends on keeping an independent opinion
Datasets and consulting generate most of SemiAnalysis’s revenue; major customers include hyperscalers, semiconductor companies and AI labs. Patel rejects advertising and paid opinions. He calls Gartner’s monetization a “racket,” citing a coding-agent ranking he disputes—but admits he cannot remember whether IBM appeared above Cursor or Claude Code. His proposed alternative is attention earned through useful research.
Objectivity has commercial consequences. Patel says customers have threatened to cancel over criticism, only for their teams to insist they still need the data. Selling favorable opinions would undermine that demand. “I think I’ve totally been wrong sometimes,” he acknowledges; his commitment is to publish what the team believes rather than make its opinions conform to a customer’s preferences.
Technical criticism and asset valuation can coexist. SemiAnalysis has criticized Iris Energy, IREN, for unreliable cloud clusters while recognizing the value of its powered land. Patel also discloses a large Fluidstack investment alongside public reporting that its data centers were delayed. Financial exposure, he argues, does not require an analyst to defend every aspect of a business.
The fund remains a separate entity, and Patel says consulting work is subject to compliance rules and substantial compliance spending. Research will not promote portfolio companies, though his connections can help founders hire and meet suppliers. He also stands by criticism of certain NVIDIA practices toward neoclouds as anticompetitive, describing that as the team’s judgment based on observed evidence.
8. Hard technical benchmarks frame the next hardware opportunity
SemiAnalysis plans inference-performance testing across Huawei chips, Amazon chips and chips from AI startups. Patel is also interested in semiconductor packaging, networking and memory technologies. These extend the firm’s existing effort to test what hardware actually delivers rather than rely solely on specifications or supply-chain forecasts.
Its new GDPX benchmark covers cyber, chip design, hardware design, materials science, biology, quant and RSI. Today, Patel says, “the models suck at most of these benchmarks,” which involve complicated tasks. His excitement concerns what improving performance could unlock for society, rather than a claim that models have already mastered those fields.
“I think hardware’s gonna just accelerate like crazy.” Over the next year, Patel expects both the number of companies making hardware and the number doing it well to “skyrocket.” Robotics is another focus, although understanding its entire supply chain remains an aspiration for his team, rather than expertise he claims it has already completed.
Full transcript
You’re building out an empire here.
We’ve got people in 15 countries. There are about 115 people, with offices in New York, Chicago, San Francisco, Oregon, Singapore, and Korea. We track every data center in the world, and as a firm, we know more about data centers than anyone else. Forty-nine percent of people in counties with a 100-megawatt data center didn’t even know there was a data center in their county.
Oh my God.
My biggest customers are hyperscalers, semiconductor companies, and AI labs.
Dylan Patel, welcome to Sorcery.
Yeah, well, good to be here. It was wizard-themed. Is that—is it Sorcery? I get that it’s like source code or whatever, but—
It’s not source code at all. No.
It’s not based on source code?
It was for sourcing deals. I come from the VC world.
Oh. I was thinking source code, or, you know, that we’re magical.
Magic would be cool. That makes a lot of sense. It was just a play on words.
But your aura has gone down a lot. It was like—
Damn.
It was like source code, wizards, source code—
VC.
—and then VC.
I know.
I think this is—
This is where the hierarchy of things—I really need to go. That’s why I live in L.A. I’m closer to the wizardry, or whatever they call it, all the wizards and, like—
There are wizards in L.A.?
There’s lots of stuff in L.A. There are crystals, Reiki, and—
Yeah, I mean, there are a lot of crystal people, crystal girls, but what do you mean? What’s Reiki? What are wizard people?
Oh, you need to get into this.
Please explain.
It’s all energy healing and the earth—
Oh, yeah, yeah, yeah.
Some of that has actually migrated up north because you guys have taken a liking to mushrooms, psychedelics, and ayahuasca.
Not me. I’ve never done a drug in my life.
Really?
Yeah.
No alcohol?
No, completely.
Holy crap.
Obviously, I drink—
That’s crazy.
I drink—
So this is kind of on theme, though, because we were calling this the Hogwarts library over here.
Mm.
You have a deep, secret library in the back of this office that’s actually quite nice.
Yeah.
Congrats.
Thank you. Thank you.
For today, I was trying to come up with all the different things we could talk about, because we could talk about everything with you. There’s a lot going on, whether it’s IPOs, models, data centers, new regulation, all the research you’re putting out, or even how you’ve been growing SemiAnalysis. It’s probably most relevant to get into the shift in D.C., but also in the U.S., and more regulation. A lot of that comes down to data centers, whether that means pushing them out of states that used to applaud them and now don’t. How are you seeing the stress or pressure from that, and do you see data centers in space as a solution?
I think space is a solution that’s still a few years away, so it’s a lot to say about what happens over the next few years. In terms of regulations, it’s at least a few years away before there are real, high volumes. I know Elon’s trying to do a shitload in 2028, but I’ll take the over on that. At some point this decade, there could be a gigawatt in space. I bet it’s this decade, maybe 2030, if I had to guess.
As far as the space question, it doesn’t solve anything in the next 3 or 4 years, or at least it won’t provide a meaningful amount of capacity. Potentially, space is way more than a few years away, too. The engineering is very hard.
As far as domestic regulations, Governor Hinojosa in Texas has been pretty positive and constructive in her discussions. We’ve tried to talk to people in her administration and her close circle, and we’ve heard what she’s said publicly. She says she’s not going to stop data centers; she’s just going to make sure they don’t raise electricity prices and are reasonable stewards of water. I think most data centers can do that pretty easily, so those things are solvable.
The union labor issue is the other one that’s kind of sketchy, because there’s very little union labor in Texas. How do you mandate union labor when you tell all these electricians, who are making $200,000 or more working on a data center, or industrial plumbers, who are making $200,000 or more at a data center, “Hey, you have to join a union”? That seems like a very unpopular thing. And all the other construction crews, right?
That seems like the biggest issue, at least based on what she’s said publicly, what her administration says, and actually building data centers in Texas. But she has a lot of levers to fight back on any data center. There are water permits, wastewater permits, stormwater permits, water consumption rules, and air permits. She can control and stop those very easily. If she does, a lot of data centers stop. There are data centers that aren’t even connected to the grid and use very little water, but she can still stop them via the air permit.
So it depends on how much of a stickler she is on the union labor point. I imagine it won’t be that crazy because it’s a lot of money and workers coming to Texas. It’s a lot of industry. It’s not the eye-watering numbers you hear about data centers, because most of that comes from outside Texas, like the chips, networking, and a lot of the materials. But it’s still a shitload of people working in the data center industry: tens of thousands of people, and hundreds of thousands in the broader sense.
We’ll see what happens, but we’ve definitely adjusted our timelines. We track every data center in the world and its timeline, and we’ve pushed multiple gigawatts out of 2027 into 2028. In 2028, quite a few gigawatts are getting pushed out. Not because they can’t build them, not because the labor isn’t there, and not because of an equipment shortage, but because permits just aren’t available. I think that’s the biggest risk.
There are a lot of jurisdictions all around the U.S. The vast majority that have banned data centers have no data centers. Most of the jurisdictions that are explicitly banning data centers or running moratoriums don’t have any anyway, or don’t have any meaningful capacity coming online.
We ran a poll in all the counties that already have a 100-megawatt-plus data center, one under construction, or one planned in the next 3 years. Funnily enough, 49% of people in counties with a 100-megawatt data center didn’t even know there was one in their county.
Oh my God.
It’s pretty fucking hilarious, because how do you not know this? We did this poll with David Shore, who collaborated with our team. One of the other findings was that only 40% of people knew a data center was even coming when a 100-megawatt data center was planned in the next 3 years.
I think it’s a function of this: even if you look at all the exit polls, data centers weren’t one of the top issues for the election. It was inflation, the war in Iran, and really pertinent things in people’s lives. It’s pretty clear that most people don’t realize there are data centers coming to their area or region, or that there are data centers already there.
They just have this nebulous view that data centers are bad because of stuff on the internet—both reasonable stuff and stuff from bad sites, as well as completely unreasonable, fake astroturfed stuff. Climate people need something to focus on, and there are also external actors who want to push anti-data-center narratives. Most people don’t know about the data centers that are coming, and the places that have them haven’t banned them yet. Texas is an example. In Ohio, some counties have banned them, but not the state as a whole.
I think it’ll become more and more pertinent, but these companies can easily do things to make it work. We put out a post saying you could just subsidize the power for everyone within a 30-mile radius, and it costs almost nothing. You can subsidize things and just give people money, and it’ll be fine.
So where does the negative narrative come from? I’ve heard amazing stories, too. Dina Powell was speaking about this on stage at the All-In Summit, and she brought, I think, a city council leader. They can now fund all the education in their area because of the benefits and revenue the data center brings to their county.
Yeah. There’s a county in Louisiana where they paid out all their teachers like $20K.
Yeah, I think that probably was it.
There’s a rule that all the property tax you collect has to be credited back to government employees, so they’re like, “Oh, shit. Okay.” If done improperly, a data center can be loud if your house is right next to it. If done improperly, data centers can use a lot of water. But if done properly, they use very little water. All of Elon Musk’s data centers use less water than 3 In-N-Outs.
Really?
Yeah. You have to count the supply chain of cows, but yes. If you count the supply chain of cows—
Oh my God.
—3 In-N-Outs is—
You’ve got an asterisk.
No, I think it’s fair, right? It’s like, what’s the embedded water usage? We did the same for the data center: all the embedded water usage of the materials in there, including the fabs building the chips, and all the embedded water usage of the power being generated from the turbines, and of getting all the oil and gas. Even if you compare the embedded water usage of the data center with the embedded water usage of In-N-Out, 3 In-N-Outs is equal to all of the data center capacity Elon Musk has.
That’s just because agriculture wastes a lot of water, and no one cares about that. But if a data center intakes that water and it evaporates for cooling, people freak out. There are obviously ways to use water in data centers that are very inefficient, but no one does that now.
Yeah.
Likewise, there’s a lot of concern about data centers not returning much to the community if done incorrectly. If you give them a property tax break and then they’re grid-connected, it’s possible they could cause grid prices to increase. They might not give much property tax back, and almost no one works in a data center. It’s great while they’re being constructed, but afterwards it’s like, who cares? So there’s this big boom and then a bust.
Most people aren’t paying attention to that. I think most people just don’t like them because they’re a little loud. If you’re close to them, sure. But if you’re not close to them, there’s no noise, which is the whole point, right? With that survey, 49% of people don’t know there’s a 100-megawatt data center in the county. It’s not like it’s some small one.
Well, do you think it also leans into the huge negative aura and narrative around AI? Data centers are the physical thing you can actually protest—
Yeah.
—versus software.
I agree. I think there are also a lot of incorrect numbers. One of the books on the New York Times bestseller list overestimated the water usage of data centers by something like 1,000 times. Then they revised it, but no one pays attention. They just cite this.
No one... Yeah.
But yeah, I think people dislike AI more than they dislike data centers, but data centers are an easy way to point at it.
So let’s talk about hating AI. We have some awesome, huge IPOs coming out. SpaceX had a big one earlier this year, and it’s now an AI company. We have Anthropic coming up. If this doesn’t land around that time, it’ll be before or after, who knows? And then we have OpenAI. We had Cerebras earlier this year. There’s a lot happening in the AI world, and I recently had Apoorva Agarwal on the pod. We talked about the four seasons of AI—
Altimeter?
He has this whole thing on the four seasons of AI. Google will be in vogue, then Anthropic, then OpenAI, and then—what was the fourth one? SpaceX. How do you deal with juggling who’s top dog at the moment?
The thing is, the market doesn’t actually shift the valuations that much. People talk about this company doing well, and that company doing well, but the market doesn’t go all over the place. It kind of smooths the curve.
Obviously, Anthropic crushed it in Q2, and then OpenAI crushed it in Q3, while Anthropic did pretty poorly. They did okay in Q3. Now they’re back to crushing it because of Opus 5.5 and Fable 5.2. OpenAI keeps delaying model releases, so maybe... And then Google will get back in.
These are competitive markets, and people like us, who watch this stuff and are terminally online, over-index on any individual data point. That’s just human nature.
Are we still watching model releases? Are we watching applications now? It seems like Meta is winning with the release of... It’s not called Jolly. What is it called?
Muse?
Muse.
Do you name your Muse Jolly?
No, that’s what it’s called. I’m just obsessed with the little—
The bear is... The, like, the—
Caricature.
The thingy is called Jolly?
Yeah.
Really? Like, the white thing?
Yeah. Mm-hmm.
Oh, I didn’t realize that.
I don’t know if it’s a bear, either.
It’s a teddy bear. It looks like a teddy bear, right?
Okay. Yeah.
I don’t know. It’s not a bear. It’s a teddy something.
It’s something.
Yeah.
It’s something fluffy.
Yeah.
But—
The fluffy thing. Got it.
The fluffy thing, that is Muse. How do you handle Muse coming into the scene and AI applications starting to pick up some momentum?
Yeah, I think applications are definitely important to watch. It’s pretty clear that Instinct and Muse, despite being worse models than OpenAI’s models, are way better products than OpenAI Dots.
I think some of OpenAI’s focus on safety restricts them. They have this thing called Guardian, and it stops the model from doing certain things in Codex and Dots, often overzealously. So Dots is just a shitty product compared to Muse and Instinct. Manus and Muse will run with what you want them to do.
There’s something to be said about being safe, but good products need to be good products first. Safety is important, but I don’t know. If it texts someone incorrectly or books an appointment incorrectly, fine, whatever.
What if it cancels something that’s important or says something not good?
Yeah, let me roll the dice.
Oh, boy. Okay.
I don’t know. No, I think obviously that’s incorrect. But you’re not hearing about Muse and Instinct doing this all the time, so I think OpenAI is just on the overzealous end.
Products are very important. Throughout the year, our spend has seesawed all over the place in terms of what we’re using, with the majority being Claude Code for most of the year. But over the last few months, we’ve gone from zero persistent agents to 45% of our $15 million-a-year AI spend being persistent agents.
The vast majority of that 45% isn’t through Anthropic’s Claude Tags or OpenAI’s Slack agent or Dots or anything like that. It’s through Perplexity Computer, which is still using Claude and OpenAI on the back end. It’s just a better harness.
It’s very interesting. I don’t know if there’s much of a sticking point for us long term. We’re a small, nimble organization that moves fast, but it says something that products are really important. Instinct doesn’t have the best model. They’re primarily using open models, and yet OpenAI is terrible compared to them.
I think product is very important. Products will be stickier in general. Muse is probably going to be a lot stickier, and Instinct is going to be a lot stickier. People are going to index to that use case. I don’t think Claude Code and Codex are going to be that sticky because developers can switch easily. Enterprise contracts will be sticky, though, and there are contracts floating around where Anthropic’s like, “Oh, if 70% of your AI spend is with us, we’ll give you this discount.”
And if it’s not, you don’t get that discount. I’ve seen them offer that to enterprise customers. Something like that is very sticky, so we’ll see what kind of stickiness happens.
I do wonder how much of this is because Anthropic and OpenAI are just bad at product. Have you seen the OpenAI chat app? It’s so dumb. You open Chat, and there’s a Chat section and a Work section. In each one, you can use a slider to choose what model you want. On the Chat side, you can choose an instant response, Pro, high, extra high, or a medium amount of reasoning effort. On the Work side, it selects the models, but there’s no Pro option. It’s like, what the fuck is this?
I think most people just log in and start using it. They have no idea they can toggle between models. Genuinely, I think probably 90% of people don’t know.
I agree, but why do you have all these options, then?
I don’t know.
Yeah, it’s bad product. I was like, this is a billion-user app.
It’s a fair point, because Tesla will at least take things off the production line. Why don’t the models do that?
Yeah. Meta is good at product, and Muse is actually intuitive. I was able to beta test Muse. Alex texted me, like, “Hey, try this new product out.” It was the week Instinct was popping off. He was like, “We’ve been working on this for a while. Hey, try it out.” So I tried it, and I was like, “Fuck, this is pretty good.” It was clear and had a good UI. That’s not the case with OpenAI and Anthropic, so I don’t know what they’re doing.
It’s this cycle of hiring a Meta VP who wasn’t actually that important at Meta, creating a bunch of garbage, and hiring a new Meta VP. I don’t know what’s going on.
So, as the market shifts into applications, do you remain bullish? I know your sentiment changed a little bit. What’s your temperature check?
Sentiment of what?
The ROI. Is it there, given the amount of spend it takes to grow these companies, apart from the big leader?
Most startups will fail. That’s just a fact of life. But some of them will be successful as hell. It seems like Instinct has some staying power. They’ve gotten a lot of users. I don’t know if it’s worth the valuation they’ve got, but they’re kicking ass, and we’ll see. We have a legitimate shot at having some staying power.
Companies like Sierra and Harvey are growing revenue really fast. Maybe their customer acquisition cost is really high, but they’re solid, and they’re in there. Those companies have ROI. There are other companies that may not. Are the inference providers worth the valuation multiples they have? Potentially not. Or maybe they are, because they’re growing revenue so fast and their margins are good.
I think most startups will fail, and some will succeed. I wouldn’t want to rain on anyone’s parade. I have my own thoughts on each company, but most of these companies are doing badass shit. The market dynamics are such that everyone has to pivot and move really fast. Some application companies will work. Some of them are just pure pass-through, though. I don’t know if you saw Harvey’s blogs; they showed that their margins have seesawed all over the place. Or if you’ve seen, “Yes, 45% of my company’s AI spend now flows through Perplexity,” I don’t know what Perplexity’s margin is on that.
Yeah.
I don’t think it’s that high. If it were a more expensive way of consuming Claude than Claude itself, I probably wouldn’t switch off of it.
1. A $500 Million Hardware Fund
This is great. You’re really getting into the investor seat, which leads us into our next topic: your starting a VC fund—or you started one.
Yeah, I already started it.
So you can’t talk about it too much, but why—
Well, I can. I just don’t want to.
You can? Okay. Then you don’t want to.
I just don’t want to.
Okay. Well, then we’re going to talk about it.
Yeah, sure.
So why extend out? You’re building out an empire here. You acquired Citrini, and you started a VC fund. What’s the goal here? How are you building out some analysis to extend?
I think there are many ways to do it. One of the things I want to do professionally and in life is have fun. I want to make money. I want to know everything, which is obviously a crazy and impossible goal. I want to spend time with those I love, like my family. Those are the basic goals.
From there, what does that mean? If I’m trying to know everything, that makes sense as a research business, as an analyst business. And I want to influence the people and things that matter. That makes sense if you’re an analyst in a research firm. You’re influencing people based on your research, opinions, and the facts you provide. You’re closest to knowing everything, although it’s obviously impossible to know everything.
There are many ways to monetize that. There’s selling research, and there’s consulting. That’s the bulk of our revenue: the datasets we sell to people or the consulting projects we work on with hyperscalers, infrastructure funds, or whoever. We work on these one-on-one consulting projects, and that work is firewalled away from the research.
Another way is investing when you see something awesome super early. We started an early-stage venture fund. I raised $500 million as a solo GP. We’re focusing on seed and Series A. That’s about all I’ll say. It’s in the infrastructure space, all the way from robotics to silicon, optics, manufacturing, and all these aspects of hardware and networking. There are many different places we’re investing, but it’s all early-stage.
We’ll never use the platform I built to pump the companies I’ve invested in. But there are many ways to help them. I have 115 people who work for me across SemiAnalysis and Citrini, and now the third company is the fund, which is separate and firewalled away. There are many ways to help people. If a company needs help, maybe we sell them research, maybe we do consulting, or, if they’re super early-stage, we can invest and give them some help pro bono.
There are a variety of ways to help people. The key thing is that I want to know everything, have fun, make money, and have influence—and obviously spend a lot of time with those I love.
As you think about that, where do you find the advantages and conflicts? Obviously, there are so many advantages to having you as an investor, and there are some conflicts with that, too. Most investors do have their own thing or their own company. You mention that you have a lot of influence and knowledge, and it’s clear that you’re compiling that together for the fund. Why did you choose the hardware side of it?
There’s some software stuff, too. There’s software for hardware, software for infrastructure, software infrastructure.
I don’t know shit about applications, so why would I invest in applications? I don’t know how to scale a fucking app to 1 billion active users. Why would I be useful? I could be useful to, let’s say, an Instinct, right?
Mm.
Help them think about infrastructure and cost or whatever. I met the founder recently, and we talked about some of this stuff, but at the end of the day, I don’t know shit about the product, and I don’t know how to scale users. How can I? I don’t think I could even make the determination that he’s going to succeed or not. He seems smart. They seem like good people, but how am I supposed to invest in that?
Whereas in my company, SemiAnalysis, I have people who have worked at ASML, Applied Materials, Lam Research, and all these companies making equipment for semiconductors. I have people who did R&D at TSMC and Intel. I have people who’ve designed chips and worked on kernels at NVIDIA, and people who’ve done infrastructure at Google, Microsoft, and Amazon. I have people who’ve worked on training models, people who’ve worked on compilers, people who’ve built data centers, and people who’ve built power plants. I have people who’ve done all of these things in my company, and I can tap into that expertise.
I think we, as a firm, know more about data centers than anyone else. I think we know more about where and how power is being generated for these data centers behind the meter. I think we know more about chips and all the aspects of chips and software and evals. We’ve started testing eval models with GDPX. There are all these different things I think I have expertise in as a company, or that we’re trying to become experts in. We’re trying to sell data, and we’re trying to do consulting, but it’s not application stuff. It’s models, infrastructure, and hardware.
There are aspirational places, right? Like robotics. No one really knows the whole robotics supply chain, but we’re trying to be experts in it. Hopefully, we’ll be the experts in it, and then it would make sense, right? I don’t understand investing in shit you don’t know anything about. I think one of the most toxic traits of investors, whether in San Francisco or New York, is that they think they know everything about something that—
They don’t know anything about—
—they don’t know shit about. Yeah. I don’t know shit about a lot of things.
Mm.
I think I know some about the things I’m investing in, and I think I know more than the vast majority of people. But even in places I’m investing, I’m learning stuff all the time. If I didn’t know anything, I’d be so lost. How do you invest like that?
Obviously, you invest in founders, and then you invest in ideas, and a great company is both of those things. I think in hardware, it’s harder to just have a great founder who figures things out. You kind of have to have a great founder and a great idea. Whereas in a lot of the application software world, you can just invest in a great founder, and they’ll figure it out.
So what does early stage mean to you, though? What’s the check size you’re going at? Because it’s such a sliding scale.
I’ll keep that confidential.
Confidential?
Yeah. Why would I tell people what I’m doing? That removes optionality for me to do something different.
Maybe someone wants your money.
If they’re awesome, they’ll find me, or I’ll find them, right? Hopefully.
I guess that’s a fair point. Are you doing a lot of outbound sourcing, or is it kind of coming to you? Do you get it through your cabal?
Cabal’s a strong word.
I don’t really know if I’m even using that word right.
I think a cabal is a group of people who are conspiring and, you know, evil. It has some evil connotation to me.
What’s the non-evil version of that?
I don’t know.
Your friends.
Yeah, my friends—
Okay.
—and team.
Besides your friends.
Friends, team, you know. There are 115 people who work for me. If they see something interesting, they’ll refer it.
Oh, you’re gonna get inundated with pitches now.
Yeah, but most people’s pitches are boring and wrong. I don’t know. I think that’s the broad view that I have.
Yeah. VC life.
VC life. I don’t know. But anyway, I think there are a lot of good ideas out there. There’s a lot of interesting work and a lot of innovators, so we’ll find them.
Fair.
The check sizes—I don’t want to talk about the specific details.
Okay. We’ll just leave that one up to the imagination. On a $500 million fund. Well, congratulations on that. I know you don’t like to talk about it, so I appreciate you sharing. In terms of Citrini, can we talk about that? What was the thought process there? It seems like you guys kind of conflict sometimes in how you view the world.
Yes. They’re bearish on AI. That’s okay. If they want to be bearish on AI, that’s fine. Look, James is awesome, and the whole Citrini team is awesome. They’ve captured the market’s imagination. They’ve been right a shitload of times, and their way of doing research is very different from the way SemiAnalysis’s research is done.
Let’s operationalize it. Let’s help them be better. Let’s improve that. I think there are a lot of things they can do better, from the way I see it, while at the same time not losing their ideal of who they are in research. I think it just made sense to join forces with them and help them with the things we can help them with.
It is a separate company. It remains a separate company. Kyle, who’s their director of research, has the most say on what gets published and what doesn’t. I think at one point when we acquired the company, they were like, “Oh, are we allowed to be bearish?” I’m like, “Dude, do whatever you want.” I’m not here to change your voice. I’m here to help you run this as a better company, right? Make it a better company.
I think the team has been pretty positive on that. They’ve been nailing a lot of calls. They got bearish on AI months ago, and I was like, “That’s crazy.”
I mean, they’ve kind of always been a little bearish on something, but I remember when the Citrini paper broke out, probably in February, right? It shook the markets, and then that was a whole topic. That was just one thing, and it had ripple effects, but—
I think some of the things they said have come true. They said it was a thought exercise, right? They were like, “It’s not what we believe is going to happen.” They’ve been super bullish on AI, but then they flipped and were super negative on AI a few months ago.
I’m still super bullish on AI in the long term, but our jobs are very different, right? SemiAnalysis is tracking the exact infrastructure: every data center, every chip. We’re testing the chips. We’re testing the models on bio, security, cyber, and chip design, and all these different aspects. We’re testing clusters, and we’re tracking every bit of the supply chain: how many cables are shipping, how many servers are shipping, how many GPUs are shipping, how many tools are shipping for the fabs, and what the price of memory is. SemiAnalysis is trying to answer all these questions on a very technical and numerical basis.
Citrini, I think, tries to be technical. They wanted to know what was going on with AI drug design, so they went and developed a scorpion antivenom with AI, and it works okay. It works okay. It’s pretty surprising, but they’re super deep into—They wanted to know if oil was going to stop being shipped, so they sent someone to the Strait of Hormuz. They’re going to keep doing crazy shit like this.
It just made a lot of sense. It’s not that I’m going to make them become part of SemiAnalysis. It’s a separate company.
Mm-hmm.
They’re awesome. There’s a lot they can do better, and we want to help them do better.
I’m really curious, because as you build out multiple businesses, who’s a business leader that you look up to? Are you going off the playbook of someone else, or how have you learned—
I think there are a lot of very interesting businesses across history and humanity, but ultimately, no one has really done the mix of things that we’re doing. I think it is uncharted waters.
Media is obviously being completely rewritten. Information services businesses are being rewritten. Everyone recognizes that Gartner, IDC, and those kinds of companies just suck and are useless, and yet information is more valuable than it’s ever been. What does a new kind of information firm look like?
In media and attention, the old guard is, in many ways, bad. I think there are still awesome reporters at places like The Wall Street Journal, Bloomberg, or The New York Times, but those brands have definitely taken a huge hit and fallen off in quality a lot. There’s the creator economy, and there are people who are just big on YouTube or some other platform—Twitter, X, Instagram, Substack. Attention is important. How do you monetize attention? How do you not just attention-hack, but also provide useful things?
Through the SemiAnalysis newsletter, the Citrini newsletter, and their social media, there are a lot of valuable things you can put out there. What’s the correct way to monetize attention? If you look at Gartner, the way they monetize it is that they’re a racket. They’ll be like, “Pay us, or we’re going to rank you poorly.” It’s not that explicit, but you could look at their AI software agent index, and it’s like, yeah, they put IBM’s coding agent—whatever the fuck it is—above, I think, Cursor or Claude Code. I don’t remember which one.
I don’t know.
But they put it above them.
I could be sleeping on IBM.
They have the Magic Quadrant, right? How the fuck is IBM’s coding agent better? Whatever. They’ve done this for a lot of folks. Obviously, the correct way is not to do that kind of bullshit, because then you lose your credibility and no one cares what you say.
One thing we will never do is take paid partnerships. We’ve never done ads, and we’ve never taken payment for an opinion. Our biggest customers are the ones we hate on the most. My biggest customers are hyperscalers, major semiconductor companies, and AI labs, and I don’t think there’s one that we only say positive things about.
We fall in and out of love with Anthropic, and I’ll say that clearly. We’ll say positive and negative things, and the same goes for any of these companies. I think it’s important for people to care what you say. You have to be objective and say what you truly believe. That’s sometimes antithetical to what people want. We’ve had people try to pull their contract because they were mad at what we said, but then their team was like, “Well, no, actually, we still want their data.”
It’s interesting: you have this attention, and you have this business where you’re selling data and consulting services. People only care about your data and consulting services because you’re an objective, truth-seeking player. You could monetize attention by selling an opinion that’s paid, but if you do that, you lose the whole thing. You always want to give your own opinion. You can be wrong sometimes. I think I’ve been totally wrong sometimes, but my whole team and I will always only say what we believe, even if we’re wrong.
That’s a little bit different. We’re a lot more cavalier. We’ve said things like, “We think some of Nvidia’s practices are anticompetitive,” with regard to how they treat certain neoclouds. We’re not going to shy away from that, even if they tell us it’s false. We’ve seen plenty of data points that make us think otherwise.
We’ve also had opinions like, “OpenAI’s product sucks in many cases,” or, “Anthropic’s product teams suck in many cases.” What is going on? Why is Perplexity my primary persistent agent supplier? Yes, they’re doing a lot of things right, but OpenAI and Anthropic are just fucking up. And yet, at the same time, we can say, “Wow, these are the best companies in the world, too.”
As long as people believe our opinion is true to our word, there will always be people who cast shadows and doubts. They’re like, “Oh, you’re just saying that because someone paid you to.” It’s also important to separate opinion. Sometimes we’ll talk about something technical publicly, and then our research will say something completely different.
For example, we’ve said Iris Energy, IREN, has terrible technology on the cloud services side. Their clusters can be unreliable. They don’t have all these other things in ClusterMAX. At the same time, we’ve said, “Oh, but they have powered land, and that’s worth a lot.” We’ve said both of these things. Or vice versa: I have a large investment in Fluidstack, and yet we’ve still said publicly that their data centers are delayed. You don’t have to compromise your morals or beliefs.
I think a lot of VCs especially think they have to be the tail that’s wagged by the dog that is their companies, and actually, it doesn’t matter. Good founders will recognize, “I’m going to give you honest feedback, and we’re going to tell you what we think is true. If you disagree with us, that’s fine. There’s no animosity here.” In fact, I think we criticize the things we love the most, at least as analysts. Just because you’re invested in something or have a financial interest doesn’t mean you have to be the tail that’s wagged by the dog.
So is that the biggest difference you’re going to make as an investor?
Oh, yeah. I think one thing is that we’ll never push our companies that we’ve invested in publicly, because those are separate companies.
Mm-hmm.
The fund is a completely separate entity and company from SemiAnalysis and Citrini. They will never say anything to pump a company that’s on the venture side. But at the same time, we have all these connections through those businesses. I just happen to know people in every layer of the supply chain, and I can help you get introduced to them or hired, or whatever. So I think there’s differentiation.
It’s the same with information I have under a consulting contract: there’s compliance. You spend a lot of money on compliance. You can’t just willy-nilly do stuff. Even if I’ve invested in a company through my fund, or if that company is a big customer of SemiAnalysis’ data or consulting, that doesn’t mean that, if we’re testing something empirically or tracking some supply chain number, we’re not going to just say what we think. Or if we think technically the direction is wrong, we’re not going to say that we think that. I think that’s the key point.
2. The Hard Parts Of Growth
I do think you’ve built a really unique business. You’ve built a phenomenal business, and you did it in a quite short amount of time. You’ve ridden an incredible market, and it seems like you’re creating some durability with the fund and other things, and with how you’re planning out research and pricing things.
But along this journey, I can’t imagine it’s all been that great. What have been the hardest lessons you’ve had to learn, or the most challenging moments?
Running a company is very hard. You lose sleep, so I don’t know, that’s fun. But it’s a lot of fun. You miss a lot of things. You have to choose what you’re going to work on, so you’re going to miss a lot of things, whether it’s in some people’s lives, your own life, sleep, or health. Obviously, that stuff gets sacrificed sometimes.
It’s really tough when you have to make tough decisions. When you’re running a business that does a lot of revenue, you have tons of tough decisions, whether it’s negotiating with a customer or team members, fighting between team members, or—
Kittens.
Yeah, we had a kitten in the office. Something really cute. But I think there are tough decisions to be made all the time. I think that’s another difference: a lot of investors have never made tough decisions.
Do I invest in this company or not? It’s like, eh. Have you fired people? That fucking sucks. Have you been sued by someone you fired? That fucking sucks. These kinds of things are annoying, and you have to learn how to deal with them and know the playbook. How do you negotiate with a customer or a supplier? How do you hire someone? How do you convince someone to work for you? How do you keep everyone motivated? All these things—I don’t know. I actually don’t know the answer to these things, right? You just fly blind.
Mm.
Maybe I’ve done it a few times, but I still haven’t done it much.
But you’ve built it out to how many offices and how many employees?
We’ve got people in 15 countries. There are about 115 people. Offices in New York, Chicago, San Francisco, Oregon, Singapore, and Korea. But we’ve got people in a bunch of other countries.
You speak all those languages?
Fuck no. I speak English, Gujarati, some Hindi, and Spanish. I’d say I can get by in 2 of those languages. I’m good. I’m decent. I can converse, but not well. No, I don’t know that many. I wish I did. I know enough Chinese that I can make people laugh.
Really?
Yeah.
Is it because your Chinese is so bad, or…?
Well, that’s exactly it.
Okay.
It’s bad, and I only know phrases that are insane.
Really?
Yeah.
Should I dare to ask which ones you know?
No, I mean, it’s up to people to ask me, right? I think—
Okay.
There are some old Chinese proverbs, and I think there are some things you can say based on the body language of what’s happening. Even if you don’t understand what the fuck is going on, you just say this phrase. An easy example is, you hear some people, and there’s a certain intonation when they’re speaking, and you say a phrase that means kind of like, “What? Why?” People will be like, “What the fuck?” It kind of makes sense, and they’ll think you know Chinese. You don’t know Chinese. But there’s obviously much more complicated stuff.
Okay. So if I wanted to—
You can talk about cows playing piano—
Oh.
—and how you can’t share an umbrella with a fat person. There are all sorts of things like this that you can say that are really insane.
So if I wanted to show that I can hang, what should I say?
Don’t ask me. I don’t know shit.
But you just said—
I lived in—
Those work.
I lived in Taiwan for a while. I don’t know. It’s context. If you learn it, then I’m giving you that, and that alpha’s decayed. It’s leaked.
All right.
It’s over.
Whatever, man.
It’s over. You’ve got to come up with your own wizardly spells.
You’re right. It all comes back to sorcery. It’s a good full-circle moment. Okay, I think we’re just about at time, if not more. But, Dylan Patel, I have to ask you: What are you most looking forward to in the next 12 months?
I think there’s a ton. There’s just a lot of stuff that we’re launching and doing. There’s testing of various chips, including Huawei chips, Amazon’s chips, and various AI startups’ chips for inference performance. The new model releases, I think, are sick. We launched a new benchmark called GDPX. It tests across many domains: cyber, chip design, hardware design, materials science, bio, quant, and RSI.
I’m excited to see the models get good at them, because the models suck at most of these benchmarks. They’re very complicated tasks, and as the models get better at them, what does that unlock for society? I think we’re going to see tremendous progress in technology, especially hardware. I think hardware’s going to accelerate like crazy. In a year, the number of companies making things in the hardware realm is going to skyrocket, and the number of companies that can do it well is going to skyrocket. It’s going to be really fun to see all the innovation in society from that.
Robotics, obviously. There are tons of niche semiconductor technologies I’m really excited for, especially in packaging, networking, and memory. So, yeah, there are a lot of things I’m excited about.
Cool. Is your favorite chip still Takis? Is that what you said?
Takis.
Takis? Takis?
Takis. T-A-K-I-S.
I don’t.
Takis. The blue ones. Or purple ones. I don’t remember what color.
They’re purple?
They’re blue or purple. I’m partially colorblind.
Really?
Yeah. They say it’s red-green color blindness, but I can tell the difference between red and green, and I don’t fucking understand that. It’s a really interesting one, right? It lives on the X chromosome, the type that I have. I can see most colors. It’s fine.
So this has been clinically confirmed?
Yeah, yeah. It lives on the X chromosome.
Okay.
It can only express itself in men. It goes from the maternal grandfather to his daughter. His daughter always has it. If you draw a Punnett square, that daughter will pass it to 50% of her sons because she has 2 X chromosomes.
Wow.
If a woman passes it to her daughter, it can skip a generation too, right? But it lives on the X chromosome, and it generally comes from your maternal grandfather. It’s an interesting thing. I see color a little bit worse, but I see way better in the dark. I think it’s rods versus cones. The light detectors in your eyes: your rods are better at telling whether it’s dark or light, and cones are better at seeing a spectrum of color. I can see every color around us. It’s just my color skills are a little worse.
What color is this?
It’s red.
What color is this?
It’s blue.
Well, then you can’t see purple? Is that what it is?
No, I see purple too. I just see purple and blue as similar.
Oh, okay.
But I’m also just kind of dumb.
No, I don’t think so.
No, I think so. I think, stylistically, right?
You’re stylistically dumb?
Maybe.
Maybe less aware.
Less aware. There we go.
There you go.
Stylistically less aware.
There you go. That sounds much more sophisticated.
Hmm. Anyways, I think it’s a fun thing to be able to see better in the dark.
How did we start talking about this? I don’t know. All right, Dylan Patel, thank you so much for your market update.
Yeah, for sure.
So—
Thanks for having me on Wizards of Waverly Place.
I know. I’m going to steal this room from now on. I think it’s very fitting.
Awesome. Awesome.