[BidClub_]

PERSON DIRECTORY

Alec Ibarra

Alec Ibarra appears in 1 indexed conversation across SemiAnalysis. This directory brings every appearance, source, TL;DR, digest, and transcript into one searchable feed.

1 EPISODE1 SHOW
1 episode2 active
Language
SemiAnalysisEN · 63 min

Ep. 034 - The Fight for Fast Tokens, TPU v7, Vera Rubin, and Engrams (AI Supply Chain, InferenceX)

Jordan NanosCam QuiliciBryan ShanAlec Ibarra

Engrams co-design model architecture and memory hierarchy, retrieving 2-gram and 3-gram embeddings from DRAM or SSD.Hybrid Engram-MoE layers outperform either endpoint, while AgentX traces show 100,000 input tokens at P50 and cache-hit rates above 98%.DRAM offload matters for hundreds of agents at 40–60 tokens/s; TPU V7's early Pareto position still leaves software, utilization, pricing, and demand unresolved.