PERSON DIRECTORY
Vibhu
Vibhu appears in 17 indexed conversations across Latent Space. This directory brings every appearance, source, TL;DR, digest, and transcript into one searchable feed.
The Future of AI Infra: from Kubernetes to Agent Sandboxes — Akshat Bubna, Modal CTO
Modal is repositioning infrastructure around agent experience, using decorators, CLI observability, and a 17-provider footprint instead of owning data centers.Its investment case rests on bursty workloads and elastic orchestration: speculative decoding may deliver 2× to 4× speedups, while batch pricing and reliability determine whether compute planning converts into margins.
Agent Inference at the "Speed of Light" — How NVIDIA moves like a $4.3 Trillion Startup
swyxVibhuNader KhalilKyle Kranen
NVIDIA’s Dynamo treats agent inference as a data-center-scale system, coordinating KV-cache-aware scheduling, disaggregated prefill and decode, and heterogeneous fleets above vLLM, SGLang, and TensorRT-LLM.The economic frontier is quality, cost, and latency across the entire workflow, with GB200 NVL72 cited as roughly 35 times cheaper per token than Hopper over much of one comparison curve.Brev’s DGX Spark integration and NVIDIA’s agent rollout could expand GPU access, but security controls remain unresolved as agents combine file access, internet access, and arbitrary code execution.