Discussion on "Inside NVIDIA Dynamo: A Deep Technical Tour of the Datacenter-Scale Inference Stack" | Hashnode
Discussion on "Inside NVIDIA Dynamo: A Deep Technical Tour of the Datacenter-Scale Inference Stack". Disaggregated prefill/decode, KV-aware routing, NIXL, KVBM, the SLA Planner, and the Kubernetes machinery behind them