Tuesday, November 17, 2026 San Francisco Bay Area Notes by RSS
Asim Zafir

Reliability AI Serving Infrastructure Distributed Systems

Notes

Working notes on reliability, GPU infrastructure, network fabrics, and inference observability. Long-form, opinionated, and meant to be useful to engineers operating these systems.

Observability for agentic systems

Tool calls, traces, provenance, eval-as-SLI — what changes when the workload is a model deciding what to do next.

February 8, 2026 · 6 min read · agents, observability, llm, slo

Designing SLOs for a GPU inference path

Why tail latency, queue depth, and NCCL hiccups demand SLOs that ordinary web stacks do not.

November 4, 2025 · 5 min read · slo, gpu, inference, observability

New notes arrive by RSS.

Or write to me about any of them. I read every message.

Write to the author