CCAR-P practice › Solution Design & Architecture · Question 6 of 110

Solution Design & Architecture

A marketplace search assistant must meet a contractual p95 latency limit with a partner. The team proposes a multi-step agent that makes several tool calls per query; offline evaluation shows a modest relevance improvement over a single retrieval-augmented call. Which reasoning is most appropriate?

Show answer and explanation

Answer: B — Treat the p95 limit as fixed and keep the single call unless the extra relevance is shown to move business results

A contractual SLA is a guardrail the design must meet; (b) respects it and asks for evidence that the extra relevance is worth anything to the business. (a) breaks a commitment for an unproven gain. (c) changes perception, not the measured p95. (d) trades one latency problem for another without checking task fit.