Home / Claude Certified Architect – Professional / Objective 4.3

Domain 4: Evaluation, Testing & Optimization · 16% of the exam · Full exam outline

4.3 Conduct A/B testing and iterative improvements

Practice questions

Question 1medium

A lender wants to validate a model change for its loan-explanation assistant. Its compliance team will not allow any customer to receive output from an unvalidated model version. Traffic is high. Which validation pattern fits?

Included in Master: master every domain.See plans
Question 2medium

A team runs a new version beside the current one, sends it copies of live requests, logs its outputs, and serves every user the current version's replies. Compared with a live A/B test, what does this approach give up?

Included in Master: master every domain.See plans