ExamPark
Course menuMLA-C02

Exams / MLA-C02 / Monitoring FMs and agents / Question 2

MLA-C02 practice question: Monitoring FMs and agents (2 of 2)

Operating, Monitoring, and Securing ML and AI Solutions A free question from our original MLA-C02 practice exam. Try it, then open the answer to see why each option is right or wrong.

Last verified against current AWS documentation ·How we write our questions

A ski resort has run an Amazon Bedrock agent for two years to answer guest questions about lift tickets, rentals and trail conditions. The agent calls action group functions for ticket lookup and rental booking, and guests report that some bookings never confirm even though the agent says they were made.

The operations team needs to see, for a failing conversation, each step the agent took, the action it called and the response it received, without changing the agent's instructions or the guest-facing code.

Which capability should the team use?

Choose one answer.

  1. A. Turn on the model's temperature setting to zero, since deterministic output makes the failing conversations easy to reproduce.
  2. B. Add a second foundation model that reviews every guest answer and writes a short summary of each conversation for the operations team.
  3. C. Enable the agent trace on invocations so that orchestration steps, action group calls and their observations are returned with each response and can be logged.
  4. D. Move the booking logic out of the agent into the guest-facing application, so the application logs show every booking.
Show the answer and explanation

Answer: C

  • A. Wrong: Temperature changes the randomness of answers and does not show which action failed or what it returned. The stem asks for visibility into the steps.
  • B. Wrong: A summary from another model describes the answer, not the action calls and responses that failed. The team needs the trace data itself.
  • C. Right: Correct. With the trace enabled, each response chunk carries trace data showing the orchestration steps, the action group invocation input and the observation the action returned, so the team can see where a booking failed. The agent's instructions do not change. Learn more: Track an agent's step-by-step reasoning process using trace (opens in a new tab)
  • D. Wrong: Moving the logic changes the architecture, which the stem rules out. Application logs would also not show the agent's reasoning steps.

Explanation

Agent traces return each orchestration step, action group call and observation, which shows where a booking request failed. Changing temperature, adding a summarizing model or moving the logic into the application either changes behavior or does not show the agent's steps.

Study

Keep practicing

Answer questions with a score at the end, or practice just this topic with the explanation after each one. No sign-up needed.

Take the free MLA-C02 practice examPractice Monitoring FMs and agentsAll Monitoring FMs and agents questions

Want more on Monitoring FMs and agents? The 5 full-length practice sets have 10 more Monitoring FMs and agents questions, 325 in all, none of them in the free exam. One payment of $14.99, no subscription. See the practice sets