MLA-C02 practice question: Guardrails and responsible AI (2 of 3)
Operating, Monitoring, and Securing ML and AI Solutions A free question from our original MLA-C02 practice exam. Try it, then open the answer to see why each option is right or wrong.
A public library runs a retrieval-augmented assistant that answers patron questions from its policy documents. Staff have found answers that are fluent but not supported by the retrieved passages, such as a fine amount that appears nowhere in the policy.
The team wants responses that are not supported by the retrieved text to be blocked before they reach patrons, and it wants answers that do not address the question to be blocked too. Neither check should require changing the policy documents.
Which Bedrock Guardrails feature should the team configure?
Choose one answer.
AA. A contextual grounding check, with a grounding threshold and a relevance threshold, applied to the response and the retrieved source passages.
BB. A word filter that blocks the words and phrases the policy documents never use, so that unsupported answers are rejected because of their vocabulary.
CC. A sensitive information filter that masks fine amounts and dollar values in each response before it is shown.
DD. Lower the model's temperature to zero and trust that the model will repeat only what the passages say.
B. Wrong: Word filters match specific words and do not compare the answer with the retrieved passages. An answer can avoid any blocked word and still be unsupported.
C. Wrong: The sensitive information filter masks personal data types, and it does not check whether an answer is supported by the retrieved text. The stem asks about grounding.
D. Wrong: Temperature reduces randomness but does not guarantee grounding, and it does not block unsupported answers. The stem asks for a check that blocks them.
Explanation
The contextual grounding check scores a response for grounding in the source passages and for relevance to the query, and it blocks responses below the configured thresholds. Word filters, personal data filters and temperature settings do not check the answer against the retrieved text.
Want more on Guardrails and responsible AI? The 5 full-length practice sets have 10 more Guardrails and responsible AI questions, 325 in all, none of them in the free exam. One payment of $14.99, no subscription. See the practice sets →