MLA-C02 practice question: Choosing foundation models in Bedrock
ML Model and Foundation Model (FM) Development A free question from our original MLA-C02 practice exam. Try it, then open the answer to see why each option is right or wrong.
An esports league runs a fan chatbot that answers short questions about schedules, rules and team rosters. It expects about 200,000 questions a day, and most answers must start appearing within one second.
Answer quality must stay high for these simple questions, and the monthly model cost must stay low. The team plans to choose a foundation model in Amazon Bedrock and test it on its own question set.
Which approach should the team take to choose the model?
Choose one answer.
AA. Shortlist smaller Bedrock models, run each on the team's labeled question set, and pick the cheapest one that meets the quality bar at the latency target.
BB. Choose the largest foundation model available in Bedrock, since the biggest model gives the best answers for every question.
CC. Train a custom language model from scratch in SageMaker AI on the league's past chat logs, and test foundation models only afterward.
DD. Use the model with the largest context window, because a larger window always reduces latency for short questions.
B. Wrong: The largest model usually responds more slowly and costs more per request, which conflicts with the one-second and cost goals. Size alone does not show quality on these simple questions.
C. Wrong: Training from scratch is costly and slow, and it is unnecessary for simple questions that existing models already answer well. The stem asks for a fast, cheap choice from available models.
D. Wrong: A large context window does not make short questions faster, and the window size is unrelated to answer quality on this task. Context size should match the amount of text the app sends.
Explanation
Model choice for a Bedrock workload should weigh quality on the team's own data against latency and cost. The largest model or a from-scratch model adds cost and delay, and context window size does not speed up short answers.
Want more on Choosing foundation models in Bedrock? The 5 full-length practice sets have 8 more Choosing foundation models in Bedrock questions, 325 in all, none of them in the free exam. One payment of $14.99, no subscription. See the practice sets →