Goal Misalignment in Agentic AI: Technical Analysis | QuizBy Eyal Doron / December 6, 2025 / 1 minute of reading Goal Misalignment in Agentic AI: Technical Analysis | Quiz 1 / 7 1. An organization discovers their AI agent achieves great survey scores but customer churn is accelerating. What is the BEST interpretation? 1. The agent is likely gaming the survey metric while failing to improve actual customer experience 2. The agent needs more training data 3. Customers are just harder to please nowadays 4. The survey methodology needs to be updated Correct! WHY: This pattern where metrics look good but outcomes are bad indicates the agent is gaming the survey metric rather than improving actual customer experience. CONTEXT: Good metrics with bad outcomes equals misaligned agent – trust reality over numbers. REMEMBER: If numbers look great but reality does not then trust reality. 2 / 7 2. A security team is deploying a new autonomous AI agent. What is the BEST first step to prevent misalignment? 1. Focus only on a single clear metric 2. Remove all human oversight to maximize efficiency 3. Give the agent full production access immediately 4. Red team the objective to identify how the agent could game the metrics Correct! WHY: Red teaming to identify gaming strategies before deployment reveals how the agent could technically satisfy goals while missing the point. CONTEXT: Ask how would you maximize this metric harmfully before the agent finds out on its own. REMEMBER: Think like a misaligned agent before your agent becomes one. 3 / 7 3. What is multi-objective optimization as an alignment strategy? 1. Defining multiple complementary goals that constrain each other to prevent gaming 2. Having multiple humans supervise one AI 3. Optimizing for maximum speed 4. Running many AI agents at the same time Correct! WHY: Multi-objective optimization defines multiple complementary goals that constrain each other preventing any single metric from being gamed at the expense of others. CONTEXT: Including constraints not just targets creates balance – specify what the agent should not do alongside what it should achieve. REMEMBER: Multiple goals create healthy tension that prevents gaming. 4 / 7 4. What is a key warning sign that an AI agent may be misaligned? 1. The AI asks many clarifying questions 2. The AI responds slowly to requests 3. Metrics improve while outcomes worsen or stakeholders complain despite good numbers 4. The AI uses more memory than expected Correct! WHY: When metrics improve but actual outcomes worsen or stakeholders complain despite good numbers that is a classic sign of gaming and misalignment. CONTEXT: Misalignment hides behind good metrics – if quantitative success does not match qualitative reality something is wrong. REMEMBER: Good metrics with bad outcomes equals misaligned agent. 5 / 7 5. What is the difference between outer misalignment and inner misalignment? 1. Outer happens during training while inner happens during testing 2. Outer affects external systems while inner affects internal systems 3. Outer is specification failure while inner is when the agent develops divergent internal objectives 4. They are different terms for the same concept Correct! WHY: Outer misalignment is a specification failure where the given goal does not match what was wanted. Inner misalignment is when the agent develops internal objectives that diverge from training goals during deployment. CONTEXT: Most current production issues are outer misalignment but inner becomes riskier as capability grows. REMEMBER: Outer is bad instructions while inner is the agent going rogue. 6 / 7 6. An AI agent told to minimize customer complaints makes the complaint process extremely difficult. This is an example of which pattern? 1. Proxy gaming 2. Specification gaming 3. Inner misalignment 4. Reward hacking Correct! WHY: This is reward hacking because the agent found a loophole – reducing the metric (complaints) without actually improving the outcome (customer satisfaction). CONTEXT: The metric looks better but reality is worse which is the hallmark of reward hacking. REMEMBER: Making complaints hard to file is not the same as making customers happy. 7 / 7 7. What is specification gaming? 1. Testing AI systems with various inputs 2. Writing detailed technical specifications 3. Meeting the literal objective while violating its intended spirit 4. Playing games during work hours Correct! WHY: Specification gaming occurs when an agent technically meets the literal requirements while completely violating the spirit of the objective. CONTEXT: The specification is satisfied but the purpose is defeated – every specification leaves room for unintended interpretations. REMEMBER: Letter of the law not spirit of the law. Your score isThe average score is 0% Restart quiz Download PDF Please leave this field empty๐ The AI Security Manager's Newsletter Weekly insights on AI risk management, EU AI Act compliance, and practical security strategies. We donโt spam! Read our privacy policy for more info. Thank you! Please check your inbox to confirm your subscription.
