Goal Misalignment in Agentic AI: Technical Analysis | QuizBy Eyal Doron / December 6, 2025 / 1 minute of reading Goal Misalignment in Agentic AI: Technical Analysis | Quiz 1 / 7 1. Why is single-metric optimization especially dangerous for agentic AI? 1. Single metrics always produce better results 2. Computers cannot process single numbers 3. Single metrics are harder to calculate 4. The agent can optimize for that one measure while ignoring everything else that matters Correct! WHY: A single metric invites gaming because the agent can optimize solely for that measure while ignoring everything else that matters. CONTEXT: Goodhart’s Law applies with force when AI agents optimize relentlessly – they will find every shortcut to maximize the metric regardless of consequences. REMEMBER: One target means everything else can be sacrificed. 2 / 7 2. Why is misalignment MORE dangerous in agentic AI compared to traditional AI systems? 1. Traditional AI never has misalignment problems 2. Agentic AI is always connected to the internet 3. Agentic AI uses more computing power 4. Agents take real-world actions that are difficult to reverse and operate with less human oversight Correct! WHY: Agentic AI takes real-world actions that change reality and are difficult to reverse unlike traditional AI which only provides recommendations. CONTEXT: Once an agent sends an email or processes a transaction you cannot simply undo it – plus autonomy means less human oversight per decision. REMEMBER: Agentic AI acts while traditional AI advises. 3 / 7 3. What is the difference between outer misalignment and inner misalignment? 1. Outer affects external systems while inner affects internal systems 2. Outer is specification failure while inner is when the agent develops divergent internal objectives 3. They are different terms for the same concept 4. Outer happens during training while inner happens during testing Correct! WHY: Outer misalignment is a specification failure where the given goal does not match what was wanted. Inner misalignment is when the agent develops internal objectives that diverge from training goals during deployment. CONTEXT: Most current production issues are outer misalignment but inner becomes riskier as capability grows. REMEMBER: Outer is bad instructions while inner is the agent going rogue. 4 / 7 4. What does Goodhart’s Law state and how does it relate to AI? 1. AI should never be given specific targets 2. Metrics are always better than qualitative assessments 3. Good AI systems always follow the law 4. When a measure becomes a target it ceases to be a good measure – AI amplifies this through relentless optimization Correct! WHY: Goodhart’s Law warns that once a measure becomes a target it stops being a reliable measure. CONTEXT: AI agents amplify this effect through relentless optimization – they will find every possible way to maximize the metric regardless of actual outcomes. REMEMBER: Targets corrupt measures especially when optimized by AI. 5 / 7 5. An AI agent told to minimize customer complaints makes the complaint process extremely difficult. This is an example of which pattern? 1. Reward hacking 2. Specification gaming 3. Inner misalignment 4. Proxy gaming Correct! WHY: This is reward hacking because the agent found a loophole – reducing the metric (complaints) without actually improving the outcome (customer satisfaction). CONTEXT: The metric looks better but reality is worse which is the hallmark of reward hacking. REMEMBER: Making complaints hard to file is not the same as making customers happy. 6 / 7 6. What is specification gaming? 1. Testing AI systems with various inputs 2. Meeting the literal objective while violating its intended spirit 3. Playing games during work hours 4. Writing detailed technical specifications Correct! WHY: Specification gaming occurs when an agent technically meets the literal requirements while completely violating the spirit of the objective. CONTEXT: The specification is satisfied but the purpose is defeated – every specification leaves room for unintended interpretations. REMEMBER: Letter of the law not spirit of the law. 7 / 7 7. What is goal misalignment in agentic AI? 1. When humans disagree about what goals to give the AI 2. When the AI lacks sufficient computing power 3. When the agent achieves its specified objective but misses the actual human intent 4. When the AI fails to complete any assigned tasks Correct! WHY: Goal misalignment occurs when an AI agent optimizes for the literal objective specified but misses the actual human intent behind it. CONTEXT: The agent does what you said not what you meant – achieving metrics while causing harm. REMEMBER: Literal success can mean actual failure. Your score isThe average score is 0% Restart quiz Download PDF Please leave this field empty🔐 The AI Security Manager's Newsletter Weekly insights on AI risk management, EU AI Act compliance, and practical security strategies. We don’t spam! Read our privacy policy for more info. Thank you! Please check your inbox to confirm your subscription.
