What is automation bias?

What is automation bias?

• A. The tendency to favor suggestions from automated systems while ignoring contradictory information
• B. The tendency to distrust automated systems
• C. The tendency to rely only on human judgment
• D. The tendency to automate all decisions

Answer: (A)

Automation bias is the tendency to over-rely on suggestions from automated systems, giving their output more weight than conflicting information from other sources. This means people may accept what the machine advises even when there’s evidence that contradicts it, and they might overlook or undervalue signs that point to a different conclusion. This dynamic often grows from trust in the system’s perceived objectivity and efficiency, leading to complacency where human judgment hasn’t been fully engaged. For example, in medicine a decision-support AI might flag a diagnosis, and clinicians may favor that AI suggestion over their own clinical reasoning, potentially missing alternative possibilities. In driving, a navigation system might route you a certain way and drivers might ignore real-time road signs or hazards that suggest a different path. This explains why the best choice describes over-trusting automation rather than distrusting it, and why it’s not about relying only on humans or automating every decision.

Automation bias is the tendency to over-rely on suggestions from automated systems, giving their output more weight than conflicting information from other sources. This means people may accept what the machine advises even when there’s evidence that contradicts it, and they might overlook or undervalue signs that point to a different conclusion. This dynamic often grows from trust in the system’s perceived objectivity and efficiency, leading to complacency where human judgment hasn’t been fully engaged.

For example, in medicine a decision-support AI might flag a diagnosis, and clinicians may favor that AI suggestion over their own clinical reasoning, potentially missing alternative possibilities. In driving, a navigation system might route you a certain way and drivers might ignore real-time road signs or hazards that suggest a different path. This explains why the best choice describes over-trusting automation rather than distrusting it, and why it’s not about relying only on humans or automating every decision.