Out-of-the-Loop Performance Problem

An Out-of-the-Loop Performance Problem is a human-automation interaction problem in which the operators of an automated system are less able to take over manual operation when the automation fails.

• AKA: Out-of-the-Loop Problem, Out-of-the-Loop Syndrome, Out-of-the-Loop Effect.
• Context:
  • It can typically arise from a loss of manual skills and of situation awareness while the automation runs.
  • ...
  • It can often be traced to vigilance and complacency problems, a shift from active to passive information processing, and a change in the feedback the operator receives.
  • It can often be moderated by the level of control the operator keeps in interacting with the automation.
  • ...
  • It can show up as slower decisions after an automation failure, as in the study by Endsley & Kiris, 1995.
  • It can be one of the consequences that the Ironies of Automation predicts for operators who must monitor automation and take over in abnormal conditions.
  • It can be related to mind wandering while the operator is left to monitor.
  • It can follow from reducing an operator's role to monitoring, which leaves fewer chances to understand the system.
  • ...
• Example(s):
  • the slower decisions after an expert-system failure in an automated navigation task (Endsley & Kiris, 1995).
  • the problems of train drivers under automatic train operation.
  • accidents attributed to it, such as the Three Mile Island Accident (1979) and the loss of Air France Flight 447 (2009).
  • ...
• Counter-Example(s):
  • an Automation Bias, which is favoring an automated recommendation over contrary information, rather than a reduced ability to take over.
  • a Human Error in a fully manual operation, which involves no hand-back from automation.
  • the failure of the automation itself, which triggers the take-over rather than being the operator's reduced ability to handle it.
• See: Ironies of Automation, Automation Bias, Situation Awareness Process, Automated System, Neglect Tolerance (Human-Robot Interaction).

---

---

References

2026

• (Wikipedia, 2026) ⇒ https://en.wikipedia.org/wiki/Out-of-the-loop_performance_problem Retrieved:2026-10-08.
  • QUOTE: The out-of-the-loop performance problem (OOL or OOTL) arises when an operator suffers from performance decrement as a consequence of automation. The potential loss of skills and of situation awareness caused by vigilance and complacency problems might make operators of automated systems unable to operate manually in case of system failure. Highly automated systems reduce the operator to monitoring role, which diminishes the chances for the operator to understand the system. It is related to mind wandering.
  • QUOTE: ... OOL is also known as out-of-the-loop syndrome and out-of-the-loop effect. ...
  • QUOTE: ... Three Mile Island accident in 1979, USAir Flight 5050 crash in 1989, Air France Flight 447 in 2009 and the loss of $400 million by Knight Capital Group in 2012 are attributed to OOL. ...
  • QUOTE: ... Automatic train operation is meant to reduce manual operation. This results in OOL performance problem for train drivers.

1995

• (Endsley & Kiris, 1995) ⇒ Mica R. Endsley, and Esin O. Kiris. (1995). “The Out-of-the-Loop Performance Problem and Level of Control in Automation.” In: Human Factors, 37(2).
  • ABSTRACT: The out-of-the-loop performance problem, a major potential consequence of automation, leaves operators of automated systems handicapped in their ability to take over manual operations in the event of automation failure. This is attributed to a possible loss of skills and of situation awareness (SA) arising from vigilance and complacency problems, a shift from active to passive information processing, and change in feedback provided to the operator. We studied the automation of a navigation task using an expert system and demonstrated that low SA corresponded with out-of-the-loop performance decrements in decision time following a failure of the expert system. Level of operator control in interacting with automation is a major factor in moderating this loss of SA. Results indicated that the shift from active to passive processing was most likely responsible for decreased SA under automated conditions.

---