THE DAY “GOD” FAILED OR OVERTRUST IN AUTOMATION. A PORTUGUESE CASE STUDY

Sampaio, José and Guerra, Antonio (2004): THE DAY “GOD” FAILED OR OVERTRUST IN AUTOMATION. A PORTUGUESE CASE STUDY. Published in: Human Performance Situation Awareness and Automation , Vol. II, No. Current Research and Trends (March 2004): pp. 70-76.

Abstract

The increasing development of computer based technologies open new horizons in task automation, helping pilots and air traffic controllers to carry out the analysis and resolution of an increasing number of cognitive tasks, in complex working environments. However, there is a general agreement that cognitive automation may lead to overtrust, complacency and loss of the necessary operational situation feed back, as the basis of the mental model refreshment which, in turn, allows for the maintenance of coherent situation awareness of all the operational processes. The case study reported suggests there is a dimension to be followed in human machine integration, which is beyond the technological deterministic approach of human machine interface design, and calls for a better human comprehension of system nature. The human comprehension of this dimension, which we introduce as the technological factor, represents the basis of systemic self-constructed situation awareness, in a real human centered development.

• Item Type: MPRA Paper
• Language: English
• Keywords: automation; situation awareness; mental model; overtrust in automation
• Subjects: O - Economic Development, Innovation, Technological Change, and Growth > O3 - Innovation ; Research and Development ; Technological Change ; Intellectual Property Rights > O33 - Technological Change: Choices and Consequences ; Diffusion Processes

References

Abdul-Rahman, A. & Hailes, S. (1999). Relying on trust to find reliable information. 1999 International Symposium on Database, Web and Cooperative Systems (DWACOS'99), Baden-Baden, Germany. Bainbridge, L. (1983). Ironies of automation. http://www.bainbrdg.demon.co.uk/Papers/Ironies.html [13-04-2003 3:10:30]. Bonini, D., Jackson, A. & McDonald, N. (2001). Do I trust thee? An approach to understanding trust in the domain of air traffic control. Proceedings of People in Control, 19-21 June, UMIST Manchester. Bisantz, A.M., Llinas, J., Seong, Y., Finger, R. & Jian, J.Y. (2000). Empirical investigations of trust-related system vulnerabilities in aided, adversarial decision-making. Center for Multi-Source Information Fusion, Dept. of Industrial Engineering, State University of New York at Buffalo. Cardosi, K. & Murphy, E. (1995). Human Factors in the Design and Evaluation of Air Traffic Control Systems. Federal Aviation Administration, Office of Aviation Research, DOT/FAA/RD-95/3. Dominguez et al., 1994. Situation Awareness: Papers and Annotated bibliography. Armstrong Laboratory, Human System Centre, ref. AL/CF-TR-1994-0085. Dzindolet et al. (2000). Buildings trust in automation. Paper presented at Human Performance, Situation Awareness and Automation: User-Centered Design for the New Millennium, The 4th Conference on Automation Technology and Human Performance and the 3rd Conference on Situation Awareness in Complex Systems, October15-19. Endsley. Mica & Esin Kiris (1995). Situation Awareness, Global Assessment Technique (SAGAT) TRACON Air traffic Control Version User Guide, TTV-IE-95-02, Texas Tech University. Eurocontrol (2003). Guidelines for Trust in Future ATM Systems: A Literature Review. EATMP Infocentre, Brussels. Grau, J. Y., Menu, J. P., Amalbertyi, R. (1995). La Conscience de la Situation en aéronautique de combat. Proceedings of AGARD conference 575, Situation awareness: Limitations and Enhancements in the aviation environment. Hollnagel, E., Cacciabue, P.C. & Bagnara, S. (1994). The limits of automation in air traffic control. Workshop report, Int. J. Human-Computer Studies, 40, 561-566. Hopkin, V.D. (1975). The controller versus automation. AGARD AG-209. Muir, B. (1994). Trust in automation: Part 1. Theoretical issues in the study and human intervention in automated systems. Ergonomics, 37, 1905-1923. Muir, B. (1987). Trust between humans and machines, and the design of decision aids. Int. J. Man-Machine Studies, 27, 527-539. Parasuraman, R., & Riley, V. (1997). Humans and automation: Use, misuse, disuse, abuse. Human Factors, 39(2), 230-253. Wickens, Christopher D. & Xu, Xidong (2002) .Automation Trust, Reliability and Attention. HMI 02-03 Technical Report, AHFD-02-14/MAAD-02-2, October. Wickens , Christopher D. (1998). Automation in Air Traffic Control: The Human performance issues, in Automation technology and Human Performance: current research and trends, edited by Scerbo & Mouloua. Wickens, C.D., Mavor, A.S. & McGee, P. (1997). Flight to the future. Human factors in air traffic control. Commission on Behavioral and Social Sciences and Education, National Research Council, National Academy Press. Woos, David D., Patterson Emily S, & Roth Emilie M. (1998). Can we ever escape to data overload? A Cognitive Systems Diagnosis- Cognitive Systems Engineering Laboratory Institute for Ergonomics, the Ohio State University.