Robert Gutzwiller
-
The Polytechnic School Campus SANTA CATALINA HALL (SANCA) Rm. 150E Mesa, AZ 85209
-
Mail code: 2880Campus: Poly
-
Robert Gutzwiller studies the critical role of the human in complex systems. His work scientifically applies cognitive engineering to cyberspace, transportation, and defense. His recent research also focuses on engineering human attention (How do humans select what task to do when they are multitasking and overwhelmed, and can models predict this behavior?), human-automation interaction (How do humans learn to interact with and trust complex systems, particularly those which use automation, artificial intelligence, and machine learning?), and defensive cyberspace operations (How does a cyber analyst protecting networks develop awareness? Could cognitive techniques be used against would-be attackers to make defenses more robust? How can we build automated defenses that operators trust and understand?).
Gutzwiller has been funded and worked on projects for the Army Research Office, Assistant Secretary of Defense, DARPA, NASA, and the Office of Naval Research, among others.
He is the author of more than 60 peer-reviewed papers, received the Human Factors Society’s Jerome H. Ely Award for the most outstanding journal article, and the Marc Resnick best paper award. Gutzwiller has been recognized for exceptional leadership and mentoring across several multi-disciplinary engineering projects in cyberspace and ship defense systems, receiving leadership and exemplary achievement awards from the United States Navy.
- Ph.D. Cognitive Psychology, Colorado State University 2014
- M.S. Cognitive Psychology, Colorado State University 2011
- B.S. Psychology, Baylor University 2008
Gutzwiller's academic lineage includes Paul Fitts, Dick Pew, Mike Posner, Chris Wickens and Ben Clegg.
attention, human-automation interaction, human-interactive machine learning, multitasking, modeling attention in overloading conditions, human factors in cyberspace defense & cybersecurity, cognitive warfare
Attention and Workload
- Lewis, C. M., Gutzwiller, R. S., & Johnson, C. K. (2024). Priority influences task selection decisions in multi-task management. Applied Ergonomics, 119, 104317.
- Johnson, C. J., Lieber, C. S., Gutzwiller, R. S., & Cooke, N. J. (2023). Team Workload in Action Teams: Exploring the Impact of Interdependence. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 67(1), 1127-1133.
- Lewis, C. M., & Gutzwiller, R. S. (2023). Examining post-error performance in a complex multitasking environment. Cognitive Research: Principles and Implications, 8(1), 65.
- Rheem, H., Steelman, K., & Gutzwiller, R. S. (2021). SEEV Modeler: A GUI-Based Tool for the SEEV Model Simulation. Proceedings of the Human Factors and Ergonomics Society Annual Meeting
- Zabala, G., & Gutzwiller, R. S. (2021). Validating the Strategic Task Overload Management (STOM) Model Using MATB II and Eye-tracking. Proceedings of the Human Factors and Ergonomics Society Annual Meeting
- Gutzwiller, R. S., Wickens, C. D., & Clegg, B. A. (2019). The role of reward and effort over time in task switching. Theoretical Issues in Ergonomics Science, 20(2), 196-214.
- Wickens, C. D., & Gutzwiller, R. S. (2017). The status of the Strategic Task Overload Model (STOM) for predicting multi-task management. Proceedings of the Human Factors and Ergonomics Society, 61, 757–761
- Gutzwiller, R. S., & Sitzman, D. M. (2017). Examining task priority effects in multi-task management. Proceedings of the Human Factors and Ergonomics Society, 61, 762–766.
- Wickens, C. D., Gutzwiller, R. S., Vieane, A., Clegg, B. A., & Janes, J. (2016). Time sharing between robotics and process control: Validating a model of attention switching. Human Factors, 58(2), 322-343. *Won the Jerome H. Ely Award for Most Outstanding Paper in Human Factors.
- Wickens, C. D., Gutzwiller, R. S., & Santamaria, A. (2015). Discrete task switching in overload: A meta-analyses and a model. Special issue of International Journal of Human Computer Studies, 79, 79-84.
- Gutzwiller, R. S., Wickens, C. D., & Clegg, B. A. (2015). The role of individual differences in the executive attentional network in switching choice and multi-task management. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 59, 632-636.
- Clegg, B. A., Wickens, C. D., Vieane, A., Gutzwiller, R. S., & Sebok, A. (2015). Circadian effects on fault management and multitasking. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 59, 627-631.
- Gutzwiller, R. S., Wickens, C. D., & Clegg, B. A. (2014). Workload overload modeling: An experiment with MATB II to inform a computational model of task management. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 58, 849-853.
- Blalock, L. D., Sawyer, B., Kiken, A., Gutzwiller, R. S., McGill, C. L., & Clegg, B. A. (2014). Cognitive load while driving impairs memory of moving but not stationary elements within the environment. Journal of Applied Research in Memory and Cognition, 5(2), 95-100.
Human Machine Teaming
- Wong, J. H., Chiou, E. K., Gutzwiller, R. S., Cook, M. B., & Fallon, C. K. (2024). Human-Artificial Intelligence Teaming for the U.S. Navy: Developing a Holistic Research Roadmap. Proceedings of the Human Factors and Ergonomics Society Annual Meeting
- Gutzwiller, R. S., & Van Bruggen, D. (2021). Human factors in automating cyber operations. Proceedings of the 54th Hawaii International Conference on System Sciences. [and see video of the talk on my main page]
- Gutzwiller, R. S., & Reeder, J. (2020). Dances with algorithms: Interactive development creates greater preference and trust in machine-learned behaviors. Human Factors, 63(5), 854-867
- Gutzwiller, R. S., Chiou, E. K., Craig, S. D., Lewis, C. M., Lematta, G. J., & Hsiung, Chi-Ping. (2019). Positive bias in the 'Trust in Automated Systems Survey'? An examination of the Jian et al. (2000) scale. Human Factors and Ergonomics Society Annual Meeting.
- Shulte, A., Donath, D., Lange, D., & Gutzwiller, R. S. (2018). A heterarchical urgency-based design pattern for human automation interaction. Human Computer Interaction International.
- Gutzwiller, R. S., Espinosa, S. H., Kenny, C., & Lange, D. S. (2018). A design pattern for working agreements in human-autonomy teaming. Advances in Intelligent Systems and Computing, 591, 12–24.
- Dzieciuch, I., Reeder, J., Gutzwiller, R. S., Gustafson, E., Coronado, B., Martinez, L., … Lange, D. S. (2017). Amplifying human ability through autonomics and machine learning in IMPACT. Proceedings of SPIE Micro- and Nanotechnology Sensors, Systems, and Applications IX, 10194, 101941Y1-11.
- Gutzwiller, R. S., & Lange, D. S. (2016). Tasking teams: Supervisory control and task management of autonomous unmanned systems. In International Conference on Virtual, Augmented and Mixed Reality (pp. 397-405). Springer International Publishing.
- Lange, D. S., & Gutzwiller, R. S. (2016). Human-autonomy teaming patterns in the command and control of teams of autonomous systems. In International Conference on Engineering Psychology and Cognitive Ergonomics (pp. 179-188). Springer International Publishing.
- Gutzwiller, R. S., Lange, D. S., Reeder, J., Morris, R. L., & Rodas, O. (2015). Human-computer collaboration in adaptive supervisory control and function allocation of autonomous system teams. In International Conference on Virtual, Augmented and Mixed Reality (pp. 447-456). Springer International Publishing.
- Clegg, B. A., Vieane, A., Wickens, C. D., Gutzwiller, R. S., & Sebok, A. (2014). The effects of automation-induced complacency on fault diagnosis and management performance in process control. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 58, 844-848.
- Lange, D. S., Gutzwiller, R. S., Verbancsics, P., & Sin, T. (2014). Task models for human-computer collaboration in supervisory control of teams of autonomous systems. IEEE Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA, 97-102.
- Gutzwiller, R. S., Clegg, B. A., & Blitch, J. G. (2013, invited). Part-task training in the context of automation: Current and future directions. American Journal of Psychology, 126(4), 417-432.
- Gutzwiller, R. S., & Clegg, B. A. (2013). The role of working memory in levels of situation awareness. Journal of Cognitive Engineering and Decision Making, 7(2), 141-154.
- Gutzwiller, R. S., Clegg, B. A., Smith, C. A. P., Lewis, J. L., & Patterson, J. D. (2013). Predicted failure alerting in a supervisory control task does not always enhance performance. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 57, 364-368.
- Lange, D., Verbanscics, P., Gutzwiller, R. S., & Reeder, J. (2013). Trust in sparse supervisory control. Trust and Autonomous Systems: Papers from the 2013 AAAI Spring Symposium, 39-43.
- Gutzwiller, R. S., & Clegg, B. A. (2012). Training for unmanned vehicle allocation with automation in a dynamic microworld. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 56, 2497-2501.
- Blitch, J. G., Bauder, C. J., Gutzwiller, R. S., & Clegg, B. A. (2012). Correlations of spatial orientation with simulation based robot operator training. Proceedings of the 4th International Conference on Applied Human Factors & Ergonomics (AHFE).
- Lange, D., Verbanscics, P., Gutzwiller, R. S., Reeder, J., & Sarles, C. (2012). Command and control of teams of autonomous systems. Proceedings of the 17th Monterey Workshop for the Development, Operation and Management of Large-Scale Complex IT Systems, Oxford, UK.
- Heggestad, E. D., Clegg, B. A., Goh, A., & Gutzwiller, R. S. (2012). How automation-based training aides and learner cognitive abilities impact training effectiveness. In A. Healy and L. Bourne (Eds.), Training cognition: Optimizing efficiency, durability, and generalizability (pp. 112-133). New York, NY: Taylor & Francis.
Cyber Security
- Gutzwiller, R. S., Fugate, S. J., Lukos, J. & Weigand, K. (2024). A Novel Visual Interface Enables Human Detection of Malware in Portable Document Format. Journal of Cybersecurity.
- Gutzwiller, R. S., Rheem, H., Ferguson-Walter, K. J., Lewis, C. M., Johnson, C. K., & Major, M. (2023). Exploratory analysis of decision-making biases of professional red teamers in a cyber-attack dataset. Journal of Cognitive Engineering & Decision Making.
- Ferguson-Walter, K.J., Major, M., Johnson, C. K., Johnson, C. J., Scott, D. D., Gutzwiller, R.S., & Shade, T. B. (2023). Cyber Expert Feedback: Experiences, Expectations, and Opinions About Cyber Deception. Computers & Security.
- Gutzwiller, R. S., Gilbert, M., Drescher, T.J., Ferguson-Walter, K. J., Mikanda, N., Johnson, C. J., & Scott, D. (2023). Frustration, Confusion, Surprise, Confidence, and Self-doubt: Cyber Operators’ Affects during a Realistic Experiment. Proceedings of the Human Factors and Ergonomics Annual Conference.
- Johnson, C. J., Ferguson-Walter, K. J., Gutzwiller, R. S., Scott, D., & Cooke, N. J. (2022). Investigating Cyber Attacker Team Cognition. Proceedings of the Human Factors and Ergonomics Annual Conference.
- Ferguson-Walter, K. J., Gutzwiller, R. S., Scott, D., & Johnson, C. J. (2021). Oppositional human factors in cybersecurity: A preliminary analysis of affective states. Workshop on Human-Centric Software Engineering & Cyber Security (HCSE&CS-2021)
- Johnson, C. K., Gutzwiller, R. S., Gervais, J., Ferguson-Walter, K. J., Fugate, S. J., & Bilinski, M. (2021). Decision-making biases and cyber attackers. Workshop on Human-Centric Software Engineering & Cyber Security (HCSE&CS-2021)
- Gutzwiller, R. S., Dykstra, J., & Payne, B. (2020). Gaps and opportunities in situational awareness for cybersecurity. Digital Threats: Research and Practice, 1(3), 1-6.
- Das, S., Gutzwiller, R. S., Roscoe, R. D., Rajivan, P., Wang, Y., Camp, L. J., & Hoyle, R. (2020). Humans and technology for inclusive privacy and security. Human Factors and Ergonomics Society Annual Meeting, 2020.
- Gutzwiller, R. S., Ferguson-walter, K. J., & Fugate, S. J. (2019). Are Cyber Attackers Thinking Fast and Slow? Exploratory Analysis Reveals Evidence of Decision-Making Biases in Red Teamers. Proceedings of the Human Factors and Ergonomics Society Meeting
- Ferguson-Walter, K., Major, M., van Bruggen, D. C., Fugate, S., & Gutzwiller, R. S. (2019).The World of CTF is Not Enough Data: Lessons Learned from a Cyber Deception Experiment. IEEE Workshop on Human Aspects of Cybersecurity.
- Nyre-Yu, M., Gutzwiller, R. S., & Caldwell, B. S. (2019). Observing Cyber Security Incident Response: Qualitative Themes From Field Research. Proceedings of the Human Factors and Ergonomics Society Meeting.
- Gutzwiller, R. S., Cosley, D., Ferguson-Walter, K. J., Fraze, D., & Rahmer, R. (2019). Panel: Research Sponsors for Cybersecurity Research and the Human Factor. Proceedings of the Human Factors and Ergonomics Society Meeting.
- Paul, C., Blaha, L., Bos, N., Fallon, C., Gonzalez, C., & Gutzwiller, R. S. (2019). Opportunities and challenges for human-machine teaming in cybersecurity operations. Proceedings of the Human Factors and Ergonomics Society Meeting
- Gutzwiller, R. S. (2019) Situation Awareness in Defensive Cyberspace Operations: An Annotated Bibliographic Assessment Through 2015. NIWC/ONR Technical Report TR-3184.
- Gutzwiller, R. S.*, Ferguson-Walter, K., Fugate, S., & Rogers, A. (2018) "Oh, look! A butterfly!" A framework for distracting attackers. Proceedings of the Human Factors and Ergonomics Society 2018. *Won the Marc Resnick Best Paper Award.
- Borghetti, B., Funke, G., Pastel, R., & Gutzwiller, R. S. (2017). Cyber human research from the cyber operator’s view. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 61, 350.
- Vieane, A. Z., Funke, G. J., Gutzwiller, R. S., Mancuso, V. F., Sawyer, B. D., & Wickens, C. D. (2016). Addressing human factors gaps in cyber defense. Proceedings of the Human Factors and Ergonomics Society, 60, 770–773.
- Fugate, S., Lukos, J., Gutzwiller, R. S., & Lester, C. (2016). Position paper: Proposing ambient visualization and pre-attentive processing for threat detection. In ACM International Conference Proceeding Series (Vol. Part F1306).
- Gutzwiller, R. S., Hunt, S., & Lange, D. S. (2016). Cyber-cognitive situation awareness (CCSA) in cyber defense: An initial cognitive task analysis. IEEE Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA (pp. 14-20).
- Gutzwiller, R. S., Fugate, S., Sawyer, B., & Hancock, P. A. (2015). The human factors of cyber network defense. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 59, 322-326. *Nominated for best paper award.
*italics denote student contribution
Context-driven Interventions through Reasoning about Cyberpsychology Exploitation
Cognitive Human Enhancements for Cyber Reasoning Systems (DARPA)
Oppositional Human Factors (OHF) Research (DOD)
Predicting automation surprise using attentional modeling (ASU GSI)
Designing Effective Intervention Points for Adversarial Influence Operations (MITLL)
Tools for Implementing Speech Agents in Crew Resource Management Training Systems (ONR)
Courses
2025 Spring
Course Number | Course Title |
---|---|
HSE 225 | Human Systems Integration |
HSE 594 | Conference and Workshop |
HSE 494 | Special Topics |
HSE 598 | Special Topics |
2024 Fall
Course Number | Course Title |
---|---|
HSE 225 | Human Systems Integration |
2024 Summer
Course Number | Course Title |
---|---|
HSE 799 | Dissertation |
2024 Spring
Course Number | Course Title |
---|---|
HSE 792 | Research |
HSE 225 | Human Systems Integration |
HSE 493 | Honors Thesis |
HSE 592 | Research |
HSE 599 | Thesis |
HSE 799 | Dissertation |
HSE 594 | Conference and Workshop |
HSE 492 | Honors Directed Study |
HSE 593 | Applied Project |
HSE 792 | Research |
HSE 494 | Special Topics |
HSE 598 | Special Topics |
2023 Fall
Course Number | Course Title |
---|---|
HSE 592 | Research |
HSE 599 | Thesis |
HSE 492 | Honors Directed Study |
HSE 225 | Human Systems Integration |
HSE 592 | Research |
HSE 593 | Applied Project |
HSE 792 | Research |
HSE 799 | Dissertation |
2023 Summer
Course Number | Course Title |
---|---|
HSE 592 | Research |
HSE 792 | Research |
HSE 584 | Internship |
HSE 792 | Research |
HSE 792 | Research |
HSE 584 | Internship |
2023 Spring
Course Number | Course Title |
---|---|
HSE 792 | Research |
HSE 225 | Human Systems Integration |
HSE 493 | Honors Thesis |
HSE 592 | Research |
HSE 599 | Thesis |
HSE 101 | Human Systems Engineering |
HSE 799 | Dissertation |
HSE 594 | Conference and Workshop |
HSE 492 | Honors Directed Study |
HSE 593 | Applied Project |
HSE 792 | Research |
2022 Fall
Course Number | Course Title |
---|---|
HSE 592 | Research |
HSE 599 | Thesis |
HSE 492 | Honors Directed Study |
HSE 225 | Human Systems Integration |
HSE 592 | Research |
HSE 593 | Applied Project |
HSE 792 | Research |
HSE 799 | Dissertation |
2022 Summer
Course Number | Course Title |
---|---|
HSE 592 | Research |
HSE 584 | Internship |
HSE 792 | Research |
HSE 792 | Research |
HSE 584 | Internship |
2022 Spring
Course Number | Course Title |
---|---|
HSE 792 | Research |
HSE 592 | Research |
HSE 599 | Thesis |
HSE 799 | Dissertation |
HSE 594 | Conference and Workshop |
HSE 494 | Special Topics |
HSE 598 | Special Topics |
HSE 593 | Applied Project |
2021 Fall
Course Number | Course Title |
---|---|
HSE 592 | Research |
HSE 599 | Thesis |
HSE 792 | Research |
HSE 799 | Dissertation |
HSE 225 | Human Systems Integration |
HSE 592 | Research |
HSE 593 | Applied Project |
2021 Summer
Course Number | Course Title |
---|---|
HSE 792 | Research |
HSE 592 | Research |
HSE 584 | Internship |
2021 Spring
Course Number | Course Title |
---|---|
HSE 792 | Research |
HSE 599 | Thesis |
HSE 799 | Dissertation |
HSE 594 | Conference and Workshop |
HSE 494 | Special Topics |
HSE 598 | Special Topics |
HSE 593 | Applied Project |
HSE 592 | Research |
HSE 499 | Individualized Instruction |
2020 Fall
Course Number | Course Title |
---|---|
HSE 592 | Research |
HSE 599 | Thesis |
HSE 792 | Research |
HSE 799 | Dissertation |
HSE 225 | Human Systems Integration |
2020 Summer
Course Number | Course Title |
---|---|
HSE 792 | Research |
HSE 592 | Research |
2020 Spring
Course Number | Course Title |
---|---|
HSE 792 | Research |
HSE 592 | Research |
HSE 599 | Thesis |
HSE 799 | Dissertation |
HSE 594 | Conference and Workshop |
HSE 494 | Special Topics |
HSE 598 | Special Topics |
HSE 590 | Reading and Conference |
- Lightning Bolt Innovation Team Award, for project work on DAISEY, 2019, Naval Information Warfare Center (U.S. Navy Research Lab).
- Marc Resnick Best Paper Award, 2018, Human Factors and Ergonomics Society.
- Exemplary Achievement Award, 2018, SPAWAR, U.S. Navy.
- Jerome H. Ely Award for the best paper in the Human Factors Journal, 2017, Human Factors and Ergonomics Society.
- Distinguished Achievement in Leadership, 2017, Command and Control Department, SPAWAR, U.S. Navy.
- David P. McCabe Excellence in Research Award, 2014, Colorado State University.
- Science Mathematics And Research for Transformation (SMART) Scholarship Award, 2012-2014, U.S. Department of Defense.
- Naval Research Enterprise Internship Award, 2012, Office of Naval Research.
- Naval Research Enterprise Internship Award, 2011, Office of Naval Research.
- Graduate Fellowship, 2008-2012, Department of Psychology, Colorado State University.
- President’s Baylor Scholarship, 2004, Baylor University.
Editorial Board, Human Factors Journal
Membership
- Human Factors and Ergonomics Society (Full Member)
- American Association for the Advancement of Science
- Society for Applied Research in Memory and Cognition
For information on my mentorship experience, please check out my CV.
For information on my work experience, please check out my CV
For information on my service activities, please check out my CV
InnoVenn - medical device design
Voting Member, U.S. Navy Institutional Review Board (IRB), at NIWC Pacific (2016-2018)
Civilian Scientist, US Navy (2014-2018)