Robert Gutzwiller
-
The Polytechnic School Campus SANTA CATALINA HALL (SANCA) Rm. 150E Mesa, AZ 85209
-
Mail code: 2880Campus: Poly
-
Robert Gutzwiller studies the critical role of the human in complex systems. His work scientifically applies cognitive engineering to cyberspace, transportation, and defense. His recent research also focuses on engineering human attention (How do humans select what task to do when they are multitasking and overwhelmed, and can models predict this behavior?), human-automation interaction (How do humans learn to interact with and trust complex systems, particularly those which use automation, artificial intelligence, and machine learning?), and defensive cyberspace operations (How does a cyber analyst protecting networks develop awareness? Could cognitive techniques be used against would-be attackers to make defenses more robust? How can we build automated defenses that operators trust and understand?).
Gutzwiller has been funded and worked on projects for the Army Research Office, Assistant Secretary of Defense, DARPA, NASA, and the Office of Naval Research, among others.
He is the author of more than 55 peer-reviewed papers cited more than 1866 times, received the Human Factors Society’s Jerome H. Ely Award for the most outstanding journal article, and the Marc Resnick best paper award. Gutzwiller has been recognized for exceptional leadership and mentoring across several multi-disciplinary engineering projects in cyberspace and ship defense systems, receiving leadership and exemplary achievement awards from the United States Navy.
Interested in the lab as a student or professional? Gutzwiller heads the Applied Attention Research (AAR) Laboratory.
- Ph.D. Cognitive Psychology, Colorado State University 2014
- M.S. Cognitive Psychology, Colorado State University 2011
- B.S. Psychology, Baylor University 2008
Gutzwiller's academic lineage includes Paul Fitts, Dick Pew, Mike Posner, Chris Wickens and Ben Clegg.
attention, human-automation interaction, human-interactive machine learning, multitasking, modeling attention in overloading conditions, human factors in cyberspace defense & cybersecurity
Multitasking, Task Switching, and Attention Modeling under Mental Overload (STOM)
- Rheem, H., Steelman, K., & Gutzwiller, R. S. (2021). SEEV Modeler: A GUI-Based Tool for the SEEV Model Simulation. Proceedings of the Human Factors and Ergonomics Society Annual Meeting
- Zabala, G., & Gutzwiller, R. S. (2021). Validating the Strategic Task Overload Management (STOM) Model Using MATB II and Eye-tracking. Proceedings of the Human Factors and Ergonomics Society Annual Meeting
- Gutzwiller, R. S., Wickens, C. D., & Clegg, B. A. (2019). The role of reward and effort over time in task switching. Theoretical Issues in Ergonomics Science, 20(2), 196-214.
- Wickens, C. D., & Gutzwiller, R. S. (2017). The status of the Strategic Task Overload Model (STOM) for predicting multi-task management. Proceedings of the Human Factors and Ergonomics Society, 61, 757–761
- Gutzwiller, R. S., & Sitzman, D. M. (2017). Examining task priority effects in multi-task management. Proceedings of the Human Factors and Ergonomics Society, 61, 762–766.
- Wickens, C. D., Gutzwiller, R. S., Vieane, A., Clegg, B. A., & Janes, J. (2016). Time sharing between robotics and process control: Validating a model of attention switching. Human Factors, 58(2), 322-343. *Won the Jerome H. Ely Award for Most Outstanding Paper in Human Factors.
- Wickens, C. D., Gutzwiller, R. S., & Santamaria, A. (2015). Discrete task switching in overload: A meta-analyses and a model. Special issue of International Journal of Human Computer Studies, 79, 79-84.
- Gutzwiller, R. S., Wickens, C. D., & Clegg, B. A. (2015). The role of individual differences in the executive attentional network in switching choice and multi-task management. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 59, 632-636.
- Clegg, B. A., Wickens, C. D., Vieane, A., Gutzwiller, R. S., & Sebok, A. (2015). Circadian effects on fault management and multitasking. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 59, 627-631.
- Gutzwiller, R. S., Wickens, C. D., & Clegg, B. A. (2014). Workload overload modeling: An experiment with MATB II to inform a computational model of task management. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 58, 849-853.
- Blalock, L. D., Sawyer, B., Kiken, A., Gutzwiller, R. S., McGill, C. L., & Clegg, B. A. (2014). Cognitive load while driving impairs memory of moving but not stationary elements within the environment. Journal of Applied Research in Memory and Cognition, 5(2), 95-100.
Human Automation Interaction, Supervisory Control, Training with Automation, and Interactive Machine Learning
- Gutzwiller, R. S., & Reeder, J. (2020). Dances with algorithms: Interactive development creates greater preference and trust in machine-learned behaviors. Human Factors, 63(5), 854-867
- Gutzwiller, R. S., Chiou, E. K., Craig, S. D., Lewis, C. M., Lematta, G. J., & Hsiung, Chi-Ping. (2019). Positive bias in the 'Trust in Automated Systems Survey'? An examination of the Jian et al. (2000) scale. Human Factors and Ergonomics Society Annual Meeting.
- Shulte, A., Donath, D., Lange, D., & Gutzwiller, R. S. (2018). A heterarchical urgency-based design pattern for human automation interaction. Human Computer Interaction International.
- Gutzwiller, R. S., Espinosa, S. H., Kenny, C., & Lange, D. S. (2018). A design pattern for working agreements in human-autonomy teaming. Advances in Intelligent Systems and Computing, 591, 12–24.
- Dzieciuch, I., Reeder, J., Gutzwiller, R. S., Gustafson, E., Coronado, B., Martinez, L., … Lange, D. S. (2017). Amplifying human ability through autonomics and machine learning in IMPACT. Proceedings of SPIE Micro- and Nanotechnology Sensors, Systems, and Applications IX, 10194, 101941Y1-11.
- Gutzwiller, R. S., & Lange, D. S. (2016). Tasking teams: Supervisory control and task management of autonomous unmanned systems. In International Conference on Virtual, Augmented and Mixed Reality (pp. 397-405). Springer International Publishing.
- Lange, D. S., & Gutzwiller, R. S. (2016). Human-autonomy teaming patterns in the command and control of teams of autonomous systems. In International Conference on Engineering Psychology and Cognitive Ergonomics (pp. 179-188). Springer International Publishing.
- Gutzwiller, R. S., Lange, D. S., Reeder, J., Morris, R. L., & Rodas, O. (2015). Human-computer collaboration in adaptive supervisory control and function allocation of autonomous system teams. In International Conference on Virtual, Augmented and Mixed Reality (pp. 447-456). Springer International Publishing.
- Clegg, B. A., Vieane, A., Wickens, C. D., Gutzwiller, R. S., & Sebok, A. (2014). The effects of automation-induced complacency on fault diagnosis and management performance in process control. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 58, 844-848.
- Lange, D. S., Gutzwiller, R. S., Verbancsics, P., & Sin, T. (2014). Task models for human-computer collaboration in supervisory control of teams of autonomous systems. IEEE Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA, 97-102.
- Gutzwiller, R. S., Clegg, B. A., & Blitch, J. G. (2013, invited). Part-task training in the context of automation: Current and future directions. American Journal of Psychology, 126(4), 417-432.
- Gutzwiller, R. S., & Clegg, B. A. (2013). The role of working memory in levels of situation awareness. Journal of Cognitive Engineering and Decision Making, 7(2), 141-154.
- Gutzwiller, R. S., Clegg, B. A., Smith, C. A. P., Lewis, J. L., & Patterson, J. D. (2013). Predicted failure alerting in a supervisory control task does not always enhance performance. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 57, 364-368.
- Lange, D., Verbanscics, P., Gutzwiller, R. S., & Reeder, J. (2013). Trust in sparse supervisory control. Trust and Autonomous Systems: Papers from the 2013 AAAI Spring Symposium, 39-43.
- Gutzwiller, R. S., & Clegg, B. A. (2012). Training for unmanned vehicle allocation with automation in a dynamic microworld. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 56, 2497-2501.
- Blitch, J. G., Bauder, C. J., Gutzwiller, R. S., & Clegg, B. A. (2012). Correlations of spatial orientation with simulation based robot operator training. Proceedings of the 4th International Conference on Applied Human Factors & Ergonomics (AHFE).
- Lange, D., Verbanscics, P., Gutzwiller, R. S., Reeder, J., & Sarles, C. (2012). Command and control of teams of autonomous systems. Proceedings of the 17th Monterey Workshop for the Development, Operation and Management of Large-Scale Complex IT Systems, Oxford, UK.
- Heggestad, E. D., Clegg, B. A., Goh, A., & Gutzwiller, R. S. (2012). How automation-based training aides and learner cognitive abilities impact training effectiveness. In A. Healy and L. Bourne (Eds.), Training cognition: Optimizing efficiency, durability, and generalizability (pp. 112-133). New York, NY: Taylor & Francis.
Cyber Security, Situation Awareness in Cyber Defense, and Oppositional Human Factors
- Ferguson-Walter, K.J., Major, M., Johnson, C. K., Johnson, C. J., Scott, D. D., Gutzwiller, R.S., & Shade, T. B. (in press). Cyber Expert Feedback: Experiences, Expectations, and Opinions About Cyber Deception. Computers & Security
- Gutzwiller, R. S., Gilbert, M., Drescher, T.J., Ferguson-Walter, K. J., Mikanda, N., Johnson, C. J., & Scott, D. (in press). Frustration, Confusion, Surprise, Confidence, and Self-doubt: Cyber Operators’ Affects during a Realistic Experiment. Proceedings of the Human Factors and Ergonomics Annual Conference.
- Johnson, C. J., Ferguson-Walter, K. J., Gutzwiller, R. S., Scott, D., & Cooke, N. J. (2022). Investigating Cyber Attacker Team Cognition. Proceedings of the Human Factors and Ergonomics Annual Conference.
- Ferguson-Walter, K. J., Gutzwiller, R. S., Scott, D., & Johnson, C. J. (2021). Oppositional human factors in cybersecurity: A preliminary analysis of affective states. Workshop on Human-Centric Software Engineering & Cyber Security (HCSE&CS-2021)
- Johnson, C. K., Gutzwiller, R. S., Gervais, J., Ferguson-Walter, K. J., Fugate, S. J., & Bilinski, M. (2021). Decision-making biases and cyber attackers. Workshop on Human-Centric Software Engineering & Cyber Security (HCSE&CS-2021)
- Gutzwiller, R. S., & Van Bruggen, D. (2021). Human factors in automating cyber operations. Proceedings of the 54th Hawaii International Conference on System Sciences.
- Gutzwiller, R. S., Dykstra, J., & Payne, B. (2020). Gaps and opportunities in situational awareness for cybersecurity. Digital Threats: Research and Practice, 1(3), 1-6.
- Das, S., Gutzwiller, R. S., Roscoe, R. D., Rajivan, P., Wang, Y., Camp, L. J., & Hoyle, R. (2020). Humans and technology for inclusive privacy and security. Human Factors and Ergonomics Society Annual Meeting, 2020.
- Gutzwiller, R. S., Ferguson-walter, K. J., & Fugate, S. J. (2019). Are Cyber Attackers Thinking Fast and Slow? Exploratory Analysis Reveals Evidence of Decision-Making Biases in Red Teamers. Proceedings of the Human Factors and Ergonomics Society Meeting
- Ferguson-Walter, K., Major, M., van Bruggen, D. C., Fugate, S., & Gutzwiller, R. S. (2019).The World of CTF is Not Enough Data: Lessons Learned from a Cyber Deception Experiment. IEEE Workshop on Human Aspects of Cybersecurity.
- Nyre-Yu, M., Gutzwiller, R. S., & Caldwell, B. S. (2019). Observing Cyber Security Incident Response: Qualitative Themes From Field Research. Proceedings of the Human Factors and Ergonomics Society Meeting.
- Gutzwiller, R. S., Cosley, D., Ferguson-Walter, K. J., Fraze, D., & Rahmer, R. (2019). Panel: Research Sponsors for Cybersecurity Research and the Human Factor. Proceedings of the Human Factors and Ergonomics Society Meeting.
- Paul, C., Blaha, L., Bos, N., Fallon, C., Gonzalez, C., & Gutzwiller, R. S. (2019). Opportunities and challenges for human-machine teaming in cybersecurity operations. Proceedings of the Human Factors and Ergonomics Society Meeting
- Gutzwiller, R. S. (2019) Situation Awareness in Defensive Cyberspace Operations: An Annotated Bibliographic Assessment Through 2015. NIWC/ONR Technical Report TR-3184.
- Gutzwiller, R. S.*, Ferguson-Walter, K., Fugate, S., & Rogers, A. (2018) "Oh, look! A butterfly!" A framework for distracting attackers. Proceedings of the Human Factors and Ergonomics Society 2018. *Won the Marc Resnick Best Paper Award.
- Borghetti, B., Funke, G., Pastel, R., & Gutzwiller, R. S. (2017). Cyber human research from the cyber operator’s view. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 61, 350.
- Vieane, A. Z., Funke, G. J., Gutzwiller, R. S., Mancuso, V. F., Sawyer, B. D., & Wickens, C. D. (2016). Addressing human factors gaps in cyber defense. Proceedings of the Human Factors and Ergonomics Society, 60, 770–773.
- Fugate, S., Lukos, J., Gutzwiller, R. S., & Lester, C. (2016). Position paper: Proposing ambient visualization and pre-attentive processing for threat detection. In ACM International Conference Proceeding Series (Vol. Part F1306).
- Gutzwiller, R. S., Hunt, S., & Lange, D. S. (2016). Cyber-cognitive situation awareness (CCSA) in cyber defense: An initial cognitive task analysis. IEEE Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA (pp. 14-20).
- Gutzwiller, R. S., Fugate, S., Sawyer, B., & Hancock, P. A. (2015). The human factors of cyber network defense. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 59, 322-326. *Nominated for best paper award.
-- and check out the recent HFES webinar which featured Dr. Gutzwiller along with two other cyber researchers.
*italics denote student contribution
Cognitive Human Enhancements for Cyber Reasoning Systems (DARPA)
Oppositional Human Factors (OHF) Research (DOD)
Predicting automation surprise using attentional modeling (ASU GSI)
Designing Effective Intervention Points for Adversarial Influence Operations (MITLL)
Tools for Implementing Speech Agents in Crew Resource Management Training Systems (ONR)
Courses
2023 Fall
Course Number | Course Title |
---|---|
HSE 592 | Research |
HSE 599 | Thesis |
HSE 492 | Honors Directed Study |
HSE 225 | Human Systems Integration |
HSE 592 | Research |
HSE 593 | Applied Project |
HSE 792 | Research |
HSE 799 | Dissertation |
2023 Summer
Course Number | Course Title |
---|---|
HSE 592 | Research |
HSE 792 | Research |
HSE 584 | Internship |
HSE 792 | Research |
HSE 792 | Research |
HSE 584 | Internship |
2023 Spring
Course Number | Course Title |
---|---|
HSE 792 | Research |
HSE 225 | Human Systems Integration |
HSE 493 | Honors Thesis |
HSE 592 | Research |
HSE 599 | Thesis |
HSE 101 | Human Systems Engineering |
HSE 799 | Dissertation |
HSE 594 | Conference and Workshop |
HSE 492 | Honors Directed Study |
HSE 593 | Applied Project |
HSE 792 | Research |
2022 Fall
Course Number | Course Title |
---|---|
HSE 592 | Research |
HSE 599 | Thesis |
HSE 492 | Honors Directed Study |
HSE 225 | Human Systems Integration |
HSE 592 | Research |
HSE 593 | Applied Project |
HSE 792 | Research |
HSE 799 | Dissertation |
2022 Summer
Course Number | Course Title |
---|---|
HSE 592 | Research |
HSE 584 | Internship |
HSE 792 | Research |
HSE 792 | Research |
HSE 584 | Internship |
2022 Spring
Course Number | Course Title |
---|---|
HSE 792 | Research |
HSE 592 | Research |
HSE 599 | Thesis |
HSE 799 | Dissertation |
HSE 594 | Conference and Workshop |
HSE 494 | Special Topics |
HSE 598 | Special Topics |
HSE 593 | Applied Project |
2021 Fall
Course Number | Course Title |
---|---|
HSE 592 | Research |
HSE 599 | Thesis |
HSE 792 | Research |
HSE 799 | Dissertation |
HSE 225 | Human Systems Integration |
HSE 592 | Research |
HSE 593 | Applied Project |
2021 Summer
Course Number | Course Title |
---|---|
HSE 792 | Research |
HSE 592 | Research |
HSE 584 | Internship |
2021 Spring
Course Number | Course Title |
---|---|
HSE 792 | Research |
HSE 599 | Thesis |
HSE 799 | Dissertation |
HSE 594 | Conference and Workshop |
HSE 494 | Special Topics |
HSE 598 | Special Topics |
HSE 593 | Applied Project |
HSE 592 | Research |
HSE 499 | Individualized Instruction |
2020 Fall
Course Number | Course Title |
---|---|
HSE 592 | Research |
HSE 599 | Thesis |
HSE 792 | Research |
HSE 799 | Dissertation |
HSE 225 | Human Systems Integration |
2020 Summer
Course Number | Course Title |
---|---|
HSE 792 | Research |
HSE 592 | Research |
2020 Spring
Course Number | Course Title |
---|---|
HSE 792 | Research |
HSE 592 | Research |
HSE 599 | Thesis |
HSE 799 | Dissertation |
HSE 594 | Conference and Workshop |
HSE 494 | Special Topics |
HSE 598 | Special Topics |
HSE 590 | Reading and Conference |
2019 Fall
Course Number | Course Title |
---|---|
HSE 592 | Research |
HSE 594 | Conference and Workshop |
HSE 599 | Thesis |
HSE 792 | Research |
HSE 799 | Dissertation |
HSE 593 | Applied Project |
HSE 494 | Special Topics |
HSE 598 | Special Topics |
2019 Spring
Course Number | Course Title |
---|---|
HSE 792 | Research |
HSE 592 | Research |
HSE 599 | Thesis |
PSY 560 | Advances/Theoretical Psych |
HSE 593 | Applied Project |
HSE 799 | Dissertation |
HSE 494 | Special Topics |
HSE 598 | Special Topics |
HSE 792 | Research |
- Lightning Bolt Innovation Team Award, for project work on DAISEY, 2019, Naval Information Warfare Center (U.S. Navy Research Lab).
- Marc Resnick Best Paper Award, 2018, Human Factors and Ergonomics Society.
- Exemplary Achievement Award, 2018, SPAWAR, U.S. Navy.
- Jerome H. Ely Award for the best paper in the Human Factors Journal, 2017, Human Factors and Ergonomics Society.
- Distinguished Achievement in Leadership, 2017, Command and Control Department, SPAWAR, U.S. Navy.
- David P. McCabe Excellence in Research Award, 2014, Colorado State University.
- Science Mathematics And Research for Transformation (SMART) Scholarship Award, 2012-2014, U.S. Department of Defense.
- Naval Research Enterprise Internship Award, 2012, Office of Naval Research.
- Naval Research Enterprise Internship Award, 2011, Office of Naval Research.
- Graduate Fellowship, 2008-2012, Department of Psychology, Colorado State University.
- President’s Baylor Scholarship, 2004, Baylor University.
Membership
- Human Factors and Ergonomics Society (Full Member)
- American Association for the Advancement of Science
- Society for Applied Research in Memory and Cognition
DISSERTATIONS
As chair:
- Chelsea Johnson (Arizona State University) – Cybersecurity and biases in decision making. Fall 2020.
- David Wallace (Arizona State University) -- Design and test of a quick catch medical apparatus. Spring 2021.
- Raghav Bhatt (Arizona State University) -- Undecided Topic.
As member:
- David Stinson (Arizona State University) – Team multitasking. Spring 2021.
- Verica Buchanan (Arizona State University) – Cybersecurity and human factors. Fall 2020.
- Glenn Lematta (Arizona State University) – Human machine teaming. Spring 2022.
- ‡ Hansol Rheem (Arizona State University) – Completed Fall 2019. Exploration of methods of implicit bias detection.
- ‡ Mollie McGuire (Claremont University) – Completed Fall 2016. Prospective memory, stress and unmanned system command and control.
MASTERS THESES
As chair:
- Garrett Zabala (Arizona State University). Spring 2020.
- Christina Lewis (Arizona State University). Spring 2021.
- Jimin (Joy) Kim (Arizona State University). SPring 2021.
As member:
- R. J. Curley (Arizona State University). Summer 2021.
- Akuadasuo Ezenyilimba (Arizona State University). Summer 2021.
- Matthew Willett (Arizona State University). Fall 2021.
- Craig Johnson (Arizona State University). Fall 2020.
- Shawaiz Bhatti (Arizona State University). Spring 2021.
- Christopher Lieber (Arizona State University). Spring 2021.
- ‡ Earl Radina (Arizona State University). Completed Spring 2019
- ‡ Alyssa Thompson (Arizona State University). Completed Spring 2019
*for more on my mentorship experience, please view my CV.
For information on my work experience, please check out my CV
Establishing Chair, Cybersecurity Technical Group, Human Factors and Ergonomics Society (2019-present). See more information here.
Grant Reviewer
- DARPA (Defense Advanced Research Projects Agency)
- ONR Global (Office of Naval Research)
Journal Reviewer
Appetite
Acta Psychologia
Computational Brain & Behavior
Ergonomics
IEEE Presence
IEEE Systems, Man, & Cybernetics
IEEE Transactions on Human-Machine Systems
International Journal of Human-Computer Interaction
International Journal of Human-Computer Studies
International Journal of Social Robotics
Human Factors Journal
Human Performance
Journal of Applied Research in Memory & Cognition
Journal of Cognitive Engineering & Decision Making
Journal of Cyber Security Technology
Journal of Experimental Psychology: Applied
Memory & Cognition
Reviewer for Human Factors and Ergonomics Society (HFES): including society awards, best paper competitions, technical group awards, workshops, panels, and general conference submissions:
- * Jerome H. Ely Best Journal Article Award (2018 reviewer)
- Augmented Cognition Technical Group
- Cognitive Engineering & Decision Making Technical Group
- Computer Systems Technical Group
- Cybersecurity Technical Group
- Human Performance Modeling Technical Group
- Internet Technical Group
- Perception and Performance Technical Group
- Training Technical Group
Institutional Review Board (IRB) Member, Active voting member, Held 2016 – 2018. Space and Naval Warfare Systems Center (SPAWAR) Pacific, U.S. Navy.
Track Leader, Organizer -- Cybersecurity ERGOX Conference. (2020, 2021) Organized conference and workshop sessions over several days for an entirely new track, Cybersecurity.
InnoVenn - medical device design
Civilian Scientist, US Navy (2014-2018)