Naturalistic Decision Making

Adam Lary is a distinguished graduate of the United States Military Academy class of 2010 with a B.S. in Engineering Psychology. His subsequent military career spanned 10 years in the U.S. Army as an Infantry officer and included Ranger school, Airborne school, and multiple combat deployments to Afghanistan and Iraq in various leadership roles. Adam transitioned out of the military in 2020 and went on to earn his M.S. in Human Factors from Embry-Riddle Aeronautical University. While completing his degree, he worked as a Human Factors Researcher conducting usability studies on electronic health record software before changing roles to lead a team of Human Factors Engineers at Garmin International, where he specializes in designing user interfaces for advanced aircraft avionics. His team spearheads human factors research initiatives focused on optimizing avionics usability and ensuring compliance with human factors regulations. Adam's blend of military leadership and human factors expertise brings a unique perspective to operationalizing human factors research and advancing aviation safety through human-centered design principles and practices.Learn more about Adam: ⁠⁠⁠Adam's LinkedInWhere to find the hosts:Brian Moon⁠⁠⁠Brian’s website⁠⁠⁠⁠⁠⁠Brian’s LinkedIn⁠⁠⁠⁠⁠⁠Brian’s Twitter⁠⁠⁠Laura Militello⁠⁠⁠Laura’s website⁠⁠⁠⁠⁠⁠Laura’s LinkedIn⁠⁠⁠⁠⁠⁠Laura’s Twitter⁠⁠

Dick co-founded Stottler Henke in 1988 as a software company dedicated to providing practical solutions to difficult problems by skillfully drawing upon a large repertoire of artificial intelligence technologies. Under Dick’s leadership, Stottler Henke has grown steadily and profitably into a 60-person research and software development company with distinctive expertise in automated planning and scheduling, intelligent tutoring systems, intelligent simulation, sensor data fusion, and autonomous systems. Dick combines a strong applied research record in artificial intelligence with practical experience in rapid and efficient knowledge engineering. He has led the development of intelligent tutoring systems that encode the expertise of instructors to provide practice-based learning and automated evaluation of student performance. Subject areas include navy tactics; army tactics, command, and control; sonar data analysis; astronaut training; helicopter cockpit operations; and battlefield emergency medicine. He led the development of intelligent planning systems for NASA space shuttle missions, satellite communications and sensor scheduling, and aircraft assembly. He also led the development of intelligent systems that autonomously control groups of drones to automatically plan and execute tasks to achieve mission objectives and react to unpredictable events. Dick has written or presented more than 80 papers and articles for publications such as the proceedings of the International Joint Conference on Artificial Intelligence (IJCAI). He received his BS in engineering from Cornell University and his MS in computer science (artificial intelligence) from Stanford University. Learn more about Dick: ⁠⁠Dick's website⁠⁠ AMER project TRACER project Space Shuttle Scheduling ESTEEM Current project Where to find the hosts: Brian Moon ⁠⁠Brian’s website⁠⁠ ⁠⁠Brian’s LinkedIn⁠⁠ ⁠⁠Brian’s Twitter⁠⁠ Laura Militello ⁠⁠Laura’s website⁠⁠ ⁠⁠Laura’s LinkedIn⁠⁠ ⁠⁠Laura’s Twitter⁠⁠

Tandi Bagian earned a Bachelor’s degree in Engineering from the University of Washington in 1979. She was employed by NASA’s Johnson Space Center and served as Lead Instructor for Astronaut Crew Training; Flight Projects Manager for the Space Biomedical Research Institute; and Head of the Crew Interface Analysis Section. This last position involved supervising six Human Factors Laboratories to support NASA’s Space Shuttle and Space Station missions. She also was a Principal Science Coordinator for Exploration Human Factors, and in that capacity informed the Agency’s Advanced Human Support Technology roadmap in preparation for Mars Exploration mission definition. In 1995, Tandi transferred from NASA to the U.S. Environmental Protection Agency and worked at the EPA’s National Vehicle and Fuel Emissions Laboratory in Ann Arbor. Along the way, she earned a Master of Science in Industrial and Operations Engineering from the University of Michigan, Ann Arbor, in 1999. In 2012, Tandi joined the Department of Veteran Affairs as Director, Human Factors Division for the VA National Center for Patient Safety. That team created an award-winning Patient Safety Boot Camp’ training for Biomedical Engineers across the entire VHA. With a vision to make sure patient safety is everyone’s business’, NCPS created strong technical partners across the over 170 VA Medical Centers, as well as with industry partners, to assist Healthcare professionals in providing ‘safer systems, safer care'. With 46 years of Federal Service, Ms. Bagian retired in 2022 and quickly became Associated with the NASA Engineering and Safety Center’s Human Factors Technical Discipline Team. And this is where we met. This HF team is responsible for responding to requests for analysis and review of human factors issues across the NASA Centers and Commercial/International Partners committed to NASA’s Moon2Mars mission. Learn more about Tandi: NESC Academy Where to find the hosts: Brian Moon ⁠⁠Brian’s website⁠⁠ ⁠⁠Brian’s LinkedIn⁠⁠ ⁠⁠Brian’s Twitter⁠⁠ Laura Militello ⁠⁠Laura’s website⁠⁠ ⁠⁠Laura’s LinkedIn⁠⁠ ⁠⁠Laura’s Twitter⁠⁠

Vaughn TAN is a consultant, author, toolmaker, and professor of strategy at University College London. For over a decade, Vaughn has helped businesses, not-for-profits, and government agencies — like the Singapore Government, Wellcome, and Carlyle Group — design themselves to flourish in uncertainty. He wrote The Uncertainty Mindset (a book about uncertainty and innovation organizations) and makes idk (a training tool for productive discomfort). He is currently working on building better strategies for different kinds of not-knowing. Vaughn has a PhD in Organizational Behavior and Sociology from Harvard University and Harvard Business School. He previously worked at Google in California on special projects (including spaceflight and big structured data) and consumer products (including Earth, Maps, and Streetview). Learn more about Vaughn: Vaughn's website ⁠Connect on LinkedIn⁠ ⁠See more of his work⁠ Where to find the hosts: Brian Moon ⁠Brian’s website⁠ ⁠Brian’s LinkedIn⁠ ⁠Brian’s Twitter⁠ Laura Militello ⁠Laura’s website⁠ ⁠Laura’s LinkedIn⁠ ⁠Laura’s Twitter⁠

Show Notes Ron Besuijen is a Training Specialist with Nova Chemicals in Joffre, Alberta. He has worked for 35 years in the petrochemical industry. He is qualified on four control panels, and was involved with the commissioning and startup of a new facility. In addition to his operational experience, Ron has been a training specialist for the last 18 years. He trains console operators with the use of a training simulator, and manages the training systems for his organization. He is a member of The Center for Operator Performance, a coalition of industry, vendors, and researchers that apply human factors methods to support human performance in petrochemical operations. He recently authored the book, Troubleshooting Tactics: How Process Operators Make Critical Decisions, applying Naturalistic Decision Making models to the complex world of petrochemical operations. Learn more about Ron: Connect on LinkedIn See more of his work Where to find the hosts: Brian Moon Brian’s website Brian’s LinkedIn Brian’s Twitter Laura Militello Laura’s website Laura’s LinkedIn Laura’s Twitter

Dr. Joan H. Johnston (Retired) has over 30 years of experience as a Senior Research Scientist with the U.S. Navy and U.S. Army. She has written and collaborated on over 100 publications and has given innumerable presentations and tutorials about her research which has had a significant impact on advancing the science of Learning, Team Training, Decision Making under Stress, Performance Measurement, and Organizational Development. She obtained her M.A. and Ph.D. in Industrial & Organizational Psychology from the University of South Florida. Dr. Johnston’s career with the Naval Air Warfare Center Training Systems Division (NAWCTSD) was marked by extensive collaborations across the Department of Defense, academia, and private industry. She was a principal Investigator and project manager for the Office of Naval Research (ONR) sponsored Tactical Decision Making Under Stress (TADMUS) program; ONR recognized her outstanding performance with the Dr. Arthur E. Bisson Prize for Naval Technology Achievement. In 2001 the Society for Industrial and Organizational Psychology also recognized this achievement with the M. Scott Myers Award for Applied Research in the Workplace. In recognition of her sustained performance excellence NAVAIR made Dr. Johnston a Research and Engineering Associate Fellow in 2008. After 22 years Dr. Johnston moved on to a promotionas the U.S. Army Research Institute’s Unit Chief in Orlando, and then eventually joined the U.S. Army Research Laboratory as a Senior Scientist at the Simulation Training and TechnologyCenter (STTC). She continued to work across agencies and services in pursuit of advancing the science of team training. She and her colleagues were recognized in 2016 for their outstanding accomplishments with the Department of the Army Achievement Medal for Civilian Service and the NTSA Modeling and Simulation Team Award. Dr. Johnston’s leadership on this program Learn more about Joan: Connect on LinkedIn See more of her work Learn more about NDM at NaturalisticDecisionMaking.org. Where to find the hosts: Brian Moon Brian’s website Brian’s LinkedIn Brian’s Twitter Laura Militello Laura’s website Laura’s LinkedIn Laura’s Twitter

This podcast episode is from an informational webinar hosted by the Naturalistic Decision Making Association on December 15th, 2022.  The webinar outlines the purpose and parameters of CTA in E/Affect, a challenge sponsored by Schmidt Futures to strengthen the case for Cognitive Task Analysis in the workplace. What is Cognitive Task Analysis? CTA is a toolkit used by psychologists, researchers, and instructional designers to understand how high-performing professionals make complex decisions. The deep insights revealed through CTA can be used to design training programs that help novices achieve proficiency at a rapid pace. Two-Stage Program The grant will support a year-long project carried out in two stages. Stage 1: CTA in Effect [DEADLINE: February 15th, 2023] The first stage will solicit case studies of CTA's ROI and award $10,000 in total prize money to the most compelling submissions. Stage 2: CTA in Affect [To take place throughout 2023] The second stage will identify high-value areas of opportunity for CTA-based training programs. An Invitation to Partners & Practitioners Are you an experienced CTA practitioner? Do you represent a  company that would like to learn more about how CTA can preserve institutional knowledge and accelerate training? If the answer to either question is yes, this podcast and the challenge it describes will be of value to you. Learn more about Naturalistic Decision Making and Cognitive Task Analysis at NaturalisticDecisionMaking.org. Thank you to Schmidt Futures for their generous sponsorship of this initiative and support of the NDMA and its mission. Learn more about their work at SchmidtFutures.com.

Date recorded: November 12, 2021 Show Description: Today we welcome John Allspaw. John is an engineering leader and  researcher with over 20 years of experience in building and leading  teams engaged in software and systems engineering. He is a co-founder of Adaptive Capacity Labs, LLC. Previously, he was  Chief Technology Officer at Etsy. He has also worked at Flickr,  Friendster, InfoWorld, Salon, Genentech, Volpe National Transportation  Center, and a bunch of other places as a consultant from time to time. John has spent the last decade bridging insights from Human Factors,  Cognitive Systems Engineering, and Resilience Engineering to the domain  of software engineering and operations. His publications include the books The Art of Capacity Planning  (2009) and Web Operations (2010) as well as the forward to “The DevOps  Handbook.” His 2009 Velocity talk with Paul Hammond, “10+ Deploys Per  Day: Dev and Ops Cooperation” helped start the DevOps movement. He holds a Master’s degree in Human Factors and Systems Safety from Lund University. Where to find John: LinkedIn Twitter Learn more about NDM: NaturalisticDecisionMaking.org Journal of Cognitive Engineering and Decision Making Where to find hosts Brian Moon and Laura Militello: Brian’s website Brian’s LinkedIn Brian’s Twitter Laura’s website Laura’s LinkedIn Laura’s Twitter

Date: 04/16/2021 Show Description: Bill is Founder, President, and CSE Fellow at Resilient Cognitive  Solutions.  Bill’s military career includes an ROTC Commission in 1977  from Carnegie-Mellon University as a Distinguished Military Graduate,  with further military education including Airborne, Ranger, Military  Intelligence Officer Basic and Advanced Courses, CAS3, and Command and  General Staff College. He has held leadership positions up to  MI Battalion Command, Brigade S3, as well as Intelligence Staff Officer  Positions at various levels up to Joint Command, receiving numerous decorations and awards including the Meritorious Service Medal.  His military career spanned 27 years of active and reserve service, retiring as a Lieutenant Colonel, Military Intelligence in  2004.   Bill’s civilian career began as a Cognitive Systems Engineer designing Advanced Control Rooms for commercial nuclear power plants,  including an alarm management system that still defines the state of the art. He is one of the longest practicing Cognitive Systems  Engineers, combining over 34 years of applied CSE experience in domains ranging from process control to national intelligence. Currently, he is focused on Advanced Decision Support using Big Data Analytics to team effectively with corresponding advances in decision-making tradecraft. Where to find Bill: ResearchGate LinkedIn Learn more about NDM: NaturalisticDecisionMaking.org Journal of Cognitive Engineering and Decision Making Where to find hosts Brian Moon and Laura Militello: Brian’s website Brian’s LinkedIn Brian’s Twitter Laura’s website Laura’s LinkedIn Laura’s Twitter

Date: 02/11/2021 Show Description: Shawn received a PhD and MA in Cognitive/Experimental Psychology from Ohio State University, with specializations in cognitive engineering, quantitative psychology, and psycholinguistics. He previously received a BA in Psychology/Music from Binghamton University (SUNY). He is a member of the Human Factors and Ergonomics Society, the American Psychological Association, the National Defense Industrial Association, and the Cognitive Science Society. Where to find Shawn: Aptima Human Centered Engineering Learn more about NDM: NaturalisticDecisionMaking.org Journal of Cognitive Engineering and Decision Making Where to find hosts Brian Moon and Laura Militello: Brian’s website Brian’s LinkedIn Brian’s Twitter Laura’s website Laura’s LinkedIn Laura’s Twitter Timestamps: Describing Aptima and how it connects to the NDM community [1:28] How human centeredness is expressed in Aptima’s core domains [6:17] Shawn’s experience transitioning from research to a more executive role [11:00] Staying true to core principles when working with a multidisciplinary team [19:04] Pushback when making the case for NDM methods [26:17] Biggest influences on Shawn’s career [31:30] Future research priorities for Aptima [38:11] How to decide whether to file a patent and what that process is like [42:18] One question to determine if someone is a human centered practitioner [46:52] Some things that not many people know about Shawn [49:58]

Date: 1/29/2021 Show Description: Simon Henderson is an independent deception consultant working in the UK and the US.  His career has involved researching, teaching, and consulting on deception, counter-deception, information operations and cyber operations within a variety of government, military, and law enforcement organisations.  He is passionate about novel and pro-social applications of these fields. Learn more about Simon’s work: Deception by Design Evaluationof the counter fake-news game, Harmony Square Immersive theatre company, Punchdrunk Learn more about NDM: NaturalisticDecisionMaking.org Journal of Cognitive Engineering and Decision Making Where to find hosts Brian Moon and Laura Militello: Brian’s website Brian’s LinkedIn Brian’s Twitter Laura’s website Laura’s LinkedIn Laura’s Twitter Timestamps: Simon’s early path to a career in deception [1:15] First exposure to NDM [5:54] Proposing to apply magic and deception skills to military [20:59] The technique of misdirection in deception [24:42] Nuances of using deception on experts [32:31] One question that could determine if someone is a magician [41:51] Differences between observing and performing magic [47:58] Outlook for the next 15 years and details about Simon’s blog and book [51:48] Two truths and a lie [1:02:55]

Date: 12/03/2020 Show Description: Dr. Mica Endsley is widely recognized as a pioneer and world leader in the study and application of situation awareness in advanced systems. She is a former President of the Human Factors and Ergonomics Society and former Chief Scientist for the U.S. Air Force. Dr. Endsley is the author of over 200 scientific articles and reports on situation awareness, decision-making, and human-system integration and is widely cited in professional journals. She is the co-author of “Designing for Situation Awareness” and speaks extensively at conferences. Dr. Endsley has a Ph.D. in Industrial and Systems Engineering from the University of Southern California. She is a Certified Professional Ergonomist (CPE). Learn more about Mica’s work: SA Technologies ResearchGate Designing for Situation Awareness: An Approach to User-Centered Design, Second Edition Handbook of Distributed Team Cognition Learn more about NDM: NaturalisticDecisionMaking.org Journal of Cognitive Engineering and Decision Making Where to find hosts Brian Moon and Laura Militello: Brian’s website Brian’s LinkedIn Brian’s Twitter Laura’s website Laura’s LinkedIn Laura’s Twitter Timestamps: The first paper Dr. Endsley ever published [1:00} The importance of situation awareness [3:10] The challenges of dealing with cognitive dissonance and confirmation bias [8:35] How to encourage open-mindedness [12:20] UFO’s and how individuals respond when their mental models fail [14:50] Past research projects that have been particularly rewarding [19:50] Reflections on serving as chief scientist for the Airforce [21:13] Insights on experiences of trying to convince others to think differently [23:30] Interesting projects surrounding situation awareness [29:57] Advice for people just entering the field of NDM [32:32] Major influences in Dr. Endsley’s career [34:25] Ideas on ways to better manage the COVID-19 response [35:32] One question that can determine if someone is an NDM researcher [40:15] Some things that not many people know about Dr. Endsley [42:18] “If you could become an expert in anything instantly, what would it be?” [43:30]