BAA-AFRL-RQKH-2015-0008-IndustryDay_Charts.pdf

1 DISTRIBUTION STATEMENT A – Approved for Public release: Distribution Unlimited, 88ABW-2015-3168, 22 Jun 15 1 September 2015

Air Force Research Laboratory

Integrity Service Excellence

Joseph Lyons, PhD Technical Advisor

711 HPW/RHXS

Air Force Research Laboratory

Human Trust and Interaction Branch

Date: 26 AUG 2015

2 DISTRIBUTION STATEMENT A – Approved for Public release: Distribution Unlimited, 88ABW-2015-3168, 22 Jun 15

Human Trust and Interaction Branch – 2 teams

Human Insight and Trust (HIT) Human Language Technology (HLT)

Addressing science challenges in:

• Human-Machine Trust/Suspicion

• Human-Robot Teaming

• Transparency Research

Addressing science challenges in:

• Machine translation (MT)

• Automatic speech recognition (ASR)

• Text-to-speech synthesis (TTS)

3 DISTRIBUTION STATEMENT A – Approved for Public release: Distribution Unlimited, 88ABW-2015-3168, 22 Jun 15

Human Insight and Trust (HIT) Domain Areas

Pilots interfacing with new tools in the cockpit

Support Today’s Need Lead The Science of Tomorrow

Supporting analysts’ trust of new tools

Exploring novel methods for Human- Robot Teaming

4 DISTRIBUTION STATEMENT A – Approved for Public release: Distribution Unlimited, 88ABW-2015-3168, 22 Jun 15

Field Study of Automated Ground Collision Avoidance System (GCAS)

• Objective: Understanding antecedents of trust among pilots

• Prior Research:

– Trust enablers = Nuisance avoidance, reliability, experience, familiarity, emotional ties to fallen Airmen, data-driven approach (Koltai et al., 2014)

• Field Study starting in 2015

– Interviews & surveys at different Air Force Bases

5 DISTRIBUTION STATEMENT A – Approved for Public release: Distribution Unlimited, 88ABW-2015-3168, 22 Jun 15

How to Foster Transparency in Automated Planning

(Lyons & Havig, 2014)

World & State Representation Decisions & Actions Diverse Assets

Adaptive Planning

Algorithms

Relief Operations

6 DISTRIBUTION STATEMENT A – Approved for Public release: Distribution Unlimited, 88ABW-2015-3168, 22 Jun 15

Quantify the Impact of Empathetic Robots (Stokes et al., 2015)

Human-Machine Teaming Experiments

• Objective: Examine the impact of empathetic vs. non-empathetic machine partner on HMT performance

• Socialization Manipulation

• Experiment 1: Virtual Interaction

• Computer-based Empathetic Partner (CEP)

• Data underway

• Experiment 2: Robotic Presence

• Partnership with Yale (Emotional Intelligence Lab, Social Robotics Lab), and MIT (Personal Robotics Lab)

7 DISTRIBUTION STATEMENT A – Approved for Public release: Distribution Unlimited, 88ABW-2015-3168, 22 Jun 15

Transparency in Autonomous Collaboration and Teaming (TACT)

UAS

Manned Aircraft

H-M Dialogue

Comm loss

Regroup/debrief

Research Challenges

• Human-Robot dialogue

• Signaling intent, awareness, benevolence

• Fostering “team” engagement

Human-Robot Teaming

8 DISTRIBUTION STATEMENT A – Approved for Public release: Distribution Unlimited, 88ABW-2015-3168, 22 Jun 15

Trust Experiments

Executive Function (EF)

• Protect against complacency?

• Study 1: Multi-UAV Study

• 2x2 design (Reliability, Workload)

• Data collection – Feb 15

Human-Robot Dialogue

• LM Explaining Robot Actions

ERA) technology

• Manipulate social style of dialogue: none, continuous, key decision points, by solicitation

• Data Collection Phase!

9 DISTRIBUTION STATEMENT A – Approved for Public release: Distribution Unlimited, 88ABW-2015-3168, 22 Jun 15

Trust & Suspicion Research

Objectives •Develop metrics for suspicion •Identify the antecedents of suspicion •Identify and validate selection tools for suspicion •Leverages multiple labs

Publications •Trust, distrust, suspicion are orthogonal (Lyons et al., 2011) •Suspicion conceptual model developed (Bobko et al., 2013; 2014) •Anterior Cingulate Cortex may be a physiological marker for suspicion (Hirshfield et al., 2014) •Special issue in Journal of Business & Psychology 2015

10 DISTRIBUTION STATEMENT A – Approved for Public release: Distribution Unlimited, 88ABW-2015-3168, 22 Jun 15

Trustworthiness in Code

1.

2.

3.

4.

5.

6.

7.

8.

<reverse_string+0x28> movzbl -0x1(%rax),%esi <reverse_string+0x2c> movzbl (%rbx,%rdx,1),%ecx <reverse_string+0x30> mov %sil,(%rbx,%rdx,1) <reverse_string+0x34> add $0x1,%rdx <reverse_string+0x38> mov %cl,-0x1(%rax) <reverse_string+0x3b> sub $0x1,%rax <reverse_string+0x3f> cmp %rdi,%rdx <reverse_string+0x42> jne <reverse_string+0x28> movzbl (%rcx),%edi movzbl (%rbx,%rdx,1),%esi mov %dil,(%rbx,%rdx,1) add $0x1,%rdx mov %sil,(%rcx) sub $0x1,%rcx cmp %r8,%rdx jne <reverse_string_neg_offset+0x20>

Trustworthiness of Software Code

• How do coders evaluate trustworthiness of code?

• Differences due to automation?

Transparency

• Human-Robot Transparency = method for establishing shared awareness and shared intent (Lyons, 2013)

Intent Environment Task Analytics Teamwork Human State

Social Intent

12 DISTRIBUTION STATEMENT A – Approved for Public release: Distribution Unlimited, 88ABW-2015-3168, 22 Jun 15

HIT Partners

• Air Force Flight Test Center

(AFTC)

– Auto GCAS study

• NASA Ames

– Transparency of automation

• Army Flight Development Directorate (AFDD)

– Funding Brownout research

• UD Robotics Lab

– Collaboration on Human-

Robot Interaction

• Wright State University

– Experimental labs

• Gettysburg College/Syracuse

– Suspicion research

13 DISTRIBUTION STATEMENT A – Approved for Public release: Distribution Unlimited, 88ABW-2015-3168, 22 Jun 15

Contact Us

Joseph Lyons, PhD Technical Advisor, Human Trust and

Interaction Branch

711 HPW/RHXS

Air Force Research Laboratory Joseph.lyons.6@US.AF.MIL

(937) 255-8734