DRAFT_HUD_Industry_Day_Slides.pdf

Soldier Lethality Cross Functional TeamUS Army Combined Arms Center

SOLDIERS AND LEADERS - OUR ASYMMETRIC ADVANTAGE

Heads Up Display (HUD) 3.0 Industry Day

7 August 2018

This event is Unclassified

Notice

Distribution Statement A: Approved for public release; distribution is unlimited.

Ground Rules

• This event is for the HUD 3.0. Existing open solicitations, current contracts, and recent awards will not be discussed.

• Only written questions may be asked. Please also submit written questions using the 3 x 5 cards provided.

– Cards may be submitted anytime to any Government person.

– 3 x 5 cards will also be collected at the breaks.

• The Government presentation today is advisory only.

Agenda (Morning)

7 August 18 0900 Start

Time

(EST)

Topic Speaker

0830 Vendor Registration/Sign-In

0900 Opening Remarks and Overview Gary Keller

0905 Welcome Remarks COL Schneider

0915 HUD 3.0 Overview and Technology Gary Keller

0945 Solder immersive Virtual Trainer (SiVT) LTC Bonnette

1030 Deliverables Mark Stephens

1050 Contract Strategy Lisa Yamakawa

1120 Summary and Questions Gary Keller

1200 Lunch

Our focus today is on Technical, Contract Strategy and our vision of the HUD 3.0

Break

Agenda (Afternoon)

7 August 18 1300 Start

Time

(EST)

Topic Speaker

1300 One-on-One Sessions

1700 Conclude

Agenda (Morning/Afternoon)

8 August 18 Topic Speaker

0900 One-on-One Sessions

1700 Conclude

Welcome

COL Schneider

Purpose

• To inform businesses of HUD 3.0 requirements and acquisition approach, hold a forum for discussion of HUD 3.0 capability requirements, and provide an opportunity for one-on-one sessions with Industry.

HUD 3.0 Requirement

HUD 3.0 Requirement

• A single platform that Soldier/Marines can use to Fight, Rehearse, and Train

• Day/Night Rapid Target Acquisition

• Machine Learning Capabilities/Artificial Intelligence

• Synthetic Training Environment (STE) Squad Capability (One World Terrain, Training Simulation Software, Training Management Tools)

• An Adaptive Squad Operating System

• Nett Warrior / ATAK Connectivity

• Fused Day/Night Vision Capabilities

• Intra-Soldier Wireless Connectivity

• Squad Lethality Rating/Metrics

• Mixed/Live Reality

Problem Statement: “The fundamental problem to overcome is an erosion in close combat capability relative to the pacing threats identified in the National Defense Strategy”.

A single platform that Soldiers/Marines can Fight, Rehearse, and Train that provides the increased lethality, mobility and situational awareness necessary to achieve overmatch against our current and future adversaries

Night Vision Capability and Integration

FutureToday2000’s1990’s1980’s1970’s

HUD 3.0

Analog

Dual Tube Aviators & SOF Maneuver Force

Integrated Rapid Target Acquisition (Lethality)

Analog/Digital Thermal

Integrated Nett Warrior (Situational Awareness)

Full Digital

Integrated STE (Fight/Rehearse/Train)

Day/Night Capable

Disruptive Technology Opportunity

Limited Integration Integration of the Head/Body/Weapon FROM Limited Walkthroughs TO Unlimited Rehearsals

Train or Fight “Train as you Fight”

A single platform that Soldiers/Marines can use to Fight, Rehearse, and Train

HUD 3.0 – Why now?

Synthetic Training Environment (STE)

Enhanced Night Vision Goggles – Binocular (ENVG-B)

Nett Warrior

Natural Visualization

Mature Capability Integration

Adaptive Soldier and Squad Architecture

Common Processor

Common Visual Day/Night Display

HUD 3.0

• Production Ready

• Government Architecture

• Artificial Intelligence

• STE training and rehearsal

Artificial Intelligence Machine Learning

Today’s Technology

Deliverables in 24 Months

Analog to Thermal + Low Light Digital

HUD 3.0 Acquisition Approach

Prototype Concept: Use traditional or non-traditional industry partners to rapidly prototype integrated HUD 3.0 capability using innovative but disciplined acquisition processes.

• Competitive OTA

• Demonstrate integration maturation via progressive capability set builds

• User feedback through multiple Soldier Touch Points (test event)

• Bottoms-up open architected system approach

• Knowledge Points (decision) provide acceleration or program modification opportunities

• Cost control through Government owned architecture, traditional IPRs, progress payments…

Today Benefits

+ Promotes Competition + Enables Interoperability + Protects IP + Mitigates Obsolescence + Rapid Cap Improvement + Deliberate Modernization

HUD 3.0

Systems Engineering Approach to Fighting Platforms:

x9

Manage the Squad as an Integrated Weapons

Platform

HUD 3.0 Prototype Development Roadmap

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27

Build Out #1 STP #1

Capability Set #1

(50 Prototypes)

Capability Set #2

(300 Prototypes)

Capability Set #3

(600 Prototypes)

Capability Set #4

(1600 Prototypes)

Month

DROTA award

UJ

TR

STP

UJ

Build Out #2 STP #2

Software and Process Dev

System Design TR

DR BRR

UJ

STP

Build Out #3

STP

#3Low Light Level Sensor Build #1 Low Light Level Sensor Build #2 Software and

Process Dev

Thermal Sensor Build #1 DR Sensor Deliveries1 2 3

UJ

BRR STP

TR

UJ

STP

#4

Build Out #4 Software and Process Dev

Thermal Sensor Build #2 / Low Light Level Build #3

Squad Architecture, Battle Drill and System Design Development

4 Sensor Deliveries

UJ

DR BRR STP Follow on Production

Capability Set DeliverablesTechnology Readiness Start Point

• Prototypes (Hardware and Software)

• Software Development Kit

• Engineering Reports

• Test Plans, Procedures & Reports

• Financial Reports

• Program Management Documentation

• Representative model or prototype system, that is tested in a relevant environment.

• Examples include testing a prototype in a high-fidelity laboratory environment or in a simulated operational environment.

UJ – User Jury STP – Soldier Touch Point DR – Design Review TR – Test Report BRR – Build Readiness Review

HUD 3.0 Prototype Development Roadmap

Month 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

Capability Set #1 Capability Set #2 Capability Set #3 Capability Set #4 Follow-on Prod

Sensors

• Integrate COTS/GOTS thermal camera into product

• Sensor ICD and preliminary design

HUD 3.0

• Configuration Database

• Configuration Mgmt. Plan

• COTS headset, COTS thermal sensor, 2-D AR

• ATAK data and 3D display of blue forces

• Data Lake HW & Architecture

• M&S analysis, gap identification

• Mission planning assist

STE

• Demonstrate initial OWT, TSS, TMT

Capability

Sensors

• Initial sensors, preliminary design for final configuration

• Preliminary design for Capability Set 4 sensors

HUD 3.0

• Arch Assessment Tool

• Distributed Functionality

• Military form factor, initial sensors, 3-D AR, RTA

• 300 nodes, network radios, ISW w RTA

• Structure/scope of Squad Performance

Model

• M&S roadmap

• Audio commands, calculate routes

STE

• Scale squad capacity to execute Battle Drills

1-11

Sensors

• Build/integrate ICD compliant thermal and low light camera modules with incremental improvements

HUD 3.0

• Comprehensive data

• Interface Control Docs

• WFOV dimming display, improved sensors, eye/hearing protection

• 600 nodes CO net, CEMA capability, AI missions

• HUD sensor data collection

• Initial capability to recreate virtual squad activity

• Identify performance data correlation utilizing machine learning

• Auto Data adjust CEMA, fire cover

STE

• Scale to FOs, UAS, MEDEVACs, PLT Wpns

Sensors

• Final sensor configuration, Production qualification

HUD 3.0

• Soldier/Sqd Architecture

• Spatial dimming, full performance sensors

• 1,600 nodes BN net, Hearing pro, ISW & AI

• Squad Performance Model

• MOPs/MOEs

• Foreign language translation

STE

• Scale to Joint Forces: Marines, Warfighting

Ex.

Prototype #1 Capabilities:

• Commercial Product – Show baseline concept

• Integration of commercial thermal sensor and Nett Warrior

• Establish squad performance data lake

• Demo of initial STE Squad

Capability development efforts

50 Prototypes

Prototype #2 Capabilities:

• Final form factor design – New Military goggle

• Integration of Tactical Assault Kit software provides AR

• Initial HUD 3.0 architecture complete

• STE Squad Capability: Squad training capability: Battle Drills 1-11; Squad Weapons, TSS, OWT, TMT, AAR

300 Prototypes

Prototype #3 Capabilities:

• Military HUD w/Wide Field of View display, military form factor thermal, ballistic and laser Protection

• ATAK Capabilty FOC

• Initial AI/ML capability

• Squad Architecture Tool & Rating IOC

• STE Squad Capability: Expanded TSS, Enablers: FO, MEDEVAC, Plt UAS, Squad and Platoon Weapons

600 Prototypes

Prototype #4 Capabilities:

• First fieldable Military HUD w/full fused thermal and low light sensor

• Functional AI/ML enabled ATAK capability

• Squad Architecture tool FOC

• Squad Lethality Rating FOC

• STE Squad Capability: Battle Drills 1-11 and USMC Squad TRs, Scalable TSS, OWT, and TMT

1600 Prototypes

Soldier Touch Point=

Additional Attributes per Capability Set

Soldier Touch Point Concept

STP #1

(Capability Set #1)

STP #2

(Capability Set #2)

STP #3

(Capability Set #3)

STP #4

(Capability Set #4)

When (Deliverables due) 4 Months 11 Months 17 Months 21 Months

What 50 Prototypes

20 DT

30 STP (3 SQD)

300 Prototypes

100 DT

200 STP (20 SQD)

600 Prototypes

100 DT

500 STP (50 SQD)

1,600 Prototypes

100 DT

1500 STP (150 SQD)

Scope

Each STP duration is

1 month with 1 week NET

SQD

• Demo commercial Product indoors

• Determine DT limits (Temperature & Vibration)

• Establish SQD performance data

• Develop data collection methods

PLT

• Demo 1st evolution of military goggle

• Begin robust DT

• Conduct various

INF/FO/ENG/MED

dismounted mission lanes (Navigate/Detect/Recog/RTA)

• Establish sensor performance, utility of data displayed, HFE, Reliability, etc

CO

• Demo next evolution of military goggle

• Continue robust DT

• Conduct various

INF/FO/ENG/MED

dismounted mission lanes (Navigate/Detect/Recog/RTA)

• Establish sensor performance, utility of data displayed, HFE, Reliability, CEMA, etc.

BN

• Rehearsal for IOT

• Demo next evolution of military goggle

• Continue robust DT

• Conduct various

INF/FO/ENG/MED

dismounted mission lanes (Navigate/Detect/Recog/RTA)

• Establish sensor performance, utility of data displayed, HFE, Reliability, EMI, Airworthiness, etc.

Where

• STP’s conducted simultaneously at a minimum of three test sites (urban (indoors/outdoors), wooded, desert, tropical, arctic, airdrop, subterranean)

• Attempt to use some of the same Soldiers throughout the STPs

• DT conducted at contractor & Government locations

HUD 3.0 - Eight (8) Capabilities

Adaptive Soldier/Squad Architecture Provide an architecture documenting existing Soldier variations

Synthetic Training Environment

Heads Up Display Integration Conformal head mounted digital sensor system with immersive see through display

Thermal Camera Development/Integration Ultra-compact thermal sensor modules with standard interfaces

Low Light Camera Development/Integration Ultra-compact digital LLL sensor modules with standard interfaces

Nett Warrior 3.0 Integration Network SA/C2 enabled by Artificial Intel for combat overmatch, Synthetic train and rehearsal, wireless and hearing protection

Squad Lethality Metrics Ability to predict Soldier/ Squad performance based on accepted model(s)

Artificial Intelligence/ Machine Learning Rule-based planning, decision, and OPFOR adaption support. Quantitative pattern recognition, change detection, id support

S w im L an es

HUD 3.0 Architecture

Today

Acquisition Benefits:

-Promotes competition -Enables interoperability -Protects Intellectual Property (IP)

Gov-owned Interfaces

HUD

Integration

-No architecture -Individual components -Up to 120 lbs of kit per Soldier -Integration of kit falls to Soldier -Unique, complex connections to other assets -No method of assessing how a new component effects overall capability

Adaptive Soldier Architecture (ASA)

Soldier

Squad to

Adaptive Soldier Architecture allows:

• Deliberate modernization of Soldiers/ Squads

• Quantitative assessment of new capabilities on the overall effectiveness of Soldiers/ Squads

What’s

Needed…..

Quantitative assessment of new components

Squad Optimization

Soldier-as-an-Integrated- Weapons-Platform (SIWP)

Platforms integrate SIWP into their designs

HUD-STE Squad Training

Integrates One World Terrain, Training Simulation Software and Training Management Tools into one Tool used by HUD.

Description: Soldier Immersive Virtual Trainer (SiVT) will allow for the rapid conduct and repetition of squad-level training in a Mixed Reality (MR) based synthetic environment; will enable training on common battle drills and provide a realistic simulation of the operational environment; and will permit training scenarios to be quickly and easily developed and modified by Warfighters to suit specific training requirements. SiVT will capture performance data and provide an After Action Review (AAR) capability where performance data and replays of training exercises will be used to support rapid improvement of soldier performance.

Capabilities

• Training Simulation Software (TSS) is the core simulation of the STE that acts as the source of, and provides synthetic representations of, the military capabilities and operational environment necessary to support collective training.

• Training Management Tool (TMT) is the capability that enables units to quickly plan collective training events, prepare training events; execute and monitor events, and assess event results.

• One World Terrain (OWT) is a 3D global terrain capability and associated information services that supports the virtual replication of the physical Earth and complexities of the operational environment (OE) in support of training in support of the STE.

Capability Set #1:

TSS: Demonstrate military content and application (Avatars, Models, and Behaviors OWT: Demonstrate ingestion of OWT inserts TMT: Demonstrate scenario creation and selection (AAR playback) Squad Cap: Demonstrate scale from 1-4 warfighters/2 trainers, initial Force on Training (FoT)

Capability Set #2:

TSS: BLUFOR Squad and OPFOR Models, Basic FoT/Force on Force (FoF) OWT: 50M meshing (inside/outside); OWT TSS models TMT: Basic scenario editor (planning/executing with AAR (rewind/edit) Squad Cap: Battle Drills 1-11, weapons prototypes of M4, M17/M9, M27, M249

Capability Set #3:

TSS: BLUFOR/OPFOR SAF interoperable with voice commands, full FoT/FoF, civilian models OWT: 200M meshing (inside/outside); OWT TSS MODELS TMT: Basic scenario editor (planning/executing with AAR (rewind/edit) Squad Cap: Battle Drills 1-11, weapons prototypes of M4, M17/M9, M27, M249

Capability Set #4:

TSS: Organic Squad with Artificial Intelligence SAF, NETT Warrior interoperability OWT: Scalable terrain with 1K observation of effects and enablers TMT: Scalable scenario editor/AAR with local repository and AAR Analysis Tool Squad Cap: Battle Drills 1-11, USMC Squad training, enabler requests for medevac, and artillery effects

STE Squad

Capability

Set#1

SL/STE OTA (SEC 804)

Prototype Concept

- Rapidly prototype systems in four progressive capability sets to be integrated and tested with the HUD 3.0; using six designated Soldier Touch Points as development and operational test

STE Squad

Capability

Set#1

STE Squad

Capability

Set#1

STE Squad

Capability

Set#1

STE Squad

Capability

Set#2

STE Squad

Capability

Set#2

STE Squad

Capability

Set#2

STE Squad

Capability

Set#3

STE Squad

Capability

Set#3

STE Squad

Capability

Set#4

HUD 3.0

DRAFT

The STE Architecture will converge today’s Live, Virtual, Constructive, and Gaming training environments into one common synthetic environment, providing new opportunities for enterprise management of Army collective training. Convergence will help overcome the challenges of multiple terrain databases, and reduce costly hardware at fixed sites with a solution that has the right levels of affordable fidelity and realism. The Army requires an Architecture that:

• Avoids proprietary interfaces

• Complies with the Risk Management Framework (RMF)

• Natively communicates with the Common Operating Environment (COE) Computing

Environments (CE)

• Retrieves data from authoritative and other data sources

• Natively communicates with the Live instrumentation systems

• Interoperates with current and future Joint service models

Open Systems Architecture

HUD-STE Squad Capability/SSVT LOE Strategic Roadmap

Sensor Development Overview

• Design:

• Uncooled LWIR, Digital LL, and SWIR sensor solutions (multiple awards)

• Deliverables (available as GFE to HUD 3.0 effort):

• Up to 2,550 LWIR sensors

• Up to 5,100 Digital LL sensors

• Up to 2,550 SWIR sensors

• Schedule:

• Initial deliveries at 8-10 months after award (300 LWIR, 600 LLL)

• Additional deliveries at 14-16 months after award (600 LWIR, 1,200 LLL)

• Final deliveries at 18-20 months after award (1,600 LWIR, 3,200 LLL)

NVESD, through the SCEC Consortium, is developing and standardizing sensor modules with aggressive SWAP for head-mounted and man-portable applications to enable next-generation Soldier Lethality capabilities.

• A key deliverable of this effort is a common sensor interface control document

• Consortium consisting of Government, sensor developers, and system integrators will draft ICD

• ICD will define mechanical and electrical (power/signal) interfaces

• MIPI Camera Serial Interface 2 (MIPI CSI-2) for imagery

• 1-2 lanes for monochrome thermal/SWIR/LLL

• Up to 4 lanes for color day/LLL

• I2C for camera control

• Standard command set

• Leverage MIPI Camera Command Interface

• Common power interface(s)

• 3.3V, 2.8V, 1.8V, and 1.2V

COMMON SENSOR INTERFACE CONTROL DOCUMENT

Specification Threshold Objective

Resolution ≥ 320 × 240 ≥ 640 × 480

Pixel Pitch ≤ 15 m ≤ 10 m

Frame Rate ≥ 30 Hz ≥ 60 Hz

Power ≤ 1.0 W ≤ 0.5 W

Size, including optics (W×H×D)

≤ 20 mm × 20 mm × 20 mm

≤ 15 mm × 15 mm × 15 mm

Horizontal Field of View

40 degrees 55 degrees

Active Source Wavelengths

≥ 1.2 m ≥ 1.2 m

Operational Modes

Depth Sensing

Depth Sensing, Asynchronous Laser Pulse Detection, Passive Imaging

Depth Sensing Method

Structured Light

Time of Flight

Depth Sensing Range

10m 25m

Depth Sensing Resolution (@ 10m)

5cm 2.5cm

Operability ≥ 99.5% ≥ 99.8%

Video Output Mobile Industry Processor Interface Camera Serial

Interface 2 (MIPI CSI-2), using 1-2 lanes

Control Interface Inter-Integrated Circuit (I2C)

Specification Threshold Objective

Resolution ≥ 640 × 480 ≥ 1280 × 1024

Pixel Pitch ≤ 12 m ≤ 10 m

Frame Rate ≥ 60 Hz 120 Hz

Power ≤ 1.0 W ≤ 0.8 W

Size, including optics (W×H×D)

≤ 20 mm × 20 mm × 25 mm

≤ 15 mm × 15 mm × 15 mm

Horizontal Field of View

40 degrees 55 degrees

Temporal Noise- Equivalent Temperature Difference (NEDT or NETD) (with F/1 lens and 300K scene)

≤ 50 mK ≤ 35 mK

Spatial NEDT (with F/1 lens and 300K scene)

≤ 50 mK ≤ 35 mK

Thermal Time Constant

≤ 12 ms ≤ 10 ms

Operability ≥ 99.5% ≥ 99.8%

Non-Uniformity Correction (NUC)

Integrated shutter or scene based, able to maintain spatial

NEDT

Scene-based, able to maintain spatial NEDT

Video Output Mobile Industry Processor Interface Camera Serial Interface 2 (MIPI CSI-

2), using 1-2 lanes

Control Interface Inter-Integrated Circuit (I2C)

SENSOR MODULE REQUIREMENTS

LWIR SWIRSpecificatio n

Threshold Objective

Resolution ≥ 960 ×

Maximum allowed by size and pixel pitch specifications

Pixel Pitch ≤ 10 m ≤ 10 m, binnable to 16-20um

Frame Rate ≥ 60 Hz ≥ 120 Hz

Power ≤ 1.5 W ≤ 1.0 W

Size, including optics (W×H×D)

≤ 25 mm × 25 mm × 25 mm

≤ 15 mm × 15 mm × 15 mm

Horizontal Field of View

40 degrees 55 degrees

Low-Light Performance

Quarter moon performanc e of an Omnibus

VIII

AN/PVS-14

Starlight performance of an Omnibus VIII

AN/PVS-14

Operability ≥ 99.5% ≥ 99.8%

Output Digital Digital

Video Output Mobile Industry Processor Interface Camera Serial Interface 2 (MIPI CSI-2), using up to 4 lanes

Control Interface

Inter-Integrated Circuit (I2C)

Digital LL

Decision Support Tool Concept

Mobility

Mobility

Squad Lethality Rating

Lethality

Situational Awareness

Data Sources:

Large Scale operational Evaluations (i.e. JRTC) Small Scale STXs Controlled Laboratory/Field Experiments

Training

Situational Awareness

Survivability

Lethality

Survivability

= Lethality + Survivability + Mobility + Situational Awareness

Captures first, second, and third order effects

- Capture and re-creation of squad actions in M&S environment

- Utilization of physical and virtual evaluation environments

- Utilization of Machine learning to identify Squad Measures of Performance and Effectiveness

Sensor Data

• GPS

• Physiological Status

Data

• Head, Weapon, &

Body Orientation

• Eye tracking

Collected Data

• Demographic Data

• Equipment

Capabilities

• Marksmanship

• Physical

Performance

• Feedback from STE

• Existing Studies

Collection and analysis of this unprecedented amount and type of data will provide an understanding and allow for the optimization of Soldier and Squad performance

- Decision Support Tool

- Squad Lethality Rating

- Combat IQ

- Mission Optimization tool

Performance Measurement and Metrics

Product Support

• Army conducts maintenance in accordance with Army Regulation (AR) 750-1 (Army Maintenance)

• Army conducts product support in accordance with AR 700-127 (Integrated Product Support)

• Army Maintenance Concept: Two level Maintenance (hardware & software)

1. Field Maintenance- remove and replace forward (Soldier)

2. Sustainment- repair in rear (Depot)

• Army objective: sustainment level maintenance done organically (Gov’t and/or partnership)

• Key product support considerations:

• Interoperability

• Tech Data to support maintenance (hardware/software)

• Training

• Technical Manuals (Operator/Maintainer)

• Risk Management Framework

• Performance based product support

Design for Product Support

DELIVERABLES

Squad Battle Drills & Tasks

ATP 3.31.8 Battle Drills:

Battle Drill 1: React to Direct Fire Contact (07-3-D9501) Battle Drill 2A: Conduct a Squad Assault (07-4-D9515) Battle Drill 3: Break Contact (07-3-D9505) Battle Drill 4: React to Ambush (Near) (07-3-D9502) Battle Drill 5: Knock Out a Bunker (07-3-D9406) Battle Drill 6: Enter and Clear a Room (07-4-D9509) Battle Drill 7:Enter a Trench to Secure a Foothold (07-3-D9510) Battle Drill 8: Conduct the Initial Breach of a Mined Wire Obstacle

(07-3-D9412) Battle Drill 9: React to Indirect Fire (07-3-D9504) Battle Drill 10: React to a Chemical Attack (03-3-D0001) Battle Drill 11: React to an IED (05-3-D1703)

USMC Specified TM & Squad T&R Events Patrolling Ops Lead a squad in a traffic control point (0311-MOUT-2002) Perform Immediate Actions (0300-PAT-1009) Conduct a Reconnaissance Patrol (INF-MAN-4302) Conduct a Combat Patrol (INF-MAN-4301) Conduct Ground Attack (INF-MAN-4001) Clear a Room (INF-MAN-3002) Conduct Tactical Casualty Care (INF-MAN-3207) Conduct a Patrol (INF-MAN-3301) React to a Meeting Engagement (INF-MAN-4209) Establish a Hasty Traffic Control Point (INF-MAN-4211) Conduct a Cordon and Search (INF-MAN-4213) Integrate Fires (INF-FSPT-4001) Provide Machinegun Fires (INF-MGUN-4001) Provide 60mm and 81mm Indirect Fires (INF-MORT-4002, INF-

MORT-4003)

Squad Organic Weapons

(S) Hand Grenades (Frag, Smoke, FB)

(A) M-4

(A) M-9/17

(A) M27

(A) M-249

(A) M203

(A) M-240B

(A) M320

(S) Javelin

(S) Mortars 60 & 81mm

(S) M72A7 LAAW

(S) M3 MAAWS

TRAINING CAPACITY (1-15)

US ARMY Squad + Trainer (9) USMC Squad + Trainer (13) Trainer (1) Attachments-Medic/Corpsman, JFO, ADA (2)

Maneuver Box 200m Observe Enablers & Effects 1000m FoT & FoF Virtual Effects

ENABLERS/EFFECTS

Indirect fire (Common Call for Fire)

MEDEVAC

PLT Level UAVs Squad Level Quadcopters ADA-Stinger

CAS/JTAC

TMT

Scenario/Exercise Development Creation/Editor Scenario Database, AAR Performance Data Collection, Storage, Dashboard

Conditions/OE OWT Terrain Inserts 200m Mesh Area Geotypical Skins/Wraps -Urban/(DUT) -Subterranean -SW Asia Village -Eastern European Town/Urban Sprawl -Temperate Woodland -Jungle -Desert

-Coastal Urban

Computer Generated Forces BLUFOR Squad Virtual Augmentees (1-14)

OPFOR

-Near Peer dismount Infantry Platoon -Near Peer Snipers X3 -Platoon Irregular Forces -40 Insurgent Forces -IED Capability -Near Peer RED UAS (PLT and SQD LVL) -RED Air (Fixed & Rotor) -Chemical Strike Capability -Representative Set Combat Vehicles -Representative Set Technical Vehicles

CIV

-Representative CIVs for geotypical OEs x40 -Local Leaders/Centers of Influence -Civilian Vehicles -Patterns of Life

HUD-STE Squad Training Deliverables

Integrates One World Terrain, Training Simulation Software and Training Management Tools into one Tool used by HUD.

Element Deliverable System (ARO + 4 months) 50 systems - Commercial HUD Headset COTS Plus - Modified COTS headset w/ integrated COTS thermal camera On-body Computer

Commercial version of on-body computer w/ initial ATAK functionality

Power Power source for commercial product Controller Controller for commercial product Communications Environment

N/A

Software Display Nett Warrior data: 2-D (T), 3-D (O) Augmented Reality Augmented Reality 2-D navigation

Simulated RTA video display Simulated SUAV video display

Artificial Intelligence

Squad duty position configurations and performance System automatic configuration

Misc. Compatible with existing helmets

CS 1/STP 1 Deliverables

System Hardware

CS 1/STP 1 Deliverables

Element Deliverable Adaptive Soldier/ Squad Architecture

Configuration Database (CD): Initial physical data, performance specifications, capabilities & comprehensive interface control documentation for infantry squad

Soldier Performance

Analysis of existing M&S capabilities and proposed priority of gaps to be addressed Established Performance Data Lake Collection of Soldier performance data from existing data sources Collection of biometric data through HUD hardware Provide tool to asses, inform, and optimize Soldier and Squad performance (Threshold) Provide equipment and mission optimization tool with real time updates (Objective)

STE

Squad Training Capability

TSS: Demo of military content & application (avatars, models, and behaviors) OWT: 50m mesh inside and outside, supports terrain of current location TMT: Basic scenario editor (planning/executing) with AAR rewind/edit OE Wraps: Daylight operations, Desert, Coniferous Forest AAR: Capture 3D video with editing tool SQD CAP: Demo scale from 1-4 warfighters & 2 trainers, initial FoT Squad CAP: 14(2) personnel, Fire team capability sample of squad training capability Equipment:

OPFOR: Virtual Small Arms, SAF provides effects on user/enemy

Supporting Software/Components

Element Deliverable System (ARO + 11 months) 300 systems -MIL HUD with Commercial Sensors Headset Conformal low profile head mounted design with day/night see-through immersive reality display, off-axis GFE thermal and low light level sensors On-body Computer

HUD 3.0 Body Pack w/ ATAK functionality

Power Conformal Wearable Battery Controller Tactile, voice, and gesture control Communications Environment

Open tactical environment

Software 3-D Nett Warrior data in augmented reality (for Situational Awareness/Mission Ccmmand) Voice comms & voice to text

Augmented Reality 3-D Navigation Rapid Target Acquisition User Interface Control External Sensors Compatibility Shared SA/C2 and Squad and below-level maneuver graphics

Artificial Intelligence

Actions on Objective: React to contact, MEDEVAC, Planning (PLT and below) Network performance adjustment automation (Squad/Platoon) Aided-target detection Pre-mission planning workflow

Misc. Compatible with existing helmets

CS 2/STP 2 Deliverables

CS 2/STP 2 Deliverables

Element Deliverable Adaptive Soldier/ Squad Architecture

Architecture Assessment Tool (AAT): Demonstrate initial predictive analytics model Hybrid application functionality on all required platforms

Soldier Performance

Analytics dashboard Structure and scope/fidelity of Performance Model M&S roadmap Provide tool to asses, inform, and optimize Soldier and Squad performance (Threshold) Provide equipment and mission optimization tool with real time updates (Objective)

STE

Squad Training Capability

TSS: BLUFOR SQD & OPFOR models OWT: Include postage stamp terrain that Soldier can be geo-imported, 100m inside/outside Mesh, import soldier location into OWT geo-location TMT: Customized data content displayed by trainer, basic scenario editor with rewind/edit OE Wraps: Mountains, Wetlands/Littoral, DUT AAR Data Capture: Did hit, should hit data, sectors of fire, line-of-sight tracking, target acquisition time, speed of engagement.

SQD CAP: 11 Squad Collective Capabilities (React to Direct Fire Contact, Conduct a Squad Assault, Break Contact, React to Ambush (Near),Enter and Clear a Room, Knock Out a Bunker, Enter a Trench to Secure a Foothold, Conduct the Initial Breach of a Mined Wire Obstacle, React to Indirect Fire, React to a Chemical Attack) Equipment: M4/16, M27, M249, M203/320, M9/17, Grenades/Smoke/ Flash Bang OPFOR: AT weapons

Element Deliverable System (ARO + 17 months) 600 systems -MIL HUD with MIL Sensors Integrated

Headset HUD 3.0 w/ waveguide optics and improved (2nd run) GFE thermal and low-light-level sensors w/ FOV >50 degrees per eye

On-body Computer

HUD 3.0 Body Pack w/ ATAK functionality, ISW compliant

Power Conformal Wearable Battery

Controller Tactile, voice, and gesture control

Communications Environment

Contested tactical environment

Software 3-D Nett Warrior data (for Situational Awareness) Voice comms & voice to text, voice control Change detection Comms automation (set up call groups, etc.)

Augmented Reality 3-D Navigation + user designated routes Rapid Target Acquisition User Interface Control External Sensors Compatibility Shared SA/C2 and Platoon and below-level maneuver graphics Post mission AAR

Artificial Intelligence

Actions on Objective: Fires capability, Interoperability Network performance adjustment automation (Company) Basic GPS denied navigation Aided-target detection and classification Pre-mission planning workflow, Post-mission resource re-distribution, Route selection overlay

Misc. Compatible with existing helmets Ballistic eye protection, Laser eye protection 3-D sound field hearing and hearing protection

CS 3/STP 3 Deliverables

CS 3/STP 3 Deliverables

Element Deliverable Adaptive Soldier/ Squad Architecture

Soldier Architecture for Soldier Performance and Equipment Squad-on-Squad performance data collection to update Architecture Tool Configuration Management Plan (CMP): Initial Draft

Soldier Performance

Collection of HUD initial sensor capability Capture and re-create Squad activity in virtual environment DOE to support Continue additional evaluations, studies, and data collection to close gaps Utilization of Machine Learning to identify correlations with performance data Provide tool to asses, inform, and optimize Soldier and Squad performance (Threshold) Provide equipment and mission optimization tool with real time updates (Objective)

STE

Squad Training Capability

TSS: OPFOR and BLUFOR SAF interoperable with voice commands, full FoF, FoT, Civ models OWT: 200M meshing collection of terrain from HUD to OWT, 600m Field of View (FoV) for enablers, Thermal/IR models Binaural audio TMT: Scenario editor populates BLUFOR, OPFOR, civilian models; Initial ability to collect Soldier biometric tracking tool OE Wraps: Arctic SQD CAP: 39 (10) Platoon size element with multiple squads executing simultaneously, FO, Medevac functionality, Virtual drone functionality, Common Call for Fire, CAS, 9 line Equipment: M240B, Grenades/Smoke/Flash Bang, Javelin, AT4, SUAV SQD Tools: Shotgun, Claymore, door breach charges, breaching equipment for a mine-wired obstacle

Element Deliverable System (ARO + 21 months) 1,600 systems - OBJ HUD and Mil Sensors with Wide Field of View Headset HUD 3.0 w/ waveguide optics and latest GFE thermal and low-light-level sensors w/ FOV >50 degrees per eye On-body Computer

HUD 3.0 Body Pack w/ ATAK functionality, ISW compliant

Power Conformal Wearable Battery Controller Tactile, voice, and gesture control Communications Environment

Denied tactical environment

Software 3-D Nett Warrior data (for Situational Awareness) Voice comms & voice to text, voice control Change detection Comms automation (set up call groups, etc.)

Automated data throttle for comms denied scenario Foreign language translation/auto-display

Augmented Reality 3-D Navigation + user designated routes Rapid Target Acquisition User Interface Control External Sensors Compatibility Shared SA/C2 and Company and below-level maneuver graphics Post mission AAR Weapons field of fire, range, and obscuration overlay

Artificial Intelligence Actions on Objective: degraded communications, channel, waveform switching, EW capability Network performance adjustment automation (Battalion) Basic GPS denied navigation Aided-target detection, classification (Man/Vehicle/Other), and recognition (enemy/friendly, vehicle type) Pre-mission planning workflow, Post-mission resource re-distribution, Route selection overlay, Assess threat (weapon/no weapon), Hostile fire locator

Misc. Compatible with existing helmets Ballistic eye protection, Laser eye protection 3-D sound field hearing and hearing protection

CS 4/STP 4 Deliverables

CS 4/STP 4 Deliverables

Element Deliverable Adaptive Soldier/ Squad Architecture

CD: Comprehensive physical data, performance specifications, capabilities & comprehensive interface control documentation for infantry squad; Full redundancy (backup & recovery);

concurrency control sub-systems are operational; access management (read/write) process in place; hosting strategy provided for Govt concurrence AAT: Squad Architecture output, Squad performance baseline and Soldier Lethality Rating;

Hosting and access management strategy

Soldier Performance

Incorporates Adaptive Soldier Architecture data, incorporate rudimentary AI feedback from STE training. Virtual evaluation environment (Decision Support Tool) V&Ved (to an agreed upon level of fidelity). Utilization of Machine Learning to identify Proposed MOPs / MOEs. SLR and Initial Squad Performance Baseline published.

Provide tool to assess, inform, and optimize Soldier and Squad performance (Threshold) Provide equipment and mission optimization tool with real time updates (Objective)

STE

Squad Training Capability

TSS: Organic squad w/ AI SAF & wrap at PLT level, NETT Warrior interoperability, Interactive voice commands, employment of AI route selection capability OWT: Scalable terrain w/ 1k observation of effects & enablers TMT: Scalable scenario editor/AAR with local repository & AAR Analysis Tool, Selected Individual Task development toolkit USMC Squad CAP: 8 Marine Corps Squad Collective Capabilities (Cordon and Search, Patrolling ops, Lead traffic control PT, Conduct recon patrol, Conduct ground attack, Clear a room, Integrate fires, Provide offensive and indirect fire (60mm Mortars, 81mm Mortars) Equipment: Enabler requests for medevac, artillery/CAS/UAS, observe red IDF effects

Programmatic Deliverables

Delivery Date Deliverable Configuration Management Plan

Product Baseline

Performance Specifications

Functional Configuration Audit (FCA) Plan

FCA Report

Configuration Control Documents (ECPs, VECPs, RFVs)

Safety Assessment Report

CS #4 Build Readiness Review Production Manufacturing Plan Reliability Program Plan

Test Failure Notification and Failed Item Analysis Report (FIAR)

HUD 3.0 Logistics Support Plan (LSP) and Test Measurement & Diagnostic Equipment (TMDE) LSP HUD 3.0 Level of Repair Analysis (LORA) and TMDE LORA

System Support Package (SSP) and SSP Component List (SSPCL)

Logistics Demonstration (LD) Plan

LD Report

Instructor & Key Personnel Training (I&KPT)

HUD 3.0 Operator/Crew Training Material

HUD 3.0 Maintainer/TMDE Training Material

HUD 3.0 -10 Technical Manual, -23&P Technical Manual, and Quick Reference Card HUD 3.0 Provisioning Parts List (PPL) & TMDE PPL

HUD 3.0 Engineering Date for Provisioning (EDFP) & TMDE EDFP

Return Process Flow Chart

Warranty Status Report

IPPT Agenda, Read-Ahead Briefing, Meeting Minutes, and Action Items

Systems Engineering Plan

Engineering Management Plan

Frequency Allocation Data

Programmatic Deliverables

Delivery Date Deliverable STP#1, STP#2, STP#3 Software Design Description STP#1, STP#2, STP#3 Software Development Report STP#1, STP#2, STP#3 Risk Management Mitigation Plan and monthly updates STP#1, STP#2, STP#3, STP#4 Monthly Program schedule updates STP#1, STP#2, STP#3, STP#4 Integrated Program Management Report STP#1, STP#2, STP#3, STP#4 Test Procedures, Test Plans and Reports STP#1, STP#2, STP#3, STP#4 Program Management Plan STP#1, STP#2, STP#3, STP#4 Test Plans are due 30 Days prior to tests and Soldier Touch Points STP#1, STP#2, STP#3, STP#4 Test Reports are due 15 Days after test and analysis complete STP#1, STP#2, STP#3, STP#4 Executable Code and Software Documentation STP#3 Interface Control Documents STP#3 CEMA Assessment and Report STP#4 Engineer Drawings, schematics to the system and spare part STP#4 Software Developer Kit (SDK)

Break

15 Minute Break

HUD Contracting Topics

• Contract Strategy & Schedule

• Other Transaction Agreement & Acquisition Approach

Contract Strategy

• The Government intends to award one (1) firm, fixed price (FFP), Other Transaction Agreement (OTA) for up to 2,550 HUD 3.0 systems.

NOTIONAL MILESTONES

- Issue Request for White Paper -------------------------------------------August 2018

- White Paper Submissions Due --------------------------------------September 2018

- Evaluation of White Papers ----------------------------------------- September 2018

- Upward Invitation(s) for Demonstration(s) --------------------- September 2018

- Demonstration(s) & selection of apparent OTA awardee --- September 2018

- Request for Prototype Proposal (RPP) ------------------------------- October 2018

- Negotiations with apparent OTA awardee ---------- October/November 2018

- OTA Award --------------------------------------------------------------- November 2018

Other Transaction Agreement (OTA)

• An Other Transaction Agreement (OTA) is an acquisition instrument which allows agencies to enter into transactions “other than” standard Government contracts, grants and cooperative agreements.

• OTAs are not subject to the Federal Acquisition Regulation (FAR), DoD FAR Supplement (DFARS) and many other statutes and regulations associated with Federal Government contracting.

• OTAs provide a commonsense, flexible, efficient and user-friendly way of linking Government buyers and commercial sellers of advanced technologies.

What is a Non-traditional Defense Contractor?

• An entity that currently is not performing and has not performed, for at least one year preceding the issuance of a Request for White Papers (RWP) by the Government, any contract or subcontract for the DoD that is subject to full coverage under the Cost Accounting Standards (CAS).

• All small businesses are considered Non-traditional

Significant Participation

• Determined on a project basis and based on the importance of the NTDC contribution to the overall execution or outcome of the proposed project.

• Examples of Significant Participation:

• Supplying a key technology, facility or unique capability

• Causing a material and quantifiable reduction in the project cost or schedule

• Causing a measurable increase in the performance of the prototype

• Value-added analysis not based on percentage of project work or value

Types of Cost Sharing (if required)

• Cash: Outlays of funds to perform the OTA project

• Includes labor, materials, new equipment, subcontractor effort

• Sources include new IR&D funds, profit or fee from another contract, overhead or capital equipment expense pool

• In-Kind: Reasonable value of equipment, materials or other property used in performance of the OTA project

White Paper

• DRAFT Announcement provides planned instructions & criteria to be required in an Offeror’s White Paper submission.

- Non-compliance with the submission instructions in Section 3 may preclude offeror from receiving an upward invitation for Demonstration.

• White Paper submissions shall not exceed fifty (50) pages (12-point font):

- Microsoft Word compatible format

- Data Rights Assertions & Specification Sheets do not count towards page limitations

- Advertising Brochures are not desired

- All submissions shall be Unclassified

• White Paper shall consist of five (5) Parts:

- Part 1: Introduction (Title Page does not count towards page limit)

- Part 2: Technical

- Part 3: Data Rights Assertions

- Part 4: Non-Traditional Participation or Price Share

- Part 5: Summary

White Paper (con’t)

• Section 1 – Introduction

• Section 2 - Technical o Technical, Price (Rough Order of Magnitude (ROM)) & Schedule for each of the eight

(8) HUD 3.0 capabilities

• Section 3 – Data Rights Assertions o Identify any intellectual property involved in the effort and associated restrictions on the Government's use of that intellectual property.

• Section 4- Significant Non-Traditional Participation or Price Share o Description of how your company will meet the requirements for non-traditional participation or price share.

• Section 5 – Summary o Total ROM for all eight (8) capabilities outlined in Section 2.

White Paper Evaluation

White papers will be evaluated through a technical review of eight (8) capabilities using the following criteria to determine which Offeror(s) will receive an Upward Invitation for Demonstration:

• Impact of the Project: Provide a solution to Fight, Rehearse, and Train with one system developed within 24 months;

• Quality and Technical Merit: Sound technical and managerial approach to the proposed work, including a demonstrated understanding of the critical technology challenges required to address each of the eight (8) capabilities and a strategy to address any technical challenges, including a risk mitigation strategy within 24 months;

• Capabilities and Experience: Capability to perform proposed work and history of performance of the Team and Team members in developing related technologies and systems within 24 months;

• Price (ROM): Initial assessment of affordability

Demonstrations

• Selected offeror(s) will provide a demonstration of capabilities at their facility

• Process Demonstration shall include:

o Configuration Database o Configuration Management o Manufacturing and Software Development o Quality Management

• Product (hardware & software) Demonstration shall include (to the maximum extent possible):

o Commercial/prototype product o Capability to integrate sensors (GFE) into commercial product o Data Lake o Interface Control Documentation and preliminary design for commercial/prototype product o Commercial-Off-the-Shelf (COTS) headset, COTS thermal sensor, 2-D Augmented Reality (AR) o Android Tactical Assault Kit (ATAK) data and 3D display of blue forces o Data Lake Hardware & Architecture o Modeling & Simulation (M&S) analysis, gap identification o Military mission planning & battle drills o Initial OWT, TSS, TMT Capability of initial STE Squad Capability development efforts

Evaluation of Demonstration

During demonstration the Government will evaluate the following:

• Technology: Technical maturity to achieve the eight (8) capabilities and provide prototypes as stated above within 24 months.

• Manufacturing and Software Development Process: Manufacturing and software development process to include assembly line, production, test, inspection, assembly, packaging and shipping of HUD 3.0s. Long lead items and potential to impact the proposed production schedule for quantities up to 2,550 units. Facility layout for minimum and maximum monthly production rates.

• Quality Management: Quality Management process for in-coming inspection; in process inspection and control; final inspection; process for identification, inspection, and control of critical performance characteristics and processes; and the process for inspection and prevention of non-conforming product.

Basis for OTA Award

• One (1) OTA award will be made to the company that best meets the Government requirements based on an integrated assessment of the evaluation results of the following Factors: White Paper, Demonstration & Price (ROM).

• The Government reserves the right to conduct a Pre-Award Survey or similar review, in order to determine Contractor responsibility.

Follow-on Production

• Given that competitive procedures will be used for selection of the OTA, and provided that the HUD 3.0 prototype project is completed successfully, the Government reserves the right to award a single follow-on production contract or agreement without further competition, as authorized by statute.

Non Disclosure Agreements

• Prospective offerors are advised that Non-Government advisors from the SETA support contractors identified below may participate in the selection process.

These companies will be excluded from competition for this award.

• All Non-Government Advisors will have signed Non-Disclosure Agreements (NDAs) with the Government.

• Prospective offerors may enter into a specific NDA with these corporate entities prior to submission of their white paper/demonstration/proposal:

o Artlin Consulting: Matt Maginniss, (703) 304-0542, matthewmaginniss@artlinconsulting.com o CACI: Tracey Anderson, (703) 679-3520, tranderson@caci.com o NCI: M. O’Brien, (571)329-2244, mobrien@nciinc.com

Summary and Written Questions

• Presented HUD 3.0 requirements and contract strategy

• Written questions are encouraged

• Submit written questions on 3x5 cards to Government personnel today if ready

• Submit future questions to ACC-APG, see contacts page

David K. Hart Army Contracting Command- Aberdeen Proving Ground

(ACC-APG)

david.k.hart.civ@mail.mil

Lisa J. Yamakawa Army Contracting Command- Aberdeen Proving Ground

(ACC-APG)

lisa.j.yamakawa.civ@mail.mil