RRL_FY24_CC_SOW_DRAFT_28Feb23.pdf

STATEMENT OF WORK (SOW)

FOR

SAILOR 2025 (S2025) READY RELEVANT LEARNING (RRL)

FISCAL YEAR 2024 (FY24) CONTENT CONVERSION (CC)

FOR

AVIATION TECHNICAIN (AT) AND AIRCREW (AW) RATINGS

Prepared For:

Commander, United States Fleet Forces Command (CFFC)

Norfolk, VA 23551-2487

Prepared By:

Naval Air Warfare Center Training Systems Division (NAWCTSD) 12211 Science Drive Orlando, FL 32826

28 FEBRUARY 2023

DISTRIBUTION A. Approved for public release. Distribution is unlimited.

Statement of Work for the RRL FY24 CONTENT CONVERSION EFFORT 28 FEB 2023 ii

This page intentionally left blank.

iii

REVIEWED BY: DATE:

REVIEWED BY: DATE:

APPROVED BY: DATE:

iv

Change Log

Date Section Number Section Title Change v

TABLE OF CONTENTS

Para. Title Page

1 SCOPE

1.1 Rating Requirements

1.2 Course, Module and Lesson Structure

1.3 Content Delivery Modes and Media Types

1.4 Agile/Scrum Approach to Content Conversion

1.4.1 Coordination with Third-Parties

1.5 List of SOW Appendices

1.6 Terms and Definitions

1.7 Government-Furnished Information (GFI)

1.8 Government-Furnished Software, Tools, and Equipment

1.9 Government-Furnished Subject Matter Experts (SMEs)

2 APPLICABLE DOCUMENTS

2.1 Government Documents

2.2 Department of Defense (DOD) Documents

2.3 Department of the Navy (DON) Documents

2.4 Authoring Instructional Materials (AIM) Documents

2.5 Industry Standards

2.6 Other Documents

3 REQUIREMENTS

3.1 General Requirements

3.1.1 RRL Content Conversion Planning

3.1.1.1 Life-Cycle Model Management

3.1.1.2 Infrastructure Management

3.1.1.3 Program Assessment and Control

3.1.1.4 Program Decision Management

3.1.2 Contract Data Requirements Lists (CDRLs)

3.1.3 Online Management System (OMS)

3.1.3.1 Scrum Board Requirements

3.1.3.2 OMS Basic Requirements

3.1.3.2.1 OMS Required Functionality for Interactive Multimedia Instruction (IMI), Supporting Material and Complex Media Reviews

3.1.3.2.2 OMS Comment Submission Capability for IMI, Supporting Material and

Complex Media Reviews

3.1.3.2.3 OMS Comment Review and Administration Capability for IMI, Supporting Material and Complex Media Reviews

3.1.4 Configuration Management (CM)

3.1.5 Contractor Subject Matter Experts (SMEs)

3.1.6 Copyrights

3.1.7 Quality Assurance and Management Plan (QAMP)

vi

3.1.7.1 Control of Government-Furnished Information (GFI)

3.1.8 Communications Plan

3.2 Security

3.2.1 Operations Security (OPSEC)

3.2.2 Unclassified Contractor-Owned Network Security – Safeguarding of

Unclassified Controlled Technical Information

3.2.3 Cyber Incident and Compromise Reporting

3.2.4 Access to DOD Installations, Government Information and Information

Technology (IT) Systems – Personnel Security Background Checks

3.2.5 Personnel Security – Background Checks

3.2.6 International Traffic and Arms Regulation

3.2.7 Personnel Security – Reporting of Adverse or Derogatory Information

Related to Contractors

3.2.8 Government-Issued Personal Identification Credentials

3.2.9 Contractor “Out-Processing” Policy

3.2.10 Supply Chain Risk Management (SCRM) for National Security Systems21

3.2.11 Protection of Critical Program Information (CPI)

3.2.12 Transmission of Controlled Unclassified Information (CUI) Via Email.. 22

3.2.13 Transmission of CUI via DOD Safe Access File Exchange (DOD SAFE)

3.3 Cybersecurity

3.3.1 Critical Program Information (CPI)

3.3.2 Cybersecurity Training and Certification

3.3.3 Software Integrity Testing and Certification

3.4 Management Requirements

3.4.1 Integrated Product Team (IPT)

3.4.2 Integrated Management Plan (IMP)

3.4.3 Work Planning and Scheduling

3.4.4 Reserved

3.4.5 Subcontractor Management and Reporting

3.4.6 Risk Management

3.4.6.1 Schedule Risk Assessment (SRA)

3.4.7 Program Progress, Tracking, and Reporting

3.4.8 Conferences, Meetings, and Reviews

3.4.8.1 Post Award Conference (PAC)

3.4.8.2 In-Process Review (IPR) Meetings

3.4.8.3 Weekly or Biweekly IPT Meetings

3.4.8.4 Test & Evaluation Working IPT (T&E WIPT)

3.4.8.5 Systems Engineering IPT (SEIT)

3.4.8.6 Data-Gathering Trips

3.5 RRL Content Conversion Requirements

Using the IPRD, IMRD, FRD, SOW Appendix A, initial Training Project Plan (TPP) and initial

Training Course Control Document (TCCD) data as a basis, the contractor vii shall conduct the following activities and deliver the required training products. The media types and their respective deliverables in each section below support each of the content delivery modes depicted in Table 2 (IFIT and SDIT). Training Material Design

3.5.1 Design for Training Product Delivery Environments

3.5.1.1 Design Implementations to Reduce TRANET Virtual Desktop

Infrastructure (VDI) Bandwidth Usage

3.5.1.1.1 Design for Experience Application Program Interface (xAPI)

Requirements

3.5.1.1.2 Design for Mobile Requirements

3.5.2 IMI, Media Types

3.5.2.1 NETC Style Guide Updates

3.5.2.2 Lesson Prototypes

3.5.2.3 Photos and Graphics

3.5.2.4 Test Package Development (Assessments)

3.5.2.5 Course Testing Plan (Administration)

3.5.2.6 Training Conduct Support Document (TCSD)

3.5.2.7 Training Program Structure Documents (TPSD)

3.5.2.8 Training Systems Support Document (TSSD)

3.5.2.9 Test & Evaluation for IMI

3.5.2.9.1 T&E Program Components for NETC LMS-deployed IMI (LMS IMI) ...37

LMS CHaRMS Record Process LMS System Integration & Testing (LMS SI&T) LMS Government Content Acceptance Testing (LMS GCAT)

3.5.2.9.2 T&E Program Components for Stand-Alone Configuration IMI (SAC

IMI)

SAC Contractor Internal Testing (SAC DT-D1) SAC Government Content Acceptance Testing (SAC GCAT)

3.5.2.10 T3 and Course Pilot Preparation

3.5.2.10.1 Instructional Media Package (Media Source Files)

3.5.2.10.2 Instructional Media Package (Final Curriculum Delivery)

3.5.3 Complex Media Types

3.5.3.1 Systems Engineering Processes

3.5.3.1.1 System Requirements Definition

3.5.3.1.2 System Requirements Analysis

3.5.3.1.3 Traceability

3.5.3.1.4 System Architectural Design

3.5.3.1.5 System Implementation

3.5.3.1.6 System Integration

3.5.3.1.7 System Verification

3.5.3.1.8 System Transition

3.5.3.1.9 Test Readiness Review

3.5.3.2 Software Engineering Processes

viii

3.5.3.2.1 Complex Media SPD

3.5.3.2.2 Complex Media Design Technical Interchange Meeting (TIM)

Complex Media Design TIM Entry Criteria Complex Media Design TIM Exit Criteria

3.5.3.2.3 Complex Media In-Progress Reviews

3.5.3.2.4 Software Architectural Design

3.5.3.2.5 Software Product Design

3.5.3.2.6 Software Implementation

Software Unit Construction and Testing

3.5.3.2.7 Software Integration

3.5.3.2.8 Cold Start Process

Software Product Execution Media and Storage Devices Software Media Marking

3.5.3.3 Test & Evaluation for Complex Media

3.5.3.3.1 Test Methods

Quality of Test Data Code Analysis

3.5.3.3.2 Software Changes during Test

3.5.3.3.3 Non-Conformance Reporting System

3.5.3.3.4 T&E Program Components for Complex Media

Internal Contractor Testing (Simulation DT-D1) Test Readiness Review (TRR) Government Acceptance Testing (Simulation IT-D1) Test Discrepancy Review Board (TDRB)

3.5.3.4 Detailed Tasks for Complex Media

3.5.3.4.1 Complex Media SI Appendices to the Rating SPD

3.5.3.4.2 Training Support Products

Complex Media T3 and Course Pilot Preparation

3.5.3.4.2.1.1 Instructional Media Package (Media Source Files)

3.5.3.4.2.1.2 Instructional Media Package (Final Curriculum Delivery)

3.5.4 Human Factors Engineering (HFE)

3.5.5 Train the Trainer (T3)

3.5.5.1 T3 Entry Criteria

3.5.5.2 T3 Exit Criteria

3.5.6 Course Pilot

3.5.6.1 Course Pilot Entry Criteria

3.5.6.2 Course Pilot Exit Criteria

3.5.6.3 Regression Testing Following T3 and Course Pilot Events

3.5.6.3.1 Post Pilot GCAT

3.5.6.3.2 Post-Pilot Complex Media Regression Test

ix

LIST OF TABLES

Table and Title Page Table 1. Rating Classification Requirements Table 2. Content Delivery Modes and Media Types Table 3. Government Documents Table 4. DOD Documents Table 5. DON Documents Table 6. AIM Documents Table 7. Industry Standards Table 8. Other Documents Table 9. Photo/Graphic Traceability Cross Reference Matrix

Statement of Work for the RRL FY24 Content Conversion Effort 28 FEB 2023

STATEMENT OF WORK (SOW)

FOR

SAILOR 2025 (S2025) READY RELEVANT LEARNING (RRL)

FYSCAL YEAR 2024 (FY24) CONTENT CONVERSION (CC)

FOR AVIATION TECHNICIAN (AT) AND AIRCREW (AW) RATINGS

1 SCOPE

This Statement of Work (SOW) defines the basic requirements to be performed under this Ready Relevant Learning Content Conversion (RRL CC) Indefinite Delivery/Indefinite Quantity (ID/IQ) contract for the Avionics Technician (AT) and Aircrew (AW) Ratings. The detailed requirements will be defined in this ID/IQ SOW and each specific Delivery Order (DO). This ID/IQ SOW documents the contractor tasks for the design, development, testing, and delivery of products in support of the RRL CC effort (see especially Appendices C, G, I). The contractor shall employ innovative instructional systems design (see Appendices C, G and I), systems engineering, and training assessment approaches in conjunction with new and modernized technologies (see Appendix G) to support accession training while simultaneously supporting the broader Sailor 2025 (S2025) overarching goal of improving Sailors’ transfer of training to the operational work environment. The following represents examples of the broader S2025 goals:

a. Converting and/or improving designated courses so they are compatible with the waterfront or shipboard environment and contribute to the acquisition of actionable knowledge (i.e., practical knowledge that will be activated by and recognized as relevant to operational work contexts and events).

b. Employing modernized media, instructional, and motivational strategies that are engaging (see Appendices G and I).

c. Scheduling the converted and/or improved content closer in time to when the training will be put into practice in the work environment.

In context of RRL, Content Conversion focuses on the instructional design, strategies, media, and content within a given course. The effort requires using Fleet-validated data and designing, developing and delivering improved training products that meet the concepts of innovative instructional systems design and modernized technologies. Content Conversion is far more involved than simply converting existing media from one format to another (e.g. converting PowerPoint or Flash files to HTML5) and includes correcting content errors and resolving content discrepancies in erroneous data as part of the effort. Content Conversion is coupled with, but distinct from, Courseware Modernization, which focuses on the delivery of training curricula

– the timing and point of need along a Sailor’s Career Long Learning Continuum (CLLC), the delivery system(s) and supporting Information Systems and Technology (IS&T) architecture, and the recording of learning event data for analytics.

1.1 Rating Requirements

The contractor shall perform tasks for the design, development, testing, and delivery of products for the ratings listed in Table 1 (highest classification of GFI isSECRET).

Table 1. Rating Classification Requirements

Rating Highest

Information Classification

Facilities Access Classification

When Classification

Required Aviation Technician (AT)

- Aviation Electronics Technician – Intermediate

(ATI)

- Aviation Electronics Technician – Organizational (ATO)

SECRET SECRET At Contract Award

Aircrew Ratings

- Naval Aircrewman

Mechanical (AWF)

- Naval Aircrewman

Helicopter (AWS)

- Naval Aircrewman

Operator (AWO)

- Naval Aircrewman –

Tactical Helicopter (AWR)

- Naval Aircrewman –

Avionics (AWV)

SECRET SECRET At Contract Award

1.2 Course, Module and Lesson Structure

Using the Government provided Functional Requirements Document (FRD), Instructional Performance Requirements Document (IPRD), Instructional Media Requirements Document (IMRD), complex media fidelity data, and requirements workbook (SOW Appendix A) as a basis, the contractor shall determine the course, module, and lesson structure for each AT AND AW rating’s curricula. The contractor shall derive the requirements for the software solutions, design, develop, test, and deliver products meeting the specified requirements.

1.3 Content Delivery Modes and Media Types

Training products are grouped under two content delivery modes: Instructor-Facilitated Interactive Training (IFIT) and Self-Directed Interactive Training (SDIT)(see Appendices C and G). Table 2 shows the four overarching content delivery modes and a high-level view of associated media types to support the RRL effort, as identified in the requirements workbook and complex media fidelity data.

NOTE: There is no traditional Instructor-Led Training Computer-Assisted Instruction (ILT-CAI) media type or instructional strategy in the RRL Content Conversion effort;

rather, the contractor shall design and develop interactive multimedia instruction (IMI) for use as IFIT that meets the requirements for being hosted in Navy eLearning (NeL). In context for Ready Relevant Learning, “IMI” is the preferred term and shall be interpreted generically as electronic media, replacing both Interactive Courseware (“ICW”) and “ILT-CAI” as terms regardless of whether the product is instructor-led or student-led, and including considerations for software management tools (e.g., Learning Management System, Learning Record Store).

Table 2. Content Delivery Modes and Media Types

Media IFIT SDIT

Actual Equipment X Actual Equipment Trainer X Augmented Reality (AR) X Checklist X X Decision Tables X X Demonstration Animation X X Demonstration Video X X Electronic Performance Support System (EPSS) Hybrid Mobile App X X Immersive Virtual Environment (IVE) X X Intelligent Tutoring System X Job Aid (JA) Level 1 IMI X X Level 2 IMI X X Level 3 IMI X X Mixed Reality (MR) X Mobile Friendly/Mobile Ready Website X X Mobile Optimized Website X X Mobile Web App X X Native App X X Paper/Paper-based X X Personal Computer (PC) Simulation X X Picture/Diagram X X Responsive Design Website X X Training Aid X X Training Support Material X X Virtual Reality (VR) X

1.4 Agile/Scrum Approach to Content Conversion

The contractor shall follow a systematic approach to curriculum (training material) development using the Agile Methodology and Scrum Framework to expedite going from GFI requirements to fully accepted training materials. The contractor shall maintain and make visible to the government at all times during the period of performance a current scrum board, including at a minimum the product backlog, sprint backlog, increments and expected government engagement in each sprint.

1.4.1 Coordination with Third-Parties

As required, the contractor shall coordinate with the Government and any third-party contractor responsible for developing complex media (e.g., virtual simulation, Augmented/Mixed/Virtual

Reality, or Immersive Virtual Environment system development (e.g., Government labs, Multipurpose Reconfigurable Training System (MRTS) 3D, PORTS, etc.). In such cases, the contractor shall design and develop training support materials that work together with the third-party developed system.

1.5 List of SOW Appendices

To complete this effort, the contractor shall follow the guidance and requirements in this SOW to include the following Content Conversion appendices to this SOW:

• Appendix A: Rating requirements covered by this SOW.

• Appendix B: Acronyms used within this SOW.

• Appendix C: Terms and definitions used within and outside this SOW regarding RRL

Content Conversion.

• Appendix D: List of the Contract Data Requirements Lists (CDRLs) identified within this SOW.

• Appendix E: Risk Assessment Example Format.

• Appendix F: Descriptions of the four RRL content delivery modes.

• Appendix G: Operational definitions of engaging instructional strategies to be used in content development under this SOW.

• Appendix H: List of Bloom’s taxonomy action verbs.

• Appendix I: Description of media type characteristics.

1.6 Terms and Definitions

Appendix C provides the terms and definitions that are critical to this SOW. These terms and definitions supersede any similar terms and definitions that may be found in other sources.

1.7 Government-Furnished Information (GFI)

The Government will provide the following on an as-is basis for the ratings:

a. Requirements workbook (Appendix A) for each rating, at DO award.

b. Complex media fidelity data for each rating, as available.

c. IPRD, at DO award.

d. IMRD, at DO award.

e. FRD, at DO award.

f. Initial Training Project Plan (TPP) for each course, at DO award.

g. Initial Training Course Control Document (TCCD), at DO award.

h. Existing Trainee Guides, Lesson Plans, Training Course Control Document (TCCD), Training Project Plan (TPP), Curriculum Outline of Instruction (COI) ) for each rating, as available, at DO award. Updates, if available, NLT 30 days after DO award.

i. Access to existing data for each rating in Content Planning Module/Learning Object Module (CPM/LOM), if available, such as existing Trainee Guides, Lesson Plans, TCCD, TPP, COI, NLT 30 days after DO award.

j. Examples of existing courseware, if available, at contract award. (For RRL the Government does not intend to provide all existing IMI or source files as GFI to discourage the contractor from simply copying and pasting content into a different format. The contractor shall plan as though no existing courseware materials are available.)

k. Applicable Style Guides, if available, at contract award. Updates, if available, NLT 30 days after contract award.

l. Technical Publications (e.g., technical manuals), if available, at contract award. Updates, if available, NLT 30 days after contract award.

Any other GFI not listed here is ancillary and its absence does not prevent the contract from being executed.

1.8 Government-Furnished Software, Tools, and Equipment

The Government will provide access to a test bed at NAWCTSD for TRANET-U Virtual Desktop Infrastructure (VDI) content for the contractor to test training materials. The contractor shall provide the necessary hardware, software, tools, personnel, materials, and facilities, not otherwise furnished by the Government, to perform the tasks specified by this SOW.

1.9 Government-Furnished Subject Matter Experts (SMEs)

Government SME access will be provided on a not-to-interfere basis. The Government is sensitive to overburdening SMEs. NAWCTSD will serve as the liaison between the fleet, Type Commander (TYCOM), Learning Centers (LCs) and/or Schoolhouses, and the contractor to coordinate access to SMEs in support of SOW activities and requirements. Location for SME support will be provided by the Government. The Government’s SMEs will be available face-to-face for key data collection activities (interviews, workshops, and reviews) and will be available for providing follow up information via phone, video-teleconference (VTC), or approved virtual meeting tools, whenever practical.

2 APPLICABLE DOCUMENTS

The following represent a list of applicable guidance documents for this effort. In the event of a conflict between the SOW and the references cited herein, the contents of this SOW take precedence. Nothing in this SOW, however, supersedes applicable laws and regulations, unless a specific exemption has been obtained. These documents will be provided to the contractor as GFI, if they are not readily available to the contractor via the Internet. For all documents listed below, the latest versions apply.

2.1 Government Documents

Table 3. Government Documents

Document Number Document Title and/or Description National Security Agency (NSA) Configuration Guide NAVAIRINST 4355.19E System Engineering Technical Review Process National Institute of Standards and Technology (NIST) Special Publication (SP) 800-44

Guidelines on Securing Public Web Servers

Document Number Document Title and/or Description United States (U.S.) Office of Personnel Management

(OPM) Final Credentialing Standards for Issuing Personal Identity Verification

• Copies of Defense Intelligence Security Agency (DISA) Configuration Guide can be obtained from http://disa.mil/.

• Copies of NSA Configuration Guides can be obtained from http://www.nsa.gov/ia/mitigation_guidance/security_configuration_guides/index.shtml.

• Copies of National Institute of Standards and Technology (NIST) documents can be obtained from http://csrc.nist.gov/publications/PubsSPs.html. Copies of OSHA standards can be obtained from http://www.osha.gov.

• Copies of OPM document can be obtained from http://www.opm.gov/investigate/resources/index.aspx.

2.2 Department of Defense (DOD) Documents

Table 4. DOD Documents

DOD Document Number Document Title and/or Description Department of Defense Instruction (DODI) 1322.26

Distributed Learning (DL) dated 05 October 2017 (https://adlnet.gov/dodi/dodi-xapi)

DODI 5000.02 Operation of the Defense Acquisition System DODI 5200.39 Critical Program Information (CPI) Identification and

Protection Within Research, Development, Test, and Evaluation (RDT&E) dated October 15, 2018

DODI 5200.48 Controlled Unclassified Information (CUI) dated March 6, DODI 8500.01 Department of Defense Instruction 8500.01 Cyber Security dated 14 Mar 2014

DODI 8510.01 Risk Management Framework (RMF) for DOD Information Technology (IT), Change 1, dated 24 May 2016

DODI 5220.22-M National Industrial Security Program Operating Manual, dated 28 Feb 2006

DOD 8570.01-M Information Assurance (IA) Workforce Improvement Program, dated 19 Dec 2005 w/Change 4, 11/10/2015

DOD Implementation Plan for Advanced Distributed Learning (ADL) dated 19 May 2000

Military Handbook (MIL-

HDBK)-881D

Work Breakdown Structures for Defense Materiel Items

MIL-HDBK-29612-1A Department of Defense Handbook for Guidance for Acquisition of Training Data Products and Services (Part 1 of 5)

MIL-HDBK-29612-2A Department of Defense Handbook for Instructional Systems Development/Systems Approach to Training and Education (Part 2 of 5)

MIL-HDBK-29612-3A Development of Interactive Multimedia Instruction (Part 3 of 5) http://disa.mil/ http://csrc.nist.gov/publications/PubsSPs.html http://www.osha.gov/ http://www.opm.gov/investigate/resources/index.aspx

DOD Document Number Document Title and/or Description MIL-HDBK-29612-4A Department of Defense Handbook Glossary for Training (Part 4 of 5) MIL-HDBK-29612-5A Department of Defense Handbook for Advanced Distributed

Learning (ADL) Products and Systems (Part 5 of 5) MIL-PRF-29612B Performance Specification Training Data Products MIL-HDBK-217F, Notice 2 Reliability Prediction of Electronic Equipment MIL-HDBK-472, Notice 1 Maintainability Prediction

• Copies of DOD Directives and Instructions can be obtained from the DOD Issuances

Website (http://www.dtic.mil/whs/directives/).

• DOD Implementation Plan for ADL can be obtained from http://prhome.defense.gov/Portals/52/Documents/RFM/Readiness/docs/adl_implementplan .pdf.

• Copies of the DOD Specifications and Handbooks can be obtained online from the DOD Single Stock Point or from the Acquisition Streamlining and Standardization Information System (ASSIST) website (http://everyspec.com/DOD/DOD-HDBK/)

2.3 Department of the Navy (DON) Documents

Table 5. DON Documents

DON Documents Document Title and/or Description DON Department of Defense Information Assurance

Certification and Accreditation Process (DIACAP) Handbook Version 1, dated 15 July 2008

NETCINST 5510.1 Content Segmentation and Classification Guide NETCNOTE 1500.6 Metadata Instruction NMCI.10011.01.UA3.E Core Build Contents Version 2.3, 02 Aug 07

Copies of the Navy Marine Corps Intranet (NMCI) Core Build Standard can be obtained from http://www.nmci-eds.com/downloads/core-build

OPNAVINST 1500.76C Naval Training System Requirements, Acquisition, and Management

Secretary of the Navy Instruction (SECNAVINST) 5000.36A

Department of the Navy Information Technology Application and Data Management

SECNAVINST 5870.4A Copyright, dated 16 Aug 2005 Secretary of the Navy

(SECNAV) M-5239.1

Department of the Navy Information Assurance Program, Information Assurance Manual, dated Nov 2005

SECNAV M-5510.36 Department of the Navy, Information Security Program, dated Jun 2006

RRLGM #21-0005A RRL Guidance Memorandum, NETC Approved Content Authoring Tools, 26 October 2022

RRLGM) #22-0001 Ready Relevant Learning Guidance Memorandum, Implementation of Practical Applications of Learning Science (PALS), 13 may 2022 http://www.dtic.mil/whs/directives/ http://prhome.defense.gov/Portals/52/Documents/RFM/Readiness/docs/adl_implementplan.pdf http://prhome.defense.gov/Portals/52/Documents/RFM/Readiness/docs/adl_implementplan.pdf http://www.nmci-eds.com/downloads/core-build http://www.nmci-eds.com/downloads/core-build

DON Documents Document Title and/or Description

• Copies of the CON DIACAP Handbook can be obtained from https://www.doncio.navy.mil/tagResults.aspx?ID=96

• Copies of the DON documents can be obtained online from the Navy’s Integrate Learning

Environment website: https://www.secnav.navy.mil/doni/Directives/Forms/AllItems.aspx

2.4 Authoring Instructional Materials (AIM) Documents

Table 6. AIM Documents

Document Number Document Title and/or Description AIM Content Planning Module (CPM) User’s Manual AIM Learning Object Module (LOM) User’s Manual

• Copies of the AIM documentation can be obtained from https://www.public.navy.mil/netc/ntt/pdfs/End_to_End_Process_SOP_(7-11-14)_Final.pdf

2.5 Industry Standards

Table 7. Industry Standards

Document Owner Document Title and/or Description ADL Co-Laboratories Shareable Content Object Reference Model (SCORM®)

2004—SCORM® is a collection of standards and specifications adapted from multiple sources to provide a comprehensive suite of e-learning capabilities that enable interoperability, accessibility and reusability of Web-based learning content.

SCORM® documents and important information about SCORM® can be obtained from:

http://www.adlnet.gov/policy.

ADL Co-Laboratories SCORM 2004 Conformance Testing Tool—This is a self-testing tool downloaded from http://www.adlnet.org to verify SCORM® compliant courseware.

ADL Co-Laboratories The Advanced Distributed Learning Registry (ADL-R): Best Practices for Updating Registered Content https://www.atsc.army.mil/tadlp/implementation/scorm/confor mance/tools_scorm.asp

Experience API SCORM Profile

Guidelines for representing SCORM® data and events as xAPI Statements. Provides a representation of the SCORM® data model as well as limited SCORM®-specific features, but uses xAPI for run time communications and tracking. The SCORM® profile was created as a compatibility approach to xAPI. It can be used to:

• Create content that can track to both a Learning Management

System (LMS) and learning record store (LRS).

• Convert existing SCORM® data to xAPI Statements that can be stored in an LRS.

http://www.adlnet.gov/policy https://www.atsc.army.mil/tadlp/implementation/scorm/conformance/tools_scorm.asp https://www.atsc.army.mil/tadlp/implementation/scorm/conformance/tools_scorm.asp

Document Owner Document Title and/or Description

• Track experiences from a learning record provider in a manner consistent with how they would've been tracked in

SCORM®.

(http://adlnet.github.io/xAPI-SCORM-Profile/) xAPI LRS Conformance Requirements

The Experience API (xAPI) Conformance Requirements for Learning Record Stores (https://adl.gitbooks.io/xapi-lrs-conformance-requirements/content/) cmi5 (Case Mix Index) Profile Specification

A profile specification for xAPI that describes packaging, launch, and important data capture concepts for traditional LMSs that include an LRS.

(https://github.com/AICC/CMI-5_Spec_Current) Aviation Industry CBT Committee (AICC)

ANSI/ASQ Q9000-2000 Quality Management Systems - Fundamentals and Vocabulary ANSI/ASQ Q9001-2000 Quality Management Systems - Requirements ANSI/ASQ Q9004-2000 Quality Management Systems - Guidelines for Performance

Improvements ANSI Z535.1-2006 (R 2011) Safety Colors ANSI Z535.2-2011 Environmental and Facility Safety Signs ANSI Z535.3-2011 Criteria for Safety Symbols ANSI Z535.4-2011 Product Safety Signs and Labels ANSI Z535.5-2011 Safety Tags and Barricade Tapes (for Temporary Hazards) Integrated Master Schedule (IMS) Global Learning Consortium

Question & Test Interoperability (QTI) Specification

Joint ADL Co-Lab Best Practices Guide for Design and Development of SCORM Assessments (https://adlnet.gov/research/scorm/scorm-2004- 4th-edition/scorm-2004-4th-edition-conformance-test-suite/)

• Copies of the industry standard documents can be found by visiting the web addresses indicated.

• Copies of the American National Standards Institute (ANSI)/American Society for Quality Control (ASQC) Standards can be obtained from the (http://www.ansi.org).

2.6 Other Documents

Table 8. Other Documents

Document Number Document Title and/or Description CJCSI 6510.01F IA and Computer Network Defense (CND) Executive Order 13465 Economy and Efficiency in Government Procurement Through

Compliance with Certain Immigration and Nationality Act http://adlnet.github.io/xAPI-SCORM-Profile/

Document Number Document Title and/or Description Provisions and Use of an Electronic Employment Eligibility Verification System, dated 6 June 2008 (Amendment to Executive Order 12989 of 13 February 1996)

NMCI.10011.01.UF0.E Core Build Contents Version 7, 22 May 2012 NAVAIRINST 5000.21B Naval Systems Command (SYSCOM) Risk Management

Policy dated 24 Jan 2008 Unnumbered Document Joint ADL Co-Lab, ADL Acquisition Guidance, dated 9 Aug

NAVPERS 18068F Volume I Navy Enlisted Occupational Standards Unnumbered Document NeL Content Hosting Frequently Asked Questions (FAQ) Unnumbered Document Navy Education and Training Center (NETC) Course Hosting

Process Unnumbered Document Content Hosting and Report Management Service (CHaRMS)

Developer User Guide V2 Unnumbered Document Virtual Desktop Infrastructure (VDI) Specifications Brief Unnumbered Document VDI Risk Management Framework package Unnumbered Document NETC Common Reference Profile

(https://netc.usalearning.net/xapi-library/resources/pdf/NETC- Common-Reference-Profile.pdf)

Unnumbered Document NETC E-learning Profile (https://netc.usalearning.net/xapi-library/resources/pdf/NETC-E-learning-Profile.pdf)

Unnumbered Document NETC Performance Support Profile (https://netc.usalearning.net/xapi-library/resources/pdf/NETC- Performance-Support-Profile.pdf)

Unnumbered Document NETC Simulation Base Profile (https://netc.usalearning.net/xapi-library/resources/pdf/NETC- Simulation-Profile.pdf)

Unnumbered Document NETC xAPI Glossary (https://netc.usalearning.net/xapi-library/resources/pdf/NETC-xAPI-Glossary.pdf)

Unnumbered Document NETC xAPI Implementation Guidelines (https://netc.usalearning.net/xapi-library/resources/pdf/NETC-xAPI-Implementation-Guidelines.pdf)

Unnumbered Document OPNAV N96, Surface Training Advanced Virtual Environment (STAVE) Interoperability Standard (SIS) Version 2.0, February 2021 (or latest version)

Unnumbered Document The Scrum Guide, The Definitive Guide to Scrum: The Rules of the Game, November 2020 (or latest), by Ken Schwaber and Jeff Sutherland

• Copies of the CJCSI document can be obtained from http://www.dtic.mil/dtic/.

• Copies of the Presidential document can be obtained from the Federal Register at http://edocket.access.gpo.gov/2008/pdf/08-1348.pdf.

• Copies of the NMCI document can be obtained from the Navy’s Integrate Learning

Environment website (https://www.public.navy.mil/netc/ile/Default.aspx).

https://netc.usalearning.net/xapi-library/resources/pdf/NETC-Common-Reference-Profile.pdf https://netc.usalearning.net/xapi-library/resources/pdf/NETC-Common-Reference-Profile.pdf

Document Number Document Title and/or Description

• Copies of the SCORM documents can be obtained from http://www.adlnet.gov/capabilities/scorm/scorm-2004-4th#tab-resources.

• Copies of the Joint ADL Co-Lab document can be obtained from https://adlnet.gov/collaboration/dadlac.

• Copies of NAVAIRINST 5000.21B can be obtained from https://directives.navair.navy.mil/.

OPNAVINST 11010.20H Facilities Project Instruction

• Copies of these instructions are available at http;//doni.daps.dla.mil.

MIL-STD--130N Department of Defense (DOD) Standard Practices –

Identification Markings of U.S. Military Property

• Copies of this standard is available online at: http://quicksearch.dla.mil/qsSearch.aspx.

DOD 5010-12M Procedures for Acquisition Management of Technical Data

• The publication shown above is available at http://www.dtic.mil/whs/directives/corres/pdf/501012m.pdf.

Defense Federal Acquisition Regulation Supplement

(DFARS) 252.211-7003

Item Identification and Valuation (August 2008)

DFARS 252.239-7001 Information Assurance Contractor Training and Certification (January 2008)

DFARS 252.204-7012 Safeguarding Covered Defense Information and Cyber Incident Reporting

FAR 2.101 Definitions FAR 52.204-9 Personal Identity Verification of Contractor Personnel FAR 52.222-54 Employment Eligibility Verification

• FAR and DFARS clauses are downloadable from https://www.acquisition.gov.

DODD 8140.01 Cyberspace Workforce management, dated 11 August 2015 DODI 8520.02 Public Key Infrastructure (PKI) and Public Key (PK)

Enabling, dated 24 May 2011 NIST SP 800-53r4 National Institute of Standards and technology (NIST) –

Security and Privacy Controls for Federal Information Systems and Organizations, dated 22 January 2015

CNSSI 1253 Committee on National Security Systems Instruction (CNSSI)

– Security Categorization and Control Selection for National Security Systems, dated 27 March 2014

SECNAV M-5239.2 Department of the Navy Cyberspace Information Technology and Cybersecurity Workforce management and Qualification manual, dated June 2016

• (The above documents are available from the following sources:

• DOD Instructions, Directives, and Manuals are available at http://www.esd.whs.mil/DD/DOD-Issuances/.

• NIST Special Publications are available at https://csrc.nist.gov/Publications.

• CNSSI Instructions are available at https://www.cnss.gov.

• SECNAV Manuals are available at https://doni.documentservices.dla.mil/manuals-secnav.aspx).

http://www.esd.whs.mil/DD/DoD-Issuances/ https://csrc.nist.gov/Publications https://www.cnss.gov/CNSS/issuances/instructions.cfm https://doni.documentservices.dla.mil/manuals-secnav.aspx https://doni.documentservices.dla.mil/manuals-secnav.aspx

Document Number Document Title and/or Description DoN NAVEDTRA Documents

NAVEDTRA 130B (series) Task Based Curriculum Development Manual, (Volumes 1-3) NAVEDTRA 131B (series) Personnel Performance Profile Based Curriculum

Development Manual, Volumes (1 – 3) NAVEDTRA 132 (series) Navy School Testing Program Management Manual NAVEDTRA 136 Naval Education and Training Command Integrated Learning

Environment Course Development and Life Cycle Maintenance

• Copies of the NAVEDTRA documents are available for download from https://www.public.navy.mil/netc/ntt/pdfs/.

Naval Air Systems Command Instructions (NAVAIRINST) NAVAIRINST 4355.19E Systems Engineering Technical Reviews, dated 6 February

• Copies of the NAVAIRINSTs are available for download from https://directives.navair.navy.mil.

NAWCTSD Documents

NAVAIR Training Systems Domain Guide

Naval Air Systems Command Training Systems Domain Guide, version 1.0, dated October 2016

Security Assessment Procedures Document

NAWCTSD Assessment Procedures for the Omnibus Standalone-Unclassified Training Systems, dated 22 September 2016

• Copies of these NAWCTSD documents will be provided as part of the contract or Government Furnished Information (GFI).

Non-Government Documents Industry Standards ANSI = American National Standards Institute ISO = International Organization for Standardization ANSI/ASQ/ISO 9001-2015 Quality Management Systems - Requirements

• Copies of the ANSI/ISO document is available from http://www.ansi.org.

Electronic Industries Alliance (EIA)/SAE International SAE/EIA-649-B Configuration Management Standard SAE/EIA-649-1 2014 Configuration Management Requirements for Defense

Contracts SAE/EIA 748-C Earned Value Management Systems GEIA-HB-649-A Configuration Management Standard Implementation Guide, Revision A of February 2016

• Copies of the EIA/SAE documents are available from http://ansi.org.

3 REQUIREMENTS

The contractor shall organize, coordinate, and control RRL content conversion activities to ensure compliance with contract requirements and timely delivery of products specified herein.

https://www.public.navy.mil/netc/ntt/pdfs/

3.1 General Requirements

The contractor shall provide the necessary hardware, software, personnel, supervision, management, materials, services, equipment, facilities, technical, logistics, and clerical support to perform the tasks specified in this SOW. The requirements defined herein form the basis for work performed for the Government during the entire contract. The contractor shall meet the requirements of the SOW in accordance with (IAW) the guidance documents provided and the contents of this document.

3.1.1 RRL Content Conversion Planning

The contractor shall

a. Identify objectives and constraints of the contract

b. Establish a work breakdown structure based on the system architecture

c. Define achievement criteria for the life cycle stages delivery dates and dependencies on external resources

d. Define roles, responsibilities, accountabilities and authorities

3.1.1.1 Life-Cycle Model Management

The contractor shall define, maintain, and assure availability of policies, life cycle processes, life cycle models, and procedures.

3.1.1.2 Infrastructure Management

The contractor shall provide the infrastructure and services to support organization and program objectives throughout the life cycle of the contract.

3.1.1.3 Program Assessment and Control

The contractor shall track the status of the program, technical and process performance that ensures the performance is in accordance with the plans and schedules that satisfy the technical objectives.

3.1.1.4 Program Decision Management

The contractor shall

a. Select the most beneficial course of action for the government where alternatives exist

b. Inform the government of decisions encountered

c. Record the decisions and rationale to support future decision-making.

3.1.2 Contract Data Requirements Lists (CDRLs)

The contractor shall update, improve, manage, and deliver acceptable contractually-required data. The contractor shall implement data management procedures and policies to provide control and configuration management (CM) of contractually-required data. The contractor shall:

a. Ensure data items to be delivered to the Government meet the quantity and quality requirements of the CDRL.

b. Establish data management procedures and policies to provide control and CM of contractually-required data. To ensure sub-contractors meet the contract data requirements set forth in the CDRL, the prime contractor shall maintain control of work completed by sub-contractors.

c. Establish and maintain data libraries via an online management system consisting of technical manuals, parent system technical description, and software documentation for the work completed for academic training systems and other data pertaining to training systems.

3.1.3 Online Management System (OMS)

The contractor shall establish, implement, and make available a secure, web-accessible OMS throughout the entire contract completion date. The OMS shall serve as a data library consisting of documentation, data, and information used, maintained, updated, and improved for use in this effort. The contractor shall use the OMS as a tool for communication between the contractor and the Government. The contractor’s OMS shall have the functionality to share files between the contractor and the Government reviewers with an intuitive file structure and naming convention, file directories, working files released for Government comment, and final deliverables. The contractor shall maintain deliverables (all versions) and Government comments on the OMS.

The contractor shall also include supporting materials, agendas, and minutes for conferences (e.g., Post Award Conference [PAC]), meetings (e.g., Integrated Product Team [IPT]), reviews (e.g., In-Progress Report [IPR]) and materials (presentations, agendas, etc.). The contractor shall make the OMS available for initial use at the PAC.

3.1.3.1 Scrum Board Requirements

The contractor shall provide browser-based access to its Scrum Board hosted at the contractor’s location. The contractor shall maintain and make visible to the government at all times during the period of performance a current Scrum Board, including at a minimum the product backlog, sprint backlog, increments, and expected government engagement in each sprint. The contractor shall provide a Scrum Board with the following basic characteristics and functionality:

a. Accessible via standard internet browsers supported by NMCI computers.

b. Control access through login and password protection.

3.1.3.2 OMS Basic Requirements

The contractor shall provide web-based access to an OMS hosted at the contractor’s location with the functionality for Government content reviewers and project managers to review, consolidate, and submit deliverable review comments produced by the contractor. Reviewers will submit review comments for documents such as agendas, meeting minutes, reports, and design documents (e.g., Software Product Design (SPD), etc.) in external files via a comment resolution matrix (CRM) rather than via a browser. Reviewers will submit IMI and supporting materials (i.e., lesson plans, trainee guides) and complex media review comments electronically through a web browser rather than capturing comments in external files via CRM. For IMI and supporting materials, and complex media reviews, the contractor shall provide an OMS with the following basic characteristics and functionality:

a. Accessible via standard internet browsers supported by NMCI computers.

b. Control access through login and password protection.

c. Display the courseware under review with an interface for reviewers to enter comments on the displayed courseware from any location.

d. View all related course documentation, such as the course lesson plan (LP), trainee guide (TG), course schedules, status reports, and lessons, during review sessions.

e. Digital traceability of each comment.

3.1.3.2.1 OMS Required Functionality for Interactive Multimedia Instruction (IMI), Supporting Material and Complex Media Reviews

The contractor shall provide access to an OMS with the following characteristics and functionality for conducting IMI, supporting material and complex media reviews:

a. Reviewers can submit comments directly from the courseware without leaving the courseware to add a comment and with the courseware remaining visible on the Reviewer’s screen while adding the comment.

b. Approved users can view, add, approve, and disapprove comments submitted via the content comment submission capability.

c. Users can submit, review, and perform administrative functions on lesson comments.

d. Users have access to all online content through a dashboard summary with indications of review assignment, review completion status, and content waiting for comment approval and submission to the contractor.

3.1.3.2.2 OMS Comment Submission Capability for IMI, Supporting Material and Complex Media Reviews

The contractor shall provide access to an OMS with the following characteristics and functionality for lesson comment submission:

a. The OMS requires a unique login ID and password combination to gain access to the courseware comment interface for each individual with access to the OMS.

b. The OMS assigns each comment a unique identifier, captures the input from the comment input page, and saves each comment to the OMS’s database.

c. The OMS registers the date, time, and login ID when a comment is edited or its status changed, along with the specific changes made and makes the information readily accessible for user viewing.

d. Reviewers can view all their comments for a single lesson or for all lessons.

e. Users can provide comments on each courseware page, and the OMS will verify each comment by page without the reviewer having to add the page identifier.

f. The OMS self-populates the comment submission form with the following information:

1. The lesson under review.

i. The topic of the lesson under review.

ii. The date and time of the comment.

iii. The commenter’s name or login identification.

b. For each comment, the user can:

1. Designate whether the change is a global change (applicable to the entire lesson) or a local change (applicable to the lesson page/slide being reviewed).

2. Input specific detailed text in the form of notes, including the ability to copy and paste large sections of text into the comment description fields.

3.1.3.2.3 OMS Comment Review and Administration Capability for IMI, Supporting Material and Complex Media Reviews

The contractor shall provide access to an OMS with the following characteristics and functionality for lesson comment review and administration:

a. Designations for at least three levels of security access to the comments:

1. Reviewers - who have access to view their and others comments.

2. Approvers - who function as master reviewers and:

i. Select and identify which of the Reviewer’s comments are to be addressed by the contractor.

ii. Receive notifications that lessons are available for review.

iii. Assigns lessons to Reviewers with associated due dates.

3. Administrators - who have access to the entire system and:

i. Function as a systems administrator by providing password and login information to reviewers. Administrators may be producers or system administrators. (Note: The Administrator is the role of the contractor.)

ii. Add new reviewers and deactivate others.

b. Export reports of all comments at once, regardless of status, for a single lesson or all lessons.

c. Export comments into Microsoft Excel format.

d. Display different views of the comments for a single lesson or lessons based on the approval status (e.g., approved, disapproved, approved with comments, pending).

e. For each comment, Approvers can:

1. Identify which posted content items have complete reviews and are waiting for approval and assignment to the contractor.

2. Review and designate all comments for further action.

i. Mark comments as “Approved,” indicating the Approver has agreed the comment needs to be addressed and has assigned it to the contractor.

ii. Mark comments as “Disapproved,” indicating the Approver has determined the comment is not to be addressed by contractor.

iii. Mark comments as “Approved with comment,” indicating the Approver has agreed the comment needs to be addressed and has added further clarification to the contractor.

3. Provide additional information in text for any comment as a separate comment field.

4. Change the status of any comment at any time.

i. Status shall include at a minimum approved, disapproved, approved with comments, and submitted/pending (indicates Government Reviewer has provided input on the lesson).

ii. Automatically assign submitted/pending status upon entering a comment before the Approver’s review.

5. Change the status of multiple comments simultaneously.

3.1.4 Configuration Management (CM)

The contractor shall define, document, manage, and apply a CM process. The contractor shall control CM to ensure only files associated with a specific date and location are in the directory for those files. The contractor shall notify the Government, via e-mail, what directories on the OMS have new or revised files by close of business each Friday.

3.1.5 Contractor Subject Matter Experts (SMEs)

The contractor shall employ personnel who are recent technical content SMEs in the AT and AW domain area with experience in operations and maintenance as required by each rating. The Government requires the contractor to employ Instructional Systems Design and Systems Engineering SMEs to ensure technical accuracy, data, information, and reports developed by the contractor meet Government specification and requirements. The contractor shall ensure personnel assigned to the contract have the appropriate security clearance necessary to access information and facilities required (see Table 1).

3.1.6 Copyrights

The contractor shall follow Federal copyright laws and DON Instructions (Secretary of the Navy Instruction [SECNAVINST] 5870.4A, Copyright) during the effort. Media assets, content, and files that are not expressly created or written by the contractor shall be accompanied with copyright permission requests and copyright granted documentation. The contractor shall cultivate and maintain a copyright database to record and track information and documentation pertaining to copyright content. The contractor shall include copyright data in the Instructional Media Package Media Source Files (CDRL F008) and Software Product Design (SPD) document

(CDRL A001).

3.1.7 Quality Assurance and Management Plan (QAMP)

The contractor shall define, document, manage, and apply a QAMP, including flowcharts, documenting multiple reviews at the program and corporate level. The contractor shall document processes (e.g., inter-rater agreements for data categorization) and management controls employed to ensure requirements are met. The QAMP shall, at a minimum, include specific work required and methods used to determine product quality and technical adequacy and include methods for conducting intermittent and ongoing reviews of deliverables.

3.1.7.1 Control of Government-Furnished Information (GFI)

The contractor shall perform the following tasks to control GFI as part of the quality management process:

a. Examine upon receipt, consistent with practicality, to detect damage.

b. Log receipt and track each GFI item.

c. Provide storage that precludes deterioration.

d. Protect from improper use or disposition.

e. Verify and audit IAW the contractor’s GFI control and management process.

f. Confer with Government at contract closeout whether to return or destroy each GFI item.

3.1.8 Communications Plan

The contractor shall define, document, manage, and apply a Communications Plan including internal and external communications. The contractor shall document the Communications Plan methods relative to planning, developing, accomplishing, and reporting management, technical, and administrative tasks relevant to requirements.

3.2 Security

The security requirements specified herein shall apply to the contractor and subcontractors. The contractor shall comply with applicable on-site security regulations related to Government installation and…