Attachment 1.1 PWS 01.09.2020draft.pdf

Office of the Under Secretary of Defense (Comptroller)

Distributed Learning

Performance Work Statement

Date: 9 January 2020

1. BACKGROUND

The OUSD(C) Financial Workforce Management Division (FWMD), as directed by the Director, Human Capital and Resource Management and the Under Secretary of Defense (Comptroller) (USD(C)) and as stated in the

Department of Defense Financial Management Workforce Strategic Workforce Plan FY 2019 – 2023, is to provide a multi-year effort to meet DoD-wide civilian workforce planning needs and facilitate lifecycle management of the

Department’s civilian Financial Management (FM) workforce. The FWMD is responsible for ensuring the DoD

Financial Management workforce has the competencies, capacity, and tools to acquire, develop, and sustain the talent needed to meet current and future mission requirements.

Department of Defense Instruction (DoDI) 1300.26, Operation of the DoD Financial Management Certification

Program (DFMCP), establishes a certification program that supports the professional development of the FM workforce and provides a framework for a standard body of knowledge across the FM workforce. IAW this DoDI, all members of the DoD FM workforce are required to achieve and maintain a certain level of certification based on their position; the certification is course-based and requires a certain number of hours of instruction in defined FM and Leadership competencies at defined proficiency levels.

Currently, the DoD FM Certification Program Learning Management System (LMS) is the system of record for documenting the learning and certification achievements of all DoD FM workforce members. LMS also hosts all of the OUSD(C) distributed learning courses. Each member of the FM workforce accesses LMS to record achievements and to take distributed learning courses. In order to access LMS, an individual must have a DoD

Common Access Card (CAC) and must have an account on LMS. Only members of the FM workforce can access the LMS. LMS is operated and maintained by Washington Headquarters Services (WHS) via a Memorandum of

Agreement (MOA) between WHS and OUSD(C). OUSD(C) distributed learning courses are installed and hosted on

LMS by WHS IAW this MOA. The government is currently exploring alternatives to the LMS for tracking and reporting learning and certification achievements and may transition to an alternative tool in the future.

FM myLearn is an OUSD(C) website that serves two purposes. It serves as an on-line course catalog listing all federal and commercial courses aligned with the competency requirements for certification, and it hosts all of the

OUSD(C) distributed learning courses. Each member of the FM workforce accesses FM myLearn to identify courses that satisfy their certification requirements and to take distributed learning courses. In order to access FM myLearn, an individual must have a CAC. OUSD(C) has contracted with a third-party service provider to operate and maintain FM myLearn. OUSD(C) distributed learning courses are installed and hosted on FM myLearn by this third-party IAW the terms of the third-party contract.

Currently, there are eighty-one distributed learning courses in the FWMD course portfolio. The high-level design document, prestoryboard, storyboard, exam, course script, and courseware source code for these courses will be available to the contractor for use in performing this contract.

All existing courseware was developed using Adobe FlashTM; Adobe Corporation will discontinue support for this technology on December 31, 2020. All courseware must be converted to HTML5 by December 31, 2020.

2. SCOPE

The objective of the FWMD is to provide sufficient National Association of State Boards of Accountancy

(NASBA)-compliant distributed learning courses such that any member of the DoD FM workforce can achieve certification, with the exception of the leadership requirement, entirely via these distributed learning courses.

The scope of this requirement encompasses all of the subject matter required for certification at any level, and it includes all of the expertise required to develop, deliver, and refresh distributed learning courses in support of the

Certification Program. Any additional expenditure such as programmactic support requirements required for management and oversight shall be incorporated in the price calculations for each training course within the curriculum.

The government is currently pursuing an initiative to increase user engagement, improve the learning experience, and enhance course effectiveness by increasing the Level of Interaction for selected courses in the FWMD portfolio.

This initiative could result in a reduction in the number of course hours supported by this contract as selected courses are upgraded to increase the Level of Interaction. The government is currently pursuing alternatives to the current Learning Management System (LMS). This initiative could result in the elimination of Deliverable

#10/LMS Accessible Course.

3. SUMMARY OF REQUIREMENTS

3.1. Non-Personal Services

The services and performance required under this contract are determined to be not inherently governmental. The contractor shall not perform or give the appearance of performing inherently governmental functions as described in

FAR Part 2 and Subpart 7.5, and all applicable DoD policy. The Government shall neither supervise contractor employees nor control the method by which the contractor performs the required tasks. All contractor personnel shall identify themselves as contracted support personnel in all forms of communication with all entities with whom

OUSD (C) has business dealings. It shall be the responsibility of the contractor to manage its employees and to guard against any actions that are of the nature of personal services, or give the perception of personal services. If the contractor believes that any actions constitute, or are perceived to constitute personal services, it shall be the contractor's responsibility to notify the Contracting Officer immediately.

3.2. Business Relations

The contractor shall successfully integrate and coordinate all activity needed to execute the requirements specified herein. The contractor shall manage the timeliness, completeness, and quality of the contract deliverables. The contractor shall provide corrective action plans, proposal submittals, timely identification of issues, and effective management of all contractor personnel (including subcontractors). The contractor shall seek to ensure customer satisfaction and professional and ethical behavior of all contractor personnel.

3.3. Contract Management

The contractor shall establish clear organizational lines of authority and responsibility to ensure effective management of the resources assigned to this requirement. The contractor must maintain continuity between the support operations at the Pentagon and the contractor's corporate offices.

The contractor shall establish processes and assign appropriate resources to effectively administer this contract. The contractor shall respond to Government requests for contractual actions in a timely fashion. The contractor shall have a single point of contact between the Government and contractor personnel assigned to support this contract.

The contractor shall assign work effort and maintain proper and accurate time keeping records of personnel assigned to work on this requirement.

3.4. Subcontract Management

The contractor shall be responsible for any subcontract management necessary to integrate work performed on this requirement and shall be responsible and accountable for subcontractor performance on this requirement. The prime contractor shall manage work distribution to ensure there are no Organizational Conflict of Interest (OCI) considerations. Contractors may add subcontractors to their team after notification to the Contracting Officer or

Contracting Officer Representative (COR).

3.5. Contractor Personnel, Disciplines, and Specialties

An integral part of successful performance under this contract is not only the production of quality products described in Section 4, but the responsiveness of contractor personnel in the day-to-day output of work products.

While the end product or deliverable is vital to successful performance, day-to-day oversight also includes client interaction and responsiveness. Accordingly, the contractor is required to proactively maintain assigned tasks and be responsive to all entities with professional business dealings related to the assigned tasks.

The contractor must at all times maintain an adequate work force for the uninterrupted performance of all tasks defined within this PWS. When hiring personnel, the contractor shall keep in mind that the stability and continuity of the workforce are essential.

The work to be performed herein is considered bona fide professional labor and is exempt from the Fair Labor

Standards Act (FLSA).

Contractor personnel must have the following general knowledge:

Knowledge of Department of Defense (DoD) organizational elements and structure as it relates to

OUSD(Comptroller).

Knowledge and experience of personal computers, Microsoft Office software (i.e. Access, Excel, Word, PowerPoint, etc.) and online distributed learning learning application software.

Knowledge and experience in development of course materials using adult learning principles, instructional system design methods, technical writing, process mapping, and distributed learning learning applications.

Knowledge and experience in DoD and Federal Government accounting, finance, auditing, budgeting

(planning, programming, budgeting, and execution), cost analysis, fiscal law, audit readiness, analysis/decision support, data analytics, acquisition, ethics, and other elements of DoD financial management.

Contractor personnel must have the following specialized DoD Financial Management experience and expertise:

DoD Planning Programming Budget and Execution (PPBE)

Developing and managing performance metrics

Facilitation and administration of workshops and focus groups

Federal CFO Act audit requirements (e.g. Financial Improvement and Audit Remediation – FIAR)

Financial Management Regulations as they pertain to DoD financial management

Financial Management Enterprise-level Competencies

Subject Matter Expertise in all of the subject matter described in Paragraph 4.01, Services Required

Contractor preferred experience and knowledge includes the following:

Working on a DoD Department-level staff (Service, OSD or Joint Staff)

Financial management certification and certificate programs

3.6. Training

The contractor shall provide training, as necessary, for their own personnel to ensure that personnel are trained on the common suite of Microsoft Office tools (e.g., Word, Excel, and PowerPoint) and other applicable programs.

The contractor shall also ensure that all of its employees have been properly trained and are qualified to perform assigned tasks under this PWS. The Government will provide or coordinate training on any new Government-provided equipment or Government-directed training (e.g., Information Assurance). If such training requires travel on the part of contractor employees, local travel costs (i.e., Metro) shall be borne by the contractor.

3.7. Travel

No travel is required in the performance of this contract.

Local travel to and from the Pentagon and the surrounding National Capital Region in support of contract performance is considered the cost of doing business and will not be reimbursed as a direct charge to the contract.

3.8. Other Direct Costs

No other direct costs is required in the performance of this contract.

3.9. Location

The majority of the services associated with this effort is anticipated to be performed off-site at contractor facilities.

However, some work may be performed on-site at Government facilities in the Washington, DC and surrounding metropolitan area.

3.10 Hours of Operation and Government Holidays

Normal workdays are Monday through Friday except U.S. Federal Holidays. Normal work hours at the OUSD(C) are 0830-1700 with a 30-minute unpaid lunch break. Contract employees working in government facilities shall start not earlier than 0700 and not later than 0900. Core hours of work are from 0900 to 1530 daily, and contract employees shall be available during core hours. During designated Government non-work days or other periods where Government offices are closed due to weather or security conditions, the contractor shall be responsible for determining whether and where its employees will work.

4. SPECIFIC TASKS

4.0. General

4.0.1. Services Required

The contractor shall provide all personnel, equipment, supplies, facilities, transportation, tools, materials, supervision, and other items necessary to:

Design, develop, refresh, test, and deliver distributed learning courses in the areas of accounting, finance, auditing, budgeting (planning, programming, budgeting, and execution), cost analysis, fiscal law, audit readiness, audit remediation, analysis/decision support, data analytics, acquisition, ethics, and other elements of DoD financial management.

Provide subject matter expertise and course content, or use content provided by government subject matter experts, for distributed learning courses in the areas of accounting, finance, auditing, budgeting (planning, programming, budgeting, and execution), cost analysis, fiscal law, audit readiness, audit remediation, analysis/decision support, data analytics, acquisition, ethics, and other elements of DoD financial management.

Deliver LMS-accessible courses and FM myLearn-accessible courses. Each course shall be in increments of at least one-half (1/2) hour.

Deliver all courses at Level of Interaction (LoI) II as defined in Para 4.0.5.

4.0.2. Compliance

All courses delivered by the contractor shall comply with the OUSD(C) Course Development Standards given in

PWS Section 10. All course refreshes shall reflect any changes to Federal and DoD regulations, policies, standard operating procedures, and guidance.

All courses delivered by the contractor shall comply with the National Association of State Boards of Accountancy

(NASBA) Statement on Standards for Continuing Professional Education Programs. The following excerpts from these NASBA standards are provided for emphasis:

Standard No. 4: CPE program sponsors must use activities, materials, and delivery systems that are current, technically accurate, and effectively designed. Course documentation must contain the most recent publication, revision, or review date. Courses must be revised as soon as feasible following changes to relative codes, laws, rulings, decisions, interpretations, and so on. Courses in subjects that undergo frequent changes must be reviewed by an individual with subject matter expertise at least once a year to verify the currency of the content. Other courses must be reviewed at least every two years.

Standard No. 5: CPE program sponsors of group, self study, nano learning, and blended learning programs must ensure that learning activities are reviewed by qualified persons other than those who developed the programs to assure that the program is technically accurate and current and addresses the stated learning objectives. These reviews must occur before the first presentation of these materials and again after each significant revision of the CPE programs. The participation of at least one licensed Certified Public

Accountant (CPA) (in good standing and holding an active license or the equivalent of an “active” CPA license in a U.S. jurisdiction) is required in the development of every program in accounting and auditing.

4.0.3. New Course Deliverables – Delivery and Acceptance Process

The contractor shall obtain government approval for the following deliverables from the COR or Functional

Representative prior to proceeding with the next stage in course development. The contractor shall work closely with the Functional Representative in the development and delivery of these deliverables to ensure course content reflects the government’s requirement; this process shall be reflected in the contractor’s Project Management Plan.

Deliverable #2, Learning Objectives (Terminal and Enabling)

Deliverable #3, High Level Design Document

Deliverable #5, PreStoryboard

Deliverables #6 and #7, Storyboard and Exam

4.0.4. Refreshed Course Deliverables – Delivery and Acceptance Process

The contractor shall obtain government approval for the following deliverables from the COR or Functional

Representative prior to proceeding with the next stage in course development. The contractor shall work closely with the Functional Representative in the development and delivery of these deliverables to ensure course content reflects the government’s requirement; this process shall be reflected in the contractor’s Project Management Plan.

Deliverable #17, Refresh Analysis Report

Deliverable #5, PreStoryboard

Deliverables #6 and #7, Storyboard and Exam

4.0.5. Definitions

4.0.5.1. LMS-Accessible Course: A fully functioning distributed learning course or multiple modules of instruction that presents the information; is aligned with the required DoD financial management competencies or other required subject areas; provides instruction at the required proficiency levels;

provides proficiency reviews; and can be installed on, launched from, and run on the DoD FM Certification

Learning Management System or similar OUSD(C) supported learning management system.

4.0.5.2. FM myLearn-Accessible Course: A fully functioning distributed learning course or multiple modules of instruction that presents the information; is aligned with the required DoD financial management competencies or other required subject areas; provides instruction at the required proficiency levels; provides proficiency reviews; and can be installed on, launched from, and run on FM myLearn.

4.0.5.3. Level of Interaction (LoI): The LoI of a course corresponds directly to the degree of learner involvement and interactivity with the course. LoI ranges from I to IV as shown in the following table;

the higher the LoI, the greater the learner involvement, interactivity, and effort to develop and refresh. All existing FWM courses are LoI II.

LEVELS OF INTERACTION (LoI)

LEVEL DESCRIPTION NOTES

Level I Basic Interaction Limited or no interaction; no ability to practice or attempt exercises

Linear based content

Typically, “click next” learning where learner must read information

Little to no control of pace of learning

Simple text, graphics and video

Level II Intermediate Interaction Transitional interactions; responses to instructional cues, clickable menus, drag and drop, multiple choice, multimedia

Linear based content with knowledge checks

More advanced audio and video often with transitions

Basic navigational control

Simple knowledge checks at the end of units – multiple choice

Level III Advanced Interaction Advanced interactions; more control over the learning experience with customization based on the learner’s input

Decision or scenario based content

Ability to enter text or input data to simulate a system or process

Animation, complex video, branching scenarios

Conceptual based knowledge checks and testing

Level IV Immersion Simulates life-like experience; high frequency of interaction, Interactive or immersion-based content

May leverage artificial intelligence for simulations;

flight simulation

Extensive use of avatars, 3D, animation and gaming techniques, may leverage multiple learnings interactions

More advanced scenario branching and questioning

4.0.5.4. Refresh Complexity (RC): RC is defined as the amount of effort required to refresh an LoI II course that is one course hour in length as compared to the effort required to develop a new LoI II course that is one hour in length. The RC ranges from RC-0 to RC-100 in increments of 1. As part of the Refresh

Analysis process in Section 8.4, Conduct Refresh Analysis and Deliverable #12, the contractor will propose an RC.

4.0.5.4.1. For example, a course with an RC of 0 would require 0% of the effort required to develop a new LoI II course, requires no changes, and is NASBA compliant. A course with an RC of

16 would require 16% of the effort required to develop a new LoI II course. A course with an RC of 52 would require 52% of the effort required to develop a new LoI II course.

4.0.5.5. Unit Price Refreshed Course: The Unit Price for a refreshed course is calculated as shown below.

As described in paragraph 8.2, the Task 2 Unit Price is a fixed price per course hour to deliver a new LoI II course using contractor SME. As described in paragraph 8.3, the Task 3 Unit Price is a fixed price per course hour to deliver a new LoI II course using government SME. As described in paragraph 8.4, the Task 4 Unit Price is a fixed price per course to conduct a Refresh Analysis, regardless of course length.

4.0.5.5.1. Contractor SME Unit Price Refreshed Course

Contractor SME Unit Price = (Task 2 Unit Price – Task 4 Unit Price) X .01

4.0.5.5.2. Government SME Unit Price Refreshed Course

Government SME Unit Price = (Task 3 Unit Price – Task 4 Unit Price) X .01

4.1. Task 1 - Program Management

The contractor shall provide program management for all tasks in this PWS. The contractor shall identify a Program

Manager (PM) to make work assignments and manage the efforts of contractor personnel and to act as the single point of contact between contractor personnel assigned to support this effort and the Government. The contractor shall establish processes and assign appropriate resources to effectively manage contractor personnel and administer this contract, shall maintain proper and accurate timekeeping records of assigned personnel, and shall respond to government requests for contractual actions in a timely fashion. The contractor shall inform the COR and the

Contracting Officer of any problems or potential problems affecting performance. Verbal notification of problems shall be documented via email and included in the Monthly Status Report.

4.1.1. Project Management Plan (PMP)

The contractor shall deliver a Draft PMP for the base period of the contract as part of the quote submission. The contractor shall deliver a final PMP for the base period IAW PWS Section 6, Deliverables (Deliverable 1).

The project plan shall describe the contractor’s approach to the government’s requirement. The project plan shall provide summary and detail milestone schedules giving delivery dates for all the required deliverables. The summary schedule shall provide a top-level view of the program activities, courses that will be developed, courses that will be refreshed, and associated major milestones during the performance period. The detail schedule shall provide a breakout by course; i.e. for each course, identify the activities and deliverables and when they will be delivered. The plan must describe any dependencies on the government for items including provision of SME, government approvals to proceed, access to facilities or networks, government furnished equipment, and when the dependency occurs.

The contractor shall deliver courses and other deliverables IAW the government-approved PMP.

The project plan shall provide a technology forecast with a three-to-five year horizon to identify changes in technology that have potential to impact the FWMD program; for example, the Adobe FlashTM end-of-life announcement effective December 31, 2020 made by Adobe Corporation in July 2017. The project plan shall identify risks and/or opportunities associated with these changes, provide recommended actions and, when approved by the government, implement the recommended actions.

4.1.2. Course Evaluation Summary (CES).

The contractor shall deliver a CES for each active course, i.e. each course that is available to DoD employees. The

CES shall summarize the student evaluations for each course for the current reporting period and cumulatively, and shall include an analysis of the course evaluation data for each course. The CES is intended to be used by the government to gauge the learning experience of students taking the course. (Deliverable 15)

4.1.3. Quality Control Plan (QCP)

The contractor shall develop and maintain an effective QCP (Deliverable 16) to ensure services are performed in accordance with this PWS. The contractor shall develop and implement procedures to identify, prevent, and ensure non-recurrence of defective services. The contractor’s quality control plan is the means by which the contractor ensures that work performed complies with the requirements of the contract.

The QCP shall document how the contractor will meet and comply with the quality standards specified in the PWS.

At a minimum, the QCP must include a self-inspection plan, an internal staffing plan, and an outline of the procedures that the contractor will use to maintain quality, timeliness, responsiveness, customer satisfaction, and any other requirements set forth in this PWS.

4.1.4. Post Award Orientation (PAO).

The Post-Award Orientation shall be held within 7 calendar days of the start of performance. Contractor shall schedule and conduct this meeting, in coordination with the Contracting Officer’s Representative (COR), and

Functional Representative.

The purpose of the Post-Award Orientation is to: 1) discuss any unique characteristics of the requirement(s); 2) identify stakeholders' roles and responsibilities; 3) review the 30 day transition-in to full performance and 4) establish a common understanding of cost, schedule, and performance expectations.

The contractor shall provide Post Award Orientation Briefing Slides and minutes (Deliverable 19). Slides, at a minimum, shall identify the key stakeholders and highlight their roles and responsibilities, describe the requirement and contractor’s approach, and describe monthly status reporting (cost, schedule, and performance). Minutes (with a list of attendees) shall capture the substance of the meeting. Provide draft of slides three calendar days prior to PAO.

4.1.5. Monthly Status Report.

The contractor shall deliver a Monthly Status Report (MSR) (Deliverable 13). The purpose of the MSR is to assist the government with surveillance and to provide support for the contractor’s invoice. The MSR shall include a draft of the contractor’s monthly invoice.

The MSR shall summarize activity against plan since the previous MSR report and shall describe any risks or impediments to the contractor’s efforts. The MSR shall include a narrative description of the contractor’s activities and PWS deliverables provided.

The MSR shall provide a Contract Funds Summary Status by CLIN as follows: total funds obligated, amount billed this reporting period, cumulative amount billed to date, and funds remaining. The MSR shall provide a Contract

Funds Detail Status that shows by CLIN the amount billed this reporting period and provides detail showing how the contractor arrived at the amount billed during the reporting period for each CLIN.

4.1.6. Meetings

4.1.6.1. Monthly Contract Status Meetings

This meeting shall be conducted at the FWMD offices in the Pentagon and/or telephonically each month as agreed upon by the government. The purpose of the meeting is to review contractor activity against plan, discuss risks to performance, and discuss invoices and other contract administration matters. The MSR shall be the basis for discussion at the meeting.

4.1.6.2. Weekly Development Status Meeting.

This meeting shall be conducted at the FWMD offices in the Pentagon and/or telephonically each week as agreed upon by the government. The purpose of the meeting is to review and discuss contractor activity with FWMD managers.

4.1.6.3. Ad Hoc Meetings.

The contractor shall conduct ad hoc meetings at the direction of the government. Meetings shall be conducted at the

FWMD offices in the Pentagon and/or telephonically.

4.1.6.4. Meeting Minutes.

The contractor shall deliver meeting minutes for all formal meetings with the government (internal and external to

OUSD(C)). (Deliverable 14)

4.1.7. Transition

4.1.7.1. Transition-In.

The contractor shall deliver a Transition-In Plan (Deliverable 17) that facilitates a seamless start-up and transition to full operations. Transition-In shall begin on the start of performance and shall be complete 30 calendar days after the start of performance.

Describe start-up and transition efforts and activities, to include a schedule with milestones by activity.

Identify points of contact (POCs) for liaison between the Government, the prime contractor, and other contracted industry partners to ensure a proper and orderly start-up and transition.

Identify start-up risks and recommended mitigation, to include dependencies on the government or external parties.

Ensure minimum disruption to vital Government business. The contractor shall ensure that there is no service degradation during the transition.

4.1.7.2. Transition-Out.

The contractor shall deliver and execute a Transition-Out Plan (Deliverable 18) sixty (60) days prior to the expiration of the contract that shall facilitate the accomplishment of a seamless transition from the incumbent to incoming contractor or Government personnel at the expiration of the order. The contractor shall establish and maintain effective communication with the incoming contractor or Government personnel for the period of the transition via weekly status meetings. The TOP shall include, but not be limited to, the following items:

Points of contact

Location of technical, program and project management documentation

Work in Progress

Transition-out schedules and milestones

Actions required of the Government, outgoing contractor, and incoming contractor

4.2. Task 2 – Deliver New Courses Using Contractor Subject Matter Expertise (SME)

4.2.1. The contractor shall provide the required SME, develop, and deliver new distributed learning courses.

4.2.2. The contractor shall provide the following deliverables for each new course:

Deliverable #2, Learning Objectives (Terminal and Enabling)

Deliverable #3, High Level Design Document

Deliverable #4, PowerPoint Slide Deck with Annotated Notes Level of Detail

Deliverable #5, PreStoryboard

Deliverable #6, Storyboard

Deliverable #7, Exam

Deliverable #8, Course Evaluation

Deliverable #9, Course Script (Narrative)

Deliverable #10, LMS-accessible Course

Deliverable #11, FM myLearn-accessible Course

4.3. Task 3 – Deliver New Courses Using Government Subject Matter Expertise

4.3.1. Using government SME, the contractor shall develop and deliver new distributed learning courses. The contractor shall facilitate government SME groups and shall meet with government SMEs in order to obtain the course content necessary to provide the required deliverables.

4.3.2. The contractor shall provide the following deliverables for each new course:

Deliverable #2, Learning Objectives (Terminal and Enabling)

Deliverable #3, High Level Design Document

Deliverable #4, PowerPoint Slide Deck with Annotated Notes Level of Detail

Deliverable #5, PreStoryboard

Deliverable #6, Storyboard

Deliverable #7, Exam

Deliverable #8, Course Evaluation

Deliverable #9, Course Script (Narrative)

Deliverable #10, LMS-accessible Course

Deliverable #11, FM myLearn-accessible Course

4.4. Task 4 – Conduct Refresh Analysis

4.4.1. The contractor shall conduct a Refresh Analysis (RA) for each refreshed course as the first step in the refresh process. The purpose of the RA is to assess the changes and amount of effort required to refresh the course.

4.4.2. The contractor shall deliver the following for each refreshed course:

Deliverable #12, Refresh Analysis Report

Deliverable #2, Learning Objectives (Terminal and Enabling)

Deliverable #3, High Level Design Document

The Refresh Analysis Report (Deliverable 12) shall provide the results of the Refresh Analysis, identify the Refresh

Complexity, provide rationale for the Refresh Complexity, and provide the price to perform the refresh using the formula from PWS Section 8.

Once the government has approved the Refresh Analysis Report, Learning Objectives and High Level Design

Document, the contractor shall proceed to the next step in the refresh process.

4.5. Task 5 – Refresh Courses Using Contractor SME

4.5.1. The contractor shall provide the necessary SME and shall refresh and deliver distributed learning courses.

4.5.2. The contractor shall provide the following deliverables for each refreshed course:

Deliverable #4, PowerPoint Slide Deck with Annotated Notes Level of Detail

Deliverable #5, PreStoryboard

Deliverable #6, Storyboard

Deliverable #7, Exam

Deliverable #8, Course Evaluation

Deliverable #9, Course Script (Narrative)

Deliverable #10, LMS-accessible Course

Deliverable #11, FM myLearn-accessible Course

4.6. Task 6 – Refresh Courses Using Government SME

4.6.1. Using government SME, the contractor shall update and deliver distributed learning courses. The contractor shall facilitate government SME groups and shall meet with government SMEs in order to obtain the course content necessary to provide the required deliverables.

4.6.2. The contractor shall provide the following deliverables for each refreshed course:

Deliverable #4, PowerPoint Slide Deck with Annotated Notes Level of Detail

Deliverable #5, PreStoryboard

Deliverable #6, Storyboard

Deliverable #7, Exam

Deliverable #8, Course Evaluation

Deliverable #9, Course Script (Narrative)

Deliverable #10, LMS-accessible Course

Deliverable #11, FM myLearn-accessible Course

5. SPECIAL REQUIREMENTS

This section describes the special requirements for this effort. The following sub-sections provide details of various considerations on this effort.

5.1. Key Personnel

Certain experienced professionals and/or technical personnel are essential for successful accomplishment of the work to be performed under this contract. These "Key Personnel" shall be identified by name within the contractor's proposal and their resumes submitted for evaluation during the source selection process. The contractor agrees that such personnel shall not be removed or replaced within the performance of this contract unless the following measures are taken.

During the first 90 calendar days of performance, the contractor shall make no substitutions of key personnel without the approval of the Contracting Officer, unless illness, death, or termination of employment necessitates the substitution. The contractor shall notify the Contracting Officer as soon as possible after the occurrence of any of these events and provide the information required below.

After the initial 90 calendar day period, the contractor may propose a substitution. The contractor shall notify the

Contracting Officer in writing of any proposed substitution at least thirty (30) calendar days in advance of the proposed substitution. The contractor shall provide a detailed explanation of the circumstances necessitating the proposed substitutions; submit resumes for the proposed substitutes, and any additional information requested by the

Contracting Officer. The contractor shall, prior to making any substitution permanent, demonstrate to the satisfaction of the Contracting Officer, that the qualifications of the proposed substitute personnel is equal to or better than the qualifications of the personnel originally identified for the position. The Contracting Officer will notify the contractor within 15 calendar days after receipt of all required information of the decision on proposed substitutions.

The Key Personnel in this contract are as follows:

5.1.1. The key position on this contract is the Program/Course Manager. The PM must possess the skills, knowledge, and training required to satisfactorily perform all services required by the contract.

Provides overall project management and ensures the utilization of all resources. Maintains cost accounting and reporting, manages meetings, provides monthly status reports, and ensures that deliverables and schedules are met. Coordinates technical tasks and maintains the training schedule.

Required Skills and Relevant Experience:

Five (5) years of executive-level management experience leading multi-disciplined teams of research analysts and various operational departments

Licensed and Certified Public Accountant (CPA) (in good standing and holding an active license or the equivalent of an “active” CPA license in a U.S. jurisdiction).

Minimum of five (5) years of senior level organizational project management experience, including requirements gathering, systems design and implementation, and ongoing project management.

Must possess extensive knowledge of distributed learning curriculum design, adult learning principles, and DoD financial management practices and requirements.

Preferred Skills and Relevant Experience:

In addition to the experience in the Required Skills section, it is preferred the Program Manager have at least three years’ DoD experience leading teams and managing projects that are similar in size and scope to the DoD FM Certification Program.

5.2. Government Furnished Equipment

Contractors performing duties in an OUSD(C) facility will be provided with OUSD(C)-owned workstations and printers. The contractor is prohibited from using any personally owned computers/laptops at OUSD(C) locations.

The government will furnish or make available to the contractor any documentation, including copies of applicable standards, or data necessary to accomplish the tasks specified in this PWS. OUSD(C) will provide laptops or other equipment that will provide the contractor with access to the OSD network from the contractor's facility.

5.3. Security

All Key Personnel on this contract must have a Secret clearance. All contractor personnel who require access to the

OSD network must have a Secret clearance. At a minimum, all contractor personnel assigned to this contract must be a U.S. citizen.

The contractor shall forward security clearances and visitor requests to the Contracting Officer’s Representative

(COR) for all personnel who require access to the government’s facility. All personnel who require access to the government’s network shall sign an OUSD(C) Non-Disclosure Agreement and shall complete Information

Awareness Training before obtaining network access. The contractor shall not use, disclose, or reproduce any proprietary data, other than as required in the performance of this PWS. The contractor shall not divulge or release data or information developed or obtained in the performance of this PWS and accompanying contract except to authorized government personnel or upon written approval of the COR.

The contractor personnel visiting any government facility in support of this PWS shall be subject to the standards of conduct applicable to government employees. Site-specific approval regarding access, issue of security badges, etc., shall be coordinated as required. The contractor personnel shall be aware at all times of any unusual persons or packages in their work area and immediately report those to the building security staff. If the contractor personnel become aware of any person seeking unauthorized access to classified materials, they shall immediately report this to the COR.

All Common Access Cards (CAC) issued to contractor personnel are government property and must be returned either upon departure from the program or at the conclusion of the contract, whichever comes first. All work under this effort is proprietary to DoD; the contractor shall not release any information regarding the work to anyone without written permission by the Government.

5.4. Documentation

Documents, data files, reports, correspondence, and all other documents and writings, together with any charts, graphs, tables, illustrations, photographs, images, and other illustrative, explanatory, historical documents related thereto or independent thereof, regardless of the medium (or media) by which they were produced, preserved, stored, or created in connection with or for purpose(s) of work performed under this PWS and contract, are property of the Government and shall be delivered to the COR promptly, upon request.

The contractor agrees to assume responsibility for protecting the confidentiality of Government records, which are not considered public information. Each contractor or employee of the contractor to whom information may be made available or disclosed shall be notified in writing by the contractor that such information may be disclosed only for purposes and to the extent authorized herein. The contractor shall not release any information related to this contract to the public, media or other unauthorized persons or organizations unless the government has conducted the appropriate security review and granted written approval (e.g. posting information to a public website).

5.5. Data Rights

All documents and materials produced by the contractor, to include the source codes of any software written as part of this contract, shall be Government owned and are the property of the Government with all rights and privileges of ownership/copyright belonging exclusively to the Government. These documents and materials may not be used or sold by the contractor without written permission from the Contracting Officer. All materials supplied to the

Government shall be the sole property of the Government and may not be used for any other purpose. This right does not abrogate any other Government rights. The contractor shall not copyright nor patent any material developed for this contract.

5.6. Government Roles and Responsibilities

Contracting Officer’s Representative (COR) - The COR monitors all technical aspects of the contract and assists in contract administration. The COR is authorized to perform the following functions: ensure the contractor performs the technical requirements of the contract; perform inspections necessary in connection with contract performance;

maintain written and oral communications with the contractor concerning technical aspects of the contract; issue written interpretations of technical requirements, including Government drawings, designs, specifications; monitor contractor's performance and notify both the Contracting Officer and contractor of any deficiencies; coordinate availability of government furnished property; and provide site entry of contractor personnel. A letter of designation issued to the COR, a copy of which is sent to the contractor, states the responsibilities and limitations of the COR, especially with regard to changes in cost or price, estimates or changes in delivery dates. The COR is not authorized to change any of the terms and conditions of the resulting order.

Functional Representatives (FR) - FRs are OUSD(C) employees with responsibility for certain certification program office requirements who assist the COR in overseeing the contractor’s efforts and ensuring the contractor’s activities and deliverables meet program office requirements.

The COR and FRs will be identified separately by the government.

5.7. Records and Information Management

Contractor shall comply with all applicable records management laws and regulations, including but not limited to

44 USC Chapters 29-31 (Federal Records Act), P.L. 113-187 (Presidential and Federal Records Act Amendments of

2014); 36 CFR Parts 1220-1239, NARA Records Management Regulations; DoD Instruction 5015.02, "DoD

Records Management Program"; OSD AI 15, "OSD Records and Information Management Program"; For

Classified Records: EO 13526, "Classified National Security Information"; and DoD 5200.1-R "Information

Security Program Regulation"; For Records containing Personally Identifiable Information (PII): DoDD -5400. 11

"DoD Privacy Program"; and OSD AI 81, OSD/Joint Staff Privacy Program. These policies include the preservation of all records, regardless of form or characteristics, mode of transmission, or state of completion.

5.8. Non Disclosure Agreement

The contractor Program Manager and all contractor employees who are provided access to the government’s network shall sign the Non Disclosure Agreement (NDA) at PWS Section 11. The contractor shall provide copies of these signed NDAs to the Contracting Officer’s Representative prior to being provided access to the government’s network.

6. DELIVERABLES

PWS

Ref

Title Deliver

To:

Estimated

Due Date / Frequency Format Description

1 4.1.1 Project

Management

Plan (PMP)

COR and

FR

- Draft PMP due 90 calendar days before start of option year;

initial PMP for base period submitted with proposal

- Final PMP due 10 business days after start of performance base and all options

- Updates as required

Word and Excel Provides time-phased description of DL course development and implementation approach and describes procedures contractor shall use to implement DL course content

2 4.2.2

4.3.2

4.4.2

Learning

Objectives

(Terminal and

Enabling)

Note 1 One time per course

IAW PMP

As agreed upon by govt

Provide statements that define the expected goal of the curriculum, course, lesson or activity in terms of demonstrable skills or knowledge that will be acquired by student as a result of instruction.

3 4.2.2

4.4.2

High Level

Design

Document

Note 1 One time per course

IAW PMP

As agreed upon by govt

Provide a HLD with the necessary details to the current curriculum to represent a suitable model for course development.

This document will include a high-level diagram depicting the overall structure of the course.

4 4.2.2

4.3.2

4.5.2

4.6.2

PowerPoint slide deck with annotated notes level of detail

Note 1 One time per course

IAW PMP

As agreed upon by govt

Provide a collection of slides as a visual aid that coordinate with the HLD, Learning Objectives, PSB, Storyboard and exam

5 4.2.2

4.3.2

Pre-Storyboard Note 1 One time per course

IAW PMP

As agreed upon by govt

Provide a preliminary document that outlines the visuals, text, and audio elements, interactions and navigation for each course

6 4.2.2

4.3.2

Storyboard Note 1 One time per course

As agreed upon by govt

Provide a document that outlines the visuals, text, and audio elements, interactions and navigation for each course

7 4.2.2

Exam Note 1 One time per course

As agreed upon by govt

Provide a formal test in order to assess a student’s knowledge or proficiency in the courses provided and to assess learning acquired

IAW Deliverable

#2/Learning Objectives

(Terminal and Enabling).

The formal test will be based on test bank questions per Section 10, Item 7.

8 4.2.2

4.3.2

Course

Evaluation

Note 1 One time per course

IAW PMP

As agreed upon by govt

Provide an electronic questionnaire, which requires written or selected responses to a series of questions in order to evaluate the instruction of a given course.

9 4.2.2

4.3.2

Course Script

(Narrative)

Note 1 One time per course

IAW PMP

As agreed upon by govt

Provide a written version of the course content.

10 4.2.2

4.3.2

LMS-accessible

Course

Notes 1+2 One time per course

IAW PMP

As agreed upon by govt

Provide a course capable of upload and execution on the current Learning

Management System.

11 4.2.2

4.3.2

FM myLearn-accessible

Course

Notes 1+2 One time per course

IAW PMP

As agreed upon by govt

Provide a course cable of upload and execution on the current FM myLearn system of record.

12 4.2.2

Refresh Analysis

Report

COR and

FR

One time per course

IAW PMP

As agreed upon by govt

Provide an analysis that determines what refresh complexity a course will be refreshed at. IAW this

PWS, the refresh complexities range from

RC-0 to RC-100.

13 4.1.5 Monthly Status

Report

COR and

FR

Tenth business day each month

MS Office Provide a monthly summary of activity against the PMP, describe any risks or impediments, describe the contractors support activity, identify deliverables delivered, and shall support the contractor’s invoice.

14 4.1.6.4 Meeting Minutes COR and

FR

Two business days after each meeting

MS Office Provide meeting minutes for all formal meetings with the government (internal and external to OUSD(C)

15 4.1.2 Course

Evaluation

Summary

COR and

FR

Monthly, as agreed upon by govt

As agreed upon by govt

Provide a Course Evaluation

Summary for each active course that is available to

DoD employees

16 4.1.3 Quality Control

Plan

COR and

FR

30 calendar days after start of base period;

updates as required thereafter

MS Office Develop, provide, and maintain an effective quality control plan to ensure services are performed IAW this PWS. This Quality control plan will depict the quality related checkpoints to be passed during/after developing course content

17 4.1.7.1 Transition-In

Plan

COR and

FR

- Draft submitted with proposal

- Final due five business days after start of performance

- Transition-in plan should begin on the start of performance and shall be complete in 30 calendar days after the start of performance

MS Office Provide a plan that lays out a series of events and resources needed to move the DL training program into the desired direction.

This plan should address deliverables, analysis, projected course development schedule, policies, procedures and a well-conceived plan for meeting contract requirements

18 4.1.7.2 Transition-Out

Plan

COR and

FR

- Sixty calendar days prior to expiration of contract

MS Office Provide a plan that describes how project deliverables will be brought to full operational status, integrated into ongoing training, and subsequently maintained.

19 4.1.4 Post Award

Orientation

(PAO) Slides and Meeting

Minutes

COR and

FR

- Submit PAO slides three business days prior to PAO.

-Minutes shall be provided five business days after the PAO.

PowerPoint or pdf Slides, as a minimum shall identify the key stakeholders and highlight their roles and responsibilities, summarize the tasks and monthly status reporting (cost, schedule, and performance). Meeting minutes (with a list of attendees) shall capture the substance of the meeting.

FR = Functional Representative

COR = Contracting Officers Representative

Note 1: The contractor shall upload the deliverable to a location on the OSD network identified by the COR. The contractor shall notify the government when the deliverables are posted to this location, and the government will inspect the deliverables prior to acceptance.

Note 2: The contractor shall deliver the course to the government for installation on LMS and FM myLearn; once installed, the government shall conduct testing to ensure the course complies with requirements prior to final…