A3 - Attach 15 Sample Task Order 6-16-22F.pdf

Amendment 2 Attachment 15 Sample Task Order

Office of Procurement Operations

MEMO FOR PERSPECTIVE OFFERORS Month, Day, Year

SUBJECT: Request for Task Order Proposal (RFTOP) for the USALearning® Training and Education Support Products and Services Solicitation SP-HRS-###### Sample Task Order

Dear Perspective Offerors, You are hereby invited to submit a request for task order proposal (RFTOP) for a Task Order in accordance with the terms and conditions of Master Indefinite Delivery Indefinite Quantity (IDIQ) Contract to support the USALearning® (USAL) Training and Education Support Products and Services.

This RFTOP is being conducted in accordance with Federal Acquisition Regulation 16.505.

This RFTOP will result in the award of a hybrid priced IDIQ Task Order to include a Contract Line Item Number (CLIN) structure of firm fixed price (FFP), time and materials (T and M), labor hour (LH), and not to exceed (NTE) for travel. As noted in the RFTOP’s Performance Work Statement (PWS), the projected period of performance is twelve (12) months from date of award. The Task Order resulting from this RFTOP will be issued for all services described in the PWS.

This RFTOP does not commit the Government to pay for the preparation and submission of a proposal.

The Contacting Officer (CO) is the only individual who can legally commit the Government to the expenditure of public funds in connection with this procurement.

Evaluations

The Government will evaluate the proposal solely on the evaluation criteria specified below. Award will be made to an offeror that is considered the best value to the Government.

The Government reserves the right to reject any or all proposals received and/or request clarification or modification of proposals as appropriate.

The evaluation criteria below are in descending order of importance. The non-price evaluation criteria below, when combined, are significantly more important than price.

Based on the rating of the proposal against all evaluation criteria, the contracting officer shall determine if the Task Order shall be awarded without exchanges. The Government will evaluate the offer, considering the following evaluation criteria, listed in descending order of importance.

Non-Price:

Technical Approach – Describes the methodology and activities that will be used to achieve the objectives, tasks, and deliverables outlined in the PWS. The offeror shall specify any assumptions made in determining its approach.

Price:

Price/Cost Summary: The ordering activity will consider the appropriate level of effort and the proper mix of labor proposed to perform in order to determine the proposed price reasonableness in accordance with scope of the Task Order and established labor rates established under the Master IDIQ.

Written Proposal Format and Instructions

The contractor’s proposal submitted in response to this RFTOP shall consist of two (2) Volumes.

Volume I, Technical: This volume shall consist of the following (Volume I page limit is 20 pages excluding staffing plan, Work Breakdown Structures (WBS), and milestone schedule attachments. The 20 pages include the Volume cover page and the volume’s table of content):

Section I: Cover Letter

Includes the Request for Proposal (RFP) number and name of the requirement referenced in the RFP Invitation Letter

Section II: Technical Approach:

The contractor shall describe its technical approach for meeting the requirements of the PWS.

You must include a technical approach. NOTE: Contractor shall provide technical assumptions in the response.

1. A proposal that clearly states how the work will be accomplished, by whom (team, etc.), timelines for completion of deliverables and interim deliverable products for government inspection and technical quality measures implemented during the process.

2. A staffing plan as an attachment that shows the labor positions required for each functional area requirement. If a subcontractor team member is proposed, it should indicate the company providing that role. Staffing plan is limited to eight (8) pages.

3. WBS will be provided as attachments for each functional area requirement. Each WBS will include:

o Hierarchical Outline- reflect three (3) levels below the root level o Estimated labor hours associated with the completion of each task o Each WBS should be included as a separate attachment to the Sample Task Order

(STO) proposal and will be no more than one page. Landscape orientation using

8.5 x 14 size may be utilized for each WBS. Graphics may be utilized as needed however must be legible with font size within graphics no smaller than 10pt. The WBS attachments are not included in the overall page count for the STO proposal.

o Each Functional Area (FA) will have one (1) WBS that may be up to four (4) pages, or a total of 12 pages for all FA areas combined.

4. A draft milestone schedule will be included as an attachment in the proposal (Note:

Milestone schedule is not included as part of the page count. (No Page limitation.) As a minimum, the milestone schedule should include:

o Estimated delivery dates for each deliverable.

o Schedule of events for reviews, meetings, or conferences.

o Project close-out for return of all source files, GFM/GFI and final invoice.

Volume II, Pricing: The Pricing Volume shall consist of the following: (No Page limitation)

• The contractor is required to submit Volume II, Price Proposal. The volume must identify the price for the entire performance period as identified in the PWS.

• The volume pricing Proposal shall include the following:

Pricing Workbook (Attachment 16) The contractor shall clearly detail all Other Direct Costs (ODC), if any, that comprises the contractor’s fixed price. An item description, quantity and unit price for each ODC shall be provided. ODCs included shall be proposed in accordance with the Master IDIQ schedule terms and conditions of which this requirement was awarded.

An explanation of any pricing assumptions.

Contractor is required to submit a completed excel spreadsheet version of the pricing template attached to this RFP. The completed excel spreadsheet shall be submitted separately from the Volume II Pricing. Failure to submit the completed excel spreadsheet pricing template may render a contractor’s Proposal as non-responsive to the RFP.

• Proposals that do not include a detailed price will be considered non-responsive.

Note: The format of the entire Proposal must have margins no less than 1 inch and font size no less than 10 points and no greater than 12 points (e.g. 10, 11 or 12 point font is acceptable) to include all attachments:

Please note that there must be no communication with the Office of Personnel Management (OPM) client Agency regarding the requirements of this RFTOP until a selection has been made. This includes any of the contractor’s potential teaming partners and subcontractors. Direct client communication regarding this acquisition could result in disqualification of the contractor for this Task Order Solicitation.

Any questions or concerns must be addressed to xxxxx@opm.gov. [NOTICE: In keeping with the Federal Acquisition Regulation (FAR), OPM adheres to the guidelines outlined in the FAR Part 1.102- 2(c), which is to conduct business with integrity, fairness, and openness. In order to avoid any appearance of impropriety, the OPM Contracting Officer reserves the right to terminate contractor participation in an Agreement for unauthorized contact with customers, presentation of gifts to Government officials, use of defamatory statements, or other inappropriate behavior.

Thank you for your consideration of this RFTOP and we look forward to receiving your quote should you decide to submit one.

Any questions regarding this RFTOP are due no later than Month, Day, Year and Time.

Proposals are due no later than Month, Day, Year and Time.

Name Contracting Specialist U.S. Office of Personnel Management

Applicable Documents:

• Sample Task Order PWS with QASP (Attached below)

• Pricing Summary Workbook (Attachment 16)

Solicitation SP-HRS-######

USALearning® Training and Education Support Products and Services

Performance Work Statement For

Sample Task Order Month, Day, Year

1.0 General

1.1 Introduction

The USALearning® (USAL) program office, originally designated as an e-Gov initiative by the White House and OMB, operates as a “Shared Service Center” (SSC) to provide centralized design, development, implementation, maintenance and procurement of e-Learning related education and training products and services in support of OPM’s Human Capital Business Reference Model.

The above activities are engaged in by the USAL program office, consistent with OPM’s mission and embodied within these two Congressional authorities cited below:

5 USC 1304 (e)(1): Authorizes the establishment of a revolving fund without fiscal year limitation for financing investigations, training and such other functions as the Office is authorized or required to perform on a reimbursable basis, including personnel management services performed at the request of individual agencies.

5 USC 4116: Directs that the Office of Personnel Management, on request of an agency, shall advise and assist in the establishment, operation, and maintenance of the training programs and plans of the agency under this chapter, to the extent of its facilities and personnel available for that purpose.

USAL through its OMB designated Best-in-Class (BIC) K/P contract provides innovative and centralized integrated learning technology products and services for the government (Federal, DoD, State and Local).

1.2 Objective

The offeror shall show a clear and concise understanding of requirements that will be performed under this IDIQ Task Order. The Task Order shall include the processes, methodologies, project management, technical understanding, and include examples as part of an overall depiction of how work has been performed in the past as it applies to these requirements.

1.3 Scope of Work

This task order consists of three (3) objectives in support of Government Customer (GOVCUST) workforce and leadership goals. The three objectives are as follows:

• Development and support for Formal and Informal Learning (FA1)

• Development and support for a mobile application/simulation (FA2)

• Organizational strategic learning development and workshop/conferencing facilitation (FA3)

1.4 Background

GOVCUST is a large agency supported by USAL and requires Training and Education support to support its Agency mission and goals.

1.5 Type of Contract Contemplated

The Government intends to award one (1) Task Order Award.

1.6 Period of Performance

The period of performance of this task order will be twelve months from date of award.

1.7 Place of Performance

The place of performance is offsite (contractor location) for requirements in para 2.1 and 2.2. Partial on-site support at the government location in Frederick Maryland is required in support of an onsite workshop, as described in para 2.3.

1.8 Applicable Documents

The following policies and/or guidelines shall apply to this Task Order:

• The Sharable Content Object Reference Model https://adlnet.gov/resources/scorm-resources/

• Government instructions- DoD Instruction 1322.26 (“Distributed Learning”) -https://adlnet.gov/policy/

• Section 508 of the rehabilitation act with the revised standards as of January 18, 2018.

https://www.section508.gov/

• IEEE 9274.1.1 – Experience Application Programming Interface (xAPI)-https://adlnet.gov/policy/fungible/

• IEEE 9274.2.1 – xAPI ProfileTechnical orders- https://adlnet.gov/policy/fungible/

2.0 Specific Requirements/Tasks

This section describes the specific requirements to be performed in this Performance Work Statement

(PWS).

2.1 Formal/Informal Learning Development (FA1)

2.1.1 Formal learning Curriculum: eLearning Design, Development and Support The course currently includes a self-paced portion that is foundational and was developed to set the stage for subsequent learning. The existing content currently totaling five (5) hours of course content. This self-paced version was created nine years ago and utilizes Adobe Flash, which is no longer usable and must be rebuilt. Some original photos and charts provided by the government are reusable, which will be provided as GFI (about 120 JPEG and PDF files). In addition, about 20% of the original text has changed and requires updates.

All original text source documents will also be made available as GFI.

a. The Contractor shall develop five (5) 60-minute lessons from the existing flash content, IMI Level II interactivity for delivery of program policy and informational knowledge required https://adlnet.gov/resources/scorm-resources/ https://adlnet.gov/policy/fungible/ for learner comprehension. Each lesson shall include checks on learning interspersed within lessons and a final learning check at the end of the lesson.

These lessons include the following modules:

1. Understanding Workplace Harassment, definitions, and policy

2. Recognition of and Immediate Steps

3. Changing Conduct

4. Resolution

5. Reporting

b. The Contractor shall develop five (5) 60-minute experiential (learning theory) scenarios at

IMI Level III which utilize high-level multimedia including videos and/or 3D simulations for depiction of real-world decision-making situations. These learning scenarios shall follow each of the five (5) lessons defined above and shall include at a minimum of three (3) branched outcomes, as well as subbranches that are used as scaffolding to re-enforce or influence learner choices. Videos shall be utilized to create realism and shall incorporate visual backgrounds and environments familiar to the learner, with at least 50% depicting a virtual work environment (offsite/remote work). Talent shall be utilized for all video roleplays with talent that represents the diversity present in GOVCUST’s workforce and leadership.

c. Contractor shall provide interactive scenarios and multimedia that may require alternative media for learners and that require the use of assistive technologies (section 508 of the Rehabilitation Act). Also, all alternative media or content shall provide the same informational knowledge as the primary content.

d. Contractor shall provide all courses that are SCORM 1.2 compliant for the GOVCUST Learning Management System (LMS). The Government will provide the Contractor with access to the staged test server environment for installation and testing of the final SCORM package on the target LMS. The target LMS is a government FedRAMP LMS which SCORM 1.2 conformant.

e. Contractor shall provide professional narration that will be used to ensure multiple mediums are used for presenting information and for increasing the overall quality of the training.

2.1.2 Live/virtual Instruction. The Contractor shall provide the curriculum materials that shall consist of information developed for in-person or virtual instructor-led delivery. The contractor shall provide instructor led materials that are approximately (200) pages and include six (6) PowerPoint slide presentations, for a classroom equivalent of two (2) hours of instruction. This information shall be updated for optimal delivery in a virtual facilitated instructional platform. The current virtual training platform utilized by GOVCUST is Adobe Connect, of which the Government will provide the Contactor with access as required as needed for development, piloting and facilitating.

The Contractor shall provide the following:

a. The contractor shall design, develop, and facilitate the instruction for four (4) separately scheduled cohort iterations of up to 50 persons in each cohort. Each event will include two

(2) hours of instructional interaction following learner completion of self-paced activities and eLearning.

b. Contractor shall provide a meeting facilitator for all sessions to assist government with the virtual instruction. The contractor shall ensure that sessions will be designed to maximize learner engagement and will include edited videos from the self-paced scenarios as pivot points during the sessions.

c. Animations shall be utilized as appropriate for the IMI Level III lessons in order to provide realism to scenarios. For simulations of actual human interactions where facial emotions are important, video should be utilized in lieu of animated characters. Animations will be described in the Storyboard regarding the type of animation to be used (2D/3D etc.) and the instructional purpose of the animation. Any voices used in animations will be accompanied by a separate script to be approved simultaneously with the storyboard for that lesson or activity.

d. The Contractor shall ensure that all video and audio scripts utilize simple, understandable text representing GOVCUSTs language and culture. The scripts should align with GOVCUSTS core values, the approved learning goals and demonstrate an understanding of the context, science, and best practices for preventing harassment in the workplace. The script will provide a detailed description of all video elements to be filmed, including a description of talent, scenes, objects, and actions to be captured.

2.1.3 Informal Learning Design & Support: Contractor shall provide informal learning information and management of social collaboration groups in the GOVCUST Learning Portal, which is a FedRAMP Drupal environment operated by GOVCUST. The Government will provide the Contractor with the content author administrative access to the environment for posting of page and media content and for facilitation of blogs/social media.

The Contractor shall Provide the following:

a. Knowledge Management. The Contractor shall provide knowledge management of 400 learning content postings of government curated publications and materials utilized in conjunction with the Program.

b. Curated Journal Articles. The contractor shall provide (50) journal articles in various formats.

The articles shall range from 10-65 pages, with most utilizing MS Word, RTF or PDF formats. The Contractor will convert all articles to 508-compliant PDF files and perform associated metadata tagging and alt tagging of images within the articles.

c. Postings of media or information by users. The Contractor shall ensure postings are compliant with GOVCUST governance plan and policies and shall remove any non-compliant postings.

d. Social media facilitation. The Contractor shall provide facilitation including seeding blog groups with initial conversation starters, reviewing all comments, removing inappropriate comments (In accordance with (IAW) governance plan) reporting as necessary, and steering discussions as needed. Contractor shall facilitate and manage two (2) social media groups as follows:

i. Leadership Group- all supervisors, managers and senior leaders

ii. Workforce Group – all non-supervisors

e. Activity-based (xAPI). These activities shall integrate with formal learning described in 5.1.

The contractor shall develop microlearning videos that utilize the existing GOVCUST LRS and create xAPI statements as needed to tracker learner completion of activities. These learner activities will include twenty learning events, accessible via GOVCUST’s Learning Portal and shall include the following attributes:

• User activities that require active learner engagements that require learner to post, comment, create, identify, resolve or other active modes of learning.

Scaffolding or hints may be utilized to prompt users to perform the action required.

• The activities/events will require no more than an average of ten minutes for completion.

• Incorporate ten microlearning videos designed to educate all GOVCUST employees on workplace harassment, including recognizing, reporting, rights and other topics. The target length for these videos should be no longer than 2-3 minutes and must be playable over mobile devices with limited Internet (cellular data).

• Provide activity completion data to GOVCUST LMS.

f. Include badges, icons, and other virtual learner reward items (Note: GOVCUST Learning Portal includes reward compilation generation and reporting).

2.2 Workforce Readiness Mobile Application (FA2)

The GOVCUST requires a mobile ready application to support its diverse workforce- which includes worker in remote locations with limited Internet and personal computer access. This remote workforce includes over 5000 employees that are issued iOS based mobile phones and/or tablets. This mobile application will also be made available to family members stationed with the worker.

The Contractor shall ensure that the mobile application will be designed to play on iOS devices and will be made available through Apple App Store internal portal or url. The contractor will register the application and ensure it meets all requirements for app stores. This effort will include the following major characteristics:

• Micro-Learning: The application will include five (5) micro-learning content objects on the full range of workforce topics, with focus on maintaining a safer, harassment-free environment, and a reporting mechanism, to include chat and other means of discussion and reporting issues with local environmental concerns including local or non- GOVCUST employee situations.

• Motivational Elements: The application may include push-notification, gamification elements, or other features that encourage consistent, long-term interaction. These features will be investigated as part of the project.

• iOS applications will be developed and tested on the current operating system for each type of mobile device to include phone and tablet devices. The contractor shall ensure 100% functionality on the operating systems available at the time of delivery. The Contractor shall be responsible for any updates and testing that may occur from iOS environments that may occur during development and prior to final delivery.

2.2.1 Phased Development: The contractor shall use an iterative, incremental agile approach to develop the application and its embedded content. The Contractor shall ensure that each development phase will produce a minimum viable product, which will be demonstrated to the Government at each incremental phase of development. Prototype delivery shall include functional client-side software, functional server-side implementation, and editable source code. At minimum, the mobile workforce readiness application functional prototype shall be delivered in several phases of advancing degree of maturity starting with design proposals.

a. The design proposals shall consist of industry standard methods to convey the nature of the user experience and user interface (UI) interactions, which may consist of wireframe, mockups, design boards, development canvases, etc. The design proposals shall also adapt to user facing UI conventions for each mobile OS (e.g., iOS and Android). The design proposals shall be presented to a panel of stakeholders that will agree upon a final application design language upon sufficient and reasonable iteration.

b. Phases of delivery:

i. The first functional prototype shall consist of a minimum of functional mockups that simulate various aspects of the application functionality, e.g., backend data serving and management, simulated data flows, simulated user interactions and interactive elements that provide interaction feedback.

ii. The second functional prototype shall have reached a level of maturity consistent with an industry accepted closed beta standard that can be tested and evaluated by a selected group of testers chosen by the stakeholders who will provide formative feedback. The prototype shall also be suitable for any necessary and appropriate summative testing in accordance with appropriate deliverables.

iii. The third functional prototype shall have reached a level of maturity that permits wider, controlled distribution for testing and evaluation by a small cohort of potential users for further formative testing and feedback in addition to any formal summative testing necessary to evaluate its impact on workforce literacy learning outcomes.

iv. The fourth functional prototype shall transition to an operations and maintenance mode where the capability will enter the production phase and the contractor will collect usability feedback from users and correct deficiencies and bugs.

2.2.2 Information Assurance: The contractor shall incorporate suitable cybersecurity controls for at Information Assurance (IA) standards. The contractor shall develop an IA strategy that provides viable alternate plans for implementing and deploying the mobile workforce literacy training system to a broad user base.

2.2.3 User-Centered Design: The contractor shall apply a user-centered design to ensure the resulting product will have appropriate usability (broadly defined) for end-users as well as the long-term system administrators. The contractor shall present proposed user-centered designs of the user facing and administrator facing user interface (UI) for review and consultation to a panel of stakeholders and plausible end-users for feedback at agreed upon design and development increments.

2.2.4 Documentation. The contractor shall ensure all final technical deliverables have robust documentation, to include guides for end-users, technical and content developers, and long-term system administrators.

2.2.5 Licensing. The contractor shall grant the Government unlimited rights to all documents and materials produced. This includes all documents and materials, and the source codes of any software., All things produced under this contract shall be Government owned and are the property of the Government with all rights and privileges of ownership/copyright belonging exclusively to the Government.

2.2.6 Long-Term Implementation and Sustainment. The contractor shall design the application, content, and supporting documentation to enable large-scale implementation and long-term sustainment.

The contractor shall use leading industry methods, standards, and services to ensure low user interaction latency, and reliability that follows good industry user experience (UX) practices. The contractor shall design the system with this end in mind and determine a comprehensive life-cycle operations and maintenance plan that enables the long-term viability of the system and its content.

2.2.7 Application support and maintenance: The contractor shall provide ongoing support and maintenance to the application. Feedback from end users gathered through the application stores, usability tests, and other opportunities shall be collected, prioritized, and implemented. The contractor shall monitor and test for software bugs, and any found shall be prioritized and addressed. Required security updates related to the Android or iOS operating systems shall be implemented.

2.2.8 Usage reporting: The contractor shall provide monthly usage reports to the USAL COR and CO.

The data shall include usage reports to be determined based on requirements from GOVCUST. At a minimum, the reports shall include number of downloads and active users by Service. The contractor shall work in collaboration with the GOVCUST hosting service for the application.

2.2.9 Content management: The workforce literacy content generated by the contractor, as well as that from other Government sources, shall have a cohesive design language that extends to any subsequent content generated by end-user administrators using the applications’ content management system (xAPI/LCMS is provided by GOVCUST). The Contractor shall ensure that All content is complete and accurate prior to implementation. The contractor shall ensure its currency and usefulness, existing content will be reviewed regularly to check for broken links, changes in policy, and other issues.

2.2.10 Design and development of social networking capabilities: The contractor shall design features in the application such as leaderboards, chat, and similar elements to encourage social interaction within the platform. To establish requirements for these features and gauge interest, the contractor shall conduct interviews/focus groups with a sample of representative end users. The contractor shall implement these requirements as mockups and present them to end users for evaluative purposes. The contractor shall develop these features into the software. In addition, the contractor shall update and maintain the existing application to support newly released devices, operating system updates, and security issues.

2.2.11 Interface design updates: The contractor shall design application interfaces to reflect the new capabilities within the application. In addition, updates to interfaces based on end user feedback gathered during testing during the previous phase of development will be designed and implemented. All designs will be presented to GOVCUST for review prior to their implementation. The contractor shall design these adjustments iteratively, with user acceptance and usability testing taking place at key milestone deliverable phases.

2.2.12 Advanced data analytics: The contractor shall establish measures of interest to the Government relative to the effectiveness of the application. These shall include demographics, interactions and responses within the application, and other measures. Data collection and analysis shall be conducted to determine the appropriate granularity and frequency of these measures to provide useful information in regular reports.

a. Completion data shall be in the form of xAPI statements which will interface with the

GOVCUST existing Learning Record Store (LRS) and Learning Management System (LMS). Access will be provided to these systems, as required, for testing purposes.

b. If the contractor is required to collect and manage personally identifiable information, the contractor shall secure data in accordance with its security classification. While working on these tasks, the contractor shall safeguard all material in accordance with applicable Government regulations.

2.3 Strategic planning consulting, development, and facilitation support (FA3):

A new Learning and Development (L&D) Chief Learning Officer (CLO) has been hired for GOVCUST, which has a total workforce of 16,000 employees. The CLO desires to analyze issues with the current training delivery across seven (7) regions that include CONUS and OCONUS locations. The CLO recognizes the impacts of the recent COVID pandemic and wants to ensure that training that supports the GOVCUST Director’s goals is being effectively implemented.

Motivational Elements: Current Federal Employee Viewpoint Surveys (FEVS) indicate that the GOVCUST workforce has concerns regarding the quality and availability of training and career development opportunities. In addition, the Director has identified leadership development as a goal for improvement across the organization.

Employees in remote locations (over 420 locations in US) do not feel that training is available or is current. These employees desire to further their skillsets and advancement capabilities. In addition, the Bureau is concerned that leadership development training is ineffective and does not address Director’s goals.

2.3.1 Requirements: The contractor will assist in the development of a strategic plan for the CLO. This plan will be drafted by the CLO’s Leadership Team, which consists of the Leadership Training Program Manager, New Employee Training Program Manager, Region Outreach & Development Program Manager, Partnership Training Program Manager and the Learning Technology Program Manager. The plan shall be developed over a six (6) month period and will include, at a minimum:

a. Four (4) fifty-person one-day virtual workshops led by a contractor facilitator. The contractor will provide the conferencing software for the workshop (must be compliant with GOVCUST browsers and approved software list, i.e. Microsoft Teams, GovZoom, AdobeConnect, WebEx or similar) and this software must be approved by the Government prior to being used.

b. Contractor shall provide facilitation services for five (5) full days for one fifty person onsite workshop, at GOVCUST’s training facility. (Located in Frederick Maryland). Contractor shall develop a agenda, slides, handouts and other electronic and non-electronic materials in support of the meeting. Government will provide the on-site facilities, food and lodging for attendees. The workshop will include Regional Representatives, and other GOVCUST key leaders, who will review draft strategic plans from the previous workshops.

c. Following the onsite, the contractor shall develop a final draft strategic plan document, including professional graphics, charts, diagrams, and data supporting the plan. This final draft plan will be presented to the Director by the CLO within two (2) weeks of the onsite.

d. The contractor shall make changes as required from the CLO Director’s guidance and finalize the Strategic Plan. The final version will be provided to GOVCUST in an electronic, printable PDF format.

3.0 Contractor Quality Assurance.

This section will apply to eLearning products delivered as part of para 2.1 and 2.2 requirements above.

The contractor shall execute usability and user acceptance testing to identify issues and assist with providing remediation for the issues found. Usability, satisfaction, and effectiveness shall be evaluated internally and iteratively on a small scale, while testing associated with major developmental milestones shall be accomplished with a larger number of representatives from the end-user community. Software development tests such as quality assurance, load testing, developer unit tests, smoke tests, white, grey and black box testing and automated UI testing shall be conducted. Quality assurance testing shall take the format of requirements validation and verification as well as use-case verification. Findings from usability testing shall be reported in a Usability and User Acceptance Report. The contractor shall deliver this report to the Government for review. Requested revisions to these documents shall be incorporated and provided in a final version by the contractor.

3.1 Formative Testing. The project will conduct frequent formative testing with human subjects, including testing of the relevant technical usability, satisfaction (Kirkpatrick Model (KM)Level 1), and effectiveness testing (KM Level 2). Early phase testing may include small-scale trials, while prototypes associated with major developmental milestones will include more robust trials with representative end-users. As part of formative testing, the contractor shall report on quality assurance evaluations, load testing, and other relevant measures of technical testing and evaluation measured against quality and performance baseline targets established at the onset of the project.

3.2 Summative Testing. Upon delivery of the final prototype, the contractor shall conduct a summative test of it with representative end-users at scale. The test will include, at a minimum, usability, satisfaction (KM Level 1), and effectiveness testing (KM Level 2), as well as quality assurance evaluations, load testing, and other relevant measures of technical testing and evaluation measured against quality and performance baseline targets.

In lieu of face-to-face summative testing, effectiveness testing will be accomplished through the xAPI data collected throughout the beta testing period using the application directly. Measures of usability and effectiveness will be established using xAPI data. Data will be compiled throughout the three development and test cycles and findings will be presented as a report at the end of the period of performance.

3.3 Acceptance. To be accepted by the Government, the final prototype shall meet Quality Assurance Surveillance Plan (QASP) (see para. 9) standards for these tests.

3.4 Beta testing period. To test new features in the application prior to their release, the contractor shall establish a testing pool and download process for a predefined set of users not to exceed 100. The contractor shall leverage existing systems, similar to Apple’s Test flight for iOS Beta testing, and/or Microsoft’s HockeyApp for Android testing. For this testing period, the contractor shall release three (3) discrete and separate milestone builds to capture and elicit feedback and performance data over a three-month period. The contractor shall analyze the resulting data to determine the effectiveness of the application. The results shall be presented to the Government in an analysis report.

4.0 Delivery or Deliverables

The following are a description of the deliverables required in performance of this task order. (See Table 1 for additional time details).

4.1 Milestone Schedule & Project Plan

Contractor shall provide a milestone plan within five (5) working days of the project award. Contractor shall provide a project plan with tasks, to include dependencies the project plan shall be provided within ten working days from award of the task order. The project plan will be briefed to GOVCUST, USAL COR & PMO for approval (briefing may be conducted in conjunction with project post-award meeting.

Government will provide the contractor with comments and concurrence/non-concurrence within five (5) working days of the briefing.

4.2 Work Breakdown Structure

Contractor shall provide a Work Breakdown Structure (WBS) as attachments for each functional area requirement. Each WBS shall include:

o Hierarchical Outline Primary task Subtasks- no more than one level

4.3 Formal/informal Learning.

Contractor shall develop a schedule for the following interim and final deliverables required for formal & informal learning. NOTE: All meetings to be conducted virtually using virtual conference software that is accessible from GOVCUST and OPM networks.

4.3.1 Design documents.

Contractor shall provide the following design documents:

a. Instructional Goals. Contractor shall provide instructional goals (objectives) statements draft report for government approval within five (5) government business days (GBDs) of award. As part of GFI, government program office will provide existing statements or general objectives, which will be refined to incorporate all requirements for the course materials to be completed under this task order. Government subject-matter-experts (SMEs) will be available for discussion immediately following post award meeting for guidance and discussion in formulation of these formal objectives. These objectives shall consist of no more than six (6) final statements.

GOVCUST will be provided three (3) government business days for review, including a virtual meeting if required for finalization of the formalized statements.

b. Content Inventory and Gap Analysis (CIGA). The contractor shall provide a complete analysis of all existing course materials and determine any informational gaps and possible sources of information. This inventory and analysis shall be completed within ten GBDs of the approval of instructional goal statements. The government will provide the contractor missing content or source for content within twenty GBDs from receipt of the CIGA.

c. Design Plan – The contractor shall provide suggestions for design structure and key elements of course materials, in include instructional approaches, blending of formal and informal learning and use of media. This design plan will be high level, no more than five (5) pages in length, with subsequent details to be defined at the storyboard stage. Design plan and media will be provided for gov review within twenty GBDs of CIGA.

d. Storyboards –The contractor shall develop storyboards for lessons and learning activities. These storyboards will provide a “screen-by-screen” description of the content, interactions, and media to be developed. For interactive scenarios, a flowchart will be utilized in conjunction with storyboards that provides sublevels of storyboards that may be encountered by the learner. The storyboards will include media placeholders that clearly articulate the instructional use of the media, as well as supplemental or alternative content or media as needed for 508 accessibly alternatives. Storyboards shall be developed and delivered for GOVCUST review on lesson-by-lesson basis, with government review time of up to five (5) gov business days for each lesson.

Learning activity storyboards may be delivered independently, or together, with three (3) GBDs for review of each, or tendays if delivered all together.

4.3.2 Final IMI Product Reviews

The interactive, online learning lessons will undergo thorough reviews prior to final delivery of the SCORM package delivery.

a. Alpha review will be conducted by the contractor, with a report of issues and corrections provided to GOVCUST and COR. All alpha deficiencies will be corrected prior to Beta review.

b. Beta review will be conducted by GOVCUST SME and PMO personnel. The review will be accomplished utilizing an online review tool, as specified in base contract, para. 4.7.7, Review Tool. GOVCUST will be allowed five (5) days for each lesson, or ten days if reviewing all.

c. Final reviews will be conducted by GOVCUST SME/PM and USAL COR personnel for SCORM packages after installation on the GOVCUST LMS staging environment, with fifteen days for final review.

4.3.3 Social Learning Activity Report

Contractor shall provide a social learning activity report monthly. The report will include # of group users, # monthly postings and any issues.

4.4. Workforce Readiness Mobile Application deliverables

4.4.1 App design proposals (see 2.2.1) shall be in electronic form, provided by contractor, that allows review and comment by GOVCUST.

4.4.2 Delivery for prototypes (see 2.2.1) shall be in electronic form, provided by contractor, that allows review and comment by GOVCUST.

4.4.3 The contractor shall develop an IA strategy (see 2.2.2) that provides viable alternate plans for implementing and deploying the mobile workforce literacy training system to a broad user base.

4.4.4 All final technical deliverables have robust documentation, to include guides for end-users, technical and content developers, and long-term system administrators (see 2.2.4).

4.4.5 Contractor shall provide the following reports

a. Monthly status reports will include the following, as a minimum:

i. Usage reports (see 2.2.8)

ii. QA and usability test report results (see 3.0)

• Formative Test report.

• Summative Test report.

• Beta Test report.

• Application/bug fix report.

4.5 Strategic planning and workshop support

4.5.1 Virtual Workshops

Contractor shall plan workshops and provide draft agendas for government review/acceptance thirty days prior to workshop. Following each workshop, the contractor will provide a summary of meetings, to include attendees, session notes and action items.

4.5.2 Onsite Workshop

Contractor will provide a workshop plan and agenda forty-five days prior to workshop start date.

Contractor to provide personnel for facilitation and documentation, as needed. Following the workshop, the contractor will provide a summary of meetings, to include attendees, session notes and action items.

4.5.3 Strategic Plan

Contractor will develop the strategic plan document based upon workshops conducted. Following the onsite, contractor will provide a high-quality draft plan for presentation to GOVCUST Director. A final plan will then be delivered in PDF, suitable for printing or online delivery and viewing.

4.6 Final Source Deliverables

Following government acceptance of all deliverables, contractor will return to GOVCUST all GFI/GFM and all interim developmental products, to include all of the following, as applicable: data files, design files, xAPI statement library(s) storyboard documents, scripts, native format audio and video files (i.e., AVI, MP3, MP4) and software source files utilized for production prior to final compilation. These files will be delivered via DVD-ROM, thumb-drive or other archival media (without tying up Internet bandwidth). Cost of this final media delivery will be included with the initial cost estimate.

a. The Contractor shall provide to the Government written releases from all talent used in the production of materials. All releases for talent, images, graphics, music, and other elements are to be obtained on a 100% buyout basis, and appropriate consideration should be given to achieve buyout at a low cost.

All work conducted under this task order is considered work-for-hire for GOVCUST and becomes the property of GOVCUST.

b. The Contractor shall provide pre- and post-production materials as requested by GOVCUST. This may include, but not be limited to: rough cuts of audio and videotapes or film; field camera footage;

master copies of audio, video, digital or print materials for in-house editing, production, reproduction, and archiving. The Contractor is required to inventory all media assets upon completion of the job.

GOVCUST will advise the Contractor on where to forward materials.

4.7. Notice to contractor. All information and data related to this project that the contractor gathers or obtains shall be both protected from unauthorized release and considered the property of the Government.

The CO will be the sole authorized official to release verbally or in writing, any data, the draft deliverables, the final deliverables, or any other written or printed materials pertaining to this contract.

Press releases, marketing material, or any other printed or electronic documentation related to this project, must not be publicized without the written approval of the contracting officer.

All applications, software or other code developed for the Government in the performance of any requirement under this contract is the sole property of the Government and will not be utilized, promoted, promogulated or provided as part of any other work outside of this contract unless specifically agreed to in writing with signature by the OPM contracting officer.

All 3rd party software or code utilized in the development of this work must be disclosed before use in the performance of this contract. The contractor will disclose the purpose of the software, and whether it is utilized only in development stages or required for operation of the final product. If required for operation, the contractor must procure and transfer unlimited use license to OPM as part of the final deliverables.

Table 1 – Schedule of Deliverables

FA

No. Deliverable Objective Format Due

1,2,3 Milestone Schedule

Ref: 4.1, milestones of contract objectives.

MS Office (doc, xls, ppt)

No later than (NLT) five (5) GBD after contract award

1,2,3 Project Plan Ref 4.1 Report documenting draft project plan, initial requirement due within 10 days, and updated monthly in conjunction with monthly report

Project management software (Trello, Jura, etc.)

NLT Ten GBDs after award;

monthly thereafter;

or continuously updated

1,2,3 Work Breakdown Structure

Ref 4.2 MSOffice or

PDF

NLT Ten GBDs after contract award

1 Instructional Goals report

Ref 4.3.1.a MS Doc NLT Five (5) GBDs after contract award

1 CIGA Ref 4.3.1.b MS Doc Ten GBDs following gov acceptance of #3

1 Design Plan Ref 4.3.1.c MS Doc Twenty GBDs following gov acceptance of #4

1 Storyboards Ref 4.3.1.d MS Office (doc, xls, ppt) or other as agreed during post award meeting

TBD, with schedule to be outlined in milestone schedule (#1) by contractor

1 IMI Alpha Review report

Ref 4.3.2.a MS Doc TBD, with schedule to be outlined in milestone schedule (#1) by contractor

1 IMI Beta Review Ref 4.3.2.b Review tool TBD, with schedule to be outlined in milestone schedule (#1) by contractor

1 IMI Final Review

Ref 4.3.2.c Review tool TBD, with schedule to be outlined in milestone schedule (#1) by contractor

1 IMI Level II- (5) hours courseware conversion from Flash

Ref 2.2.1 SCORM files TBD, with schedule to be outlined in milestone schedule (#1) by contractor

1 IMI Level III (5) hours experiential scenarios

Ref 2.2.1.b, SCORM files TBD, with schedule to be outlined in milestone schedule (#1) by contractor

1 Live /virtual ILT curriculum

Ref 2.1.2 MS Office/PDF

TBD, with schedule to be outlined in milestone schedule (#1) by contractor

1 Social Learning Report

Ref 4.3.3 MS Doc Within Five (5) days following the end of the month

2 App Design Proposal

Ref 4.4.1 MS Office (doc, xls, ppt)

TBD, with schedule to be outlined in milestone schedule by contractor

2 1st Functional Prototype

Ref 4.4.2 Review tool TBD, with schedule to be outlined in milestone schedule by contractor

2 2nd Functional Protype

Ref 4.4.2 Review tool TBD, with schedule to be outlined in milestone schedule by contractor

2 3nd Functional Protype

Ref 4.4.2 Review tool TBD, with schedule to be outlined in milestone schedule by contractor

2 IA Strategy Ref 4.4.3 MS Office (doc, xls, ppt)

TBD, with schedule to be outlined in milestone schedule by contractor

2 Documentation, end-user guides

Ref 4.4.4 MS Office (doc, xls, ppt) and PDF

TBD, with milestone schedule by contractor

2 Monthly Usage Report (with Monthly Status Report)

Ref 4.4.5 MS Doc Within five (5) days following the end of the month

2 Formative Test Report

Ref 4.4.5 MS Doc TBD, with schedule to be outlined in milestone schedule by contractor

2 Summative Test Report

Ref 4.4.5 MS Doc TBD, with schedule to be outlined in milestone schedule by contractor

2 Beta Test Report Ref 4.4.5 MS Doc TBD, with schedule to be outlined in milestone schedule by contractor

2 Application Bug/Fix Report (with Monthly Status Report)

Ref 4.4.5 MS Doc Within five (5) days following the end of the month

3 Virtual Workshop Plan & Agenda

Ref 4.5.1 MS Doc Thirty days prior to workshop

3 Virtual Workshop Meeting notes/summary

Ref 4.5.1 MS Doc Five (5) GBDs following workshop

3 Onsite Workshop handouts and presentation

Ref 4.5.2 MS Doc Twenty GBDs following gov acceptance of #4

3 Onsite Workshop Meeting notes/summary

Ref 4.5.2 MS Office (doc, xls, ppt) or other as agreed during post award meeting

TBD, with schedule to be outlined in milestone schedule (#1) by contractor

3 Draft Strategic Plan

Ref 4.5.3 MS Office (doc, xls, ppt) or other as agreed during post award meeting

TBD, with schedule to be outlined in milestone schedule (#1) by contractor

3 Final Strategic Plan

Ref…