J.3 Questions with Responses_6-30-22.pdf

Number

RFP/SOW

Section and Page Number

Question Response

RFP, Vol. 2, Business/Price Proposal

Could HMS CMS provide some historical data for level of effort (LOE) and ODCs to help prepare a reasonable Basis of Effort (BOE)? No historical data for level of effort (LOE) or ODCs will be given.

2 N/A Is there an incumbent contractor(s) for this scope of work?

This procurement combines cybersecurity training requirements from the following three (3) contracts: Iron Vine Security LLC Contract # 47QTCA19D00HF/Task Order #75FCMC21F0082

THE MITRE CORPORATION Contract # 75FCMC18D0047/Task Order

#75FCMC19F0010

Assyst Inc. Contract # HHSM-500-2016-00031l/Task Order #75FCMC18F0001

3 SOW 2.7 p 18 As there was no DD Form 254 attached to the RFP, the assumption is that there are no requirements for contractors to access classified information. Is this correct? There are no requirements for contractors to access classified information.

4 SOW 3.3 p 23 As the Period of Performance (PoP) begins on September 16, 2022 it is assumed that the due dates for Deliverables #0001, #0002, and #0003 follows the beginning of the PoP not the date of contract award. Is this correct?

Correct

5 SOW 2.2 p 11 Bullet 5

It is assumed that the course source files and a list of content authoring tools used to create the course source files will be furnished as GFE. Is this correct? That is not a correct assumption.

6 RFP I.4 pp 29-30 As the current version of the WCAG is 2.1 (as of 2018), it is assumed that the contract will adhere to the WCAG 2.1 and that a version of the VPAT template aligned with WCAG 2.1 will be provided. Is that correct?

That is not a correct assumption, as the WCAG 2.1 standards did not replace the WCAG 2.0 standards (they are independent of one another). The VPAT that was provided includes the WCAG 2.0 standards, which is consistent with what CMS identified in the SOW as being applicable. However we are providing the VPAT 2.4 Rev (March 2022) version, which is the most recent version of the VPAT (it also includes the WCAG 2.0 standards).

8 RFP Section M.1

We do not have corporate experience as our company is newly established.

However, the staff at our company has extensive experience in the areas of academia, education, cybersecurity, and health-IT. Can that be listed in lieu of corporate experience?

No, all offerors must provide the corporate experience described in the RFP. At least one corporate experience example must come from the prime contractor.

9 RFP Section M.1

The proposals are weighed based on four factors. Factor 1 is “Corporate Experience”. Given that our “Corporate Experience” is lacking but our personnel and subcontractors are highly experienced, can that be used to measure our experience based on our personnel’s vast experience and the subcontractors’?

Corporate experience of subcontractors can be used; however, at least one corporate experience example must come from the prime contractor.

10 RFP Section M.1

How will the other Factors, namely Factor 3 “Past Performances” be weighed when compared to Factor 1? Are all of Factors weighed equally (25% split) or can a Factor outweigh corporate experience if sufficiently argued?

As per the RFP page 59 Evaluation Process "All evaluation factors other than cost or price, when combined, are significantly more important than cost or price. The non-price factors will be considered in the following descending order of importance:"

Factor 1: Corporate Experience Factor 2: Management Approach Factor 3: Past Performance Factor 4: Section 508 Compliance/VPAT

11 RFP L. 10

Volume 2 Pg. 57

Please confirm there is no page limit for the word or pdf and excel files in Vol 2 Business/Price Proposal. There is no page limit for Volume 2. The RFP has been updated accordingly.

RFP L. 10

Corporate

Experience Pg

Please confirm that work performed by significant subcontractors can be included in the Corporate Experience projects? See Response #9

RFP Section H.4

To what extent are we to be involved in the technical development of the unified LMS? Do we need to have a software development team assembled and if so, of what size?

7 See section SOW 2.2.1 & 2.2.2

RFP L. 10

Corporate

Experience Pg

Please confirm work performed as a subcontractor be evaluated as Corporate Experience? See Response #9

RFP L. 10

Corporate

Experience Pg

Will state or local government or commercial work be evaluated as Corporate Experience?

Yes, state, local Government, and commercial work be evaluated as Corporate Experience. RFP has been updated accordingly.

RFP L. 10 Past

Performance Pg.

Will relevant contract work performed as a subcontractor be evaluated as Past Performance? See Response #9

RFP L. 10 Past

Performance Pg.

The instructions state "Offerors and proposed significant subcontractors without relevant Federal government past performance experience may ask customers to submit no more than three (3) Past Performance Questionnaires (PPQs) each for the same or similar work directly to the Contracting Officer (see Attachment J.4)."

Does this mean that Federal government past performance experiences or PPQs are expected from the Prime and any significant subcontractors?

PPQs may be provided for the Prime and any significant subcontractors as appropriate.

RFP Section M Factor 2:

Management Approach Pg. 60

The evaluation criteria provided states "In addition, the Government will evaluate the match or fit of key position descriptions and resumes with the proposed technical approach." However, there is no technical approach narrative requested in the instructions. Does the government mean that they will evaluate the match or fit of key position descriptions and resumes with the proposed Work Breakdown Structure that is requested as part of Tab B Management Approach?

Yes, the RFP has been updated to provide instructions for the submission of key personnel resumes.

RFP L. 10

Volume 1 Pg. 53 and Tab D Pg. 56

The Section 508 VPAT Attachment J.5 is currently included as Vol 1, Tab D, outside of page count. Since it is a stand alone document would the government allow Attachment J.5 Section 508 VPAT to be submitted as a separate attachment?

Yes, J.5 Section 508 VPAT is to be submitted as a separate attachment.

RFP L.10 Tab A.

Corporate

Experience para

b. Pg. 54

The minimum information required for each project includes "cumulative dollar value of contract at closure". If the project is still ongoing, will the government accept the anticipated total contract value if all options are exercised?

Yes.

20 SOW 2.2.1 Page

This section identifies "deployment" support and specific features/functions for a LMS, indicating the government plans to migrate to a new LMS. Is this correct?

A new LMS will be procured under separate contract, initially just for cybersecurity and privacy support. Migration activities are TBD. The agency currently employs a Learming Management System (LMS), also known as the HHS Learning Portal, which is used across the Department of Health and Human Services (HHS). The LMS is used to track course registrations, complete mandatory and online trainings, view training history, certifications, curricula and more. This LMS procurement is not impacted by this SOW.

21 SOW 2.2.1 Page 9 If a new LMS is planned, when is it expected to be deployed? Post contract award

22 SOW 2.2.1 Page

If a new LMS is planned, please confirm that its acquisition, hosting and system integration within a secure CMS environment are outside of this contract. See Response #20

23 SOW 2.2.2 Page 11 Are these requirements specific to support the current or a future LMS? These requirements will support both the current and future LMS.

24 SOW 2.2.2 Page

If support of the current system is required, can the government please provide technical specifications of the current LMS so that administration can be proposed accurately.

No current LMS is deployed

RFP Section L and Sections K.3 and K.4, Pgs. 41‐45

Are Representations and Certifications required to be submitted with this proposal. If so, please confirm that Representations and Certifications are to be included in the Volume 2 Business/Price Proposal.

Escalate with about 20+ licences.

L.10 Volume 2

Business Volume

p. 57

The SOW lists both required and optional tasks. Should the Offeror include the Optional Tasks in the firm Fixed Price (FFP) total amount or break out the Optional Tasks separately?

Yes, offerors shall provide separate pricing for each optional task.

Attachment J.1 Statement of

Work Table of Contents

Under Item 2) in the Table of Contents (TOC), the Task Areas are listed. For Task Areas 2.3 and 2.7, the TOC lists them as Optional while in the text of the SOW they are not listed as Optional. Further, Optional Tasks 2.6 is written as required yet in the text of the SOW is listed as optional. Finally, Optional Task Area 2.8 is not listed in the TOC. Please clarify which tasks are optional and which are required.

A refresh of the TOC was inadvertently omitted. See updated SOW.

28 RFP Section L, Given the Firm Fixed Price nature of this contract, it is difficult to put a box around what the government is requesting in each task area. Throughout the SOW, the use of the terms such as "support"; "if necessary"; "optional task" implies variables associated with determining the level of effort. Is it the Government's intention to have this as a firm fixed price effort?

Even though there are optional tasks, yes, it is the government's intent to award a Firm-Fixed-Price contract.

29 RFP Section L, If the contract is intended on being firm fixed price, will the government please provide the LCATS and their associated estimated hours for each task area to ensure a fair and reasonable comparison among vendors? If not, can you provide the Independent Government Cost Estimate (IGCE)?

The IGCE, labor categories and estimated hours will not be provided. With the exception of the designated key personnel positions/labor categories, offerors are to propose the labor categories that they deem necessary to execute their approach to the requirements within the SOW, along with the associated hours for key and non-key positions.

Attachment J.1

Statement of Work Task Area 2 Page 9

Which contractor supports the LMS that is in place today? What is the LMS that is in place?

See Responses #20‐#24

Attachment J.1

Statement of Work Task Area 2 Page 9

The SOW references statements like "the LMS will…" and "this solution will…" . To determine the LOE for an FFP contract, the timeline for support activities is imperative. Is there a project underway to enhance the LMS? When will that be completed?

There is no project underway to enhance the LMS, as one does not currently exist.

Attachment J.1 Statement of Work

Task Area2.2 CyberVets Training

The SOW does not describe or provide more information on how CMS implements the CyberVet training program which gives the current contractor/incumbent a clear advantage. To ensure a fair competition, will the government provide more background, context, quantify number of veterans attending, number courses given, and other information necessary to accurately price this task area?

See: https://www.cms.gov/about‐cms/careers‐cms/cms‐cybervets‐ program#:~:text=The%20CyberVets%20program%20is%20a%20six‐ month%20rotation%20at,skills%20required%20to%20protect%20our%20data%20and%20n etwork.

Attachment J.1 Statement of Work Task

Area2 2

How many veterans attend each of the 6 month rotation? See Reponse #32

Attachment J.1 Statement of Work Task

Area2 2

Please elaborate on the timelines for the how CMS implements employee integration process?

As per SOW Section 2.2.3 Task Area 2.3: CyberVet Training, Contractor is to "Develop and manage the internal CMS employee integration with the CyberVets program as part of Training Modernization."

Attachment J.1 Statement of Work Task

Area2 2

How many computer based tasks (challenges) are expected each year? Contractor should determine this number that will satisfy task and facilitate deep learning of operational cyber security concepts.

Attachment J.1 Statement of Work Task

Area2 2

How many CyberVet promotional and marketing materials are anticipated per year? Contractor should determine this number.

Attachment J.1 Statement of Work Task

Area2 2

How many conferences and contributing articles for academic and professional journals are anticipated per year? Contractor should determine this number.

Attachment J.1 Statement of Work Task

Area2 2

What is the governments' vision scope, and strategy for the CMS CyberVets Center of Excellence? Contractor should recommend the strategy and vision.

Attachment J.1 Statement of Work Task

Area2 2

What is the government's vision, scope, and strategy for the CMS CyberVets as a Service (CVaaS) To be determined in conjuction with contractor recommendations.

40 SOW 3.2, page 22; RFP page 54

The SOW references two Key Personnel (Program/Project Manager and Senior Education/Trainer SME," but does not list personnel requirements. Additionally, the current RFP instructions do not include instructions regarding key personnel resumes or letters of commitment. Can the Government confirm neither the technical nor business volumes require information regarding key personnel?

See Response #17

41 SOW 3.3, page 23 The deliverables table on SOW page 23 lists only seven deliverables. Can the Government confirm these are the only deliverables required throughout the life of the contract?

No, these are the known deliverables.

42 SOW 2.2.7, page

The SOW specifies training requirements for cleared employees, including "enployees that will product classified documents and/or access classified systems," ; however, the SOW and RFP do not outline clearance requirements for staff. Can the Government specify what clearances are required to perform contract efforts?

Clearences refer to Federal employees.

43 RFP Volume 1, As written, the RFP instructions for the technical volume do not require Offerors to provide an approach to meeting SOW requirements. Can the Government confirm this is not required? If it is required, will the Government expand the page count to provide adequate space for technical approaches?

Confirmed that the technical volume does not require offerors to provide an approach to meeting SOW requirements other than what is required for the management approach.

44 RFP Volume 1, page 54 and 55

The RFP instructions do not include page limits for either Tab B Management Approach or Tab C Past Performance. Can the Government confirm there are no page limitations for these sections, as long as they fall within the 25-page technical volume limitation?

Correct - they should fall within the overall 25 page limit.

45 RFP Volume 1, The RFP instructions on page 55 state "The Offeror and all its significant subcontractor(s) identified in the proposal are required to provide a summary to disclose all of the following for the past performance information with a period of performance end date within the last past 3 years of the date of this solicitation:

1. All CMS contracts/task orders greater than the simplified acquisition threshold

2. All relevant contracts/orders entered into with:

o Other Federal Government Agencies, o State Agencies, o Local Governments, and o Commercial Customers." Can the Government confirm Offerors and subcontractors are required to provide a summary of all contracts and task orders?

If so, will the Government expand the page allocation or exclude past performance references from the page count for the technical volume?

CMS will not expand the page limit.

RFP Volume 1, Tab D Section

Compliance/VPA

T

As stated within J.5, "The VPAT is a template used to document a product's conformance with accessibility standards and guidelines." Can the Government specify what product/product type they would like Offerors to test for Section 508 compliance?

CMS will evaluate the HHS Product Accessibility Template (PAT) submission to determine whether the offeror demonstrates its ability to comply with the applicable Section 508 accessibility standards.

RFP Volume 1, Past

Performance, The RFP instructions state, " Offerors and proposed significant subcontractors without relevant Federal government past performance experience may ask customers to submit no more than three (3) Past Performance Questionnaires (PPQs) each for the same or similar work directly to the Contracting Officer (see Attachment J.4)." Can the Government confirm PPQs are only required if Offerors/subcontractors do not have relevant Federal government past performance?

Yes, that is correct.

48 2.2.1 Task Area 2.1: Training What is the maximum size of the user base that the LMS needs to support? Not relevant to the SOW.

2.2.1 Task Area

2.1: Training Modernization

What are your concurrent usage requirements? CMS does not understand this question.

2.2.1 Task Area

2.1: Training Modernization

Does the Government have a preference for LMS deployment location i.e. public cloud versus on premise install at CMS data center? See Responses #20 and #48.

2.2.1 Task Area

2.1: Training Modernization

If public cloud is a deployment option, would the Government be open to both PaaS and SaaS options? See Responses #20 and #48.

2.2.1 Task Area

2.1: Training Modernization

In addition to the statement of work, does the Government have a decomposed list of LMS requirements? This data would be needed in order to scope and configure the system?

See Responses #20 and #48.

2.2.1 Task Area

2.1: Training Modernization

What is the current LMS application supporting Enterprise Cybersecurity Awareness and Training Program? There is not a current LMS.

2.2.1 Task Area

2.1: Training Modernization

Does the Government have a desired implementation timeline/go live requirement for the new system? Post contract award

2.2.1 Task Area

2.1: Training Modernization

Does the Government require an LMS that has a multi-tenancy framework for supporting other online initiatives? See Responses #20 and #48.

2.2.1 Task Area

2.1: Training Modernization

Does this effort include migrating courses from an existing LMS to the new LMS?

How many courses and/or content items will need to be migrated? What content specifications were used to develop the courses to be migrated? For example, SCORM 2004

There is not a current LMS. Approximately 50+ courses and/or content items will need to be migrated.

2.2.1 Task Area

2.1: Training Modernization

What would be the service level agreements for the LMS I.e. system availability, system performance, etc. See Responses #20 and #48.

2.2.1 Task Area

2.1: Training

Modernization, What kind of support is required for the mobile platform?

Does the LMS have to have an app, or can it be a browser on the mobile device?

How does CMS define responsive?

Will the course design be mobile first?

See Responses #20 and #48.

2.2.3 Task Area

2.3: CyberVet

Training, Page 13

Is this a technical integration such as an authentication or SSO; "Develop and manage the internal CMS employee integration with the CyberVets program as part of Training Modernization."

No

2.2.1 Task Area

2.1: Training

Modernization, Booking SMEs and mentoring Does the platform need to provide features that are “Training Management System-like”? Things such as booking rooms, booking instructors/SMEs, schedule equipment?

What kind of feature are needed to support mentoring relationships? Things such as pick a mentor, track mentor meeting, manage mentor feedback?

See Responses #20 and #48.

2.2.4 ** Optional Task ** Task

Area 2.4: Content Development

Services, Page

Which courseware specifications would be used for new content developed? For example: SCORM x.x, cmi5, etc.. To be determined in conjuction with contractor recommendations.

2.2.4 ** Optional Task ** Task

Area 2.4: Content Development

Services, Page

Does the Government have a tool/platform in place for managing the content lifecycle? For example: Learning Content Management System (LCMS) No

3.2 Key Personnel, Are there any onsite requirements for key personnel or other supporting staff?

Contractor staff (key and non‐key) are not currently required to work onsite; however, this could change.

64 Section 2.2.4, Item #15

We understand that all developed content must be 504 and 508 compliant. Can the gov clarify if the contractor will be responsible for navigating the materials through the 508 review process and the CMS 508 approving officials? Will the contractor be responsible for completing any forms or procedures that accompany receiving 508 approval before a training materials can be utilized with an audience?

Yes and yes

65 Section 2.2.5, Item #3

Can the government quantity the volume of engagement and outreach efforts that are expected annually? Please indicate if the outreach efforts are confined to emails or if the efforts include web-based outreach or other methods.

No

66 Section 2.2.5, Item #4

Can the government please specify the volume of different responsibility types (manager, admin, general user, etc.)? No

Section 2.2.5, Item

#5 Can the government specify the anticipated reporting schedule (daily, weekly, monthly, quarterly?) for delivering reporting and tracking of RBT activities?

Monthly and as requested

68 Section 2.2.5, Item #6

Can the government please quantify the volume of training expected for each of the training methods? For example, how many classroom training events are expected annually and how long is each training? How many web-based training modules are expected annually? How many “other methods” are expected to be developed or delivered annually?

Answers to these questions will be as a result of demand and discussion with the contractor.

69 Section 2.2.5, Item #7 Can the government clarify the current number of different RBT groups? RBT groups are based on the NICE framework.

70 Section 2.2.5, Item #8 Can the government clarify how many training webinars are expected annually? No, expect them to be based on demand.

71 Section 2.2.5, Item #9

Can the government clarify the quantity expected annually for each the training seminars, training meetings, and conferences? No

72 Section 2.2.5, Item #10

Can the government clarify the quantity of training materials (1 pages, slicks, slick sheets, and presentation materials) expected annually? No

73 General

Given the FFP nature of the contract, the scoping questions are critical for determining the level of effort. There is one week between the Q&A due date (6/17/22) and the notice of intent due date (6/24/22). Will the government be able to provide answers in time to determine a bid/no bid response?

The due date for notices of intent has been extended to 7/6/22. See Amendment 2 dated 06/30/2022.

74 General

Given the large number of questions (whose answers greatly impact an Offeror's ability to provide an LOE or technical response), will the Government extend the due date for the Notice of Intent deadline and Technical and Business Proposal deadline?

See Response #74

75 General Is this a new requirement? Is there an incumbent? if so, can CMS share the vendor name? See Response #2

76 General What is the expected contract value / contract ceiling with and without Optional Tasks? CMS will not provide an expected contract value/ceiling.

77 Pg 6 SOW 1.2 The SOW states, "Recommend, employ, and manage a unified learning management solution." Would it be the contractors responsibility to develop a new LMS system through this contract?

See Response #20

78 Pg 7 SOW 1.2 Does CMS have an existing LMS system? If so, if operations and maintenance of that system in scope for this contract while the new system is being developed? See Response #20

79 Pg 9 SOW 2.2.1

Under this contract, will the contractor work to modernize existing elements of a learning management solution or provide consulting services to identify, set-up, deploy, and maintain new elements of a modernized learning management solution? If elements currently exist, can CMS share which LMS, LRS, and other virtual technologies the contractor will help deploy and maintain?

See Response #20

80 Pg 9 SOW 2.2.1 Is CMS looking to identify a vendor with a SaaS LMS? No

81 Pg 11 SOW 2.2.2 Does CMS have an LMS support team who would continue to provide LMS support during the contract POP, or would the majority of LMS admin support and service be provided under this contract?

Initial LMS support will be procurred under separate contract. Any further support is expected from this contract.

82 Pg 14 SOW 2.2.3 How many participants are there in the CyberVet Training program and for what duration? See Response #32

83 Pg 14 SOW 2.2.3 What Training Platform does the CyberVet Program use and what licenses are needed? Escalate with about 20+ licences.

84 Pg 18 SOW 2.2.7 Is this task “Training for Cleared Employees” for the contractor to perform for its own employees or for the contractor to deliver to CMS employees? For Federal employees

85 Pg 18 SOW 2.2.7 To clarify, is the SOW asking that the contractor train its own employees? If yes, is the SOW saying that the training must be done in the Baltimore area? Does that include training being conducted at contractor offices or virtually?

No

86 Pg 18 SOW 2.2.7 What level of clearance is needed to perform work under each task? Will any LCATs need to have top secret clearance? If so, which ones? What level of clearance is needed for each role?

No, only pulblic trust security clearence is required.

87 Pg 20 SOW 2.2.9 “5) Training should be all-encompassing". Is this in reference to contractor support and pricing? Could CMS clarify what “all encompassing” means?

All material required for successful training is to be provided unless otherwise noted.

88 Pg 20 SOW 2.2.9

“#2 Classroom training and outreach will be conducted at the CMS Single Site in Baltimore. Attendees could be remote, and the contractor may need to work across US time zones”. Could CMS clarify this item? 1. What is the CMS Single Site? 2. Does the contractor/trainer need to be onsite at the CMS Single Site even if all attendees are remote, or can the contractor/trainer and training support team also be remote?

3. Can CMS clarify what type of “outreach” needs to be conducted at the CMS Single Site?

1. Single site means the campus in Baltimore. 2. The trainer can be remote. 3.

Adequate outreach to the community at CMS single site to maximize awareness and attendance.

89 Pg 20 SOW 2.2.9 For pricing and labor hour estimation, should the contractor assume 2-3 in person and/or remote classes per month? Can CMS provide course length in hours?

The number of classes will be dependent on the type of training offered. It may exceed 2-3 classes per month especially in support of the CyberVet program.

90 Pg 13 SOW 2.3

Can you provide additional details on the CyberVets program at CMS such as how long the program is, how many times they currently meet per year, how many participants, etc.? Is it the goal of CMS to increase the number of program participants and, if so, can you share the goals of the program?

See response #32 Increase program participants is not a goal.

91 Pg 22 SOW 3.2 CMS requests two key personnel. Could CMS describe the role and qualifications required for the Program/Project Manager and the Senior Education/trainer SME?

There is nothing unique about the PM role. The qualifications of the SME should be self-evident based on task requirements.

92 Pg 27 RFP H.5 The RFP indicates the contractor shall follow FISMA and FedRAMP standards.

Does the current LMS system hold FedRAMP certification? If so, at what level? Moderate

93 Pg 27 RFP H.5

The RFP indicates the contractor shall follow FISMA and FedRAMP standards. Is the goal for the new LMS system to hold FedRAMP certification? If so, will this contract be responsible for supporting the FedRAMP process to include developing supporting documentation?

See Response #20

94 Pg 27 RFP H.5 The RFP indicates the contractor shall follow FISMA and FedRAMP standards. Is it a requirement that any recommended solutions/technologies hold FedRAMP certification? If so, at what level?

See Response #20

95 Pg 27 RFP H.5 Will the system require a new ATO? If so, will the contractor be responsible for supporting the ATO process to include developing supporting documentation (i.e.

SSP, etc.) and documenting controls statements?

Yes. It is expected that the contractor will work with an assigned Information System Security Officer (ISSO).

96 Pg 57 RFP L.10 Volume 2

For the price proposal, is it acceptable to submit two documents? One excel document for the price proposal and one PDF/Word document for the BOE? Or should the Excel document be embedded in the PDF/Word document?

Yes, separate files are acceptable.

97 Pg 59 M.2 Section M

Evaluation Process. The non-price factors do not list technical approach. Will the technical approach be included in the evaluation process? If so, where does it fall in the order of the evaluation factors?

See Response #43

RFP, Page 55, Section: Tab C., Paragraph b.

Instructions

In order stay within format prescribed in the RFP, can the layout of the Table to summarize past performance be horizontal instead of vertical as shown in the Table provided? For example, list the categories horizontal with responses to the right or below the stated topic title.

Yes, as long as all required elements are included and the page limit is not exceeded.

RFP, Page 55, Section: Tab C., Past Performance

Can Past Performance be excluded from the 25 page limit for Volume 1 - Technical? No

SOW, Page 9, Section: 2.2.1:

Task Area 2.2.1:

Training Modernization

Paragraph a. states "Support and maintain, as necessary, a Learning Management System (LMS) that will seamlessly manage participant registration, creation, distribution, and reporting of all training activities across ISPG or OIT to ensure compliance and audit-readiness." Has CMS ISPG already purchased an LMS software product with licensing?

See response #20

SOW, Page 16, Section 2.2.5:

Optional Task

How many classroom training sessions are required on a monthly basis? See Response #89

SOW, Page 11, Section 2.2.2:

Task Area 2.2:

LMS Support

The first paragraph states "The contractor shall assist the course developers by helping load, configure, edit, remove, maintain, and update courses in the LMS, to include addressing LMS configuration and system settings." Is the LMS already being provided by CMS? If not, does the Government want bidders to provide a LMS solution?

See Response #20

SOW, Page 21, Section 3.2: Key Personnel

Are resumes required for Key Personnel. The RFP does not ask for resumes for Key Personnel. Do we need to submit resumes for key personnel? If yes, is there a page limit?

If yes, can the resumes be excluded from the 25 page count limit?

Can resumes be submitted as an attachment?

Yes. No. Yes. Yes

RFP, Attachment J.5 - Section 508 Voluntary Product Accessibility Template

There is a new VAPT Version 2.4 Rev. Does the Government still want bidders to use the current Attachment J.5 - Section 508 VPAT? See Response #6

105 SOW: Optional Tasks

Do the optional tasks in the SOW need to be priced separately in the Price Volume? See Response #26

106 RFP 220509

Cover letter states solicitation is issued to "all qualified Service-Disabled Veteran- Owned Small Business (SDVOSB) concerns". Will CMS consider responses from other qualifying small businesses if no SDVOSB qualify? We are a certified WOSB and DSB interested in the opportunity, but do not wish to waste the government's time.

Based on the extensive market research performed, CMS made a decision to set this procurement aside SDVOSBs only.

RFP - Pg 54

(TAB A.

Corporate Experience)

How many of the 2-5 projects/contracts must be from the SDVOSB Prime? Can these references all come from significant subcontractor(s)?

At least one needs to be for the offeror/prime contracor; the RFP has been updated accordingly.

RFP - Pg 55 (TAB C. Past Performance)

How many PP references are required? Should the PP references be the same ones used for Tab A Corporate Experience?

There is no set number for past performance examples as long as they do not exceed the page limits and otherwise conform to the RFP instructions/requirements.

RFP - Pg 55 (TAB C. Past Performance)

Is the 508 compliance specifically targeting an LMS software or platform? If so, which one? No

RFP - Pg 55 (TAB C. Past Performance)

Please clarify the requirement to complete the 508 compliance documentation. For which platform is this to be done? See Responses #46 and #109

RFP Pages 56 & 60 (TAB D Factor

4: Section 508 Compliance)

This requirement is very confusing as it does not identify what needs to be evaluated. Although the VPAT template appears very complete and all the hyperlinks work appropriately, the statement on Pg. 56, "state exactly how you meet or do not meet the applicable standards listed in the SOW" does not define what we are supposed to evaluate for 508 compliance or exception. What site, document, EIT Supplies, or display are we to evalute using the VPAT?

See Responses #46 and #109

SOW Pg 11 (2.2.2 Task Area

2.2: LMS

Support)

Please identify the current LMS (and release version) the contractor will need to support. Is the current LMS based on Moodle or another LMS product? To be announced after award.

RFP Pg 57 (Volume 2

Business/Price Proposal)

Does the Excel spreadsheet need to have the disclosure statement on the bottom of each page? That is up to the offeror to determine if they want to include a disclosure statement.

114 SOW, Sec 2.2.1,

pg. 10

Would the CMS consider Interactive LMS to be called out in this solicitation as a requirement? No

115 SOW, Sec 2.2.3, pg 13

Cognitive apprenticeship is a framework that has slight varitons depending on which organization is implemeting the model. Is their a definitive model, author, or book that CMS has determined to be the authoritative source for defining the cognitive apprenticeship learning model for developing the curriculum?

No

116 SOW, Sec 2.2.3, pg 14

#24 Mentions external certification programs, does CMS plan to stick with the SANS GIAC certifications as the programs certification programs? TBD

117 n/a

Commercial training experience would be extremely helpful and important for the delivery of this work for the CMS. Will the CMS weigh and consider Federally-focused, past commercial experience firms that can prove their experience and successes, as an additional qualifier?

CMS will only consider offerors who can demonstrate qualifications comesurate with the tasks in the SOW.

118 n/a

Can SDVOSBs with Cyber experience (from the leadership to the newest employee and tremendous past performance in closely-related federal training - to include training for exiting servicemembers) be weighed and scored as an additional qualifier for this solicitation, to include leveraging the Subcontractor partner's past performance?

See response #117

119 n/a Would the CMS be open to a battle rhythm of technology presentations, while on contract, to further enhance the value-added task of recommending technologies and learning systems?

See responses #117 & #20

SOW Section

2.2.1 Intro, Page

How many federal staff and/or contractors have been and will be involved in the "current training program and emerging draft materials"? To what degree will this contract need to interact and coordinate with others involved in ISPG training efforts?

Prior training support is expected to be absorbed into this contract as optional tasks are exercised.

121 SOW Section 2.2.1, Pages 9-11

Will the contractor bear the cost of the LMS software and seats, or can that be added as an ODC with exact cost TBD based on software the government selects and seats the government requires?

No, see response #20

122 SOW, Task Area 2.2, Page 11

Would the government consider providing the total number of courses, along with the scope and complexity of the courses, to assist bidders with estimates? No

123 SOW, Task Area 2.2.3, Page 13

Would the government consider providing the total number of courses, along with the scope and complexity of the courses, in the CyberVets training program to assist bidders with estimates?

See response #32

SOW Section

2.2.3 / Task Area

2.3 CyberVet

Training, Page 13-

Does the Government expect the contractor to teach all CyberVets courses outline in the CyberVets 24-Week Course Outline (https://www.cms.gov/files/document/cms-cybervet-course-outline.pdf), or are there existing instructors and curriculum for this program?

Contractor will be responsible for CyberVet course instruction.

SOW Section 2.2.3, #26, Page

"Provide all necessary licenses for the CyberVets training platform." Does the government have an existing platform it wants the contractor to support, or is the contractor free to recommend the platform? How many participants are part of each CyberVet training cohort? Will licenses be needed beyond the time of the cohort?

See response #32 Recommendations are welcomed.

SOW Section

2.2.3 #17, Page

"As needed, identify and book cyber security professionals to be brought in as guest lecturers." Can the Government identify the frequency of the guest lectures? Will the government pay for these lectures, or should the contractor include these costs in their bid?

It is expected that the contractor will recommend guest lecturers as needed to support the training program. The contractor will assume the cost. FFP

127 SOW, Task Area 2.2.5, Page 16

Would the government consider providing the total number of courses, along with the scope and complexity of the courses, to assist bidders with estimates? No

128 SOW, Task Area 2.7, Page 19

Are the Training Requirements for Cleared Employees here listed as a deliverable, as Requirements to work on the CMS contract, or both? Training here refers to Federal staff

129 SOW Optional Tasks

Should the contractor include optional tasks (2.2.4, 2.2.5, 2.2.6, 2.2.8) as separate FFP pricing items? See Response #26

SOW Section

2.2.7 Training

Requirements for Cleared Employees, Pages 18-19

How many cleared employees (Top Secret and below) does CMS have? How many new cleared employees does CMS onboard monthly? Not relevant to the SOW.

SOW Section

2.2.7 Training

Requirements for Cleared Employees, Pages 18-19

Can the government please confirm that the task "Training Requirements for Cleared Employees" is not optional, unlike 2.4, 2.5, 2.6, and 2.8, which are labeled as "Optional"?

It is not optional

SOW Section

2.2.7 Training

Requirements for Cleared Employees, Pages 18-19 and RFP H.3.c, Pages 21-26 and

SOW 3.4 #2,

What level of clearances are required for staff working on this contract? Public trust

SOW Section

2.2.7 Training

Requirements for Cleared Employees, Pages 18-19 and RFP H.3.c, Pages 21-26 and

SOW 3.4 #2,

Can the government please confirm that staff will be allowed to contribute to the project remotely/virturally prior to obtaining their CMS badge/PIV card? Yes, staff can contribute remotely.

134 SOW Section 2.2.9, Page 20

Can the Offeror assume that we need to develop the Course Evaluation Form? If not, would the Government supply a copy of the Course Evaluation Forms referenced in Section 2.2.9, Assumptions, SLA’s and Operating Constraints?

The format of the evaluation form is open for discussion after award date.

SOW Section 3.4 #5, Page 23;

RFP Volume 2, #3, Page 58

Can the government please confirm that the contractor should not include potential travel in its FFP pricing but that travel will be billed separately, with prior approval from the authorized CMS COR?

The FFP should include all costs anticipated to perform the requirements.

136 SOW Section 3.4 #6, Page 23

What tools (and versions of tools) are included in "the current CMS standard desktop suite"? Windows Office

137 SOW Section 3.4, Page 24

For BOE development, will all remote training be conducted with Government supplied software (Zoom, etc.) or with the CMS Virtual Private Network? Yes, unless otherwise indicated.

SOW Section 4.1, Page 25 SOW Section 4.3, Page 27

Please clarify the need for Section 4.1 Transition In as it is not included in RFP Section B.3 or F.1?

RFP Sections B.3 and F.1 have been updated to reflect that Transition-In activities are included in the Base Period and shall not exceed 2 months.

139 SOW Section 4.1, Page 25

Is there an incumbent for all or part of this work? If there is no current incumbent, what needs to be transitioned and hence the Transition In? See Response #2

140 RFP Section C.1, Can the Government please advise on how many of the staff supporting this contract will be required to work onsite at CMS HQ and how much virtual (or hybrid) work is expected?

No staff are currently working onsite, however this could change.

141 RFP Section C.1, Page 5 Will any work be required onsite at CMS locations outside of the Baltimore area? No

RFP Section C.1, Page 5 and Page 57 #3 ODCs;

SOW 2.2.5.10,

Will the contractor be required to produce paper copies of training and promotional materials at its own expense? If yes, what quantity is expected? Yes, unless otherwise indicated. However, this can be discussed further.

143 RFP H.4, Page

Does the government require names and resumes of key personnel as part of the technical volume? Can the Offeror assume required resumes will be excluded from the 25 page limit of the Technical Proposal?

Yes and correct.

RFP L.10,

Technical Proposal, TAB C, Page 56

To streamline the evaluation process and burden on current contract PMOs, Offer recommends that PPQs be limited to those past performances included in Tab A.

Corporate Experience versus all relevant contracts included in Tab C. Past Performance. Please clarify?

CMS does not understand this question. Please see Responses #16 and #47 regarding PPQs.

RFP L.10,

Technical Proposal, TAB D, Page 56

Can the Government clarify the VPAT (Tab D) requirement? Can the Offeror assume that we can use any relevant product for the proposal VPAT response?

See Responses #46 and #109

RFP L.10,

Technical Proposal, TAB D, Page 56

For BOE development, can the Offeror assume a VPAT is required for each class or deliverable?

See Responses #46 and #109

RFP Section M.1

FAR 52.2.217.5 -

Evalution of Options (Jul 1990), Page59

Is the Government including all Optional Tasks, Option Years, or both in their pricing evaluation? See Response #26

RFP Section M.1, Factor 2, Page

Does the government have a desired resume format? Is there a page limit for resume submissions? Which volume should offerers submitt the resume? Are resumes included in total page count?

There is no format required.See Response #17 and 103.

RFP Section M.1, Factor 2, Page

"proposed technical approach" Should this be proposed "technical and management approaches" See Response #43

RFP L.7 General, item #5

pg. 52

Item #5 of section L.7 General states, "Identification of significant subcontracts, if any. For the purposes of this solicitation, a significant subcontractor is defined as a subcontractor performing major or critical aspects of the requirements relevant to the prospective contract."

Can we assume that the Government meant to say the "Identification of significant subcontractors", and not subcontracts?

Yes, Section L.7 has been updated accordingly.

RFP L.7 General, item #1-5

pg. 53

Section L.7 General states, "All proposals must include the following information:

1. Full spelling of the company name

2. DUNS number and CAGE number of the prime and any subcontractors

3. Point of contact

4. Address

5. Identification of significant subcontracts, if any. For the purposes of this solicitation, a significant subcontractor is defined as a subcontractor performing major or critical aspects of the requirements relevant to the prospective contract."

Can we assume that this information, provided in the form of a cover memo, would also be exclued from the 25pg limit for the Technical Proposal?

The RFP instructions have been updated to clarify that this information is to be included in the Technical Proposal Transmittal Letter, which is not included in the page limit.

RFP L.10

SUBMISSION

REQUIREMENT

S AND

PROPOSAL DUE

DATE, Volume 1

TECHNICAL

PROPOSAL,

TAB B.

Management Approach

pg. 54

Can we assume that the SOW requirements should be addressed in the work break down structure (WBS) only?

If not, where should the SOW narrative be addressed?

Yes, there should be a mapping of the SOW requirements to the WBS

RFP L.10

SUBMISSION

REQUIREMENT

S AND

PROPOSAL DUE

DATE, Volume 1

TECHNICAL

PROPOSAL,

TAB C. Past Performance

pg. 55

Would the Government consider removing Tab C. Past Performance from the 25pg page limit?

No

RFP L.10

SUBMISSION

REQUIREMENT

S AND

PROPOSAL DUE

DATE, Volume 1

TECHNICAL

PROPOSAL,

TAB C. Past Performance

pg. 56

Tab C Past Performance states, "Offerors and proposed significant subcontractors without relevant Federal government past performance experience may ask customers to submit no more than three (3) Past Performance Questionnaires (PPQs) each for the same or similar work directly to the Contracting Officer (see Attachment J.4)."

Will the Government please confirm the PPQs are not required for Offers and subcontractors that have relevant Federal Government past performance experience?

PPQs are not required for offerors and subcontractors that have relevant Federal Government past performance.

RFP M.1 FAR

52.217-5 – Evaluation of Options (Jul 1990), Factor 2:

Management Approach Pg. 60

The RFP states in section M.1, Factor 2 Management Approach, "In addition, the Government will evaluate the match or fit of key position descriptions and resumes with the proposed technical approach." However, section L.10 SUBMISSION REQUIREMENTS AND PROPOSAL DUE DATE, TAB B. Management Approach does not define where resumes should be provided. Can the Government please tell us where they would like key personnel resumes provided in the response?

See Response #17

RFP M.1 FAR

52.217-5 – Evaluation of Options (Jul 1990), Factor 2:

Management Approach Pg. 60

Although section M.1, Factor 2 Management Approach states that resumes will be evaluated, it does not state if resumes count toward TAB B. Management Approach 25pg limit. Can we assume that resumes do not count toward the TAB B.

Management Approach 25pg limit? See Response #17

RFP L.10

SUBMISSION

REQUIREMENT

S AND

PROPOSAL DUE

DATE, Volume 2

BUSINESS/PRIC

E PROPOSAL

Pg. 57-58

Does the Government have a pricing template they prefer vendors to use?

No

SOW2.2.1 Task Area 2.1:

Training Modernization Pg. 9-11

Is the review of the current training program and draft materials expected to be a continuing effort through the life of the contract? What is the timeline for an initial delivery of a training strategy? Continuous improvement in the program is expected. 30 days

SOW2.2.1 Task Area 2.1:

Training Modernization Pg. 9-11

How will it be determined that a learning analytics dashboard is "necessary?" Will the government determine that, or the contractor based on the results of their review of training requirements? The determination will be a joint decision.

SOW2.2.1 Task Area 2.1:

Training Modernization Pg. 9-11

Should implementation costs of the learning analytics platform be included in pricing?

No

SOW2.2.1 Task Area 2.1:

Training Modernization Pg. 9-11

Are startup and operating costs (for example, cloud services or hardware) for the LMS to be included in the bid?

No

SOW2.2.1 Task Area 2.1:

Training Modernization Pg. 9-11

What are the anticipated number of users for the LMS -students, course developers, trainers, and supervisors or training managers?

Potentially 11,000

SOW2.2.1 Task Area 2.1:

Training Modernization Pg. 9-11

How many different courses per student are anticipated?

CMS does not understand the relevance of this question.

SOW2.2.1 Task Area 2.1:

Training Modernization Pg. 9-11

Should the contractor develop the metrics for relevance and engagement or will those be provided? What online courses are already developed for this effort? What is their length? What modalities (eg, lecture, graphics, hands-on) do they employ?

How many students have taken them? Can the government share student feedback for the current courses?

Yes. 10+. Varies. Varies. 1000+. No

SOW2.2.1 Task Area 2.1:

Training Modernization Pg. 9-11

Under this task, will the contractor be expected to rework existing courses to ensure relevance and engagement, or will they report their findings to the current course developers for modification of the courses? Yes

SOW2.2.1 Task Area 2.1:

Training Modernization Pg. 9-11

In what sense are elements (5) and (8) optional? Will the government decide whether they're required, or will the contractor decide based on the outcome of the training evaluation? Government will decide

SOW 2.2.2 Task Area 2.2: LMS Support

pg. 11-13

How many formal courses are projected? How many exist currently? How often will these be updated? Unknown at this time

SOW 2.2.2 Task Area 2.2: LMS Support

pg. 11-13

In addition to the formal course, how many micro-learning instances are projected?

How many exist currently? To be determined in conjuction with contractor recommendations.

SOW 2.2.2 Task Area 2.2: LMS Support

pg. 11-13

How many LMS end-users will there be? How many course developers? CMS administrators? Potentially 11,000, 2 - 3, 2

SOW 2.2.2 Task Area 2.2: LMS Support

pg. 11-13

Are the LMS administrators expected to be onsite?

No

SOW 2.2.2 Task Area 2.2: LMS Support

pg. 11-13

Should the cost of the content management system be included in the pricing?

No

SOW 2.2.3 Task Area 2.3:

CyberVet Training Pg. 13-15

Are there any historical throughput numbers available from the government for the CyberVet Training? CMS does not understand what is meant by throughput. See Response #32 regarding details regarding the CyberVet Program.

SOW 2.2.3 Task Area 2.3:

CyberVet Training Pg. 13-15

Can the Government provide a projected throughput figure for the CyberVet Training?

Not as this time. Current cohorts consist of three individuals.

SOW 2.2.4 **

Optional Task ** Task Area 2.4:

Content Development Services Pg. 15-16

Should this optional task be included in the respondent's bid? Would the government consider T&M for this task, since the level of effort is not clear?

See Response #26. The government intends to award a FFP contract.

SOW 2.2.4 **

Optional Task ** Task Area 2.4:

Content Development Services Pg. 15-16

How many breach tabletop exercises are projected? How many participants?

To be determined in conjuction with contractor recommendations.

SOW 2.2.4 **

Optional Task ** Task Area 2.4:

Content Development Services Pg. 15-16

(2) anticipates that content will be updated by CMS; while (3) requires the contractor to update content.