16-236-SOL-0002_QA_Final_120915_2.0.pdf

16-236-SOL-0002 Questions

No. Reference Document

Reference Paragraph

Questions

1 16-236-SOL-

0002_RFP

Sections B.3.1. – B.3.5 & 1.6.11

Section B.3.1 – B.3.5 identify labor category number 1.3 as Program Manager Level II. Section 1.6.11 identifies a Project Management Lead (Project Manager Level II) as key personnel.

Will the Government please clarify if both of these references pertain to the same position?

1a.

Answer: Yes these are the same labor category.

2 16-236-SOL-

0002_RFP

Section 1.6.11 The solicitation states “The contractor shall provide a contract manager who shall be responsible for the performance of the work”.

(a.) Is the reference to a Contract Manager intended to be a Program/Project Manager responsible for the performance of the work?

(b.) Is this Contract Manager role a separate role from the Program/Project Management Lead (Project Manager Level II) identified as Key Personnel?

2a.

Answer: (a.) The Contract Manager is intended to be an individual whom is part of the key personnel and has authority to act on behalf of the contracting company.

(b.) No, the Contract Manager role is not a separate role from the identified key personnel.

3 16-236-SOL-

0002_RFP

Section F.5 The solicitation states “Most of the work will be completed at the contractor’s facility”.

Are there any permanent Government site seats available for Contractor personnel?

3a.

Answer: Yes, for key personnel to support face-to-face communications with the RPMS Program and Investment Manager and other OIT leadership.

4 16-236-SOL-

0002_RFP

Section I.1, 52.204-

Is the 52.204-7, Central Contractor Registration (FEB 2012) reference intended to be System for Award Management (Jul 2013)?

4a.

Answer: That is correct. This clause has been updated to reflect this change.

5 16-236-SOL-

0002_RFP

Section I.1, 52.222-

As noted in FAR 22.1101, the Service Contract Act of 1965, now codified at 41 U.S.C. chapter 67, Service Contract Labor Standards, was enacted to ensure that Government contractors compensate their blue-collar service workers and some white-collar service workers fairly, but it does not cover bona fide executive, administrative, or professional employees.

“Professional employee,” as used in this subpart, means any person meeting the definition of “employee employed in a bona fide. . . professional capacity” given in 29 CFR 541. The term embraces members of those professions having a recognized status based upon acquiring professional knowledge through prolonged study.

The inclusion within the solicitation of FAR 52.222-46, Evaluation of Compensation for Professional Employees, acknowledges that proposed personnel are considered "professional employees". As such, this contract should not be subject to the Service Contract Act. Please remove this requirement.

5a.

Answer: The inclusion of FAR 52.222-41 was a clerical error and has been removed in Amendment 004.

6 16-236-SOL-

0002_RFP

Section I.1 The FBO.gov posting states that “this Request for Proposal (RFP) is being issued as a total small business set-aside under NAICS 541512 "Computer Systems Design Services".

(a.) Is this procurement designated a 100% small business set-aside?

(b.) Will the Government amend the solicitation to include FAR 52-219-6, Notice of Total Small Business Set-Aside?

6a.

Answer: FAR 52.219-6 has been included in Amendment 004.

7 16-236-SOL-

0002_RFP

Section I.1, 52.219-

The solicitation contains FAR 52.219-4, Notice of Price Evaluation Preference for HUBZone Small Business Concerns.

This FAR clause applies only in instances where a contract is to be awarded on the basis of full and open competition as stipulated in U.S.C. Title 15 Section 657a(b)(3)(A).

(a.) Is this procurement a full and open competition?

(b.) If not, will the Government please remove this FAR clause from the solicitation?

7a.

Answer: This FAR clause has been removed per Amendment 004.

8 16-236-SOL-

0002_RFP

Section K Section K contains many outdated references. For instance, www.ccr.gov has since been replaced by www.sam.gov and the Central Contractor Registration (CCR) has been replaced by the System for Award Management (SAM).

Will the Government please update the solicitation accordingly?

8a.

Answer: This section has been updated to reflect this change.

(See Amendment 004)

9 16-236-SOL-

0002_RFP

Section L.1 The solicitation states “Offerors’ proposals must cover the IDIQ and Task Order separately”.

(a.) Will the Government please clarify the reference to “Task Order”?

(b.) Is an associated sample task order anticipated?

9a.

Answer: The reference to a task order is a clerical error. As a result, this reference has been removed and now only refers to the IDIQ (See amendment 004).

10 16-236-SOL-

0002_RFP

Section L.9 The solicitation states “A completely executed copy of Section K - Representations, Certifications and Other Statements of Offerors, must be included as a part of your business proposal”.

Please confirm that offerors may satisfy this requirement by checking paragraph (d) of Section K.3.D (FAR Annual Representations and Certifications (Dec 2014).

10a.

Answer: All offerors are instructed to review the amended Section K in its entirety and fill in the applicable sections.

http://www.ccr.gov/ http://www.sam.gov/

11 16-236-SOL-

0002_RFP

Section L.15.A.

Please confirm that FAR 52.215-22 and 52.222-46 do not apply at the IDIQ level and instead apply at the task order level.

11a.

Answer: FAR 52.215-22 is no longer applicable to solicitation 16- 236-SOL-0002 (See amendment 004). FAR 52.222-46 is applicable to the IDIQ and subsequent orders.

12 16-236-SOL-

0002_RFP

Section C.1.5.2 – Task 2, Software Testing

This requirement is identical to the RPMS Software Engineering Support Services RFP (16-236-SOL-0001_RFP), Section C.2.8. Task 8, Testing.

Please clarify the scope of Software Testing in this Quality Assurance and Customer Support Services requirement versus the Software Engineering Support Services requirement?

12a.

Answer: Testing under 16-236-SOL-0001 covers unit testing for application modules covered under that solicitation, as well as support for other testing activities that are completed by other developers or testing contractors. For 16-236-SOL-0002, the testing includes managing and conducting the integration testing activities across multiple developers, coordination of alpha and beta testing activities, and professional support for the implementation of the software testing process area. This solicitation also covers summative usability testing.

13 16-236-SOL-

0002_RFP

Section C.1.5.3 – Task 3, Implementation and Deployment Support

This requirement is identical to the RPMS Software Engineering Support Services RFP (16-236-SOL-0001_RFP), Section C.2.9. Task 9, Implementation and Deployment Support.

Please clarify the scope of Implementation and Deployment Support in this Quality Assurance and Customer Support Services requirement versus the Software Engineering Support Services requirement?

13a.

Answer: The Quality Assurance and Customer Support Services requirement as applicable to Implementation and Deployment support includes management and distribution of all official software testing products and product releases, training coordination and training support. A customer service component is associated with delivery of these services. 16-236- SOL-0001 addresses developer level support for these activities but does not take on a lead role.

14 16-236-SOL-

0002_RFP

Section C.1.5.4 – Task 4, Training and User Documentation Support

This requirement is identical to the RPMS Software Engineering Support Services RFP (16-236-SOL-0001_RFP), Section C.2.10, Task 10, Training and User Documentation Support.

Please clarify the scope of Training and User Documentation Support in this Quality Assurance and Customer Support Services requirement versus the Software Engineering Support Services requirement?

14a.

Answer: The Quality Assurance and Customer Support Services requirement as applicable to Training and Documentation support includes management and distribution of all official software testing products and official product releases, training coordination and training support and not just those tasked to other respective contracts. The contractor also has primary responsibility for user-facing documentation, such as user manuals, help documentation, training documentation, etc.

Documentation support under this solicitation also serves as quality assurance method over developed software products under other contracts. 16-236-SOL-0001 addresses developer level support for these activities but does not take on a lead role in developing user-facing documentation.

15 16-236-SOL-

0002_RFP

Section C.1.5.5 – Task 5, User Support

This requirement is identical to the RPMS Software Engineering Support Services RFP (16-236-SOL-0001_RFP), Section C.2.11. Task 11, User Support.

Please clarify the scope of User Support in this Quality Assurance and Customer Support Services requirement versus the Software Engineering Support Services requirement?

15a.

Answer: The Quality Assurance and Customer Support Services requirement as applicable to User support includes management and assistance to users with distribution of all official software testing products and official product releases, training coordination and training support and not just those tasked to other respective contracts. 16-236-SOL-0001 addresses developer level support for these activities, at a higher tier of support when bugs or defects are identified, but does not take on a lead role in responding to customer problem reports.

16 16-236-SOL-

0002_RFP

Section C.1.5.6 – Task 6, Quality Assurance

This requirement is identical to the RPMS Software Engineering Support Services RFP (16-236-SOL-0001_RFP), Section C.2.14.

Task 14, Quality Assurance.

Please clarify the scope of Quality Assurance in this Quality Assurance and Customer Support Services requirement versus the Software Engineering Support Services requirement?

16a.

Answer: The Quality Assurance and Customer Support Services requirement as applicable to Quality Assurance includes Quality Assurance over all development and support activities. While not responsible for designing the software development methodology, the contractor will be responsible for evaluating its effectiveness through testing and process quality assurance activities, including Standard CMMI Appraisal Method for Process Improvement (SCAMPI). 16-236-SOL-0001 addresses support for these activities in so much that the selected software development methodology will be determined through that solicitation and implemented by the selected contractor and in so much that all process participants have responsibility for ensuring process quality assurance.

17 16-236-SOL-

0002_RFP

Section C.1.5.7 – Task 7, Product Documentation Support

This requirement is identical to the RPMS Software Engineering Support Services RFP (16-236-SOL-0001_RFP), Section C.2.15. Task 15, Product Documentation Support.

Please clarify the scope of Product Documentation Support in this Quality Assurance and Customer Support Services requirement versus the Software Engineering Support Services requirement?

17a.

Answer: The contractor must provide documentation for the task areas for which it is responsible as well as providing quality assurance over project documentation from other contractor-developed deliverables.

16-236-SOL-

0002_RFP

Section. 1.5.4

Training and user documentation:

Q: Usually development teams create notes files, install manuals, etc. Is the SQA team responsible for creating these as the initial authors?

18a.

Answer: Contracted developers working under other awards will provide the working drafts of development-related document deliverables. However, the contractor awarded this contract will be responsible for deliverables related to their scope of work and responsible for quality assurance of all other SDLC deliverables, including conformance to documentation standards, versioning methodologies, grammatical soundness and management of the official release documents.

16-236-SOL-

0002_RFP

Section. 1.5.5 Q: Are the environments referenced in this section to include Production

19a.

Answer: Not enough information to answer this question.

16-236-SOL-

0002_RFP

Section 1.6.1

The contractor shall develop and implement procedures to identify, prevent, and ensure non-recurrence of defective services.

Q: What Is the evaluation for ensuring non-recurrence of defective services? And, is it recurrence of failed test during

IV&V?

20a.

Answer: The Contractor’s technical proposal response to Quality Control and the formal Quality Control Plan as it relates to deliverables will serve as the evaluation method for ensuring non-recurrence of defective services.

Failed test during IV&V is one area for ensuring non-recurrence.

16-236-SOL-

0002_RFP

Section F2

CMMI audit is listed as deliverable but it is listed as an optional task, will this be removed or understood as optional only if exercised?

21a.

Answer: CMMI audit will not be removed and the government may exercise the option at any time.

16-236-SOL-

0002_RFP

Section H18

Metric # 6 -- 85% of stakeholder problem reports will be resolved on first contact with the customer.

Q: What will be the primary method stakeholders submit problem reports?

22a.

Answer: The primary methods stakeholders submit problem reports are email, telephone or via a RPMS helpdesk ticket.

23 16-236-SOL-

0002_RFP

H.4 Staff Clearances and Access to HHS- Controlled Facilities

This section includes Special Qualifications, i.e. CMMI ML 3, Agile, MU. Are these specific to H4, i.e. staff must have these special qualifications or are they specific to the Qualifications of the Contractor as is the case with ESS?

23a.

Answer: Certifications in the Special Qualifications section apply to organization and/or individuals as afforded by the certifying body. The contractor is responsible for putting forward a team that can fulfill the requirements of the PWS effectively and efficiently, including task coverage and meeting stated performance objectives.

24 16-236-SOL-

0002_RFP

1.6.1 Quality

Control and f.2 Deliverables

Section 1.6.1 indicates that 3 copies of the QCP must be delivered within 5 days of the start of the contract. F.2 requires the QCP be delivered one month after the start of the contract.

Recommend QCP be delivered within one month of the contract start.

24a.

Answer: This section has been revised per Amendment 004.

25 16-236-SOL-

0002_RFP

F.2 Offeror may develop a revised schedule of deliverables for their development methodology.

Is the Government requesting that the QA&CSS contractor create the IHS Development Methodology?

Can the QA contractor propose revised deliverables for developers?

25a.

Answer: The government is not asking the QA&CSS Contractor to create the IHS Development Methodology. The government is asking for the methodology the QA&CSS Contract will use to implement tools and dashboards accordingly as outlined deliverables in this RFP.

No the QA contractor cannot propose revised deliverables for development projects.

26 16-236-SOL-

0002_RFP

l.3, Technical Criterion 1

2nd – bullet – Is the Government requesting the QA contractor propose a development methodology that is to be evaluated in the criterion?

Should the Government request a QA methodology instead?

26a.

Answer: No. The Government is identifying in this section that it will evaluate proposals based on the overall documented details respondents propose/provide that demonstrate an understanding of the work the RFP outlines with respect to the requirements and technical approach that organizational quality assurance and quality management require within various software methodologies and software development lifecycle processes.

27 16-236-SOL-

General Would the Government consider giving an extension from November 13 to November 30?

27a.

Answer: Yes, the original date was extended to December 22, 2015.

28. 16-236-SOL-

0002_RFP

Key Personnel; The contractor shall provide a contract manager who shall be responsible for the performance of the work.

Please provide clarification on the difference between the

• Program Manager Level II

• Project Manager Level II

• Contract Manager [Is this an overhead position]

28a.

Answer: Program/Project Manager Level II are the same (typographical error). The Contract Manager is not an overhead position as the individual is expected to be available during business hours.

29. M.3 Page 93 Basis for Award; Sentence begins with However, the government will not make an award at a significantly higher cost to the Government to achieve slightly superior technical merit and past performance. Ending in; the Government reserves the right to make an award to other than the lowest priced Offeror or to the Offeror with a higher technical score if the Contracting Officer determines that to do so would result in the best value to the Government. Please clarify how this differs from a Best Value requirement?

29a.

Answer: The language described was inserted to define the best value parameters. This language clarifies that Best Value can be applied to both technical and cost.

30. Task Areas 1.5 -1.5.13

Page 8-15 Will the government please clarify any conflicts of interest in the awards of multi Tasks Orders to one company?

30a.

Answer: The Government was unable to identify the question based on the reference section.

31. L.2 Volume I Technical Proposal

Is the government requiring Letters of Commitment for Key Personnel resumes?

31a.

Answer: No the government is not requiring letters of commitment for key personnel. The government requests resumes of key personnel.

32. 1.5.3 Task 4 Training and User Documentation Support;

1.5.4.1 Sub-

Task 4.1 Training and User Documentation Support Services; 1st sentence.

In cases where the Task Order work is to be done at the contractor’s site. Please clarify “what is on site”;

• Government site

• Federal Product Owners site

• Task order contractors site

32a.

Answer: Contractor site refers to the official work location for which contractor personnel shall work that is not managed by the Federal Government.

33. General Is there currently an incumbent for this effort?

33a.

Answer: Yes but this RFP has been restructured to include additional work and so there is not a one-to-one alignment between incumbents and this RFP.

34. General If there is an incumbent, can you please provide the contractor name and contract number?

34a.

Answer:

This RFP has been restructured to include additional work beyond the prior Software Quality Assurance contract.

Therefore, there is neither a one-to-one alignment between incumbents and work performed under this PWS.

35. General What is the contract value of the incumbent contract?

35a.

Answer: See response to question 34a.

36. 1.6.1 Quality Control

Document states “The approach to Quality Control should map to the con-tractor’s selected development methodology…”. What SDLC does your organization use?

36a.

Answer: See answer in 37 a.

37. General Will the government supply a copy of your SDLC?

37a.

Answer: The current methodology in use is the HHS Enterprise Performance Lifecycle. See the following:

http://www.ihs.gov/cpic/lifecycle/

However, IHS anticipates improvement in processes to also support Agile project teams.

38. 1.6.2.Quality Assurance

Document states “The government shall evaluate the contractor’s performance under this contract in accordance with the Quality Assurance Surveillance Plan’ (QASP). Further in the RFP, it states that the contractor will create a QASP is this correct?

38a.

Answer: No. The QASP identifies performance metrics in this RFP. The contractor shall develop a corresponding dashboard to report these metrics in accordance with the QASP.

39. 1.6.11 Key Personnel

Document states “The contractor shall provide a contract manager who shall be responsible for the performance of the work.” Is this person a key?

39a.

Answer: Yes

40. 1.6.11 Key Personnel

Document states “The contractor shall provide a contract manager who shall be responsible for the performance of the work.” Should their resume be included with the other three (3) resumes?

40a.

Answer: Yes

41. F.2 Deliverable Schedule and Deliverables

19, 15 Quality Control Plan under “1.6.1 Quality Control (page 15)” states that it is to be submitted within 5 working days of the start date of the contract, whereas this section states one month after start date.

Which requirement is accurate?

http://www.ihs.gov/cpic/lifecycle/

41a.

Answer: 30 days upon award

42. CMMI audit 19 Document states “9 months after award” whereas under 1.5.13. Task 13 CMMI Audit Support (page 14) is considered OPTIONAL. Should it state AS NEEDED?

42a.

Answer: No. It’s optional to the government to task it.

43. Special Qualifications

Will this section be used as an additional discriminator under section M.5 –Technical Evaluation?

43a.

Answer: This section has been revised per Amendment 004.

44. Applicability to Subcontractors

Will flow-down language in subcontracting agreement for this section satisfy this requirement?

44a.

Answer: Yes as long as it meets the requirements provided in H.4 “Applicability to Subcontractors”

45. H.8. HHS

Section 508 Accessibility Standards Notice (SEP 2009)

Document states “Technical standards from 36 CFR part 1194 Subpart B have been determined to apply to this acquisition. Solicitation respondents must describe how their proposed Electronic and Information Technology (EIT) deliverables meet at least those technical provisions identified as applicable in the attached Government Product/Service Accessibility Template (VPAT)…. meet at least those functional performance criteria identified as applicable in the attached Government Product/Service Accessibility Template (VPAT).”

Attachment is missing?

45a.

Answer: The Section 508 VPAT can be found as a new attachment. See Amendment 004.

46. L.1 Proposal 83 Document states “Offerors’ proposals must cover the IDIQ and the Task Order separately. For proposals to be considered acceptable, they must cover applicable portions of Sections B and C in their entirety.

Partial proposals will not be considered for award. What does the word “separately” refer to; does this mean responding to requirement in separate subsection one for IDIQ and another for TO?

46a.

Answer: The reference to a task order is a clerical error. As a result, this reference has been removed and now only refers to the IDIQ (See amendment 004).

47. L.1 Proposal 83 Since the IDIQ and task order requirements are not identified separately in the RFP. What are the Task Order requirements for this proposal?

47a.

Answer: See answer 46a above.

48. L.1 Proposal 83 Since the IDIQ and task order requirements are not identified separately in the RFP. What are the IDIQ requirements for this proposal?

48a.

Answer: See response in question 46a above.

49. L.3.A. Volume I Format

Document states “Responses to Volume I should not exceed 100 pages (resumes, commitment documentation, and/or supporting attachments are not included in the page limitations). Please elaborate on what is considered commitment documents? Are they for resumes?

49a.

Answer: The general definition of commitment documents are supporting documentation that are between contract companies and individuals to demonstrate key personnel are agreeable to be employed by the company upon award.

A resume alone is not a commitment.

50. L.3.A. Volume I Format

Document states “Responses to Volume I should not exceed 100 pages (resumes, commitment documentation, and/or supporting attachments are not included in the page limitations). Please elaborate on what is considered commitment documents? Are they for subcontractors?

50a.

Answer: Resumes provided by potential employees whom have agreed to work for the contract company upon award or actual letters of commitments are considered commitment documents.

They apply to all key personnel.

52. 4. Technical Criterion 4 – Quality Assurance Surveillance Plan

Is the QASP part of the 100 pages or is it excluded?

52a.

Answer: The page limit has been reduced to 50 pages. See amended page 83. The QASP report documentation can be submitted as an appendix if needed.

53. L.13.C. 90 Document states “The template allows vendors or developers to self-evaluate their products or services and document in detail how they do or do not conform to a specific Section 508 accessibility standard.

Instructions for preparing the HHS Section 508 Evaluation Template may be found under Section 508 policy on the HHS Office on Disability website (http://www.hhs.gov/od/).” Link is inactive, please provide HHS Section 508 Evaluation Template?

53a.

Answer: An electronic copy of the Section 508 VPAT has been provided in Amendment 004.

54. M.3. BASIS FOR

AWARD

Document states “508 Compliance”. Where should this data appear?

Specifically, Which volume? Under what Technical Criteria? Supporting attachments? Etc.

http://www.hhs.gov/od/)

54a.

Answer: Offerors should determine where the 508 information is best describes their respective capabilities.

55. General Is cover page excluded from page count?

55a.

Answer: No

56. General Is compliance/cross reference matrix excluded from page count?

56a.

Answer: Offerors may include this as an appendix which is not counted towards the page limitation.

57. General Is table of contents excluded from page count?

57a.

Answer: yes

58. General Is acronym list excluded from page count?

58a.

Answer: Offerors may include this as an appendix which does not count towards the page limitation

59. 2. Technical Criterion – Key Personnel

Document states” The plan must include names of personnel proposed, their skill category, and hours and rates by labor category.”

Is the requirement an error since Section L does not mention a requirement for a Plan?

59a.

Answer: This section has been amended in Amendment 004.

61. B.3.1. BASE

YEAR: (EXACT

DATES TO BE

COMPLETED

UPON AWARD)

4-6 If proposed labor categories are different, offerors should map their labor category titles to those in the pricing table. If “Labor Category” column is acceptable can the “Contractor Labor Category” column be left blank or should this column just repeat the data in the “Labor Category” column?

61a.

Answer: All offerors are instructed to still complete all applicable columns and mirror the suggested labor category titles if they are the same as proposed.

62. Attachment 3 Labor Category Description

Does the Government intend to add years of experience and education requirements to the RPMS Labor Categories?

62a.

Answer: Additional language has been added to Section L and M in regards to this question. Please see Amendment 004.

63. RFP, Section K

K:

REPRESENTATIONS,

CERTIFICATIONS

AND OTHER

STATEMENTS OF

OFFERORS

Please confirm that the NAICS code for this acquisition is 541512 as listed on the FBO announcement page.

63a.

Answer: That is correct, the NAICS code for this solicitation is 541512 which was approved in accordance with SBA regulations.

64. RFP Section M

2. Technical Criterion - Key Personnel

Second bullet states "the plan must include names of personnel proposed, their skill category, and hours and rates by labor category."

Please clarify if we are providing a Staffing Resource Plan? If so, which Volume should it be included in?

64a.

Answer: This information should be included in Volume I:

Technical.

66. RFP Mod 1 - L L.4. VOLUME II:

PAST

PERFORMANCE

"Offerors are instructed to complete the past performance reference template (See Attachment) for three (3) contracts. Proposed subcontractors must also complete the template for three (3) contracts." Please confirm that the Government requires both the Prime and all Subcontractors to submit 3 surveys each for the IDIQ. (i.e. Prime 3, 10 subcontractors = 33 PP Surveys)

66a.

Answer: If there are 10 sub-contractor companies then yes the total is 33.

67. RFP Section L

L.8 Proposal Submission

Offerors are to submit proposals electronically, what is the file size limitation when submitting a proposal via email?

67a.

Answer: File size limitation is 25 MB for email. Multiple emails can be submitted but most be properly annotated with the vendor’s name, solicitation number, and email sequence number.

68. RFP Section L

L.2 Basic Format Under L.2 Basic Format, Volume III is titled as the "Cost/Price Proposal" but in section L.5 Volume III is titled as the "Business Proposal" please clarify which title Offerors should use for Volume III.

68a.

Answer: The correct title of Volume III is Business Proposal. This clerical error has been corrected in Amendment 004.

69. RFP Section L

L.6 Assumptions, Conditions, Or Exceptions

Please clarify whether the Government is asking Offerors to submit an Optional Volume IV for Assumptions, as it states that "Offerors must submit, under separate cover, all (if any) assumptions, conditions or exceptions with any of the terms and conditions of this solicitation. If not noted in this section of your proposal, it will be assumed that the Offeror proposes no assumptions for award, and agrees to comply with all of the terms and conditions set forth."

69a.

Answer: All offerors are instructed to include an additional cover page outlining any assumptions, conditions, or exceptions for each of the (3) volumes that should be submitted under this solicitation. For example: a separate cover would be needed for Volume I, 2, and 3. If a offeror has no assumptions, conditions, or exceptions, no additional cover page is needed.

70. RFP Section L

L.2 Basic Format Please confirm that the Government does not have any requirements in terms of Font size, Font style, and margins for this proposal.

70a.

Answer: There is no requirement for font size, style or margins.

71. 16-236-SOL-

Is experience in direct patient care (clinical, nursing, or allied health) or experience in clinical applications support in the healthcare industry or a degree in Medical Informatics a requirement for any proposed key personnel?

71a.

Answer: No

72. 16-236-SOL-

Is software development/maintenance within the scope of work presented in the solicitation?

72a.

Answer: Only as it relates to testing software and managing testing tools, including automated test scripts.

73. 16-236-SOL-

Does the incumbent contractor provide user support of a nature that would require clinical/patient care domain knowledge?

73a.

Answer: No

74. 16-236-SOL-

On what platform(s) does the RPMS run?

74a.

Answer: Windows 2008, AIX v, and Intersystems Esemble\Cache

75. 16-236-SOL-

What software engineering tools are currently in use to support the

RPMS?

75a.

Answer: (a) Serena requirements manager, Serena business manager, UNANET, MS Project and SharePoint.

76. 16-236-SOL-

Is the RPMS implemented as a client/server application?

76a.

Answer: yes parts are

77. 16-236-SOL-

Will the offeror have access to the development and test environments?

77a.

Answer: Not to development environments. Offeror shall manage test environments.

78. 16-236-SOL-

Will the Government provide service desk statistics regarding the number of calls per day/month?

78a.

Answer: No.

79. 16-236-SOL-

What service desk software is currently in use?

79a.

Answer: Heat version 9.6.2 Build 23

80. 16-236-SOL-

What clinical devices currently interface with the RPMS?

80a.

Answer: Multiple pharmacy and lab products, implemented at each facility’s discretion.

81. 16-236-SOL-

Reference Paragraph G.7.5 Equipment. The paragraph states: “The Contractor shall provide laptops, servers, software and all software development equipment necessary to meet the requirements under this PWS”.

Question: The paragraph suggests that the offeror will participate in software development activities. Will the offeror participate in the development process beyond testing, QA and IV&V (i.e., coding)?

81a.

Answer: No, application coding and software development are not within scope of this PWS.

82. 16-236-SOL-

What positions currently require a background check?

82a.

Answer: All positions require a background check.

83. 16-236-SOL-

Is the current RPMS configuration 508 and WCAG compliant?

83a.

Answer: Many components are, in particular patient-facing systems. Some legacy products are not.

84. 16-236-SOL-

Although indicated as optional (1.5.11 and 1.5.12), will the contractor be required to submit a software development plan with development resource and category allocation although no development labor Categories are indicated in the RFP?

84a.

Answer: That would be determined in a task order.

85. 16-236-SOL-

What level of detail is required to address the development need? A development plan that includes development methodology? System Development Life Cycle?

85a.

Answer: Detail is dependent on what the offer proposes to support best value.

86. 16-236-SOL-

Does "innovative development initiatives" 1.5.12. Task 12 mean proposals for new Architecture implementation or simply different application development solution?

86a.

Answer: The Quality Assurance contract does not have a section 1.5.12

87. 16-236-SOL-

0002_RFP

What positions are included in the 12,000 hours for Deployment /

Training / User Support?

a. Is this the equivalent of the current OIT Helpdesk?

b. Is it limited to individual package support (Tier III)?

c. Are training positions included?

d. Are some of all of these the equivalent of those positions currently involved in BCMA deployment, EHR training, etc?

87a. Answer: Types of positions are to be proposed by offeror.

Please refer to attachment “Labor Category Descriptions” for a description of applicable labor categories.

a.) No b.) No, it covers all supported RPMS applications.

c.) Yes d.) Partially.

88. 16-236-SOL-

0002_RFP

What positions are included in 6,000 hours for Quality Assurance

Analyst?

e. Are these the equivalent of SQA?

f. Are these more an IV&V role after a project’s SQA process?

88a. Answer:

e. Yes, but there is no one-to-one comparison. Please refer to attachment “Labor Category Descriptions” for a description of applicable labor categories.

f. No, this contractor is responsible for quality assurance and

IV&V.

89. 16-236-SOL-

0002_RFP

What are the current equivalent (or similar) positions for

Technical Writer Level I and Technical Writer Level II?

89a. Answer: Please refer to attachment “Labor Category

Descriptions” for a description of applicable labor categories.

90. 16-236-SOL-

What are the current equivalent (or similar) positions for Test Engineers?

90a.

Answer: Please refer to attachment “Labor Category Descriptions” for a description of applicable labor categories.

91. 16-236-SOL-

0002_RFP

The two RFPs (-0001 and -0002) both reference training, support, QA and development lifecycle. In some cases, the specific scope bullets are identical. Understanding that what is requested may not be identical to what is currently in place, can the government be any more specific with regard to the distinction – where one ends and the other begins, or where the overlaps are?

91a. Answer: See responses to questions 12-16.

92. 16-236-SOL-

0002_RFP

Section B, lead paragraph, specifies “The purpose of this contract is to obtain services to provide development, maintenance and support for clinical, administrative, clinical, and infrastructure applications [of]… RPMS.” To what degree should offerers address the “development” part of this purpose?

92a. Answer: To the degree it can demonstrate a comprehensive understanding of software development lifecycle concepts associated with organizational software testing, quality assurance, training and user support.

93. 16-236-SOL-

0002_RFP

Section H.8 refers to the document as a “BPA.” This abbreviation is not defined internal to the document nor is it defined on the related attachment. Please clarify. Should offerers consider this document a Blanket Purchase Agreement?

93a.

Answer: The reference to a BPA is a clerical error and has been corrected in Amendment 004.

94. 16-236-SOL-

Paragraph L.2 specifies the appropriate content and format of the response for the IDIQ portion. Paragraph L.1 specifies that

"Offerors’ proposals must cover the IDIQ and the Task Order separately" but no subsequent paragraph defines the appropriate response as relates the TO. Please clarify.

94a. Answer: See answer 46a.

95. 16-236-SOL-

0002_RFP

Paragraph L.3.a - (3) states that the offeror will "emphasize how the firm will monitor and control ongoing projects that will take place during the life of the IDIQ." But it is not clear to what

'projects' the directive refers, this being a fundamentally SQA and

User Support contract (per the stated Scope). Please clarify.

95a. Answer: The government wants to understand the processes offerors will use in performing task orders under this PWS and contractor managed projects and sub-projects related to quality assurance, deployment, training, and user support.

96. 16-236-SOL-

0002_RFP

Paragraph L.3.a - (4) states that the QASP should cover all services defined within the PWS; does that mean that the QASP should include methods of surveillance of services not performed under this contract, but which are mentioned, as well as those performed under the contract? Are there specific areas of work that the QASP should not cover?

96a. Answer: The QASP should only include methods of surveillance of services covered under this PWS.

97. 16-236-SOL-

0002_RFP

"Development" and references to "Full Lifecycle Development," as well as a requirement to describe how the offerer will support

"Next Generation" 508 compliance appear in various areas within the solicitation - but no mention is made of “development” or

“software development” within Section C-1.4 Scope. Please clarify.

97a. Answer: 508 compatibility applies not only to software development but also documentation and training techniques.

98. 16-236-SOL-

0002_RFP

In the document received, there appear to be no Sections C.1.6.4 through C.1.6.10. Are there additional paragraphs we should consider or respond to?

98a. Answer: This is a numbering error and has been corrected in

Amendment 004

99. 16-236-SOL-

0002_RFP

In the document received, there appears to be no Section C.1.15.

Is there an additional paragraph we should consider or respond to?

99a. Answer: This is a numbering error and has been corrected in

Amendment 004

100. 16-236-SOL-

0002_RFP

Section 1.4 includes “Software Testing Tools.” Is this to mean to that the offerer will develop these tools, provide tools, or utilize these tools? Since “development” is not within the scope of the contract, it is not obvious what type, depth or frequency of software testing is envisioned, so likewise the reference to tools is unclear.

100a. Answer: Minimal development as it relates to software quality assurance and testing is a capability expected as part of the software quality assurance and testing processes.

Large scale development of testing tools is not. Offers should propose solutions that optimize how software quality assurance testing tools may be incorporated into the work and clarify assumptions.

101. 16-236-SOL-

0002_RFP

Since the -0001 and -0002 RFPs were clearly let as two separate contracts, is there any perspective that IHS can share concerning the government’s preference for the same vs. different contractors winning these bids?

101a. Answer: No

102. 16-236-SOL-

0002_RFP

Are the key personnel expected to start on the project after award or will there be a separate Task Order for them? Will there be a separate Task Order to fund the other personnel?

102a. Answer: Key personnel are expected to start upon award. A task order outlining work will be issued shortly after award.

103. 16-236-SOL-

0002_RFP

Is the staffing plan required in 2 weeks as stated in F.2 or is it 25 days as stated in 1.6.11? It is unclear what the Government expects on staffing.

103a. Answer: Key Personnel should be on staff at time of award and a staffing plan provided within two weeks. Section 1.6.11 requires that notice of substitutions of key personnel be provided within

25 days.

104. 16-236-SOL-

0002_RFP

Under H.4 (Special Qualifications) it states CMMI Level III or higher is preferred? If it isn’t required, why is there a deliverable for an annual CMMI audit? If a company does not have this certification how will it impact their proposal?

104a. Answer: CCMI is a favorable certification. The agency desires to measure the capabilities and maturity of the software development processes managed under this contract and to achieve continuous improvement. Therefore, there is benefit to the government for the contractor to already have these certifications. The annual audit will measure performance of the work covered under this contract and other contracts.

105. 16-236-SOL-

0002_RFP

Will there be Software Development on the project? On page 3 in

Section B the Government cites under Organization of Contract

Document: the purpose of this contract is to obtain services to provide development……..

It is not clear about development in Section C. In Section C 1.3 one of the objectives is software development with no specific requirements about development.

Additionally, in the Deliverable Schedule and Deliverable starting on page 13 two line items indicate Software Development, the first is on page 14 “Complete Software Builds” and secondly on page 15 “FOIA Software Release”. Both of these items indicate development but the labor categories cited by the Government do not appear to accommodate development skills. Please clarify.

105a. Answer: As part of software testing a degree of development is expected. Large scale development projects are not anticipated.

Staff should have the capabilities that include understanding software development in order to meet the objectives of this contract.

106. 16-236-SOL-

0002_RFP

On page 35 Section H, the SOW cites “secure facility,” is it the

Government’s expectation that the contractor provide a secure site rather than performers working from home? If a secure location is expected, can the Government clarify those requirements in greater detail?

106a. Answer: The government expects that performers secure hardware and control systems in a facility (office/home) that protects against physical and electronic threats.

107. 16-236-SOL-

0002_RFP

Do the Time and Material Rates have to absorb the cost of any equipment or any other expected costs or can any charges other than labor be billed to the government? If so how will this be handled as it is not clear in the RFP.

107a. Answer: Time and Material rates do not include cost of equipment. Materials should be detailed separately within the cost proposal.

108. 16-236-SOL-

0002_RFP

Please share the details of current testing team, » Team Size Testing Team Org Structure

108a. Answer: The current structure does not support the desired performance objectives.

109. 16-236-SOL-

What is the current state of development of RPMS application?

109a. Answer: The RPMS is a set of 80+ applications. In mixed lifecycles and inclusive of multiple programming languages.

See the following:

http://www.ihs.gov/RPMS/index.cfm?module=Applications

110. 16-236-SOL-

0002_RFP

Please can you provide the IHS Application Architecture Diagram?

110a. Answer: This is currently not available for public release.

111. 16-236-SOL-

0002_RFP

Can you please specify the integrations and integration check points of the RPMS application and the application land scape?

111a. Answer: Question is not clear.

112. 16-236-SOL-

0002_RFP

Has any test automation been done so far if so what are the tools used and no. of scripts automated?

112a. Answer: No http://www.ihs.gov/RPMS/index.cfm?module=Applications

113. 16-236-SOL-

Please confirm regarding the Development methodology used Eg: Traditional Waterfall model, Agile Model etc.

113a. Answer: A hybrid of waterfall and iterative development.

114. 16-236-SOL-

0002_RFP

Please confirm if IHS has any existing Test Cases/Scripts or User Stories; If so what is the volume?

114a. Answer: IHS has test scripts associated with all releases. The volume can range in quantity based on the planned work.

User Stories are provided with some business requirements are greater than 5000+.

115. 16-236-SOL-

0002_RFP

Who are the end users and roles defined in RPMS application

115a. Answer: End users are Physicians, Nurses, Pharmacists, Laboratorians, Dentist, Behavior Health Professionals, Coding and Billing Professionals.

116. 16-236-SOL-

0002_RFP

What is the platform that RPMS application is running on and what are the priority operating systems and devices

116a. Answer: Answer: Windows 2008, AIX v, and Intersystems Esemble\Cache

117. 16-236-SOL-

What are the test environments that Indian Health Services is expecting the vendor to execute the test cases/scripts

117a. Answer: Environments that simulate a comprehensive suite of applications that makes up the RPMS Health IT System.

118. 16-236-SOL-

0002_RFP

Please list the activities that Indian Health Services is expecting under Implementation and Deployment Support

118a. Answer: RPMS is a distributed system installed at approximately 427+ sites. Implementation and Deployment management activities include the processes, establishment of systems and functions associated with integrating official software releases to the customer production environment.

119.

16-236-SOL-

Please list the activities that Indian Health Services is expecting under Training and documentation support

119a. Answer: IHS expect that training coordination and documentation support services include a comprehensive organization and management approach to developing training methods, models and approaches for the enterprise. Proposal address processes and methods as

120. 16-236-SOL-

0002_RFP

Please list the activities that Indian Health Services is expecting under Product Release Management

120a. Answer: IHS expects offers to detail their processes for managing; planning, scheduling and controlling a software build through different stages and environments; including testing and deployment within proposals.

121. 16-236-SOL-

In page number 7 under scope please can you elaborate what is meant by Basic services to support the PWS objectives

121a. Answer: See section 1.3 and 1.4.

122. 16-236-SOL-

0002_RFP

Please comfirm if Non Functional Testing is in scope (Security, Performance, Compatibility)

122a. Answer: Yes this type of testing is in scope.

123. 16-236-SOL-

0002_RFP

Are the requested services a new opportunity or currently/previously provided by any contractors or permanent employees

123a. Answer: These activities were provided by multiple contract companies.

124. 16-236-SOL-

0002_RFP

Can you specify if any testing tools are used at Indian Health Services

124a. Answer: No testing tools are used.

125. 16-236-SOL-

What is the current level of detail, completeness and quality of documentation available on the systems/applications

125a. Answer: See the following website.

http://www.ihs.gov/RPMS/

126. 16-236-SOL-

0002_RFP

In technical proposal Section L2 what is meant by commitment documentation.

126a. Answer: See answer in 49 a.

127. 16-236-SOL-

0002_RFP

Under cost proposal kindly let us know the documents that need to be submitted. The only sentence listed is ”fully executed section K”. Please clarify the exact documents to be submitted.

Can the documents be embedded in the price proposal?

127a. Answer: All offerors are to complete the following sections under Section K:

K.1, K.3.A, K.3.B, K.4.A, K.4.C, K.5.B, K.6, K.7

128. 16-236-SOL-

0002_RFP

Do we need to sign on both Technical & price proposals documents (Cover page)? If yes can we have our own cover page format or is there some other format that needs to be followed ? Kindly clarify?

128a. Answer: Yes, all offerors can use their own format for the cover page.

129. 16-236-SOL-

Please can you specify what do you mean by development, is that Test case/scripts development or is it application development using programming languages like Java, .Net, C#

129a. Answer: Question is unclear.

130. 16-236-SOL-

0002_RFP

Under cost proposal kindly let us know the documents that need to be submitted. The only sentence listed is ”fully executed section K”. Please clarify the exact documents to be submitted.

Can the documents be embedded in the price proposal?

130a. Answer: See question No. 127

131. 16-236-SOL-

0002_RFP

Can you share your historical volumes of Accessibility Testing in terms of Test cases and other Testing Artifacts

131a. Answer: Not at this time.

132. 16-236-SOL-

0002_RFP

Can you specify if any testing tools for Accessibility testing are used at Indian Health Services

132a. Answer: No tools have been used for the distributed RPMS system. The WAV accessibility tool has been used for manual accessibility inspection of patient-facing, web-based systems.

133. 16-236-SOL-

Is Indian Health Services planning for the automation of Accessibility Testing

133a. Answer: This should be addressed in the offeror’s technical proposal.

134. 16-236-SOL-

0002_RFP

Please let us know the total no of public websites that need to be tested for Accessibility

134a. Answer: The Personal Health Record (PHR) portal and any other newly developed public-facing applications. The bulk of product to be tested includes over 80 client-server applications.