N0018917R0017.docx

N00189-17-R-0017

Section SF 1449 - CONTINUATION SHEET

TECHNICAL ANALYTICAL SUPPORT

FFP

Test and Evaluation Analytical Support Services FOB: Destination

MILSTRIP: N5702316RC00078

SIGNAL CODE: J

NET AMT

Travel

FOB: Destination

NET AMT

Other Direct Costs

FOB: Destination

NET AMT

FFP

Test and Evaluation Analytical Support Services Pursuant to FAR 52.217-8, Option to Extend Services for an additional six months.

FOB: Destination

NET AMT

FFP

Travel Pursuant to FAR 52.217-8, Option to Extend Services for an additional six months.

FOB: Destination

NET AMT

FFP

Other Direct Costs Pursuant to FAR 52.217-8, Option to Extend Services for an additional six months.

FOB: Destination

NET AMT

MINIMUM AND MAXIMUM QUANTITIES

This contract is one of a set of Multiple Award Contracts (MAC). As referred to in paragraph (b) of the “Indefinite Quantity” clause of this contracts, each MAC contract has a total contract minimum quantity of $2,500.00 worth of orders. The contract maximum for this individual contract is a total of $ insert individual contractor’s proposed amount at time of award worth of orders.

The maximum value of the MAC program is $ insert the value of the largest individual contract at time of award.

OCI

Notice of Inclusion of an Organizational Conflict of Interest (FAR 9.507-1)

relationship between the offeror and the company

conflict of interest.

(b) The basis for including an OCI clause is:

The Contractor may gain access to proprietary information of other companies during contract performance.

(c) Nature of the proposed restraint upon future contractor activities is outlined in the ORGANIZATIONAL CONFLICT OF INTEREST section below; and

(d) This solicitation contains a clause entitled Organizational Conflict of Interest which is to be included in the contract to be awarded hereunder. The language of this clause is not subject to negotiation.

ORGANIZATIONAL CONFLICT OF INTEREST

(a) Definitions - In this clause:

interest in the development, production, or analysis of the weapon system, equipment or program which are identified in the statement of work of this contract.

(iii) “Affiliates” means employees or officers of the contractor and first tier subcontractors involved in the performance of this contract, or in the decision making process concerning this contract.

(b) Warranty Against Existing Conflicts of Interest

(c) Restrictions on Contracting

(d) Non-Disclosure of Proprietary Data

Certain information of a proprietary nature may be submitted to the Government by a system supplier. While performing under this contract, the prime contractor and any subcontractors may receive this information. The prime contractor and any subcontractors agree to use and examine this information exclusively in the performance of this contract and to take the necessary steps to prevent disclosure of such information to any party outside the Government, as long as it remains proprietary. The contractor and the subcontractors agree to indoctrinate their affiliates who will have access to this information as to the proprietary nature of the information and the relationship under which they have possession of the information. Affiliates will also be informed that they may not engage in any other action, venture or employment where this information will be used for profit of any party other than the party furnishing this information. Additionally, the contractor and subcontractor agree to execute agreements to this effect with companies providing proprietary data for performance under this contract. The contractor and subcontractors will restrict access to proprietary information to the minimum number of employees for performance of this contract.

(e) Government Remedy

The contractor agrees that any breach or violation of the warranties, restrictions, disclosures or non-disclosures set forth in this conflict of interest clause shall constitute a material and substantial breach of terms, conditions, and provisions of the contract and that the Government may, in addition to any other remedy available, terminate the contract for default.

QASP

Quality Assurance Surveillance Plan For the Analytical Operational Test and Evaluation Support Services At COMOPTEVFOR Norfolk VA

1. Purpose This quality Assurance Surveillance Plan (QASP) is a Government developed and applied document used to make sure that systematic quality assurance methods are used in the administration of the Performance Based Service Contract (PBSC) standards included in this contract and on the subsequent task orders issued there under. The intent is to ensure that the contractor performs in accordance with performance metrics set forth in the contact documents, for in the contract and that the government only pays for the acceptable level of services received.

2. Authority Authority for issuance of this QASP is provided under Contract Section E, Inspection and Acceptance, which provides for inspections and acceptance of the articles services, and documentation called for in task orders to be accomplished by the Contracting Officer or his/her duly authorized representative.

3. Scope The QASP is put in place to provide Government surveillance oversight of the Contactor’s quality control efforts to assure that they are timely, effective and are delivering the results specified in the contact or task order. The QASP is not a part of the contract nor is it intended to duplicate the Contractor’s Management Plan.

4. Government Resources The following definitions for government resources are applicable to this plan:

Contracting Officer – A person duly appointed with the authority to enter into, administer, or terminate contracts and make related determinations and findings on behalf of the government.

Contracting Officer’s Representative (COR) – An individual designated in writing by the Contracting Officer to act as his/her authorized representative to assist in administering a contract. The source and the authority for a COR is the Contracting Officer. COR limitations are contained it the written letter of appointment.

5. Responsibilities The Government resources shall have responsibilities for the implementation of this QASP as follows:

Contracting Officer – The Contracting Officer ensures performance of all necessary actions for effective contracting, ensures compliance with the terms of the contract and safeguards the interests of the United States in the contractual relationship. It is the Contracting Officer that assures the Contractor receives impartial, fair, and equitable treatment under contract. The Contracting Officer is ultimately responsible for the final determination of the adequacy of the contractor’s performance.

Contracting Officer’s Representative (COR) – The COR is responsible for technical administration of the project and assures proper government surveillance of the contractor’s performance. The COR is not empowered to make any contractual commitments or to authorize any contractual changes on the governments behalf. Any changes that the contractor deems may affect contact, price, terms, or conditions shall be referred to the contracting Officer for action.

6. Methods of QA Surveillance The below listed methods of surveillance shall be used in the administration of this QASP.

Customer Feedback – Customer feedback may be obtained from random customer complaints. Appropriate forms will be made available by the COR for the patrons. The COR shall have sole custody of the suggestion box. Customer complaints, to be considered valid, must set forth clearly and in writing the detailed nature of the complaint, must be signed and must be forwarded to the COR.

Inspections – Each phase of the services rendered under the contract is subject to the Government inspection during the contractors operations and after completion of a task. Inspections may be routine functions performed by the COR, or performed by others outside of the COMOPTEVFOR command. The contractor shall not substitute Government Inspection for effective quality control. Government inspections may be conducted in an unannounced manner by the COR or other individuals designated outside the COMOPTEVFOR organization. The COR shall maintain a Contract Discrepancy Report (CDR), a copy of which will be provided to the contractor. Within three days, the contactor shall reply in writing to the CDR’s by stating reason’s for the unsatisfactory performance(s) and shall identify the corrective action(s) that will be taken to prevent reoccurrences.

Performance Evaluation Meetings – During the first two months of the contract, the Contractors Project Manager will meet weekly with the COR. Such meetings will be conducted at least monthly thereafter. The purpose of these meetings will be to review the contractors performance and to/will include the issuance of any CDR(s) issued during the period. A mutual effort will be made to resolve all problems identified.

7. Documentation The COR will, in addition to the providing documentation of the Contracting Officer, maintain a complete Quality Assurance file. All such records will be retained for the life of the contract. Information in the Quality Assurance file will be considered when completing the annual Contractors Performance Assessment reporting System (CPARS) report.

8. Identified QA Surveillance Items The following Performance Based Service Contracts (PBSC) items listed in Enclosure (4) and are identified within the performance based statement of work presented in section J of the solicitation and are to be monitored under this QASP.

1. CDRL, Data Item N001, Review of Documentation

a. Measurement/Metric:

(1) Accuracy and Timeliness

b. Performance Standard Accuracy:

(1) No rejected reports due to major discrepancy

c. Performance Standard Timeliness

(1) Within 10 working days after receipt of designated documents, unless otherwise agreed upon in advance with the OTD

d. Maximum Error Rate:

(1) Accuracy – 3%

(2) Timeliness – 3% Review of Documentation. Deliverable may take the form of draft comment letters, draft presentations, and spreadsheets. Draft comment letters in COMOPTEVFOR format to be submitted within 10 working days after receipt of designated documents, or determined by operational requirements, coordinated with the OTD.

2. CDRL, Data Item N002, Test Planning and Project Operations Support

a. Measurement/Metric:

(1). Accuracy and Timeliness

b. Performance Standard Accuracy:

(1) No rejected reports due to major discrepancy

c. Performance Standard Timeliness

(1) Within 5 working days after receipt of designated documents, unless otherwise agreed upon in advance with the OTD

d. Maximum Error Rate:

(1) Accuracy – 3%

(2) Timeliness – 3%

Test Planning & Project Operations Support. Draft deliverables in COMOPTEVFOR format to be submitted within five working days after receipt of designated documents from the Government (unless otherwise agreed upon with the OTD).

3. CDRL, Data Item N003, Draft TEMP Input

a. Measurement/Metric:

(1) Accuracy and Timeliness

b. Performance Standard Accuracy:

(1) No rejected reports due to major discrepancy

c. Performance Standard Timeliness

(1) Within 7 calendar days after delivery of CDRL A002, unless otherwise agreed upon in advance with the OTD

d. Maximum Error Rate:

(1) Accuracy – 3%

(2) Timeliness – 0%

Draft TEMP Input. Deliverable in COMOPTEVFOR format to be submitted within five working days after receipt of designated documents from Government.

4. CDRL, Data Item N004, Draft Test Plan Input

a. Measurement/Metric:

(1). Accuracy and Timeliness

b. Performance Standard Accuracy:

(1) No rejected reports due to major discrepancy

c. Performance Standard Timeliness

(1) Within 14 calendar days after receipt of applicable background documentation, unless otherwise agreed upon in advance with the OTD

d. Maximum Error Rate:

(1) Accuracy – 3%

(2) Timeliness – 3%

Draft Test Plan Input. THE CONTRACTOR SHALL DEVELOP AND DELIVER TEST PLANS USING THE MOST CURRENT COMOPTEVFOR TEST PLANNING CHECKLIST AND BEST PRACTICES. TEST PLANS (DELIVERABLES TOUCHPOINT A THROUGH E) SHALL INCLUDE THE PURPOSE OF TEST, SUT/SOS DESCRIPTIONS, COI DISCUSSIONS, LIMITATIONS, DATA QUALIFIED FOR OT, THE TEST SCHEDULE, DETAILED METHOD OF TEST, DATA COLLECTION PLAN, AND THE DATA ANALYSIS PLAN.

THE DRAFT TEST PLAN IS DUE TO THE GOVERNMENT NOT LATER THAN 30 DAYS PRIOR TO DUE DATE OF THE ACTUAL TEST PLAN, AS DETERMINED BY THE GOVERNMENT. REVISIONS TO THE TEST PLAN TO INCORPORATE CHANGES DIRECTED BY THE GOVERNMENT ARE DUE NO LATER THAN FIVE WORKING DAYS AFTER RECEIPT OF THE CHANGES, UNLESS OTHERWISE DIRECTED BY THE GOVERNMENT.

5. CDRL, Data Item N005, M&S Accreditation Support Documentation

(1). Accuracy and Timeliness

b. Performance Standard Accuracy:

(1) No rejected reports due to major discrepancy

c. Performance Standard Timeliness

(1) Within 10 working days after receipt of applicable background documentation, unless otherwise agreed upon in advance with the OTD

d. Maximum Error Rate:

(1) Accuracy – 3%

(2) Timeliness – 3%

6. CDRL, Data Item N006, Draft Final Report

a. Measurement/Metric:

(1). Accuracy and Timeliness

b. Performance Standard Accuracy:

(1) No rejected reports due to major discrepancy

c. Performance Standard Timeliness

(1) Within 10 working days after receipt of designated documentation/test results, unless otherwise agreed upon in advance with the OTD

d. Maximum Error Rate:

(1) Accuracy – 3%

(2) Timeliness – 3%

7. CDRL, Data Item N007, Trip/Technical Report

(1). Accuracy and Timeliness

b. Performance Standard Accuracy:

(1) No rejected reports due to major discrepancy

c. Performance Standard Timeliness

(1) Within 5 working days after completion of the trip, unless otherwise agreed upon in advance with the OTD

d. Maximum Error Rate:

(1) Accuracy – 3%

(2) Timeliness – 3%

Trip/Technical Reports. Contractor format is acceptable. The contractor shall prepare a trip report detailing key information issued at the program meeting attended within five (5) working days after returning from the meeting Electronic copies are preferred; are required to be submitted in MS Office-compatible media; contractor format of contents acceptable.

8. CDRL, Data Item N008, Monthly Progress and Status Report

a. Measurement/Metric:

(1). Accuracy and Timeliness

b. Performance Standard Accuracy:

(1) No rejected reports due to major discrepancy

c. Performance Standard Timeliness

(1) Within 5 working days after completion of the reporting period, unless otherwise agreed upon in advance with the OTD

d. Maximum Error Rate:

(1) Accuracy – 3%

(2) Timeliness – 3%

Monthly Progress Reports. Contractor format is acceptable. The contractor shall prepare a progress, performance and funds expenditure report by the 15th of the month starting one month after contract award, unless otherwise agreed upon with the OTD.

9. CDRL, Data Item N009, Annual Summary Report

a. Measurement/Metric:

(1). Accuracy and Timeliness

b. Performance Standard Accuracy:

(1) No rejected reports due to major discrepancy

c. Performance Standard Timeliness

(1) Within 30 days after the option year.

d. Maximum Error Rate:

(1) Accuracy – 3%

(2) Timeliness – 3%

Annual Summary Report. Contractor format acceptable. The contractor shall prepare a progress, performance and funds expenditure report within 30 days after the option year ends.

10. CDRL, Data Item N010, MBTD Database Output Report

a. Measurement/Metric:

(1). Accuracy and Timeliness

b. Performance Standard Accuracy:

(1) No rejected reports due to major discrepancy

c. Performance Standard Timeliness

(1) Within 1 working day after the request.

d. Maximum Error Rate:

(1) Accuracy –10%

(2) Timeliness – 10%

MBTD Database Output Report. MBTD Output formats. Contractor shall prepare Database Output reports based on completed MBTD steps. Outputs include, but are not limited to, COI Listing, Sub-Task hierarchy, Conditions and Attributes to Sub-Task cross reference, Attribute matrix, Conditions matrix, Vignette to Data Requirements to Test Methods Matrix, Vignette Resource Matrix and others.

11. CDRL, Data Item N011, Design of Experiment IEF Inputs

a. Measurement/Metric:

(1). Accuracy and Timeliness

b. Performance Standard Accuracy:

(1) No rejected reports due to major discrepancy and IAW COTF policy, procedures and best practices.

c. Performance Standard Timeliness

(1) Within 7 working days after the request or as agreed upon with the government timeline/priority list.

d. Maximum Error Rate:

(1) Accuracy – 3%

(2) Timeliness – 10%

Design of Experiment IEF Inputs. Contractor shall produce a statistical package based on the IEF Test Design section format, containing the Factors (Conditions), Response Variables (Measures) and Run Matrix (test design samples) using information gathered during the MBTD Process. Included in the package shall be Sigma (standard deviation), Delta (effect size), Alpha and resulting Confidence, and Beta and resulting Power values for each of the test vignettes determined by the MBTD process.

12. 12. CDRL, Data Item N012, IEF Document Input

a. Measurement/Metric:

(1). Accuracy and Timeliness

b. Performance Standard Accuracy:

(1) No rejected reports due to major discrepancy

c. Performance Standard Timeliness

(1) Per the agreed to government timeline/priority list.

d. Maximum Error Rate:

(1) Accuracy – 3%

(2) Timeliness – 3%

IEF Document Inputs. IEF Template Inputs. Contractor shall provide inputs to various programs IEF based on MBTD outputs. This includes, but is not limited to, COI Tables, Vignette Tables, Subtask Hierarchy Tables, Conditions, Attributes to Subtask Tables, Vignette to Data Requirements to Test Method Tables, Attribute tables, Filtered Conditions Tables, Data Element Tables, Resource Tables, Survey Sheets and DOE write-ups.

13. CDRL, Data Item N013, Information Assurance Test Report

a. Measurement/Metric:

(1). Accuracy and Timeliness

b. Performance Standard Accuracy:

(1) No rejected reports due to major discrepancy

c. Performance Standard Timeliness

(1) Within 30 days after the option year.

d. Maximum Error Rate:

(1) Accuracy – 3%

(2) Timeliness – 3%

Information Assurance Test Report. Draft deliverables in COMOPTEVFOR format to be submitted within 15 days after completion of test event (Unless otherwise agreed upon with the OTD).

14. CDRL, Data Item N014, Technical Editor Review

a. Measurement/Metric:

(1). Technical/Editorial

b. Performance Standard Technical:

(1) No rejected reports due to major discrepancy within 1 year

c. Performance Standard Editorial

(1) No rejected reports due to major discrepancy within 1 year.

d. Maximum Error Rate:

(1) Technical – 12%

(2) Editorial – 12%

Technical Editor Review. Provides complex technical writing and editing but not limited to; Test and Evaluation Master Plan (TEMP), comment and forwarding letters, Test Plans, Evaluation Reports, several other variations of test reports in multiple formats, evaluation assessments, tactics guides, modeling and simulation accreditation and other documents associated with OT&E. Ensures continuity with project details is maintained, and that all operational, technical, and analytical issues and objectives have been addressed. The contractor provides technical, writing, and editorial support directed toward ensuring the quality (accuracy, logic, content, clarity, reliability, format, and grammar) of OPTEVFOR documentation associated with OT&E. Contractor must ensure official markings, downgrading instructions and distribution statements are correctly used on all documents applicable.

15. CDRL, Data Item N015, Analysis Working Group (AWG) and System Evaluation Review Board (SERB) Process Documentation

a. Measurement/Metric:

(1). Accuracy and Timeliness

b. Performance Standard Accuracy:

(1) No rejected reports due to major discrepancy and IAW COTF policy, procedures and best practices.

c. Performance Standard Timeliness

(1) As agreed upon with the government timeline/priority list.

d. Maximum Error Rate:

(1) Accuracy – 0%

(2) Timeliness – 10%

AWG and SERB process documentation will include (but not limited to) all data identified critical for subtask/COI resolution, including Key Performance Parameters (KPP), Measures of Effectiveness and Measures of Suitability that will be included in the applicable section of the test reports. This data will also include reliability growth curves, key response variables, and any other data that the government feels is pertinent to the issue or deficiency development or COI resolution.

LIST OF ATTACHMENTS

I. Labor Category Rate Matrix II. Past Performance Information Form III. Past Performance Report/Questionnaire Form IV. DD Form 254 V. Contract Administration Plan VI. Organizational Conflict of Interest – List of prime manufacturers and major subcontractors

PERFORMANCE WORK STATEMENT

For the Analytical Operational Test and Evaluation Support Services At COMOPTEVFOR Norfolk VA

1.0 Scope of Tasking. Contractor will provide technical and analytical support to Commander, Operational Test and Evaluation Force (COMOPTEVFOR) in the definition, conduct and analysis of structured operational and integrated test and evaluation (IOT&E) of US Navy systems. This support will be required in one or more of the following forms: Documentation Review, Test Planning Support, Operational Test Design, Test Analysis and Reporting, Test Operations Support, Modeling and Simulation Support, and Program Management Support.

a. Place of Performance. Unless required to support mission accomplishment, work shall primarily be performed at the customer’s site. If the number of personnel exceeds onsite capabilities, unclassified work will be expected to be performed offsite. The customer location is:

b. While onsite at COMOPTEVFOR, the contractor shall comply with OPNAVINST 5239 (series), with specific regard to non-government hardware and software. The IA program instruction may be found at: http://doni.daps.dla.mil/Directives/05000%20General%20Management%20Security%20and%20Safety%20Services/05-200%20Management%20Program%20and%20Techniques%20Services/5239.1C.pdf

c. Travel. Travel will be required throughout the course of this contract. All travel costs shall be in accordance with the Federal Travel Regulations (FTR). Invoices shall include actual costs experienced. Airfare shall be based on the lowest available cost for coach or economy in writing, in advance. Travel dates and locations are to be confirmed through the TA and approved by the COR in writing, prior to commencement of any travel.

d. The Contractor is not authorized to perform any travel that is not in conjunction with this contract. It is the Department of the Navy (DON) policy not to allow a charge of profit or fee on reimbursable items. The Government will make no reimbursements for a contractor’s local travel. In no instance shall the contractor exceed the amount specified in the contract for travel CLIN and ODC CLIN expenses. Locations include CONUS, OCONUS and at sea locations and any other location, which may be added on a task order basis based on future test requirements. For planning purposes any travel location OCONUS must be considered as a possible travel location unless travel restrictions at time of test do not permit entry. Possible OCONUS locations include the following:

Andros Island, Bahamas Darwin, Brisbane, Melborne, Newcastle, Perth, and Sydney, Australia;

London, England;

Honduras; Singapore La Spezia, Italy Guam Hawaii Halifax, Nova Scotia Nanoose, British Colombia Columbia Belize Guatemala Souda Bay Crete Mexico

And any other location, which may be added on a task order basis based on future test requirements.

1.1 Travel Instructions. Ensure all Contractors supporting this requirement meet the minimum requirements of the COMUSFLTFORCOM/COMPACFLCINST 6320.3A, dtd 07May13, Medical Screening for U.S. Government Civilian Employees, Contractor Personnel, and Guests Prior to Embarking Fleet Units. Any travel OCONUS by the Contractor will need to review the Foreign Clearance Guide at http://www.fcg.pentagon.mil and select the country of intended travel.

a. This is not a personal services contract. The contractors/sub-contractors should be well educated in respect to “personal services”. No one (Government employee or military) may task the contractor to perform work that is not listed in the delivery order, nor do the contractors take direction in the performance of their task from anyone other than their corporate manager and/or prime contractor, as appropriate.

b. Privity, the legal term that defines the relationship between two parties of a contract, does not exist between the Government and the sub-contractor. Therefore, the Prime contractor is responsible for ensuring, through its own internal processes, that quality work is performed and delivered on time, by any subcontractors to meet the objectives of the prime contract. Formal direction to sub-contractors flows only thought the prime contractor. There can be simultaneous communication between the prime contractor and the subcontractor, but the Government and the subcontractor cannot bypass the prime contractor to communicate directly with each other.

1.2. ADP REQUIREMENTS: The Government will provide, if required, the necessary computer, work station/system access for on-site work. Those offerors assigned as Off-site will not be assigned government furnished ADP assets.

1.3. Other Direct Costs (ODCs). ODCs consist of test equipment and supplies as required for performance of Task Orders. In no instance shall the contractor exceed the amount specified in the contract for ODC CLIN expenses.

2.0 Specific Tasking. In accordance with Section C of the basic contract, the contractor shall provide support in evaluating the operational effectiveness and suitability of the projects listed in paragraph 7, and any other project subsequently assigned to COMOPTEVFOR by the CNO for OT&E, in accordance with the format prescribed in COTFINST 3980.2 series, Operational Test Director’s Guide (or other governing references listed in paragraph 5 as applicable). The manual maybe found at: http://www.public.navy.mil/cotf/OTD/OTD%20Manual.pdf

a. Documentation Review (Associated CDRL: A001, A016)

(1) Review program documentation, including but not limited to and subject to minor fluctuation: Required Operational Capability (ROC) Projected Operational Environment (POE), Concept of Operations (CONOPS), Operational Requirements Documents (ORD), Test and Evaluation Master Plan (TEMP), Mission Needs Statement (MNS), Initial Capabilities Document (ICD), Capability Development Document (CDD), and Capability Production Document (CPD), Navy System Training Plan (NTSP), manning documents, Program Acquisition Logistics Support Plan (ALSP), training manuals, and operator and maintenance manuals, information support plan, Systems Security Authorization Agreements (SSAA), IA Strategy, Authority to Operate (ATO) or Interim ATO, Platform IT Risk Approval (PRA) or Interim PRA, Interim PRA POA&M, IA certification and accreditation package and provide comments, assist in the staffing and subsequent inclusion of the governments adjudicated comments from the Comment Resolution Matrix (CRM) associated with the program/s being directly supported.

b. Operational Test Design Development (Associated CDRL: A004, A005, A011,A014)

Plan and design operational tests, and analyze the resulting data in order to obtain objective conclusions in support of Integrated Testing, in conjunction with mission-based Critical Operational Issues (COI), cross-referenced with Navy Mission Essential Task Lists (NMETL) and/or Joint Mission Essential Task Lists (JMETL). Operational Tests are to be conducted in conjunction with the IOT&E methodology, in accordance with existing COMOPTEVFOR Operational Test Director Manual.

c. TEMP/MTP Development (Associated CDRL: A003)

(1) Draft TEMP/MTP comments and applicable portions of the respective document. During the TEMP/MTP review process, the contractor should ensure the minimum acceptable operational performance requirements (older programs) or Measures of Effectiveness, Measures of Suitability (MOE/MOS) (newer programs) from the approved ORD/ICD/CDD/CPD are incorporated. COMOPTEVFOR contributes to all parts of the TEMP (in working sessions, through comment letters, or other means of communication.) and provides the OT&E portions throughout the document. This requires familiarity with other program documentation (MNS, ORD, ICD/CDD/CPD, Information Assurance (IA) strategy, ONI Capstone TA, etc.) and close coordination with the Decision Authority (DA), particularly during program changes.

(2) Revisions to the draft TEMP/MTP may be required due to internal and external staffing of a Comment Resolution Matrix (CRM), these revisions will be required to be made by the contractor after government adjudication of any/all comments received.

d. Operational Test Planning (Associated CDRL: A002, A004, A005, A011, A014)

(1) Assist in use of Mission Based Test Design (MBTD), for Operational Testing (OT), Developmental Testing (DT) assists, Early Operational Assessments (EOA), Operational Assessments (OA), Joint Concept Technology Demonstrations (JCTD), Quick Reaction Assessments (QRA), Initial Operational Test and Evaluation (IOT&E), and Follow-on Test and Evaluations (FOT&E), Verification Correction of Deficiencies (VCD) and compile data necessary to draft the test plans (both integrated and operational).

(2) Conduct background research and provide analytical support and recommendations for the development of data collection plans for testing the operational effectiveness and suitability.

(3) Devise test matrices and procedures to satisfy COMOPTEVFOR testing objectives.

(4) Determine data reduction/reconstruction requirements (including hardware and software resources necessary for the collection and storage); identify facilities which can provide this processing; and prepare appropriate documentation to support the required service(s).

(5) Draft Test plans (deliverables Touchpoint A through E) shall include the purpose of test, Sut/SoS descriptions, COI discussions, limitations, data qualified for OT, the test schedule, detailed method of test, data collection plan, and the data analysis plan.

(6) Revisions to the draft test plan may be required due to internal and external staffing of a Comment Resolution Matrix (CRM), these revisions will be required to be made by the contractor after government adjudication of any/all comments received.

e. Operational Test Execution(Associated CDRL: A005)

(1) Provide support in conducting liaison with model proponents, Verification and Validation (V&V) agents, developing agencies, Navy laboratories, service Cryptologic Agencies, Navy operational commands, other U.S. Government agencies, and hardware/software contractors to ensure that Modeling and Simulation (M&S) OT&E requirements are adequately addressed to permit timely and effective accreditation of M&S in support of OT&E.

(2) Provide support in maintaining an M&S database that consists of the version and accreditation status of all M&S used in OT&E.

(3) Attend program review meetings with the Operational Test Director (OTD) during the timeframe in various locations and provide technical reports and observe demonstrations/test events as appropriate with OTD, collect test data, and provide technical reports.

(4) Assist OTD as required in briefing test participants, emphasizing the objectives of the test event and specific data-gathering requirements for each participant.

f. Operational Test Data Analysis (Associated CDRL: A005, A017)

(1) Perform data reduction and preliminary analysis of data to ensure data validity, prior to more detailed data processing. Assist the OTD and OTC when making assessments regarding specific risk areas based on the results of data analysis. To that end, the 5 x 5 consequence versus likelihood risk matrix shall be used as the basis for all risk assessments, when applicable; utilization of a comment resolution matrix will be optimized to ensure adjudication of all comments by the government.

(2) Correlate data using appropriate statistical techniques to analyze operational effectiveness and suitability tests and provide follow-up assistance as necessary on test reports and briefs.

(3) Provide analysis to support COI resolution on all data identified critical for subtask/COI resolution, including Key Performance Parameters (KPP), Measures of Effectiveness (MOE) and Measures of Suitability (MOS) that will be included in the applicable section of the test reports. This data will also include reliability growth curves, key response variables, and any other data that the government feels is pertinent to the issue or deficiency development or COI resolution.

g. Operational Test Reporting (Associated CDRL: A006)

(1) Shall provide the following reports, but not limited to and subject to minor fluctuation; Operational Test Agency Assessment Report (OAR) and Operational Test Agency Milestone Assessment Report (OMAR), OAR/OMAR, Operational Evaluation Report (OER) or Operational Test Agency Follow-on Evaluation Report (OFER), Letter of Observation (LOO), Operational Utility Assessment (OUA) report, Independent Operational Test and Evaluation (IOT&E) report.

h. Administrative Support (Associated CDRL: A007, A008, A009, A010, A015)

(1) Provide the Technical Point of Contact (TPOC) with following reports (but not limited to and subject to minor fluctuation) the Trip/Technical Reports, Monthly Progress Reports, Annual Summary Reports progress of work on assigned tasks, conferences/meetings attended, work plans, and the expenditure of funds and labor hours during the month.

(2) Provide support in conducting liaison with developing agencies, Navy laboratories, Navy Operational Commands, other U.S. Government agencies, and hardware/software contractors to ensure that OT&E requirements are adequately addressed to permit timely and effective testing.

3.0 Deliverables. The Government reserves the right to specify deliverables at the task order level. Data items required from the contractor are specified in the Contract Data Requirements List (CDRL), DD Form 1423. Not every CDRL will apply to each order. Quantities, delivery dates, and other particulars will be identified in the individual task orders issued under this contract.

a. CDRL A001 Documentation Review

(1) Review program documentation, including but not limited to and subject to minor fluctuation: Required Operational Capability (ROC)/Predicted Operational Environment (POE), Concept of Operations (CONOPS), Operational Requirements Documents (ORD), Test and Evaluation Master Plan (TEMP), Initial Capabilities Document (ICD), Capability Development Document (CDD), and Capability Production Document (CPD), Navy System Training Plan, manning documents, Program Acquisition Logistics Support Plan (ALSP), training manuals, and operator and maintenance manuals, and provide comments, assist in the staffing and subsequent inclusion of the governments adjudicated comments from the Comment Resolution Matrix (CRM) associated with the program/s your directly supporting.

b. CDRL A002 Test Planning and Project Operations Support

(1) Assist In The Development Of Critical Operational Issues (COI) Integrated Evaluation Framework (IEF) For Operational Testing (OT), Developmental Testing (DT) Assists, Early Operational Assessments (EOA), Operational Assessments (OA), Joint Concept Technology Demonstrations (JCTD), Observation Of Operational Capabilities (OOC), Independent Operational Test And Evaluation (IOT&E), And Follow-On Test And Evaluations (FOT&E), and compile data necessary to draft the tests (both integrated and operational).

(2) Conduct background research and provide analytical support and recommendations for the development of data collection plans for testing the operational effectiveness and suitability.

(3) Draft TEMP comments and TEMP Part III and applicable portions of Part IV.

(4) Devise test matrices and procedures to satisfy COMOPTEVFOR testing objectives.

(5) Determine data reduction/reconstruction requirements (including hardware and software resources necessary for the collection and storage); identify facilities which can provide this processing; and prepare appropriate documentation to support the required service(s).

(6) Revisions to the draft test plan may be required due to internal and external staffing of a Comment Resolution Matrix (CRM), these revisions will be required to be made by the contractor after government adjudication of any/all comments received.

c. CDRL A003 TEMP/MTP Development Support

(1) Draft TEMP/MTP comments and applicable portions of TEMP/MTP.

(2) During the TEMP/MTP review process, the contractor should ensure the minimum acceptable operational performance requirements (older programs) or MOE/MOS (newer programs) from the approved ORD/ICD/CDD/CPD are incorporated.

(3) Provide input to all parts of the TEMP/MTP (in working sessions, through comment letters, or other means of communication.) derived from familiarity with other program documentation (MNS, ORD, ICD/CDD/CPD, Information Assurance (IA) strategy, ONI Capstone TA, etc.) and close coordination with the DA, particularly during program changes.

(4) Revisions to the draft TEMP/MTP may be required due to internal and external staffing of a Comment Resolution Matrix (CRM), these revisions will be required to be made by the contractor after government adjudication of any/all comments received.

d. CDRL A004 Draft Test Plan Input

(1) Draft Test plans (deliverables Touchpoint A through E) shall include the purpose of test, Sut/SoS descriptions, COI discussions, limitations, data qualified for OT, the test schedule, detailed method of test, data collection plan, and the data analysis plan.

e. CDRL A005, M&S Accreditation Documentation

(1) Provide support in conducting liaison with model proponents, V&V agents, developing agencies, Navy laboratories, service Cryptologic Agencies, Navy operational commands, other U.S. Government agencies, and hardware/software contractors to ensure that M&S IOT&E requirements are adequately addressed to permit timely and effective accreditation of M&S in support of IOT&E.

(2) Provide support in maintaining an M&S database which consists of the version and accreditation status of all M&S used in IOT&E.

f. CDRL A006, Final Report

(1) Draft deliverable in COMOPTEVFOR format to be submitted within fifteen days after completion of test event unless otherwise agreed upon in advance with the OTD.

(2) Final report can be; Letter of Observation (LOO), Observation of Operational Capabilities (OOC), Early Operational Assessment (EOA) or Operational Assessment (OA), Initial Operational Test and Evaluation (IOT&E), Follow On Test and Evaluation (FOT&E) or Verification Correction of Deficiencies(VCD).

g. CDRL A007, Trip/Technical Report

(1) Contractor format acceptable. The contractor shall prepare a trip report detailing key information issued at the program meeting attended within five (5) working days after returning from the meeting.

(2) Electronic versions are preferred and are to be submitted in MS Office-compatible media; contractor format of contents acceptable.

h. CDRL A008, Monthly Progress and Status Report

(1) Contractor format acceptable. The contractor shall prepare a progress, performance and funds expenditure report by the 15th of the month starting one month after contract award, unless otherwise agreed upon with the OTD.

i. CDRL A009, Annual Summary Report

(1) Contractor format acceptable. The contractor shall prepare a progress, performance and funds expenditure report within 30 days after the base year or option year ends.

j. CDRL A010, MBTD Database Output

(1) MBTD Output formats. Contractor shall prepare Database Output reports based on completed MBTD steps.

(2) Outputs include, but are not limited to and subject to minor fluctuation, COI Listing, Sub-Task hierarchy, Conditions and Attributes to Sub-Task cross reference, Attribute matrix, Conditions matrix, Vignette to Data Requirements to Test Methods Matrix, Vignette Resource Matrix and corrections documented within a comment resolution matrix.

k. CDRL A011, Design of Experiment IEF Inputs

(1) Contractor shall produce a statistical package based on the IEF Test Design section format, containing the Factors (Conditions), Response Variables (Measures) and Run Matrix (test design samples) using information gathered during the MBTD Process.

(2) Included in the package shall be Sigma (standard deviation), Delta (effect size), Alpha and resulting Confidence, and Beta and resulting Power values for each of the test vignettes determined by the MBTD process.

l. CDRL A012, IEF Document Development

(1) Contractor shall provide inputs to and develop IEF documents for various programs based on MBTD outputs.

(2) This includes, but is not limited to and subject to minor fluctuation, COI Tables, Vignette Tables, Subtask Hierarchy Tables, Conditions, Attributes to Subtask Tables, Vignette to Data Requirements to Test Method Tables, Attribute Tables, Filtered Conditions Tables, Data Element Tables, Resource Tables, Survey Sheets and DOE write-ups.

m. CDRL A013, Technical Editor Review

(1) Provides complex technical writing and editing this includes but is not limited to and subject to minor fluctuation;

(a) Test and Evaluation Master Plan (TEMP), comment and forwarding letters, Test Plans, Evaluation Reports, several other variations of test reports in multiple formats, evaluation assessments, tactics guides, modeling and simulation accreditation and other documents associated with IOT&E.

(2) Ensures continuity with project details is maintained, and that all operational, technical, and analytical issues and objectives have been addressed.

(3) The contractor provides technical writing, and editorial support directed toward ensuring the quality assurance and quality control, accuracy, logic, content, clarity, reliability, format, and grammar of OPTEVFOR documentation associated with IOT&E.

(4) Contractor must ensure official markings, downgrading instructions and distribution statements are correctly used on all documents applicable.

n. CDRL A014, Analysis Working Group (AWG) Design of Experiment Working Group (DWG) and System Evaluation Review Board (SERB) Process Documentation

(1) The AWG, DWG and SERB process documentation will include (but not be limited to) all data that is identified critical for subtask/COI resolution, including Key Performance Parameters (KPP), Measures of Effectiveness and Measures of Suitability that will be included in the applicable section of the test reports.

4.0 Minimum Personnel Requirements. The contractor is required to submit for those positions identified as “Key Personnel” for review and evaluation with their technical proposals for award purposes. Further, the contractor will be required to submit for identified labor categories for review and approval prior to performance on any applicable task order award. As described in the minimum personnel requirements relative and comparative emphasis is given where applicable between the testing, analytical and/or writing competencies within respective labor categories. In addition to the warfare specific labor categories, note the following over-arching categories which may be also be required:

· Program Manager

· Information Systems Security Manager

· Psychometric Scientist

· Modeling and Simulation Technician

· Statistician

· Technical Editor

4.1. Minimum Requirements for All Offerors. Within the last 5 years (unless stated otherwise), all personnel shall:

a. Possess U.S. citizenship.

b. Required. A minimum security clearance of SECRET or TOP SECRET (specified by DD254) is required for personnel supporting tasks. Any personnel proposed to work on any effort shall be eligible for necessary clearances to immediately begin performance at the time of task award.

c. Demonstrated familiarity with MS-Office software.

4.2 Minimum Requirements for each Personnel Position

a. Program Manager

(1) In addition to the requirements listed in paragraph 4.1, the following personnel qualifications are required over the life cycle of the contract:

(a) Must have 8 years (within the last ten years) of experience in planning and organizing work tasks, developing test plans, collecting data, and performing reconstruction and analysis for the test and evaluation or tactical operations related efforts. Of the 8 years, four must be in a project or program management capacity.

(b) Must have current working knowledge of the Navy and multi-service missions, operations, logistics, management, and organizational responsibilities.

(c) Must have working knowledge of the DoD 5000 series, OPNAVINST 5000.42 series, as well as SECNAVINST 5000 series instructions. DOD 5000.01, DOD 5000.02 , SECNAVINST 5000 series http://doni.daps.dla.mil/opnav.aspx?RootFolder=%2fDirectives%2f05000%20General%20Management%20Security%20and%20Safety%20Services&View=%7bDEF0EB11%2d3785%2d4F67%2dB5A1%2dAE9F8EB752BC%7d

(d) Must have demonstrated the ability to interact effectively within the naval community and have a demonstrated ability to communicate the results of the operational analysis to sponsoring activities and decision makers.

b. Information Systems Security Manager

(a) Must possess demonstrated experience in the certification and accreditation (C&A) process, vulnerability assessment and remediation, Assured Compliance Assessment Solution (ACAS) and Risk Management Framework (RMF).

(b) Must possess demonstrated experience performing and supporting computer network defense operations and analysis and evaluation of data pertaining to the cyber security system.

(c) Must possess demonstrated experience to perform functions related to the protection of information systems, the detection of intruders or malicious code and the response against cyber-attacks.

(d) Must possess demonstrated experience interpreting and analyzing existing Information Technology (IT) policies and guidelines to make technical and cyber security decisions on IT capabilities.

(e) Must possess demonstrated experience developing, modifying, rewriting and coordinating short and long range policies and programs for effective management of current cyber operations.

(f) Must possess demonstrated experience developing test and evaluation…