3_Atch_Draft_QASP.pdf

53 WEG/82 ATRS

MULTI-FUNCTIONAL TEAM (MFT)

QUALITY ASSURANCE SURVEILLANCE PLAN (QASP)

FOR

WATERCRAFT OPERATIONS AND MAINTENANCE

FA4819-15-C-XXXX

TYNDALL AFB FL

11 September 2014

This QASP is provided as information only and will not be made part of the contract award.

FA4819-14-R-0005

Atch 3

TABLE OF CONTENTS

1.0. SERVICE OBJECTIVE 4

2.0. MULTI-FUNCTIONAL TEAM (MFT) 4

QUALITY ASSURANCE SURVEILLANCE PLAN (QASP) GOALS

2.1. QUALITY WORKMANSHIP & EFFICIENCIES 4

2.2. EXCELLENT CUSTOMER SERVICE 4

2.3. PWS COMPLIANCE 4

3.0. MFT MEMBERS, ROLES, AND RESPONSIBILITIES 4

3.1. MFT ACQUISITION TEAM DUTIES AND RESPONSIBILITIES 4

3.2. CONTRACTING OFFICER’S REPRESENTATIVE (COR) MANAGEMENT 5

3.3. QUALITY ASSURANCE PROGRAM COORDINATOR (QAPC) 5

3.4. CONTRACTING OFFICER (CO) 6

3.5. CONTRACT ADMINISTRATOR (CA)/CONTRACT SPECIALIST 6

3.6. CONTRACTING OFFICER’S REPRESENTATIVE (COR) 7

3.7. TECHNICAL SPECIALIST/FUNCTIONAL EXPERT 8

3.8. CONTRACTOR 8

3.9. OTHER EXPERTS/ADVISORS 8

4.0. GOVERNMENT QUALITY ASSURANCE APPROACH 8

4.1. PURPOSE 8

4.2. SURVEILLANCE PROCEDURES 9

4.3. QUALITY ASSURANCE (QA) FILE 9

4.4. SURVEILLANCE METHODS 11

4.5. CAPTURING SURVEILLANCE FOR PAST PERFORMANCE ASSESSMENT 11

REPORTING

4.6. PAST PERFORMANCE INFORMATION 13

4.7. SERVICES SUMMARY 13

4.8. PROCEDURES FOR SURVEILLANCE OF NON-SS ITEMS 14

4.9. PERFORMANCE DEFICIENCIES 14

4.10. ACCEPTANCE/CERTIFICATION OF SERVICES 15

5.0. PERFORMANCE MANAGEMENT 15

5.1. MARKET RESEARCH 15

5.2. PERFORMANCE IMPROVEMENT MEASURES 15

5.3. RELATIONSHIP BUILDING 15

5.4. DISPUTE RESOLUTION 16

6.0. ATTACHMENTS 16

1. Quality Assurance (QA) File Index 17

2. Periodic Surveillance Report 18

3. COR Surveillance Assessment Report 26

4. COR Mid-Term Past Performance Assessment Report (PPAR) 27

5. COR Inspection Checklists 28

1.0. SERVICE OBJECTIVE. To provide quality aerial target operations and maintenance services for watercraft operations on Tyndall AFB in accordance with the Performance Work Statement (PWS).

2.0. MFT QUALITY ASSURANCE SURVEILLANCE PLAN GOALS

2.1. Quality Workmanship and Efficiencies. The Government expects quality workmanship in all services performed. New components shall meet or exceed existing components in terms of manufacture and quality. All work shall be performed in accordance with manufacturer’s recommendations, national vehicle maintenance codes, applicable federal, state, and local laws and regulations unless otherwise stated in the PWS.

2.2. Excellent Customer Service. The contractor shall ensure all work is performed in accordance with standard commercial practices, manufacturer’s recommendations, and applicable federal, state, and local rules and regulations.

2.3. PWS Compliance. Ensure the contractor meets all provisions of the PWS.

3.0. MULTI-FUNCTIONAL TEAM (MFT) MEMBERS, ROLES, AND

RESPONSIBILITIES

3.1. MFT DUTIES AND RESPONSIBILITIES

3.1.1. Foster partnerships with industry to ensure exchanges of information among the service industry and other business experts occur. Ensure key stakeholders participate in developing, implementing, and executing the acquisition strategy.

3.1.2. Provide support to senior leadership as required (i.e., performance metrics, data, briefings). Provide reports and early warnings of significant variances in cost, schedule, or performance to senior leadership. Complete annual performance reviews in accordance with the Annual Execution Review (AER) MAJCOM Services Program Health Template.

3.1.3. Research the commercial market to ensure the MFT is using the most efficient and effective assessment methods, techniques, and best commercial practices in performance of the contract.

3.1.4. Develop, implement, and execute a performance-based acquisition strategy, to include performance metrics that support a higher level of contract performance, fosters synergistic partnerships, accommodates changing or unforeseen mission needs, and leverages commercial best practices. Ensure the acquisition strategy aligns mission performance needs with performance-based work statements and acquisition approaches designed to deliver the desired mission support results.

3.1.5. Manage risk to ensure mission performance is within cost and schedule constraints.

3.1.6. Develop, implement, and execute a source selection, if applicable, that provides an integrated assessment of the offeror’s proposal and ensures a best value source selection based on the requirements of the request for proposal.

3.1.7. Plan, program, and budget adequate funds to ensure the execution is within the approved funding baseline.

3.1.8. Develop, implement, and manage milestones to ensure the acquisition supports mission requirements within the approved funding baseline.

3.1.9. Identify opportunities to improve performance throughout the life of the acquisition.

This includes benchmarking against industry, identifying initiatives, assessing the risk associated with these initiatives, using the QASP to implement initiatives, and monitoring the success of implementation.

3.1.10. Assess and manage contractor performance data to include submitting Contractor Performance Assessment Reporting System (CPARS) reports.

3.1.11. Develop, implement, and execute performance measurement and management in accordance with this QASP.

3.1.12. Ensure the requiring office and contractor understand the unique programs impacting an acquisition, e.g., Air Force Hazardous Materials Management Process (HMMP), safety, security, environmental, etc.

3.2. COR MANAGEMENT

3.2.1. Is responsible for the development and delivery of the requirements package in order to ensure timely award of the contract.

3.2.2. Nominates two (2) Contracting Officer Representatives (CORs) to satisfy surveillance requirements of the contract, in writing. The two CORs do not require identification of primary and alternate, but may at the unit’s discretion. The functional commander/functional director (FC/FD) may endorse the nomination at their discretion.

3.2.3. Periodically reviews surveillance documentation submitted by the COR to determine adequacy and quality of surveillance.

3.2.4. Rates the performance of COR duties as part of the performance assessment throughout the period of the contract.

3.2.5. The FC/FD is the CPAR assessing official for this contract, and is responsible for validating the CPAR when it is due.

3.3. QUALITY ASSURANCE PROGRAM COORDINATOR (QAPC)

3.3.1. Advises team members on all quality assurance issues for the requirement.

3.3.2. If required, advises team on all CPAR issues.

3.3.3. Assists the functional area in preparing the PWS and the QASP.

3.3.4. Conducts and provides review of “draft” CPARS for compliance with the Air Force CPARS Guide prior to submission to the assessing official (FC/FD) in CPARS.

3.4. CONTRACTING OFFICER (CO)

3.4.1. Forms the acquisition milestones for the acquisition process jointly with COR management.

3.4.2. Ensures acquisition processes, i.e., market research, gathering of past performance information (PPI), source selection, solicitation, evaluation, and award are aggressively performed.

3.4.3. After contract award, ensures the MFT convenes 6 months after contract award or when exercising an option to determine whether recompetition is required.

3.4.4. A duly appointed CO is the only individual authorized to enter into, administer, and/or terminate contracts and make related determination and findings.

3.4.5. The CO is the only individual that is authorized to delegate (delegation must be in writing) specific contract administration duties to other individuals. This includes the COR.

3.4.6. The CO ensures oversight and control of contracting actions.

3.4.7. CPARS Administration. The CO is responsible for reviewing and providing inputs/recommendations, if warranted, to the COR responsible for writing the initial draft of the CPAR

3.5. CONTRACT ADMINISTRATOR (CA)/CONTRACT SPECIALIST

3.5.1. Performs acquisition processes; i.e., market research, gathering of past performance, source selection, solicitation, evaluation, and award.

3.5.2. Assesses the necessity of recompetition even though there may be remaining options.

3.5.3. Coordinates all contract actions decided by the CO and COR management or COR.

3.5.4. Assists coordination between COR management, COR, and QAPC on all COR and COR management training requirements and PWS/QASP development.

3.5.5. Provides finalized QASP to the QAPC.

3.5.6. Maintains contract file and ensures all required documentation is in the file and current.

3.5.7. CAs review first draft of CPAR prior to submission to assessing official and provide input/comments/advice to the COR/initial drafter of the CPAR.

3.6. CONTRACTING OFFICER’S REPRESENTATIVE (COR)—Previously called QAP, QAE, COTR, and QAS personnel

3.6.1. Assists COR management in preparing the PWS. Generally, the COR is the primary author/coordinator for development of the PWS.

3.6.2. Is the primary author of and coordinator for the development of the QASP unless COR management dictates otherwise.

3.6.3. Shall be familiar with contract terms and conditions.

3.6.4. Will request additional training, if needed, from the CO.

3.6.5. Monitors, assesses, and documents the contractor’s performance in accordance with this QASP. COR will document acceptable and unacceptable performance.

3.6.6. Shall maintain a surveillance folder/binder containing a copy of this QASP, along with all surveillance reports, contract documents, and correspondence.

3.6.7. Notifies the CO of any significant performance deficiencies.

3.6.8. Provides any recommendations to improve the QASP or PWS.

3.6.9. Submits monthly surveillance reports/documentation to the CA for review on a monthly basis (Attachment 3). If service is performed less frequently, reports will be submitted on a quarterly basis at the CO’s discretion.

3.6.10. Shall perform/assist in gathering market research, gathering past performance, and evaluating proposals, taking into consideration quality assurance/control issues/perspectives throughout the life cycle of the acquisition.

3.6.11. If the COR is also the technical specialist from the functional area, he/she will assist in gathering market research relative to the technical aspects of the requirement and will evaluate trade-offs.

3.6.12. Ensures the contractor complies with the requirements of FAR Clause 52.222-50(c), (d), and (f) regarding Combating Trafficking in Persons.

3.6.13. Responsible for accomplishing the first draft of the CPAR for this contract. The assessment will be based on objective data or measurable subjective data, per the DoD

CPARS Guide. Local Policy is established – coordination will be given through milestones by the Tyndall AFB CPARS Focal Point (QAPC).

3.7. TECHNICAL SPECIALIST/FUNCTIONAL EXPERT

3.7.1. Assists in gathering market research relative to the technical aspects of the requirement throughout the acquisition life cycle.

3.7.2. Evaluates past performance, price, and technical trade-offs throughout the acquisition life cycle.

3.8. CONTRACTOR

3.8.1. Shall control the quality of services and/or supplies. The contractor is responsible for performing or having performed all inspections and tests necessary to substantiate that the services furnished under this contract conform to contract requirements.

3.8.2. Shall tender to the Government for acceptance only those services or supplies that conform to contract requirements.

3.8.3. Shall establish a quality control plan (QCP). The contractor shall maintain their own internal commercial quality control program/procedures identifying all aspects of work. The plan shall sufficiently identify procedures to prevent recurrence of defective services and ensure the Government receives quality services in performance of this PWS. Should there be instances of repeated unsatisfactory performance, supporting documentation may be requested by the Government for review (for example DD Form 1753, Master Station Log). Complete records of all inspection work performed by the contractor shall be maintained and made available to the Government during contract performance and for as long afterwards as the contract requires. Contractor shall provide an electronic and hard copy of the QCP to the CO, COR, and COR management for review and acceptance. Any revision to the QCP shall also be submitted to the CO, COR, and COR management.

3.9. OTHER EXPERTS/ADVISORS (as required) to provide advice and guidance; i.e., Small Business Specialist, Legal, Finance, Security Forces, Safety, etc.

4.0. GOVERNMENT QUALITY ASSURANCE APPROACH, METHODS, AND TOOLS

TO ASSESS CONTRACTOR PERFORMANCE

4.1. PURPOSE. This section of the QASP will be used as a guide to the Government’s COR and COR management. It provides a systematic method to evaluate the services the contractor is required to furnish. The surveillance/evaluation methods identified in this QASP, in concert with the contractor’s quality control procedures, will assure the Government of acceptable contractor performance.

4.1.1. The QASP is intended to be a “living document.” That is, it should be revised or modified as circumstances warrant throughout the contract period. Following contract award, this document should be reviewed by the COR to ensure that it will work cooperatively with the Contractor’s QCP, but not duplicate its provisions.

4.1.2. The contractor, and not the Government, is responsible for management and quality control actions to meet the terms of the contract. The role of the Government is quality assurance to ensure contract standards are achieved.

4.1.3. Revisions to the Quality Assurance Surveillance Plan: Revisions to this plan are the responsibility of the functional area and must be coordinated through the CO and the QAPC.

4.2. SURVEILLANCE PROCEDURES

4.2.1. Performing Surveillance. Actual surveillance must be done as stated in this QASP.

Surveillance includes scheduling, observing, documenting, and resolving performance issues discovered through surveillance.

4.2.2. Scheduling Surveillance. The COR is responsible for developing a monthly schedule of surveillance activities based on the QASP’s requirements. The schedule should be completed no later than 7 calendar days before the beginning of the period it covers. The COR must give one copy of the schedule to the CA before start of the surveillance period.

Computer-generated or locally devised forms may be used. Note: scheduling of surveillance does not apply to customer complaint or customer survey surveillance.

4.2.3. Observing Contractor Performance. The COR must inspect task performance by watching actual task performance, physically checking an attribute of the completed task, checking a management information report, or otherwise inspecting the task or its results to determine whether or not the performance meets the standards contained in the contract.

4.2.4. Documenting Surveillance

4.2.4.1. Documentation is required to record, evaluate, and report contractor’s performance.

This documentation provides the CO and CA with contractor status as it applies to the performance criteria. Every effort should be made to make this report to the CO and CA as accurate as possible. The COR is required to maintain accurate records of the contractor’s performance and keep COR management informed of all data pertaining to contractor status. Documenting surveillance is of major importance to the total process of surveillance.

The CO and CA cannot properly administer the contract without documentation of actual surveillance.

4.2.4.2. All documentation resulting from surveillance must be made part of the contract file. The COR must keep the documentation files during the surveillance period, but either monthly or at the conclusion of the contract, as directed by the CO, the COR must give the files to the CO for inclusion in the official contract file.

4.3. QUALITY ASSURANCE (QA) FILE. A QA file must be developed and maintained by the COR assigned to accomplish QA for a performance requirement. The folder is typically contained in a hardcopy, but may be maintained in a computer database provided there is adequate back up of the data to preclude accidental loss. The folder must contain as a minimum, the following documents and be set up using the QA File Index (Attachment 1).

4.3.1. Quality Assurance Surveillance Plan. Maintain a copy of the QASP.

4.3.2. Appointments. Request for COR letter, COR nomination netters, and CO’s designation of COR letter to the COR acknowledged by the COR and contractor. Training certificates are also included here.

4.3.3. Contract Documents. The contract with all modifications, directive documents references, pertinent terms defined by the contract, equipment listings, and PWS.

4.3.4. Meeting Minutes

4.3.4.1. Multi-Functional Team Meeting Minutes. Minutes are the responsibility of the CA. Minutes shall be provided (email) to all team members, to include members that did not attend the meeting. The COR shall maintain a copy of the minutes in the QA folder.

4.3.4.2. Monthly or Periodic Performance Meeting Minutes. The COR, contractor (or representative), CA, and CO (when warranted) will meet monthly or periodically as necessary to discuss contract performance, resolve issues, discuss customer complaints, and provide positive interaction and feedback to all parties. Minutes are the responsibility of the CA. The CA must provide a copy of the minutes to the COR to be maintained in the QA folder. (A meeting should occur at least annually to adequately justify performance assessment ratings and exercise option years; mid-point is recommended for feedback and opportunity for corrections if necessary.)

4.3.5. Surveillance Documentation. All surveillance documentation—acceptable and unacceptable—is to be maintained in this section. Types of surveillance documentation may include periodic surveillance reports (local format Attachment 2 or Performance Assessment Report (PAR), Corrective Action Reports (CARs), Customer Complaint Records (CCR)(both active and resolved), monthly surveillance summaries, and trend analysis, etc. In addition, all paperwork/memos for record (MFRs) that support the documented surveillance should be kept in this section as well. The types of information that may be included are details of inspections or data gathering, conversations or meetings with the contractor, notes and comments that support the inspection paperwork, MFRs of phone conversations, email messages, etc. For unacceptable contractor performance, this section may have COs inputs/determinations, cure notices, and show-cause letters and any other documentation that revolve around contractor performance exceeding performance thresholds (not meeting the minimum acceptable quality level or thresholds in the SS).

4.3.6. Past Performance Assessment Reports. Semi-annual Past Performance Assessment Reports (PPARs) shall be filed in this section.

4.3.7. Customer Complaint Instructions. File your customer complaint training materials in this section. See paragraph 4.4.2.2 below.

4.3.8. Final Acceptance and Funding Issues. If not using the Wide Area Work Flow- Receipt and Acceptance method of accepting/certifying services rendered, keep a copy of the DD 250s or letter of acceptance for each month here. This is also the place to keep paperwork for future changes to the contract; i.e., addendums, Form 9s, options, etc. that must be worked during the life of the contract.

4.4. SURVEILLANCE METHODS

4.4.1. Periodic Surveillance. CORs are to be objective, fair, and consistent in evaluating contractor personnel. Periodic surveillance shall be conducted on an as-occurs basis.

4.4.1.1. The COR will review documentation and/or observe accomplishment of performance objectives to ensure the minimum performance threshold(s) has (have) been met.

4.4.1.2. The COR must document each surveillance as it is conducted. This is an important component of the Air Force record of the contractor’s performance. All performance must be documented, whether it is acceptable or unacceptable. The COR shall use the COR Inspection Lists at Attachment 8.

4.4.2. Customer Complaint

4.4.2.1. The COR is the customer point of contact and must collect all customer complaints.

4.4.2.2. The COR must furnish written instructions and customer training to each organization (or person) receiving the contractor’s service. Instructions and training should cover the format and content of the customer complaint program and the service to be surveilled; the action that may be expected from the COR, CA, and CO as a result of the complaints; and the limitations on the customers in dealing with contractor personnel.

4.4.2.3. All complaints and any resulting resolution of such complaints must be documented and become a permanent part of the QA surveillance records.

4.4.2.4. A customer complaint is a valid complaint when the COR, after a thorough investigation, determines the complaint’s validity.

4.5. CAPTURING SURVEILLANCE INFORMATION TO ASSIST IN MEETING PAST

PERFORMANCE INFORMATION REQUIREMENTS

4.5.1. Past Performance Assessment Report (PPAR). At the midpoint of each period of performance (POP), the COR is required to complete a narrative summary of contractor past performance for the first half of the POP. The data will be used by the CPARS assessing official to complete the evaluation and narrative blocks of the CPARS report. The COR will forward the narrative to the CO addressing all of following assessment elements:

4.5.1.1. Quality of Service. Assess the contractor’s conformance to contract requirements, specifications, and standards of good workmanship (e. g., commonly accepted technical, professional, environmental, or safety health standards).

4.5.1.2. Schedule. Assess the timeliness of the contractor against the completion of the contract, task orders, milestones, delivery schedule, and administrative requirements (e. g., efforts that contribute to or effect the schedule variance).

4.5.1.3. Business Relations. Assess the integration and coordination of all activity needed to execute the contract, specifically the timeliness, completeness, and quality of problem identification; corrective action plans; proposal submittals; the contractor’s history of reasonable and cooperative behavior; customer satisfaction, timely award and management of subcontracts; and whether the contractor met small/small disadvantaged and woman owned business participation goals.

4.5.1.4. Management of Key Personnel. Assess the contractor’s performance in selecting, retaining, supporting, and replacing, when necessary, key personnel.

4.5.2. Performance Ratings. The ratings used for the PPAR are described by one of the following five adjectives: Exceptional, Very Good, Satisfactory, Marginal, and Unsatisfactory. These terms are subjective and are not derived through use of any mathematical computations or formulas. The COR will rate each one of the assessment elements explained in the paragraphs above, using one of the following ratings in their narrative summary. The criteria for each rating are reflected below:

4.5.2.1. Exceptional. Performance meets contractual requirements and exceeds many to the Government’s benefit. The contractual performance of the element or sub-element being assessed was accomplished with few minor problems for which corrective actions taken by the contractor were highly effective.

4.5.2.2. Very Good. Performance meets contractual requirements and exceeds some to the Government’s benefit. The contractual performance of the element or sub-element being assessed was accomplished with some minor problems for which corrective actions taken by the contractor were highly effective.

4.5.2.3. Satisfactory. Performance meets contractual requirements. The contractual performance of the element or sub-element contains some minor problems for which corrective actions taken by the contractor appear or were satisfactory.

4.5.2.4. Marginal. Performance does not meet some contractual requirements. The contractual performance of the element or sub-element being assessed reflects a serious problem for which the contractor has not yet identified corrective actions. The contractor’s proposed actions appear only marginally effective or were not fully implemented.

4.5.2.5. Unsatisfactory. Performance does not meet most contractual requirements and recovery is not likely in a timely manner. The contractual performance of the element or sub-element contains serious problem(s) for which the contractor’s corrective actions appear or were ineffective.

4.6. PAST PERFORMANCE INFORMATION: Past performance will be based on data collected from periodic surveillance and customer complaints gathered throughout the year. All data will be maintained in the COR’s contract folder.

4.7. SERVICES SUMMARY

SS Item Number

Performance Objective

PWS

Paragraph

Performance Threshold

Method of Surveillance

SS #1 Administration Para 1.1. 90% Periodic Surveillance

SS #2 Target Systems Retrieval

Para 1.2. 100% Periodic Surveillance Customer Complaint

SS #3 Target Systems Retrieval Dive Capability

Para 1.2.5. 100% 100% Inspection Conducted as Occurs

SS #4 Launch Corridor Clearance

Para 1.3. 100% Periodic Surveillance Customer Complaint

SS #5 Radio Operations Para 1.4. 100% Periodic Surveillance

SS #6 Watercraft Vessel Operating Systems (Missile Retrievers)

Para 1.5.4.1. 95% Periodic Surveillance

SS #7 Watercraft Vessel Operating Systems (USAF Range Patrol Boats)

Para 1.5.4.2. 95% Periodic Surveillance

SS # 8 SFS Boat Maintenance

Para 1.5.4.4 95% Periodic Surveillance

SS #9 Shipyard Level Maintenance

Para 1.6.1.

and 1.6.2.

95% Periodic Surveillance

SS #10 Grounds/Facility Maintenance

Para 1.7. 90% Periodic Surveillance

SS #11 Supply Para 1.8. 90% Periodic Surveillance

SS #12 Special Situations Para 1.9. 100% 100% Inspection Conducted as Occurs

SS #13 Quality Control Para 2.1. 100% Periodic Surveillance

SS # 14 Fuels Para 3.5.7 95% Periodic Surveillance

4.8. PROCEDURES FOR SURVEILLANCE OF NON-SS ITEMS

4.8.1. All NON-SS items—that is, any provision/requirement stipulated in the PWS, but not included in the Service Summary—may be evaluated as necessary by the COR to ensure contractor is in compliance with the PWS. Customer complaints and periodic surveillance are the usual forms of surveillance for non-SS items. The use of sound judgment is necessary when evaluating non-SS items. These items were not included in the SS for a reason. Use objective and subjective reasoning when evaluating non-SS items.

4.9. UNACCEPTABLE PERFORMANCE/REPERFORMANCE PROCEDURES

4.9.1. The COR will document all findings using a CCR form, Periodic Surveillance Report, or when necessary a CAR initiated by the COR or letter of concern initiated by the CO. The COR shall verbally notify the Contractor’s site manager and/or the quality control inspector (QCI) of the finding and provide a copy of the finding. The site manager and/or QCI shall respond with the following information: contractor response as to cause, corrective action, and actions to prevent recurrence. The COR will ensure the response is completed in its entirety, coordinated through the CO, with a copy retained in the official contract file. This information will be included when assessing the contractor’s overall performance (i.e., option exercise, CPARS, past performance questionnaires, etc.).

4.9.2. Deficiencies shall not exceed the performance thresholds cited in the SS for each performance objective.

“If any of the services do not conform to contract requirements, the Government may require the contractor to perform the services again in conformity with contract requirements, at no increase in contract amount. When the defects in services cannot be corrected by re-performance, the Government may –

(1) Require the contractor to take necessary action to ensure that future performance conforms to contract requirements; and

(2) Reduce the contract price to reflect the reduced value of the services performed.”

4.10. ACCEPTANCE/CERTIFICATION OF SERVICES

4.10.1. Invoices and receiving reports shall be submitted electronically in accordance with DFARS 232.7003 as authorized by FAR 52.212-4(g).

4.10.2. Services (including data deliverables) shall be accepted and certified via the Wide Area Work Flow-Receipt and Acceptance website at https://wawf.eb.mil.

4.10.2.1. The contractor will electronically initiate the 2 in 1 invoice and electronically submit it to the COR.

4.10.2.2. The COR electronically submits the form to DFAS for payment.

5.0. PERFORMANCE MANAGEMENT

5.1. MARKET RESEARCH. Market research continues throughout the life cycle of the contract. Through market research, the MFT will further develop a comprehensive understanding of the marketplace and identify best practices (researching the marketplace to remain current with most efficient and effective assessment methods and techniques; performing market research throughout the life of the contract to ensure the team is knowledgeable of the commercial marketplace, etc.)

5.2. PERFORMANCE IMPROVEMENT MEASURES. Monthly or periodic performance meetings as necessary. The COR, contractor (or representative), CA, and CO (when warranted) will meet monthly or periodically as necessary to discuss contract performance, resolve issues, discuss customer complaints, and provide positive interaction and feedback to all parties. The COR will provide a list of any unresolved deficiencies to the contractor's quality assurance representative to afford him/her the opportunity to show where the problem is already in the process of being worked. If evidence is shown where the contractor’s quality program has already documented the deficiency and timely corrective action is working the problem, the COR will follow up with the contractor’s quality control representative to ensure the deficiencies are remedied in a timely manner in accordance with the PWS. All deficiencies associated with performance requirements listed on the SS, whether remedied by the contractor or not, will be included in the COR’s monthly report regardless of who identified the deficiency. One of the primary goals of these meetings is to foster good communication, trust, and teamwork to resolve issues before they become significant challenges. The COR will provide a copy of the meeting minutes to all attendees within 5 workdays of the meeting. This meeting MUST occur at least annually; recommended at the mid-point of the contract’s period of performance.

5.3. RELATIONSHIP BUILDING. In the performance-based management process, https://rmb.ogden.disa.mil/ performance improvement becomes a joint responsibility between the Government stakeholders and the contractor. This assures input from both sides and increases involvement in the process, ownership results, and accountability for performance. To help cement this joint responsibility, and further performance improvement, multi-functional team meetings will be held at a minimum of once every 6 months.

5.4. DISPUTE RESOLUTION. The Government’s policy is to try and resolve all contractual issues in controversy at the CO’s level. Reasonable efforts should be made to resolve controversies prior to the submission of a claim. Agencies are encouraged to use Alternate Dispute Resolution (ADR) to the maximum extent practicable. See Federal Acquisition Regulation (FAR) parts 33.204 Policy through 33.214 Alternate Dispute Resolution (ADR).

6.0. ATTACHMENTS: 5

1. Quality Assurance (QA) File Index

2. Periodic Surveillance Report

3. COR Surveillance Assessment Report

4. COR Mid-Term Past Performance Assessment Report (PPAR)

5. COR Inspection Checklists

Attachment 1 QA File Index

Tab 1 Quality Assurance Surveillance Plan, signed by all MFT members

Tab 2 COR and COR Management Documentation

A. Request for COR Letters (from CO) B. Nomination of COR Letters (from Unit) C. COR’s QAPC-led COR Training Certificates D. COR’s CO-led Contract-specific Training Certificates E. Designation of COR Letters (from CO) to COR, with COR Acknowledgement and Contractor Acknowledgement F. COR DAU Training Certificates G. COR Refresher Training Certificates H. COR Management (Supervisor/Functional) Notification Letter (if required) I. COR Management Training Certificates

Tab 3 Contract Documents

A. Contract with all Modifications

B. PWS

C. Contractor’s Quality Control Plan, accepted by the CO

Tab 4 Meeting Minutes Documentation

A. Minutes of Multi-Functional Team Meetings B. Minutes of Monthly or Periodic Performance (Progress) Meetings

Tab 5 Surveillance Documentation (acceptable and unacceptable)

A. Periodic Surveillance Reports, Customer Complaints, 100% Inspection, etc.

B. Corrective Action Reports, Letters of Concern, and all supporting documentation C. Cure Notice/Show Cause Letters and all supporting documentation

Tab 6 Past Performance Assessment Report (CPARS applicable)

Tab 7 Customer Complaint Instructions

Tab 8 Final Acceptance and Funding Issues

A. DD 250, Monthly Receiving Reports (N/A if using WAWF process) B. AF Form 9, Funding Requests C. Expenditure Log

Attachment 2

Periodic Surveillance Report

Date/Time of Surveillance: ___________________________

COR: _________________________________________

Contractor: __________________________________ Contract Number ________________

SS Item(s)/PWS Paragraph(s) Surveilled: __________________________________________

Summary of Observations:

Actions taken to remedy discrepancies (if any noted):

Other comments (i.e. trends, positive points, etc.):

Attachment 3

(EXAMPLE)

COR Surveillance Assessment Report

Surveillance Period Covered: ____________________

COR: _______________________________

Contractor: __________________________ Contract Number: ___________________

________ The contractor has met all the requirements of the contract.

________ The contractor has not met all the requirements of the contract. These are summarized in this report and are supported by the COR periodic surveillance checklists and/or reports and customer complaints attached to this report.

Overview of Performance: (describe your overall perspective of the contractor’s performance.

Tell what the contractor did or failed to do. Let the CA / QAPC Know if they are acceptable or not acceptable. Describe what you’re doing to resolve unsatisfactory conditions if you stated unacceptable performance.)

Corrective Action Requests (if any noted): (Describe any contract nonconformities (verbal/written CARs issued), proposed corrective action, any help needed from the QAPC, Contracting Officer, etc.)

Areas of Concern: (List any items that you’re having difficulties with, any potential problems, concerns about the evaluation process, etc. Let the CA/ QAPC know that you need assistance.

Don’t wait until it’s too late and the auditors /IG visit you.)

Other comments (i.e. trends, positive points, change of personnel, etc.):

Cc: COR Management / Contracting Officer ____COR Signature_____

Attachment 4

COR Mid-Term Past Performance Assessment Report

Mid-Term Report Covers _________________thru ____________________.

COR: ________________________________________________________

Contractor: ____________________________________________________

Contract Number: _______________________________________________

I am forwarding this report to the CPARS Assessing Official to summarize the contractor’s past performance over the first half of the period of performance being evaluated on the Contractor Performance Assessment Report (CPAR). This period of performance covers the performance from _______ through _________. I have reviewed the past six months of reports from the past performance meetings to arrive at the following comments for the four assessment elements that will be included in the Annual Contractor Performance Assessment Report (CPAR).

(1) Quality of Service. (Rating: ________) Assess the contractor’s conformance to contract requirements, specifications and standards of good workmanship (e.g., commonly accepted technical, professional, environmental, safety, or health standards).

(2) Schedule. (Rating: ________) Assess the timeliness of the contractor against the completion of the contract, task orders, milestones, delivery schedule, and administrative requirements (e.g., efforts that contribute to or effect the schedule variance).

(3) Business Relations. (Ratings: ________) Assess the integration and coordination of all activity needed to execute the contract, specifically the timeliness, completeness and quality of problem identification, corrective action plans, proposal submittals, the contractor’s history of reasonable and cooperative behavior, and customer satisfaction.

(4) Management of Key Personnel. (Rating: ________) Assess the contractor’s performance in selecting, retaining, supporting and replacing, when necessary, key personnel.

Attachment 5 COR Inspection Checklists

INSPECTION # 1 - ADMINISTRATION

1. Periodic inspection # 1 shall be utilized to inspect contractor Administration.

2. Periodic inspections shall be conducted at a minimum of two times per month.

3. The SS performance threshold is 90%.

4. The periodic inspection checklist covers 100% of the established criteria found in section 1.1 of the watercraft operations and maintenance PWS.

5. Performance is unacceptable if any of the criteria in section 1.1 are determined to be defective during periodic inspections.

6. Periodic inspection schedule shall be compiled by COR using periodic dates and times and selected by means other than a statistically random basis.

OPERATIONS AND MAINTENANCE OF WATERCRAFT OPERATION

QUALITY ASSURANCE SURVEILLANCE PLAN

Periodic Inspection # 1 Section 1.1

DATE TIME

TASK: Administration Minimum surveillance: Two times per month

Performance Threshold:

90%

SUB TASK: Administration SAT UNSAT 1 1.1. Does the contractor support administrative functions which are relative to the facility and mission of the watercraft operations (AF Form 332)?

2 1.1. Does the contractor support the forms management program?

3 1.1. Does the contractor support the publications management program?

4 1.1. Does the contractor support Government distribution and correspondence requirements?

5 1.1. Does the contractor provide :

5(a) - Weekly statistical mission reports?

5(b) - Monthly statistical mission reports?

5(c) - Quarterly statistical mission reports?

5(d) - Semi-Annual statistical mission reports?

REMARKS:

INSPECTOR'S SIGNATURE

CONTRACTOR'S SIGNATURE

INSPECTION # 2 - TARGET SYSTEMS RETRIEVAL

1. Periodic inspection # 2, along with customer complaints, shall be utilized to inspect Target

Systems Retrievals. Customer complaints shall be investigated by the COR and forwarded to the CO when warranted.

2. Periodic surveillance inspections shall be conducted at a minimum of four times per month.

3. The SS performance threshold is 100%.

4. The periodic inspection checklist covers 100% of the established criteria found in section 1.2 of the watercraft operations and maintenance work statement.

5. Performance is unacceptable if any of the criteria in section 1.2 are determined to be defective during periodic inspections.

6. A periodic inspection schedule shall be compiled by COR using periodic dates and times and

OPERATIONS AND MAINTENANCE OF THE WATERCRAFT OPERATIONS

PERIODIC INSPECTION # 2

Section 1.2

DATE TIME

TASK: Target System Retrieval Minimum surveillance: Four missions per month

Performance Threshold:

100%

SUB TASK: TARGET SYSTEM RETRIEVAL SAT UNSAT

1 1.2. Does the contractor recover targets and related equipment IAW established

MOI #4?

2 1.2. Does the contractor follow established marine operating instructions to prevent contractor damage to targets?

3 1.2. Are recovery boats at predetermined recovery position(s)?

4 1.2. Are weather reports and recovery capabilities reported upon entering the Gulf?

5 1.2. Does the contractor notify drone control of surface vessels endangering launch and recovery capability? (WEGI 11-250 pg 37, para 3.16.5)

6 1.2. Does the contractor give an estimated time of arrival (ETA) for recovery positions and docks?

7 1.2. Are targets off loaded properly?

8 1.2. Are parachutes properly retrieved and off-loaded?

9 1.2. Are parachutes immersed in fresh water when not immediately picked up at dock?

10 1.2. Is the target system contractor notified for equipment removal?

11 1.2. Does contractor follow base lighting lamp rules during target off loads at the docking area?

12 1.2. Does the contractor use Government-furnished photo equipment to take snap shots of all subscale launches during launch windows?

13 1.2. Does the contractor provide adequate crew members to support missions which require three missile retrievers when provided with a 24 hour notice?

14 1.2. Does the third missile retriever crew support target missions when directed by the 82d ATRS?

INSPECTION # 3 - DIVE OPERATIONS

1. 100% inspection # 3 shall be utilized to inspect Dive Operations.

2. 100% inspection shall be conducted on an “as occurs” basis.

3. The SS performance threshold is 100%.

4. 100% inspection checklist covers 100% of the established criteria found in section 1.2.5 of the watercraft operations and maintenance PWS.

5. Performance is unacceptable if any of the criteria in section 1.2.5 are determined to be defective during 100% inspection.

OPERATION AND MAINTENANCE OF THE WATERCRAFT OPERATIONS

PERIODIC INSPECTION # 3

Section 1.2.5

TASK: DIVE OPERATIONS

Minimum surveillance: As Occurs

Performance Threshold:

100%

SUB TASK: DIVE OPERATIONS SAT UNSAT

1 1.2.5. Have all dive operations been performed according to applicable Occupational

Safety and Health Administration Standards? (CFR Title 29, Part 1910, Subpart T, Commercial Diving Operations)

2 1.2.5. Are divers available to recover targets up to 20 timers per year?

3 1.2.5. Do contractor divers perform underwater maintenance on vessels?

4 1.2.5. Do contractor divers perform recovery of drone targets floating and submerged?

5 1.2.5. Does the contractor ensure normal SCUBA diving support is adequate to support all dive taskings to prevent delays in mission completion?

6 1.2.5. Does the contractor provide snorkel operations when SCUBA is not required?

INSPECTOR’S SIGNATURE

CONTRACTOR’S SIGNATURE

INSPECTION # 4 - LAUNCH CORRIDOR CLEARANCE

1. Periodic inspection # 4, along with customer complaints, shall be utilized to inspect Launch

Corridor Clearance. Customer complaints shall be investigated by the COR and forwarded to the CO when warranted.

2. Periodic surveillance inspections shall be conducted at a minimum of four times per month.

3. The SS performance threshold is 100%.

4. The periodic inspection checklist covers 100% of the established criteria found in section 1.3 of the watercraft operations and maintenance PWS.

5. Performance is unacceptable if any of the criteria in section 1.3 are determined to be defective during periodic inspections.

PERIODIC INSPECTION # 4

Section 1.3

TASK: Launch Corridor Clearance Minimum Surveillance: Four missions per month

Performance Threshold:

100%

SUB TASK: Launch Corridor Clearance SAT UNSAT 1 1.3. Does the contractor keep the restricted launch corridor cleared for subscale and unmanned full-scale target launches?

2 1.3. Does the contractor ensure subscale/full scale targets are not delayed or canceled due to non-clearance?

3 1.3. Does the contractor utilize appropriate vessels to clear launch corridor area?

4 1.3. Does the contractor distribute safety fliers to vessels and persons contacted prior to target launch and recovery periods?

5 1.3. Is the contractor prepared to make an advisory “CHUTE, CHUTE, CHUTE” call in the event an anomaly occurs during a subscale drone launch that merits immediate recovery?

6 1.3. Does the contractor provide a boat and adequate crew members capable of performing corridor clearance duties during subscale/full scale target operations around Crooked Island Sound when provided notification by the 82 ATRS on the Friday prior to the operational week?

7 1.3. Does the contractor’s fuel tank gauge register full before the boat leaves for the day’s mission?

8 1.3. Does the contractor refuel his boat after completion of the day’s mission?

9 1.3. Does the contractor abide by usage and storage of his supplied range patrol boat when not being utilized by the 82 ATRS?

10 1.3. Does the contractor support FPCON requests?

11 1.3. Does the contractor provide a third MR to support up to 15 special missions per year?

INSPECTOR’S SIGNATURE CONTRACTOR’S SIGNATURE

INSPECTION # 5 - RADIO OPERATIONS

1. Periodic inspection # 4 shall be utilized to inspect Radio Operations.

2. Surveillance inspections shall be conducted at a minimum of two missions per week.

3. The SS performance threshold is 100%.

4. The periodic inspection checklist covers 100% of the established criteria found in section 1.4 of the watercraft operations and maintenance PWS.

5. Performance is unacceptable if any of the criteria in section 1.4 are determined to be defective during periodic inspections.

scheduled by means other than a statistically random basis.

PERIODIC INSPECTION # 5

Section 1.4

TASK: Radio Operations Minimum Surveillance: Two missions per week

Performance Threshold:

100%

SUB TASK: Radio Operations SAT UNSAT 1 1.4. Does the contractor operate the on-shore communications center?

2 1.4. Does the contractor conduct operational checks with all mission vessels on VHF, UHF, and satellite phones?

3 1.4. Does the contractor initiate and maintain a complete radio log (DD Form 1753) during mission periods?

4 1.4. Does the contractor maintain hourly communications with Air Force boats while underway?

5 1.4. Does the contractor initiate warning broadcast on VHF Channel 16 at 90, 60, 30, 15, 10, and 5 minutes prior to each sub- and full-scale launch?

6 1.. Does the contractor make warning broadcast on VHF Channel 16 at 1600 hours for the next duty day’s mission?

7 1.4. Does the contractor relay mission information to other on-base units?

8 1.4. Does the contractor operate the shore station during FSAT/SSAT, Special

Mission, and maintenance periods when a vessel is away from harbor and keep in communications by either land line or satellite phone?

INSPECTION # 6 - WATERCRAFT VESSEL OPERATING SYSTEMS MR

MAINTENANCE

1. Periodic inspection # 6 shall be utilized to inspect Watercraft Vessel Operating Systems.

2. Surveillance inspections shall be conducted at a minimum of four times per week IAW PWS para 1.5.4.1 and 1.5.4.1.1.

3. The SS performance threshold is 95%.

4. The periodic inspection checklist covers 100% of the established criteria found in section 1.5 of the watercraft operations and maintenance performance work statement.

5. Performance is unacceptable if 5% of criteria in section 1.5 are determined to be defective during periodic inspections.

PERIODIC INSPECTION # 6

Section 1.5.4.

TASK: Watercraft Vessel Operating Systems (Missile Retriever Maintenance) Minimum Surveillance: Four times per week

Performance Threshold:

95%

SUB TASK: Watercraft Maintenance SAT UNSAT 1 1.5.4. Does the contractor maintain engine and generator room diesel engines, fuel systems, air systems, lubricating systems, cooling systems, exhaust systems, electrical systems, and diesel engines tune-ups?

2 1.5. 4. Is the contractor cleaning, maintaining, inspecting, troubleshooting, adjusting, removing, repairing, and replacing assemblies (main engines, generators, reverse gears) and associated components?

3 1.5. 4. Does the contractor exercise warranty repair/replacement items 4 1.5. 4. Does the contractor maintain the following systems:

4a - Power take offs (PTO) 4b - Throttle controls 4c - Air compressors 4d - Emergency alarms/stops 4e - Bilge/fire pumps 4f - Main engine shaft coupling and stuffing boxes 4g - Anode protection system 4h - Steering system 4i - Crane and hydraulic system 4j - Air condition/heating systems 4k - Minor repairs to reverse gears

5 1.5.4. Does the contractor maintain interior and exterior watercraft surfaces: decks, super structures, hull, bulkheads, bilges, staterooms, voids, heads, cradles, and rails?

6 1.5.4. Does the contractor provide the necessary preventive measures in keeping paint residue from entering bay waters during vessel painting?

7 1.5.4. Does the contractor aid companies during warranty period work?

8 1.5.1. Does the contractor maintain dive support boats, work raft, and dive boat outboard engines?

9 1.5.4. Does the contractor keep engine RPM setting properly adjusted?

10 1.5.4. Is the contractor maintaining watercraft IAW applicable AF instructions, technical orders, and service manuals related to Government assigned vessels?

11 1.5.4. Does the contractor provide level-of-experience documentation on individual(s) performing diesel repairs?

12 1.5.4. Have maintenance and operational checkouts for watercraft operating systems been performed in a timely manner?

13 1.5.4. Does the contractor send time-lapsed equipment to proper maintenance facilities?

14 1.5.4. Does the contractor monitor and document vessel instrumentation readings?

15 1.5.4. Does the contractor participate in the JOAP program (oil analysis)?

INSPECTOR’S SIGNATURE

CONTRACTOR’S SIGNATURE

INSPECTION # 7 - RANGE PATROL BOAT MAINTENANCE

1. Periodic inspection # 7 shall be utilized to inspect range patrol boat maintenance.

2. Periodic inspections shall be conducted at a minimum of two times per month.

3. The SS performance threshold is 95%.

4. The periodic inspection checklist covers 100% of the established criteria found in section

1.5.4.2 of the watercraft operations and maintenance PWS.

5. Performance is unacceptable if 5% of the criteria in section 1.4 are determined to be defective during periodic inspections.

PERIODIC INSPECTION # 7

Section 1.5.4.2

Task: Watercraft Vessel Operating Systems (Corridor Boat Maintenance) Minimum Surveillance: Two times per month

Performance Threshold:

95%

SUB TASK: RANGE PATROL BOAT MAINTENANCE SAT UNSAT

1 1.5.4.2. Are range patrol boats being kept clean and washed down after each mission?

2 1.5.4.2. Does the contractor remove/install outboard engines and outboard components aboard range patrol boats?

3 1.5.4.2. Are range patrol boat-related main engine parts in stock?

4 1.5.4.2. Are range patrol boat trailers being properly maintained?

5 1.5.4.2. Are range patrol boats being hauled monthly for cleaning and upkeep?

1.5.4.2. Are range patrol boats bottom anti-fouling paint systems being renewed every 18 months or as needed?

INSPECTION # 8 - SHIPYARD-LEVEL MAINTENANCE

1. Periodic inspection # 8 shall be utilized to inspect…