RFP_FA8052-15-R-0012_Atch_3.pdf

QASP

SG5 PROJECT MANAGEMENT SUPPORT

U.S. AIR FORCE MEDICAL SUPPORT AGENCY

RESEARCH AND ACQUISITION DIRECTORATE

(AFMSA/SG5)

18 May 2015

QUALITY ASSURANCE SURVEILLANCE PLAN (QASP) For

SG5 PROJECT MANAGEMENT SUPPORT

TABLE OF CONTENTS:

1.0 Mission 3

2.0 Purpose 3

3.0 Authority 4

4.0 Roles and Responsibilities 4

5.0 Contractor’s Quality Control Plan (QCP) 6

6.0 Performance Requirements and Method(s) of Surveillance 6

7.0 Surveillance Documentation 7

8.0 Acceptance of Services 9

9.0 Contract Management 9

10.0 Coordination and Approval 10

Appendices:

1. Services Summary (SS) and Method of Surveillance 12

2. Corrective Action Report (CAR) 18

3. Customer Complaint Record 20

4. Performance Assessment Report (PAR) 21

5. COR Services Summary Monthly Surveillance Report 23

5a. Performance Ratings used for COR Services Summary Surveillance Report 30

6. COR File Table of Contents 31

Quality Assurance Surveillance Plan (QASP)

1.0 Mission

AFMSA/ Office of the Surgeon General for Research and Acquisitions (SG5) has the responsibility for research and acquisitions within the Air Force Medical Service (AFMS).

AFMSA/SG5 manages and directs research portfolios comprised of applied research and development programs and pursues research and technology solutions to address identified capability gaps or needs. AFMSA/SG5 transforms medical capabilities by leveraging academia, industry and internal Air Force (AF) research to address critical short-term, mid-term and long-term challenges in support of the AF and Joint Warfighter.

2.0 Purpose

This Quality Assurance Surveillance Plan (QASP) is a government-developed document used to determine if the contractor’s performance meets the performance standards outlined in the contract. The QASP establishes procedures on how to conduct surveillance/inspection process to ensure successful PWS performance. It provides a systematic method for continuous oversight process to determine conformity with the technical requirements of the contract. The QASP establishes:

• What will be monitored.

• How monitoring will take place.

• Who will conduct monitoring.

• How monitoring efforts and results are documented.

The contractor is responsible for implementing and delivering performance that meets contract objectives using its Quality Control Plan (QCP). The QASP provides the structure for the government’s surveillance of the contractor’s performance to assure that it meets contract requirements. It is the government’s responsibility to be objective, fair and consistent in evaluating contractor performance. The Contracting Officer (CO) shall also ensure that the contractor receives impartial, fair, and equitable treatment under this contract and determines the final assessment of contractor performance.

The QASP is not part of the contract nor is it intended to duplicate the contractor’s QCP. This QASP is a living document. Flexibility in the QASP is required to allow for an increase or decrease in the level of surveillance necessary based on contractor performance.

The government may provide a copy of the QASP to the contractor to facilitate open communication. In addition, the QASP should recognize that unforeseen or uncontrollable circumstances might occur that are outside the control of the contractor.

The QASP should ensure early identification and resolution of performance issues to minimize impact on mission performance.

3.0 Authority

Authority for issuance of this QASP is provided under Part 37.604 and 46.4 of the Federal Acquisition Regulation (FAR), Inspection of Services clauses (also reference 52.212-4 Contract Terms & Conditions—Commercial Items Paragraph (a) Inspection/Acceptance), which provides for inspection, acceptance and documentation of the service called for in the contract or order.

This acceptance is to be executed by the Contracting Officer (CO) or a duly authorized representative.

4.0 Roles and Responsibilities

Multi-Functional Team Roles and Responsibilities. The purpose of the multi-functional team is to create an environment that shapes and effectively executes acquisitions within their purview. The emphasis is on teamwork, trust, common sense and agility. These stakeholders are responsible for the acquisition throughout the life of the requirement, instituted under the authority of the senior leadership; every representative within the multi-functional team brings to the team their unique level of expertise. The following personnel comprise the Multi-Functional Team (MFT) and shall oversee and coordinate surveillance activities.

Government Representatives:

Contracting Officer (CO) – The CO shall ensure performance of all necessary actions for effective contracting, ensure compliance with the contract terms, and shall safeguard the interests of the United States in the contractual relationship. The CO shall also ensure that the contractor receives impartial, fair, and equitable treatment under this contract and shall determine the final assessment of the contractor’s performance. The CO shall designate a primary and alternate COR prior to contract award. Upon request, the CO shall provide an assessment on COR performance to the COR Supervisor. The CO is the only person with the authority to make interpretations of and changes to the contract.

Specific duties of the CO include:

• Delegating authority for inspection and/or acceptance to COR in accordance with the terms and conditions of the contract.

• Informing the contractor of the names, duties, and limitations of authority for all COR assigned to the contract.

• Periodically assessing the COR’s performance.

• Managing contractor performance surveillance data, including submitting Contractor

Performance Assessment Reporting System (CPARS) reports.

• Ensuring the MFT reviews this QASP annually (at a minimum) for recommended changes.

• Providing contract-specific training (to include refresher training) administered by CO or

CO’s designee to all appointed CORs.

Contracting Officer Representative (COR) Supervisor– The COR Supervisor nominates the COR, ensures the COR is trained before performing any COR duties and supports the COR’s surveillance activities.

Contracting Officer’s Representative (COR) - The COR is responsible for providing continuous program and technical oversight of the contractor’s performance. While the COR may serve as a direct conduit to provide Government guidance and feedback to the contractor on technical matters, they are not empowered to make any contractual commitments or any contract changes on the government’s behalf. The COR is responsible for reporting early identification of performance problems to the CO and may use the applicable appendix items for documenting contractor performance.

Specific duties of the COR include:

• Evaluating and documenting the contractor’s performance in accordance with the procedures set forth in the QASP.

• Recommending any changes necessary to the contract, PWS, QASP, or other items to provide operations that are more effective or eliminate unnecessary costs.

• Keeping a COR file that accurately documents the contractor’s actual performance (i.e.

COR surveillance reports).

• Utilizing COR file data (i.e. performance and COR surveillance reports) to assist the CO in the preparation of the CPARS reports.

• Receiving required training before performing any COR duties (IAW MP5301.602-2(d)).

• To notify the CO immediately regarding contractor non-compliance with FAR 52.222-

50, “Combating Trafficking in Persons.”

o The Contractor shall comply with FAR 52.222-50, Combating Trafficking in

Persons. Additional information about Trafficking in Persons can be found at the site for the Department of State’s Office to Monitor and Combat Trafficking in Persons: http://www.state.gov/j/tip o In accordance with the Defense Contingency COR Handbook section on Combating Trafficking in Persons, the COR must inform the PCO if the Contractor/subcontractor and/or Contractor/subcontractor personnel fail to comply with the requirements of FAR 52.222.50.

o The PCO must convey the information to DoD Combat Trafficking in Persons (CTIP) Law Enforcement and Support / Office of Under Secretary of Defense (OUSD) Personnel and Readiness (P&R) Defense Human Resources Activity

(DHRA).

Quality Assurance Program Coordinator (QAPC) - The QAPC is responsible for developing, managing, and implementing the Quality Assurance Program. The QAPC provides the QAPC Led Training & may provide refresher training, as needed.

http://www.state.gov/j/tip http://www.acq.osd.mil/dpap/ccap/cc/corhb/Files/DCCOR_Handbook_2012.pdf

Contractor Representatives:

Contractor – Complies fully with the terms and conditions of the contract and ensures non-conforming contract services are identified and corrected.

Specific duties of the Contractor include:

• Participating as a member of the MFT in the post-award management phase.

• Maintaining and implementing their commercial quality procedures that ensure contract requirements are met.

• Ensuring that the QCP is revised when necessary to prevent recurrence of non-conforming contract services.

• Tendering to the government for acceptance, only those services that conform to contract requirements.

• Recommending any changes to the contract that will provide operations that are more effective or eliminate unnecessary costs.

5.0 Contractor’s Quality Control Plan (QCP)

A Contractor’s QCP, and updates a needed, is provided in accordance with the terms and conditions of the contract. The Contractor’s QCP compliments this QASP and is located in the contract file.

The Contractor shall submit a draft QCP no later than ten (10) days after award. The Contractor shall develop and maintain an effective quality control plan to ensure services are performed in accordance with this PWS. The Contractor shall develop and implement procedures to identify, prevent, and ensure non-recurrence of defective services. The Contractor’s QCP is the means by which he assures himself that his work complies with the requirement of the contract. The Contractor is responsible for contract management and quality control, not the Government. The QCP will be delivered via e-mail to the CO for the COR’s acceptance. The COR will provide a written notice of any changes to be made to QCP or notice of acceptance in writing to the Contractor. The Contractor shall submit any updates to the QCP within five (working) days after the first review by the COR. Any updates to the QCP will be reviewed by the COR for acceptance in writing.

6.0 Performance Requirements and Method(s) of Surveillance

6.1 Contract Surveillance

The goal of the QASP is to ensure that contractor performance is effectively monitored and documented. The COR’s contribution is their professional, non-adversarial relationships with the CO and the contractor, which enables positive, open and timely communications. The COR uses the methods contained in this QASP to ensure the contractor complies with contract requirements. The COR function is responsible for a wide range of surveillance requirements that effectively measure and evaluate the contractor’s performance. Additionally, this QASP is based on the premise that the contractor, not the Government, is responsible for management and quality control/quality assurance actions to meet the terms of the contract.

Incentives. Performance that continually exceeds the performance objectives as outlined in the PWS may result in reduced surveillance and favorable Contractor Performance Assessment Reports (CPAR). Performance that does not meet the performance objectives as outlined in the PWS may result in re-performance of the defective service in accordance with the Inspection of Services clause, reduction of fee/price, negative CPAR reporting and/or increased surveillance.

Non-Service Summary (SS) Items. Quality performance is expected on all contract requirements by the contractor and is not limited to just SS items. All Non-SS items may be inspected by the COR.

6.2 Surveillance Summary

The Services Summary (SS) and Method of Surveillance (Appendix 1) is the list of performance objectives and thresholds that must be performed by the contractor. This summary details the method(s) of surveillance the COR will use to validate and inspect these performance objectives.

Inspection of each objective will be documented in the COR file.

Performance objectives define the desired outcomes. Performance thresholds define the level of service required under the contract to meet the performance objective. The Government performs surveillance, using this QASP, to determine the quality of the contractor’s performance as it relates to the performance thresholds. The PWS and QASP should be used to form the foundation of the COR’s inspection.

Method(s) of Surveillance:

100% Inspection: The COR will inspect and evaluate the contractor’s performance each time it is performed. The result of the contractor’s overall performance is then evaluated to determine acceptability of the service provided.

Customer Complaint: The COR is the point of contact and must collect all customer complaints.

The Customer Complaint Record below will be used for this purpose. All complaints and any resulting resolution of such complaints must be documented with the information required on the customer complaint form. Customer complaint forms become a permanent part of the COR file.

7.0 Surveillance Documentation

7.1 Corrective Action Report (CAR) (Appendix 2)

Corrective Action reporting is divided into two categories, which are as follows: minor and major.

Minor: A minor discrepancy is a departure from established standards having little bearing on the service provided. Some examples would be data deliverables with minor grammatical or spelling errors or insufficient copies of documents. When the COR identifies a minor discrepancy, the COR shall document the discrepancy and verbally contact the designated contractor representatives, but is not required to notify the CO. However, if the same minor discrepancy is identified more than once, it may be an indication that a major discrepancy is occurring or has occurred because the contractor has not taken proper steps to prevent recurrence. In this case, the COR shall notify the CO in writing, which may include e-mail.

Major: If at any time the COR identifies a condition as having a significant adverse effect on the quality of the service, such as those stated below, the COR shall document their findings and notify the CO immediately in writing. E-mail is acceptable. Major discrepancies will be reported by the COR to the designated contractor representative in writing; however, copies of written correspondence will be coordinated with the CO prior to issuance to the contactor representative. Some examples are contractor failure to meet a performance objective, failure to provide adequate corrective action to preclude recurrence of government-identified findings, failure to provide corrective action to deficiencies identified by the COR within a prescribed suspense period or failure to adhere to security regulations that results in a security incident.

7.2 Customer Complaint Record (Appendix 3)

The COR shall ensure complaint procedures and forms are made available to all customers (See Customer Complaint Record below). Any personnel that observe questionable or incomplete services or services not performed, or performed improperly, should immediately contact the COR. The COR shall receive, document, and validate or invalidate all complaints. If the complaint is invalid, the COR shall contact the complainant and explain why the complaint was invalid. The COR shall fully document the resolution for each complaint on the Customer Complaint Record. Complaints will be tracked and if the performance threshold is exceeded, the COR shall notify the CO in writing. The CO will notify the contractor and appropriate action can be taken.

7.3 Performance Assessment Report (PAR) (Appendix 4)

PARs will be used to report all minor discrepancies and will be generated by the COR and sent to the contractor for corrective action. Contractor will be given ten (10) days to correct PARs unless they have requested an extension. If three (3) minor discrepancies are found, combine them and process a CAR.

7.4 COR Services Summary Monthly Surveillance Report (Appendix 5)

The communication of expected outcomes begins the performance management feedback loop.

Performance standards are expressed in the PWS and are assessed using the methods of surveillance shown in the SS surveillance. This report shall be submitted to the Contracting Officer (CO) (through the Contract Specialist) and uploaded into the CORT Tool no later than the 10th business day of each month. The CO may agree to print this report from the CORT Tool each month in lieu of a separate submittal.

8.0 Acceptance of Services

Before acceptance of product(s) or service(s) and/or approval of an invoice, the COR shall prepare a COR Services Summary Surveillance Report (Appendix 5) in accordance with the QASP and FAR 52.212-4 (Contract Terms and Conditions – Commercial Items), Inspection and Acceptance Clause or FAR 52.246-4 Inspection of Services—Fixed Price (or -5 for Cost Reimbursement/-6 T&M & LH, etc.). The report can be tailored to meet the surveillance needs for the requirement but as a minimum, it must contain the Services Summary with Performance Ratings & explanation(s) for any PWS requirement rated above or below “Satisfactory” (See Attachment 1 to Appendix 5 for definitions of Performance Ratings). The report shall identify both positive and negative performance. The report shall be signed and dated by the COR & CO and uploaded to the CORT Tool.

The COR will certify that acceptable services were received, in accordance with the terms and conditions of the contract. The COR will certify receipt of contractor services via the Wide Area Workflow (WAWF) website. Certification of services shall be accomplished no later than seven

(7) calendar days after receipt of the invoice. To avoid payment of interest penalties, if the invoice is unacceptable, it should be rejected in WAWF within the first seven (7) calendar days after receipt of the invoice, and the CO should be notified immediately.

9.0 Contract Management

The MFT shall conduct periodic progress meetings to review the contractor’s performance. At these meetings, the CO will apprise the contractor of how the Government views the contractor’s performance and the contractor will apprise the Government of problems, if any, being experienced. The contractor will immediately notify the CO and/or COR of any work being performed that the contractor considers over and above the requirements of the contract.

Appropriate action shall be taken to resolve any outstanding issues (i.e. CPARS, customer complaint reports, etc.).

The MFT shall also provide any recommended changes to the QASP to the CO at the progress meetings or on an annual basis (at a minimum).

Initial Contract Performance Review: This evaluation shall take place within 30 days after the contractor assumes full performance responsibilities (i.e. after completion of transition/mobilization) to ensure the contractor has successfully started performance, completed transition, is fully operations, and is within the estimated cost, schedule, and performance parameters of the contract.

Initial Contract Performance Review Criteria

• Technical. Assess the contractor’s conformance to contract requirements, specifications and standards of good workmanship (e.g., commonly accepted technical, professional, environmental, safety, or health standards).

• Schedule. Assess the timeliness of the contractor against contract requirements;

task orders, milestones, delivery schedule, administrative requirements, and sample negative and positive turnaround times (e.g., efforts that contribute to or affect the schedule variance).

• Management/Performance. Assess the integration and coordination of all activity needed to execute the contract, specifically the completeness and quality of problem identification, corrective action plans, the contractor’s history of reasonable and cooperative behavior, customer satisfaction and management of subcontracts including progress on small business subcontracting goals.

• Staffing. Assess the contractor’s performance in selecting, retaining, supporting and replacing when necessary, personnel.

COR Contract File: A contract file must be established and maintained by the COR. The COR shall maintain the file in a computer data base system using the Contractor Officer Representative Tracking (CORT) Tool. Until notified otherwise, the COR shall also maintain a hard copy (paper) file. The COR will create a profile, complete the required training, and upload their certificates into the CORT Tool and then self-nominate by selecting their supervisor who will approve this action. Final approval, in CORT, is accomplished by the CO. Upon Approval, The CORT tool will be used to track CORs, contract documents, reports and all other documentation maintained in the hard copy COR file. The contents of the COR Contract file are shown at Appendix 6.

10.0 Coordination & Approval: The multi-functional team member signatures below indicate their coordination and acceptance/approval of the QASP for the “SG5 PROJECT MANAGEMENT SUPPORT”. These signatures indicate coordination on the plan at the time of development and will remain in effect until the plan is changed.

QASP COORDINATION:

JODY R. CALLENDER, GS-13, DAF Date Primary COR/Program Manager Title: Finance and Resource Management

AFMSA/SG5

CHARLES D. HAWKINS, GS-13, DAF, PMP Date Alternate COR Title: Program Manager

AFMSA/SG5O

JAVIER S. TAMEZ Date Contracting Officer

773 ESS/PKA

QASP APPROVAL:

KARLA F. DODD Date

QAPC

Appendix 1 – Services Summary (SS) and Method of Surveillance:

773 ESS/PKA

Performance Objective Performance

Work Statement

(PWS)

Reference

Performance Threshold Method of Surveillance

Prepare/submit documents in appropriate formats in accordance with (IAW) Air Force Handbook (AFH) 33- 337, The Tongue and Quill.

2.1.1.1 No more than 3 grammatical, punctuation errors per page, per project/document per period

Customer Complaint

Plan and coordinate Director and Division Chief travel arrangements within twenty four (24) hours of request in the Defense Travel System.

2.1.1.3 No more than 1 missed

accommodation per period

Customer Complaint

Collect request for office supplies

2.1.1.4 No more than 1 missed

leadership accommodation per period

Customer Complaint

Assist the Government with records management

2.1.1.8 No more than 1 error per 6

month period

Customer Complaint

Integrate the use of formats and management processes into periodic reviews for decision making.

2.2.1.4 No more than 2 formatting

errors per period, per project

Customer Complaint

Prepare status reports, program reviews and presentations in accordance with the defined format. Update and maintain portfolios to accommodate development and revision of strategic business plans, execution plans, and requirements analysis to ensure that they align with Division research strategies and guidance.

2.2.1.6 No more than 2 formatting

errors, grammatical errors, or content errors per project per period

Customer Complaint

Statement

(PWS)

Reference

Performance Threshold Method of Surveillance

Attend JPC steering committees, working groups and Integrated Product Teams (IPT)s, High Performance Team (HPT)s, related JPC, In-Process Reviews (IPR), Risk and Analysis (R&A) meetings.

Remain apprised of JPC activities and progress, and ensure AFMS gaps and requirements are represented in JPC priorities using the Integrated AFMS Capability Gaps (Material/Knowledge products).

2.2.1.7 No more than 1 customer

complaint per period

Customer Complaint

Analyze proposals for technical, scientific, and fiscal content as it relates to current trends in the clinical investigations program. Provide technical analysis of research to achieve results within the clinical investigation program in order to specifically align priorities based on current AF requirements and needs.

2.3.1.1 No more than 2 missed

suspense in a period

Customer

Statement

(PWS)

Reference

Performance Threshold Method of Surveillance

Provide SG5 management with relevant statistics or simulations for making decisions on the administrative and programmatic aspects of AFMS SBIR program to ensure core AFMS capability gaps are tracked and developed into topics that result in successful projects as required.

2.4.1.1 No more than 2 missed

suspense in a period

Customer Complaint

Gather information from SMEs in all aspects of research and examine information for the short and long term SBIR program. Assess current SBIR business approaches and identify possible areas of improvement as required by the Government Program Manager (PM).

2.4.1.2 No more than 2 missed

suspense in a period

Customer Complaint

Maintain a centralized AFMS SBIR Program Management process for SBIR related activities by utilizing existing mature SBIR processes and infrastructure at AF Research Laboratory and Medical Research Materiel Command (MRMC).

2.4.1.3 No more than 2 missed

suspense in a period

Customer Complaint

Complete scientific and technical analysis of modernization research proposals submitted for project review and funding.

2.5.1.1 No more than 1 complaint

per project, per project

Customer

Statement

(PWS)

Reference

Performance Threshold Method of Surveillance

Develop mathematical and statistical models to analyze, identify and define problems on programs based on analytical information in order to assist with management plans for each MTA and the Directorate programs.

2.5.1.2 No more than 1 complaint

per project, per project

Customer Complaint

Coordinate and assist membership participation in JPC steering committees, working groups and IPTs.

Remain apprised of JPC activities and progress.

Ensure AFMS gaps and requirements are represented in JPC priorities using the Integrated AFMS Capability Gaps (Materiel/Knowledge products).

2.5.1.4 No more than 1 complaint

per period

Customer Complaint

Use statistical analysis or simulations to analyze information and develop practical solutions to ensure force survivability

2.6.1.1 No more than 1 complaint

per 6 month

Customer Complaint

Provide MC-CBRN program recommendations for internal and external customers and command policy. Recommendations shall be in accordance with the following: AFI 41-106 Medical Readiness Health Program Management.

2.6.1.3 No more than 1 complaint

per 6 month

Customer

Statement

(PWS)

Reference

Performance Threshold Method of Surveillance

Identify, validate and elevate medical CBRN requirements for consideration to the AF priority CBRN Joint Priority List.

2.6.1.7 No more than 1 complaint

per 6 period

Customer Complaint

Provide subject matter expertise to MAJCOM SGRs and program managers on the JCIDS process including all required documentation, staffing procedures and other relevant policies and guidelines.

2.6.1.9 No more than 1 complaint

per 6 period

Customer Complaint

Organize and coordinate all aspects of an IPT and HPT and/or a CBA Team.

2.7.1.1 HPTs accomplished on-time, accomplishing AFMS meeting agenda, presentation of information per project

Customer Complaint

Meet objectives for meetings/HPT attendance

2.7.1.1 and 2.7.1.4

Ensure appropriate attendees and participants are invited 96% of the time, provided at each HPT and all meetings that are organized by the Contractor. This surveillance method will be conducted at each meeting that the contractor is required to conduct.

100% Inspection

Collect monthly metrics, analyze aggregate data and develop initial findings and recommendations for senior leaders to review as required by SG5 leadership.

2.7.1.7 and 2.8.1.5

Provide error-free and technically correct 90% of the time, per project, based on the identification of capability gaps submitted by the users per project

Customer Complaint

Assist in preparing, coordinating, and providing complete requirements documentation for approval/signature

2.7.1.13 Documents shall be at least

98% error-free for the life of the contract, with corrections made 100% of the time to the government’s satisfaction

100% Inspection

Statement

(PWS)

Reference

Performance Threshold Method of Surveillance

Coordinate the SGROCC meetings with the AFMS leadership

2.8.1.1 meetings accomplished on-time, accomplishing 98% AFMS meeting agenda, 100% Inspection

Prepare and brief status updates as required at SMMAC, SGROCC, the AFROC, and the JROCC.

2.8.1.4 Briefs accomplished on-time

and 90% error free

100% Inspection

Assistance with performance reports and staff development

2.9.1.1 No more than 1 missed

action within a period

100% Inspection

Provide planning and logistical support to AFMSA/ Research and Acquisition Meetings.

2.9.1.5 Reporting 98% accurate per

report, per period

100% Inspection

Appendix 2 – Corrective Action Report

CORRECTIVE ACTION REPORT (CAR)

(If more space is needed, use reverse and identify by number)

1. CONTRACTOR

2. CONTRACT NUMBER

3. TYPE OF SERVICES

4. FUNCTIONAL AREA

5. SUSPENSE

DATE

6. CONTROL

NUMBER

7. DEFICIENCY MAJOR MINOR

FINDING:

FINDING IMPACT:

Please respond with a written corrective action plan that details the corrective action of the cited deficiency, the cause of the deficiency, and actions taken to prevent recurrence by Suspense Date in Block 5. If date was not entered in Block 5, the contractor is not required to provide a response.

8. CONTRACTING OFFICER’S REPRESENTATIVE (COR)

TYPED NAME AND GRADE

SIGNATURE AND DATE

9. ISSUING AUTHORITY

TYPED NAME AND GRADE

SIGNATURE AND DATE

10. COR RESPONSE TO CONTRACTOR CORRECTIVE ACTION AND ACTION TAKEN TO PREVENT

RECURRENCE

11. COR DETERMINATION

ACCEPTED REJECTED

12. CLOSE DATE

Appendix 3 – Customer Complaint Record

CUSTOMER COMPLAINT RECORD

DATE/TIME OF COMPLAINT

SOURCE OF COMPLAINT

ORGANIZATION

BUILDING NUMBER

INDIVIDUAL

PHONE NUMBER

NATURE OF COMPLAINT

CONTRACT REFERENCE

VALIDATION

DATE/TIME CONTRACTOR INFORMED OF COMPLAINT

ACTION TAKEN BY CONTRACTOR

RECEIVED/VALIDATED BY

Appendix 4 – Performance Assessment Report

PERFORMANCE ASSESSMENT REPORT (PAR)

(If more space is needed, use reverse and identify by number)

1. CONTRACT/TASK ORDER NUMBER 2. CONTRACTOR 3. TYPE OF SERVICES

4. CONTRACTING OFFICER’S REPRESENTATIVE (COR) SIGNATURE AND DATE

5. COR PHONE 6. SUSPENSE DATE

I. PERFORMANCE

7. DEFICIENCY (CHECK ALL BOXES THAT APPLY)

NEW

REPEAT

NO DEFICIENCY NOTED

8. SERVICES SUMMARY or PWS PARAGRAPH ITEM REVIEWED

9. BRIEF DESCRIPTION OF DEFICIENCY (IF DEFICIENCY BOX WAS

CHECKED)

10. DETAILED PERFORMANCE ASSESSMENT

II. CONTRACTOR VALIDATION

11. CONTRACTOR REPRESENTATIVE CONCUR NON-CONCUR

12. CORRECTIVE ACTION ESTIMATED COMPLETION DATE

13. CONTRACTOR REPRESENTATIVE CORRECTIVE ACTION AND PREVENTION OF RECURRENCE OR REASON FOR NON-CONCURRENCE

OF COR CITED DEFICIENCY

III. ACTION CORRECTED

14. CONCUR NON-CONCUR COR SIGNATURE AND DATE

15. COR REMARKS (REQUIRED)

16. CONTRACTOR REPRESENTATIVE REMARKS

Appendix 5 -

“COR Services Summary Monthly Surveillance Report”

CONTRACT/TASK ORDER #:_______________________

SERVICE: __ ________________________

SURVEY PERIOD: ____________________

Requirement PWS Paras AQL/Performance Threshold (Performance is acceptable if…)

Surveillance/ Monitoring Method

Performance Rating See Appendix 5.a for ratings & definitions

Prepare/submit documents in appropriate formats in accordance with (IAW) Air Force Handbook (AFH) 33-337, The Tongue and Quill.

2.1.1.1 No more than 3 grammatical, punctuation errors per page, per project/document per period

Customer

Plan and coordinate Director and Division Chief travel arrangements within twenty four

(24) hours of request in the Defense Travel System.

2.1.1.3 No more than 1 missed

accommodation per period

Collect request for office supplies

2.1.1.4 No more than 1 missed

leadership accommodation per period

Customer Complaint

Assist the Government with records management

2.1.1.8 No more than 1 error per 6

month period

Customer Complaint

Integrate the use of formats and management processes into periodic reviews for decision making.

2.2.1.4 No more than 2 formatting

errors per period, per project

Surveillance/ Monitoring Method

Performance Rating See Appendix 5.a for ratings & definitions

Prepare status reports, program reviews and presentations in accordance with the defined format.

Update and maintain portfolios to accommodate development and revision of strategic business plans, execution plans, and requirements analysis to ensure that they align with Division research strategies and guidance.

2.2.1.6 No more than 2 formatting

errors, grammatical errors, or content errors per project per period

Attend JPC steering committees, working groups and Integrated Product Teams (IPT)s, High Performance Team (HPT)s, related JPC, In-Process Reviews (IPR), Risk and Analysis (R&A) meetings. Remain apprised of JPC activities and progress, and ensure AFMS gaps and requirements are represented in JPC priorities using the Integrated AFMS Capability Gaps (Material/Knowled ge products).

2.2.1.7 No more than 1 customer

complaint per period

Surveillance/ Monitoring Method

Performance Rating See Appendix 5.a for ratings & definitions

Analyze proposals for technical, scientific, and fiscal content as it relates to current trends in the clinical investigations program. Provide technical analysis of research to achieve results within the clinical investigation program in order to specifically align priorities based on current AF requirements and needs.

2.3.1.1 No more than 2 missed

suspense in a period

Provide SG5 management with relevant statistics or simulations for making decisions on the administrative and programmatic aspects of AFMS SBIR program to ensure core AFMS capability gaps are tracked and developed into topics that result in successful projects as required.

2.4.1.1 No more than 2 missed

suspense in a period

Surveillance/ Monitoring Method

Performance Rating See Appendix 5.a for ratings & definitions

Gather information from SMEs in all aspects of research and examine information for the short and long term SBIR program.

Assess current SBIR business approaches and identify possible areas of improvement as required by the Government Program Manager

(PM).

2.4.1.2 No more than 2 missed

suspense in a period

Maintain a centralized AFMS SBIR Program Management process for SBIR related activities by utilizing existing mature SBIR processes and infrastructure at AF Research Laboratory and Medical Research Materiel Command

(MRMC).

2.4.1.3 No more than 2 missed

suspense in a period

Complete scientific and technical analysis of modernization research proposals submitted for project review and funding.

2.5.1.1 No more than 1 complaint

per project, per project

Surveillance/ Monitoring Method

Performance Rating See Appendix 5.a for ratings & definitions

Develop mathematical and statistical models to analyze, identify and define problems on programs based on analytical information in order to assist with management plans for each MTA and the Directorate programs.

2.5.1.2 No more than 1 complaint

per project, per project

Coordinate and assist membership participation in JPC steering committees, working groups and IPTs. Remain apprised of JPC activities and progress. Ensure AFMS gaps and requirements are represented in JPC priorities using the Integrated AFMS Capability Gaps (Materiel/Knowled ge products).

2.5.1.4 No more than 1 complaint

per period

Use statistical analysis or simulations to analyze information and develop practical solutions to ensure force survivability

2.6.1.1 No more than 1 complaint

per 6 month

Surveillance/ Monitoring Method

Performance Rating See Appendix 5.a for ratings & definitions

Provide MC-CBRN program recommendations for internal and external customers and command policy.

Recommendations shall be in accordance with the following: AFI 41-106 Medical Readiness Health Program Management.

2.6.1.3 No more than 1 complaint

per 6 month

Identify, validate and elevate medical

CBRN

requirements for consideration to the AF priority CBRN Joint Priority List.

2.6.1.7 No more than 1 complaint

per 6 period

Provide subject matter expertise to MAJCOM SGRs and program managers on the JCIDS process including all required documentation, staffing procedures and other relevant policies and guidelines.

2.6.1.9 No more than 1 complaint

per 6 period

Organize and coordinate all aspects of an IPT and HPT and/or a CBA Team.

2.7.1.1 HPTs accomplished on-time, accomplishing AFMS meeting agenda, presentation of information per project

Surveillance/ Monitoring Method

Performance Rating See Appendix 5.a for ratings & definitions

Meet objectives for meetings/HPT attendance

2.7.1.1 and 2.7.1.4

Ensure appropriate attendees and participants are invited 96% of the time, provided at each HPT and all meetings that are organized by the Contractor. This surveillance method will be conducted at each meeting that the contractor is required to conduct.

100% Inspection

Collect monthly metrics, analyze aggregate data and develop initial findings and recommendations for senior leaders to review as required by SG5 leadership.

2.7.1.7 and 2.8.1.5

Provide error-free and technically correct 90% of the time, per project, based on the identification of capability gaps submitted by the users per project

Assist in preparing, coordinating, and providing complete requirements documentation for approval/signature

2.7.1.13 Documents shall be at least

98% error-free for the life of the contract, with corrections made 100% of the time to the government’s satisfaction

Coordinate the SGROCC meetings with the AFMS leadership

2.8.1.1 meetings accomplished on-time, accomplishing 98% AFMS meeting agenda, Prepare and brief status updates as required at

SMMAC, SGROCC,

the AFROC, and the

JROCC.

2.8.1.4 Briefs accomplished on-time

and 90% error free

Assistance with performance reports and staff development

2.9.1.1 No more than 1 missed

action within a period

Surveillance/ Monitoring Method

Performance Rating See Appendix 5.a for ratings & definitions

Provide planning and logistical support to AFMSA/ Research and Acquisition Meetings.

2.9.1.5 Reporting 98% accurate per

report, per period

SERVICE or STANDARD (For Non-Service Summary Items found not meeting standards):

PREPARED BY: ____________________________________ DATE: _________________

JODY CALLADER, GS-13, DAF

CONTRACTING OFFICER: ___________________________DATE:_________________

Appendix 5.a

“Performance Ratings used for COR Services Summary Monthly Surveillance Report”

The evaluation ratings are as follows:

Excellent/Outstanding – Performance meets contractual requirements and exceeds many to the Government’s benefit. The contractual performance of the element or sub-element being assessed was accomplished with no problems and the contractor actions were highly effective.

Very Good - Performance meets contractual requirements and exceeds some to the Government’s benefit.

The contractual performance was accomplished with few minor problems for which corrective actions taken by the contractor were effective.

Satisfactory - Performance meets contractual requirements. The contractual performance contains some minor problems for which corrective actions taken by the contractor were satisfactory.

Marginal - Performance does not meet contractual requirements. The contractual performance reflects a serious problem for which the contractor has not yet identified corrective actions. The contractor’s proposed actions appear only marginally effective or were not fully implemented.

Unsatisfactory – Performance does not meet most contractual requirements and recovery is not likely in a timely manner. The contractual performance contains a serious problem(s) for which the contractor’s corrective actions appear or were ineffective.

Appendix 6

CONTRACTING OFFICER'S ANNUAL COR FILE INSPECTION CHECKLIST

(to be accomplished in the anniversary month of appointment) AND COR CONTRACT FILE INDEX

Contract Type A B C

Date File Review Accomplished Contract Exp:

Position Name

Request for

COR

Support Ltr (Date)

CLC 106

or CLC

222 Cert (Date)

CLM 003

Cert

(Date)

QAPC

COR

(COR I)

Trainin g (Date)

CO

Contract Specific

(COR II)

Training

(Date)

Nominati on

Complete (Dates) (Ltr &

CORT)

Designati on Ltr signed by all parties (last date signed)

Termination Ltrs

(Date)

SDO

COR SUP

COR

Alt COR

Does the COR File contain the following, as applicable:

(mark one location for each of the following)

NOTES:

1. COR shall be able to show CO the document(s) in the system. Not just state that's where it is.

2. The CORT Tool is not DoD 5015.2 Record System compliant. Therefore cannot be used as a location for COR files. However, use of CORT Tool is mandatory.

TOPICS TO DISCUSS

WAWF EDA

COR File (Hard or

Soft)

Other (Specify)

A Basic contract and all attachments and Task Order B All Modifications to Basic contract and Task Orders

C PWS

D QASP (have COR explain QASP) E Contractor's Quality Control Plan (CQCP) F Surveillance Inspection Reports G QASP being followed? (SDS items, type of inspection, etc)

H Did the contractor receive formal notification of unacceptable inspections? Conversations with the contractor documented?

I Customer Complaint Records J Corrective Action Report(s) K Minutes of Post-Award Conference (if applicable)

L

Minutes of Initial Contract Performance Review IAW AFI 63-101

4.9 (taken place w/I 30 days after the contractor assumes full performance responsibilities or waiver from SDO).

M Documentation showing control/disposition/monitoring of GFP (if applicable)

N OPSEC CLC 107 training certificate

O Trafficking in Person certificate P WAWF training certificate

CONTRACTING OFFICER'S ANNUAL COR FILE INSPECTION CHECKLIST Page 2 of 2

CONTRACT NUMBER

COMMENTS:

Printed Name

SIGNATURE DATE

COR

CO or Contract Administrator

Contracting person performing inspection

QAPC