Attachment 2 - QASP_MTI Deliberate Development_092021.pdf

502 CONS/JBKAE

JBSA Lackland, Texas

MTI Deliberate Development

FA3016-22-Q-0001

QUALITY ASSURANCE SURVEILLANCE PLAN

FOR

737th Training Group, Basic Military Training

Military Training Instructors (MTI) Deliberate Development and 37th Training Wing Human

Performance Program

September 20, 2021

MTI Deliberate Development

FA3016-22-Q-0001

l. OBJECTIVE. This Quality Assurance Surveillance Plan (QASP) has been developed and will adhere to Performance-Based Services Acquisitions (PBSA) guidelines. This Quality Assurance Surveillance Plan will be used by the Multi-functional Team (l\1FT) to ensure contractor compliance and is designed to provide the l\1FT to ensure contractor compliance and is designed to provide the l\1FT a vehicle to ensure delivery of the QASP will also provide the Contracting Officer Representative (COR) an effective systematic surveillance method for each item listed in the Performance Work Statement (PWS), specifically on the Service Summary (SS). The premise of commercial contracting is for the contractor to assume responsibility for the work they produce. The government will also rely on the contractor's quality control measures for ensuring contractual requirements are met.

2. RESULTS. The result in managing this acquisition through this QASP is to provide the 737 TRG and 37th TRW with clear concise reports of evaluation on organization surveys to measure behavior in the training environment and the training of737th Training Group instructor and supervisory staff to support the deliberate development of military training instructors in required military training instructor core competencies.

3. GOALS OF THE MULTI-FUNCTIONAL TEAM (MFT). The purpose of the l\1FT is to create an environment that shapes and executes an acquisition. The emphasis is on teamwork, trust, common sense and agility. The goal is to obtain efficiencies, improved performance, and cost savings throughout the acquisition life cycle.

4. MUL Tl-FUNCTIONAL TEAM MEMBERS & THEIR RESPONSIBILITIES. The l\1FT is composed of stakeholders in the acquisition. These stakeholders are responsible for the acquisition throughout the life of the requirement. See QASP signature page for l\1FT membership.

4.1. Contracting Officer's Representative (COR): is responsible for monitoring, assessing, recording and reporting on contractor compliance with the terms and conditions of the contract. The COR will have primary responsibility for completing quality assurance monitoring forms that will be used to document the inspection and evaluation of the contractor's performance. The COR will maintain surveillance documentation, notify the Contracting Officer (CO) of any significant performance deficiencies and recommend improvements to the QASP and PWS throughout the life of the acquisition. See also in

AFF ARS MP5301.602-2( d) and Designation Memorandum for further clarification of COR duties and responsi bili ti es.

4.1.1. Joint Appointment Module (JAM) and the Surveillance and Performance Monitoring (SPM) Module in Procurement Integrated Enterprise Environment (PIEE): The DoD mandatory web-accessible management applications JAM and SPM are designed to nominate, appoint, track and terminate, if necessary, CORs and to serve as the web-based portal for all relevant COR documents to include monthly status reports/surveillance documents on service contracts. COR nomination and appointment functions are in JAM, COR monitoring functions are in SPM. CORs are required to register and upload their COR nomination in JAM and surveillance documentation in SPM. See the DoD User Guide for JAM COR Appointments and SPM Contract Surveillance for further guidance.

4.2. The Contracting Officer (CO): has overall responsibility for overseeing the contractor's performance in the areas of contract compliance, contract administration, cost control and property control; reviewing the COR assessment of the contractor's performance; and serves as a liaison between the COR and the contractor. The CO is the only person with the authority to direct the contractor in the performance of their duties under the contract and to make interpretations of and changes to the contract.

The CO will facilitate Multi-Functional Team meetings. See also AFFARS MP5346.103, Contracting

Office Responsibilities, and AFF ARS MP5301.602-2( d) for further clarification of CO duties and responsibilities.

MTI Deliberate Development

FA3016-22-Q-0001

4.3. The Functional Commander/Functional Director (FC/FD)/ COR Management: Encompasses the

FC/FD and the COR Supervisor and has overall responsibility for developing the PWS and the QASP and ensuring they satisfy mission requirements, are performance-based, foster innovation and define metrics.

COR Management will assign COR(s) and notify the CO of any changes to this designation. FC/FD will review contractor performance documentation, prepared by the COR, on a regular basis to ensure performance is compatible with mission objectives. See also AFF ARS MP5301.602-2( d) for further clarification on COR Management duties and responsibilities.

4.4. The Contracting Squadron Commander (CSC): serves as the Business Advisor to senior leadership;

develops and implements acquisition strategies for services acquisitions; provides oversight of the Multi functional Team in planning, assessing contractor performance and managing the acquisition throughout the life of the requirement IAW the FAR, DFARS and AFFARS.

4.5. The Quality Assurance Program Coordinator (QAPC): develops, manages and implements the base Quality Assurance Program; supports the Multi-functional Team in the development of contract requirements, ensuring requirements are clearly stated and enforceable; aids in development of the

Service Summary (SS) and QASP and provides training to all FC/FD, COR and others that interact with this contract as needed.

4.6. The Contract Specialist (CS): is the focal point for issues regarding the contract; prepares and processes modifications to the contract; assists the CO in ensuring contractor performance meets contract standards; records and transcribes minutes for meetings.

4.6.1. CS will perform COR assessment on a periodic basis as determined by the CO. The CS will verify that the COR is accomplishing their surveillance according to the QASP. If deficiencies are discovered in the COR surveillance procedures, the CO will notify the FC/FD and COR Management and provide any assistance requested, such as additional training for COR. The CS will ensure that the COR is documenting their surveillances in a timely manner. A check of the COR files will also be performed on an annual basis.

5. PERFORMANCE MANAGEMENT. The following outlines the approach, methods and tools to be used by the MFT to manage this acquisition upon award.

5.1. COR(s) shall evaluate and document contractors' performance in accordance with the procedures outlined in this QASP and maintain resulting surveillance documentation. The results of surveillances shall be maintained as Past Performance information and utilized to prepare and support annual Contractor Performance Assessment Report System (CP ARS) reporting, if required.

5.2. The contractor shall implement and maintain a Quality Control Plan (QCP) to ensure the contract services conform to the requirements of the PWS.

5.3. The United States Government has adopted a zero tolerance policy regarding trafficking in persons.

Additional infonnation about trafficking in person may be found at the website for the Department of

State's Office to Monitor and Combat Trafficking in Person at http://www.state.gov/g/tip.

5.3.1. IA W FAR 52.222-50 and DFARS PGI 222.17, Combating Trafficking in Persons, CORs must monitor the contractor's performance regarding trafficking in persons such that noncompliance with stated regulatory guidance is brought to the immediate attention of the CO. CORs must inform the CO if the contractor, contractor personnel, subcontractor, or subcontractor personnel have failed to comply with the requirements of this clause and PGI.

MTI Deliberate Development

FA3016-22-Q-0001

5.3.2. The contracting officer shall, through the contracting officer's local commander or other designated representative, immediately notify the Combatant Commander for the geographical area in which the incident has occurred. The Unified Combatant Command DefeneLINK website at http:/ /www.detensdink.mil/specials/unifiedcommand/, identities each command's area of responsibility.

5.3.3. The contractor shall take appropriate action should a violation occur. For corrective procedures and remedies for non-compliance see contract clause FAR 52.222-50.

5.4. The MFT shall continue to meet after award as necessary to ensure high levels of contractor performance, foster a synergistic partnership, and support mission requirements.

6. METHODS OF INSPECTION APPLICABLE TO THIS CONTRACT.

6. 1. Periodic Inspection - CO Rs will perform periodic inspections of the Service Summary objectives using a locally developed checklist. Periodic inspections will be performed on a periodic (daily, weekly, monthly, quarterly, etc.) basis as determined by the COR. Whenever a discrepancy is noted during a periodic inspection the COR shall follow the procedures outlined in paragraph 10.l of this plan. The COR's schedules (if applicable) are submitted to the contract administrator for review prior the month being inspected.

6.2 One Hundred Percent Inspection - CORs will inspect and evaluate the contractor's performance each time it is performed for Service Summary objectives inspected by One Hundred Percent Inspection.

Whenever a discrepancy is noted during an inspection the COR shall follow the procedures outlined in paragraph 10.1 of this plan.

6.3. Customer Complaint - The COR is the point of contact and must collect all customer complaints. A locally developed form may be used for this purpose. The COR must investigate a complaint to determine its validity. If not valid, the COR will inform the customer, and indicate on the form that the complaint is closed and why it was determined not valid. If valid, the COR documents how they determined its validity and provides the contractor's representative of copy of the complaint and have them initial the form. The COR forwards a copy of the complaint to the Contracting Officer and notifies the customer of the resolution of the complaint. Customer Complaint forms become a permanent part of the COR surveillance records. CORs provide training and assistance for customers in the procedures for filing customer complaints.

7. SERVICE SUMMARY WITH INSPECTION METHODS INCLUDED

7.1. Behavioral Analyst - BMT

P.O.

Performance Objective

PWS

Performance Threshold

# Paragraph

1. Provide weekly status update 1.2.1.3.1 No more than one (1) missed update or failure including course of actions, to provide updated information every semi-status of current analysis annual period (Jan-Jun, Jul-Dec).

projects and next steps. INSPECTION METHOD: Random sampling of weekly updates

2. Attend weekly organizational 1.2.1.6 No more than three (3) missed meetings per strategy meetings quarter. INSPECTION METHOD: Random sampling of attendance

3. Provide written report or slide presentation of analysis quarterly and conduct 1-3 iterative briefings of findings.

4. Create slide presentation which summarizes quarterly written report; conduct 3-5 briefings.

5. Create or review logic model metrics and present 3-5 iterative briefings per quarter.

6 . Review all BMT survey products, semi-annually

7. Attend strategy session with training director and key BMT leaders, semi-annually

8. Using government and civilian sources develop benchmarks to apply against analyzed data to establish trends and goals.

9. Statistical techniques must be consistent with industry standards.

7.2. Behavioral Development Specialist

P.O.

Performance Objective

10. Flt CC and IS orientation to basic behavioral tools completed within 60 days of arrival.

11. Review all PLDPs and work withFLT-CCs and ISs.

12. Provide value based coaching to each Flt CC and IS to develop skills and effectively give and receive feedback.

1.2.1.1 &

1.2.1.3.2

1.2.1.1 &

1.2.1.3.3

1.2.1.1 &

1.2.1.3.4

1.2.1.2

1.2.1.4

1.2.1.1

1.2.1.1 &

1.2.1.2

PWS

Paragraph

1.2.2.1

1.2.2.2

1.2.2.3.1 &

1.2.2.3.2

MTI Deliberate Development

FA3016-22-Q-0001

Not more than 98 calendar days may pass between written reports, but may miss (1) of the 3-5 briefing per quarter. INSPECTION

1\1:ETIIOD: Random sampling of report and briefings

Presentation must be completed NL T 45 days after the completion of each quarter, but may miss (1) of the 3-5 briefing per quarter.

INSPECTION 1\1:ETIIOD: Random sampling of presentation and briefing

Presentation must be completed NL T 45 days after the completion of each quarter, but may miss (1) of the 3-5 briefing per quarter.

INSPECTION 1\1:ETIIOD: Random sampling of presentation and briefing

100% compliant. Task must be completed twice a year. Contractor will submit review showing task was completed NL T last day in

June and NL T last day in December each year.

INSPECTION METHOD: Random sampling of review

100% compliant. Task must be completed twice a year. Contractor will coordinate with the training director to ensure they attend meetings. INSPECTION METHOD: Random sampling of attendance

Sources must be identifiable and statistically sound using industry standards. 100% accuracy required. COR will inspect data for accuracy.

INSPECTION METHOD: Random sampling data accuracy

No more than one (1) data entry or calculation discrepancy per month. INSPECTION 1\1:ETIIOD: Random sampling of data

Performance Threshold

No more than one (1) missed orientation per 60 day period. INSPECTION METHOD: Random sampling of attendance

No more than one (1) missed review per quarter. INSPECTION METHOD: Random sampling of reviews

100% compliant. Contractor will keep a record of all sessions to verify each Flt CC and IS received coaching. INSPECTION 1\1:ETHOD:

Random sampling of attendance record

13. Deliver transformational classroom continuation training.

14. Delivers Initial Military

Values-Based Instruction

Fundamentals Courses for

MTis.

15. Delivers Initial Military

Values-Based Instruction

Fundamentals Courses for FC-

IS.

7.3 Military Values-Based Instruction

P.O.

Performance Objective

16. "Reach-back" application of classroom principles

17. Monthly values based training report

18. Assisting MTI trainers and observing 1-4 training sessions per month

19. Monthly MTI trainer report

1.2.2.4 &

1.2.2.5

1.2.2.6

1.2.2.6

PWS

Paragraph

1.2.3.1

1.2.3.2

1.2.3.3

1.2.3.4

MTI Deliberate Development

FA3016-22-Q-0001

Courses are conducted IA W the Program of

Instruction and occur as scheduled, unless approved by the government. No more than one (1) missed course per quarter. Contractor will keep a record of all classes to verify each was performed. INSPECTION METHOD:

Random sampling of attendance

Courses are conducted IA W the Program of

Instruction and occur as scheduled, unless approved by the government. No more than one (1) missed course per quarter. Contractor will keep a record of all classes to verify each was performed. INSPECTION METHOD:

Random sampling of attendance

Courses are conducted IA W the Program of

Instruction and occur as scheduled, unless approved by the government. No more than one (1) missed course per quarter. Contractor will keep a record of all classes to verify each was performed. INSPECTION METHOD:

Random sampling of attendance

Performance Threshold

Courses are conducted IA W the Program of

Instruction and occur as scheduled, unless approved by the government. No more than one (1) missed course per quarter. Contractor will keep a record of all classes to verify each was performed. INSPECTION METHOD:

Random sampling of attendance

Report must be provided NL T 15 days after the conclusion of the month. INSPECTION

METHOD: Random sampling of reports

Provide training based on government approved instruction with a minimum of 1 training session per month. Contractor will keep a record of observations. INSPECTION METHOD: Random sampling of records

Report must be provided NL T 15 days after the conclusion of the month. INSPECTION METHOD: Random sampling of reports

7.4 Data Processors/Survey Administrators/Text Reader.

P.O.

Performance Objective

PWS

Performance Threshold

# Paragraph

20. Administers and proctors each 1.2.4.1 100% compliant. No missed sessions.

session of the RAND Trainee INSPECTION METHOD: Random sampling

Survey. of attendance

21. Daily RAND Trainee Survey after action report.

22. Picks up, sorts, classifies and processes feedback forms.

23. Classifies and processes all written comments from the

BMT End of Course Survey.

24. Administers, proctors, sorts, classifies and processes Safety and Well-Being survey.

25. Administers and proctors each session of the RAND MTI Survey.

26. Daily RAND MTI Survey after action report.

27. Administers, processes, sorts, classifies and proctors each session of the Special Interest Survey.

28. Manages and maintains filing system for written survey and critique comments.

29. Logs feedback data into database and emails original documents to leadership

30. Creates process reports based on the feedback processes upon request.

31. Reads feedback comment sheets, populates data fields, into a software generated text file, and uploads this file into analytical software.

7.5 Behavioral Analyst - HP

P.O.

Performance Objective

32. Provide weekly status update including course of actions, status of current analysis projects and next steps.

1.2.4.1

1.2.4.2

1.2.4.3

1.2.4.4

1.2.4.5

1.2.4.5

1.2.4.6

1.2.4.7

1.2.4.8.

1.2.4.9

1.2.4.10

PWS

Paragraph

1.2.5.3.1

MTI Deliberate Development

FA3016-22-Q-0001

No more than one (1) missed report per quarter.

INSPECTION IvfElHOD: Random sampling of reports

100% compliant. Must be completed as described. Only exception is federal holidays or facility closures. INSPECTION IvfETHOD:

Random sampling of collection process

100% compliant to include tracking of urgent comments. Must be completed as described each time. INSPECTION IvfElHOD: Random sampling of classification process

No more than one (1) missed survey session per quarter. 100% tracking of urgent comments required. INSPECTION IvfETHOD: Random sampling of attendance

100% compliant. No missed sessions.

INSPECTION METHOD: Random sampling of attendance

No more than one (1) missed report per semi-annual session. INSPECTION IvfETHOD:

Random sampling of reports

No more than one (1) missed survey session annually. 100% tracking of urgent comments required. INSPECTION IvfElHOD: Random sampling of attendance

No more than 3 improperly filed documents per quarter. INSPECTION IvfElHOD: Random sampling of filing system data

100% compliant. Must be completed as described. Data is reviewed quarterly for accuracy. INSPECTION IvfETHOD: Random sampling of data

Report data must be accurate with no more than one data error per report. INSPECTION IvfElHOD: Random sampling of reports

Uploads are 98% accurate and occur with 24 hours upon receipt. INSPECTION IvfETHOD:

Random sampling of system data

Performance Threshold

No more than one (1) missed update or failure to provide updated information every semi-annual period (Jan-Jun, Jul-Dec).

INSPECTION IvfElHOD: Random sampling of weekly updates

33. Attend weekly organizational strategy meetings

34. Provide written report or slide presentation of analysis quarterly and conduct 1-3 iterative briefings of findings.

35. Create slide presentation which summarizes quarterly written report; conduct 3-5 briefings.

36. Create or review logic model metrics and present 3-5 iterative briefings per quarter.

37. Review all HP survey products, semi-annually

38. Attend strategy session with

HP director and key 3 7 TRW leaders, semi-annually

39. Using government and civilian sources develop benchmarks to apply against analyzed data to establish trends and goals.

40. Statistical techniques must be consistent with industry standards.

1.25.6

1.2.5.1 &

1.2.5.3.2

1.2.5.1 &

1.2.5.3.3

1.2.5.1 &

1.2.5.3.4

1.2.5.2

1.2.5.4

1.2.5.1

1.2.5.1 &

1.2.5.2

8. CONTRACT MANAGER NOTIFICATION.

MTI Deliberate Development

FA3016-22-Q-0001

No more than three (3) missed meetings per quarter. INSPECTION METHOD: Random sampling of attendance

Not more than 98 calendar days may pass between written reports, but may miss (1) of the 3-5 briefing per quarter. INSPECTION

METHOD: Random sampling of report and briefings

Presentation must be completed NL T 45 days after the completion of each quarter, but may miss (1) of the 3-5 briefing per quarter.

INSPECTION METHOD: Random sampling of presentation and briefing

Presentation must be completed NL T 45 days after the completion of each quarter, but may miss (1) of the 3-5 briefing per quarter.

INSPECTION METHOD: Random sampling of presentation and briefing

100% compliant. Task must be completed twice a year. Contractor will submit review showing task was completed NL T last day in

June and NL T last day in December each year.

INSPECTION METHOD: Random sampling of review

100% compliant. Task must be completed twice a year. Contractor will coordinate with the HP director to ensure they attend meetings.

INSPECTION METHOD: Random sampling of attendance

Sources must be identifiable and statistically sound using industry standards. 100% accuracy required. COR will inspect data for accuracy.

INSPECTION METHOD: Random sampling data accuracy

No more than one (1) data entry or calculation discrepancy per month. INSPECTION

METHOD: Random sampling of data

The COR will ensure that the contract manager/project manager is frequently informed of contract performance status. Whenever a discrepancy is noted during an inspection the COR will provide a copy of the inspection to the contract manager/project manager. The contract manager signs or initials and dates the COR copy to indicate they have been notified of the discrepancy. This does not constitute agreement with the finding. The COR will also notify the Contracting Officer of all discrepancies noted during the surveillance.

9. NON-SERVICE SUM:MARY ITEMS.

Everything that is written into the contract is required to be provided by the contractor. Non

Service Summary items will be inspected on a periodic basis.

MTI Deliberate Development

FA3016-22-Q-0001

10. CERTIFICATION OF SERVICES.

Certification of services is petlormed by COR via Wide Area Work Flow (WA WF) system. At the end of each billing period, service provider inputs invoice information in the WA WF system. WA WF automatically notifies appropriate COR via email of pending invoice. COR accesses WA WF and verifies accuracy of service provider's data. If data is correct, COR certifies invoice and payment is conducted by

Defense Finance Accounting System (DF AS). If COR encounters errors in service provider's invoice, COR consults with on site manager or contractor's billing official to mutually rectify data. If service provider disagrees with COR, issue is forwarded to the CO for resolution.

10.1. Unacceptable Services. The COR shall determine the cause of contractor unacceptable services.

10.1.1. If any government action, or lack of action, caused or contributed to the unacceptable petlormance, the petlormance will not be counted against the contractor. The COR will take steps to ensure the government does not intetlere with the contractor's petlormance in the future.

10.1.2. If contractor caused, the COR shall document the occurrence in accordance with (IA W) the methods of surveillance outlined in this QASP. IA W contract terms and conditions, the government reserves the right to inspect any services that have been tendered for acceptance. The Government may require re-petlormance of nonconforming services at no increase in contract price. If re-petlormance will not correct the defects or is not possible, the government may seek an equitable price reduction or adequate consideration for acceptance of nonconforming supplies or services. Disputes between the COR and the contractor on the validity of a performance assessment shall be referred to the Contracting

Officer.

11. CONTRACTOR RATING.

The Contracting Officer will petlorm a monthly contractor rating using the common DoD Rating System.

The periodic contractor rating will be based on the monthly surveillance reports accomplished by the

COR.

12. CONTRACTOR PERFORMANCE ASSESSMENT RATING (CPARS).

CPARS is applicable to all service contracts valued over $1,000,000 and all health care service contracts valued at over $150,000. Guidance on CPARS is available from the Department of the Air Force CPARS Guide and the 502 CONS CP ARS representative.

13. INITIAL EVALUATION OF CONTRACTOR PERFORMANCE.

Initial evaluation of contractor petlormance is a joint dete1mination by the multi-functional team that the contractor has successfully started petlormance, completed transition, is fully operational, and is within the estimated cost, schedule, and petlormance parameters of the contract. The initial petlormance review shall take place within 30 days after the contractor assumes full petlormance responsibilities. (i.e. after completion of transition/mobilization).

REVIEW & ACCEPTANCE.

Name: ROBERT S WILSON Title: Primary COR, 737 TRG

DH ILL Q N. Kl ERA Digitally signed by

DHILLON.KIERAN.K.1282346750

N.K.1282346750 Date: 2021.09.20 15:56:06-05'00'

Name: KIERAN K. DHILLON, Lt Col, USAF

Title: Alternate COR, 37 TRW/HP

FISCHER WILLIA

Digitally signed by

· FISCHER.WILLIAM.D.113103345

M. D .1131 033458 �ate: 2021.09.20 16:00 06-05'00'

Name: WILLIAM D FISCHER

Title: Functional Commander/Director/ COR Management

LAMBERT.MARIA.C.12 Digitally signed by

31166293 ����;�;;����-�o;;;:��

!�?to• Name: MARIA C. LAMBERT Title: Quality Assurance Program Coordinator, 502 CONS/JBKP

WATTERS. LANC

E.M .1369711357

Digitally signed by

WA TTERS.LANCE.M .13697113

Date: 2021.09.21 19:27:35 -05'00'

Name: LANCE M. WATTERS Title: Contract Administrator, 502 CONS/JBKAE

DE LA Digitally signed by DE LA

ROSA.ROBERT.1129086226

ROSA. ROBE RT.11 Date: 2021.09.22 01:32:01 29086226 -05'00'

Name: ROBERT DE LA ROSA Title: Contracting Officer, 502 CONS/JBKAE

MTI Deliberate Development

FA3016-22-Q-0001

Page 10 oflO