PWS_ATTACHMENT_C_-_SERVICES_SUMMARY.docx

PWS ATTACHMENT C – SERVICES SUMMARY

TABLE 2 – SERVICES SUMMARY

a) Qualified key personnel are on the job at contract start, unless previously negotiated by the CO.

b) Vacancies are filled with qualified key personnel within 21 calendar days of vacancy, unless approved in writing or otherwise directed in advance by the CO AND

c) There is no mission impact due to position vacancies or unqualified personnel.

The following acceptable criteria and thresholds are also used for annual CPAR evaluation.

Contract Start:

Minimum acceptable criteria is based on having key personnel in place timely at contract (PoP) start.

Thresholds are as follows:

-- SATISFACTORY: 100% Key personnel in place within first 30 days of PoP start -- VERY GOOD: 100% Key personnel in place within first 15 days of PoP start -- EXCELLENT: 100% Key personnel in place within first 5 days of PoP start

· Who: Primary COR

· What: Reports vacancies, tracks vacancies/fill actions; reports non-conformances

· Where: Reports Contractor personnel vacancies and fill actions to the CO/CM; notifies the CO/CM and the QAPC of non-conformances

· When: Reports contractor personnel vacancies to the CO/CM upon personnel departure; notifies the CO/CM when the position is filled with a qualified person; notifies the CO/CM/QAPC of non-conformance if vacancies exceed 21 calendar days or impact mission

· How: All vacancy, fill action, and non-conformance notifications will be sent by e-mail to usaf.jbanafw.afdw-staff.mbx.afdw-fiar-follow-on-contract@mail.mil. Monthly, COR updates/annotates vacancies and any non-conformance as a result via monthly QA Report—any non- conformance issued is also reported in Wide Area Work Flow WAWF where appropriate

Vacancies (all include with “no impact to mission”):

Minimum acceptable criteria is based on filing vacancies timely for key personnel.

Thresholds are as follows:

-- SATISFACTORY: Key personnel vacancy filled with qualified personnel NLT 21 days, and no gov’t concerns expressed regarding qualification of personnel at the time of rating -- VERY GOOD: All vacancies (not just key personnel) filled with qualified personnel NLT 21 days, and no gov’t concerns expressed regarding qualification of personnel at the time of rating -- EXCELLENT: Key personnel vacancy filled with qualified personnel NLT 10 days, and no gov’t concerns expressed regarding qualification of personnel at the time of rating

Workload balanced effectively, to include minimized use of subcontractors, resulting in minimal negative mission impact

The following acceptable criteria and thresholds are also used for annual CPAR evaluation.

Workforce stability Minimum acceptable criteria is based on the lapse rate for key positions.

Thresholds are as follows:

-- SATISFACTORY: 5-7% quarterly lapse rate on key positions -- VERY GOOD: 3-5% quarterly lapse rate on key positions -- EXCELLENT: <3% quarterly lapse rate on key positions Who: Primary: AF FIAR Support PM

· Secondary: QAPC, Lead COR

· What: Review Lapse Rate report for accuracy

· Where: Documented in Tab 9 of the COR Folder as defined in Table 5 of the QASP

· When: Quarterly

· How: QAPC and PM compare Contractor provided position vacancy details against published lapse rate threshold of less than 5% during the reporting period for compliance

a) 100% of deliverable requirements are met and received on time

AND

b) Critical information is accurate.

· Who: Primary COR/applicable PM

· What: Inspects, validates, and accepts Table 1 deliverables

· Where: Documented in Tab 9 of the COR Folder as defined in Table 5 of the QASP

· When: On the scheduled times as defined in QASP Para 3.2.1.

· How: Verification and acceptance of all required deliverables will be communicated to the Contractor via e-mail and annotated in the COR’s Monthly Report.

· What: Validate accuracy of Contractor’s Small Business Participation as reported in the electronic Subcontracting Reporting System (ESRS)

· Where: ESRS report found at: www.esrs.gov

· When: Semiannually 31 Mar/30 Sep

· How: Within 30 days of the due dates IAW FAR 52- 219(l)(1)(i), the QAPC validates the SB plan was submitted, and CM validates the accuracy, to include meeting small business goals of 25% or greater IAW Subcontracting Plan

Provide sufficient strategic development for alternative and future process solutions.

Performance acceptable when no more than 25% deviation from the standard.

Performance acceptable when 75% of CAPs are designed effectively to include evidence of proper analysis and identification of any future/target state impacts and assessments and corrective actions related to business process re-engineering. Evidence of adequate coordination with business process and systems owners, and related stakeholders.

The following acceptable criteria and thresholds are also used for annual CPAR evaluation.

Minimum acceptable criteria include the following quality components:

--Sound root cause analysis with justification --Countermeasures clearly address root cause --Measurable results --Identifies parties responsible for execution; address stakeholder issues; comm plan for buy-in/roll out --Realistic and timely Implementation plan (achievable given govt/AF constraints) Minimum acceptable criteria include the following time component:

- Remediation plan with quality components developed within 6 weeks after NFR issued by the IPA Thresholds for CPARS evaluation are as follows:

SATISFACTORY: 75% of CAPS meet quality standards/accepted by Govt within 6 weeks of signed NFR -VERY GOOD: 85% of CAPS meet quality standards/accepted by Govt within 6 weeks of signed NFR –EXCELLENT: 95% of CAPS meet quality standards/accepted by Govt within 6 weeks of signed NFR

· Who: Government business process area/task lead.

· What: Validate CAP steps and planned implementation timeline, related business processes (legacy and target environments) and re-engineering assessment.

· Where: As documented in monthly CAP report.

· When: Within 6 weeks of NFR. As retesting/validation occurs internally or by external audit entities. Government business process/task lead should perform assessment within 30 days of IPA or external auditor related finding.

How: 100% review of CAP and related strategic analysis documentation. Reported to the COR, in a written documented fashion, on at least a bi-weekly basis when performance thresholds are not met.

Provide sufficient strategic development for alternative and future process solutions.

Performance acceptable when no more than 25% deviation from the standard.

Performance acceptable when 75% of implemented/closed CAPs that are retested by the IPA auditor or other external audit entity do not identify the same control or process failures to the extent the proper root cause and corrective action was not identified (taking into consideration no new processes were developed).

· Who: Government business process area/task lead.

· What: Validate CAP documentation, and corrective action information.

· Where: As documented from follow-on IPA auditor’s external auditor’s testing and documentation.

· When: As retesting/validation occurs. Government business process/task lead should perform assessment within 30 days of IPA or external auditor related finding.

How: 100% review of CAP and related strategic analysis documentation. Reported to the COR, in a written documented fashion, on at least a bi-weekly basis when performance thresholds are not met.

Performance acceptable when 95% of NFRs and CAPs are accurately reflected in recurring internal and external NFR and CAP reporting trackers.

· Who: Government business process area/task lead.

· What: Validate NFR and CAP reporting tracker.

· Where: As documented in monthly CAP reporting tracker.

· When: Monthly.

· How: 100% review of CAP reporting tracker. Reported to the COR, in a written documented fashion, on at least a bi-weekly basis when performance thresholds are not met.

Developing and Maintaining Population Completeness Universe of Transactions and Manual Reconciliations (Population Completeness)

Performance acceptable when 95% of population completeness documents are updated within 30 days of any known/key changes, to include business processes and systems capabilities/related requirements development and associated controls.

Performance is acceptable when documented strategies and approaches for data analytics/techniques are presented and initial deployment occurs within 30 days of population or reconciliation gaps.

· Who: Government business process area/task lead.

· What: Validate completeness of Population Completeness and Reconciliation Strategy and Analysis documentation.

· Where: As documented in monthly CAP report (information should be reported as a significant deficiency and identify related CAP development).

· When: First review within 1 month of known population completed or reconciliation gap.

· How: 100% review of CAP and related strategic analysis documentation. Reported to the COR, in a written documented fashion, on at least a bi-weekly basis when performance thresholds are not met.

Provide functional, technical and administrative support services necessary to assist with the development/evaluation of business process requirement policies/processes, system requirements, control requirements, test plans, and mitigation plans for inclusion in updating cycle memos, risk control matrices, and Air Force policy/process requirements (Enduring Audit Readiness-A-123 and Entity Level Controls).

Retained refinement of products, strategy, communication, and training with SAF/FM and office of primary responsibilities on a recurring basis that documents the assessment/evaluation of existing practices, capabilities, policies, best practices, and deficiencies.

Products and strategies must demonstrate compliance with/impacts of noncompliance with Federal Manager’s Financial Integrity Act of 1982, OMB A-123, Federal Financial Management Improvement Act of 1996 and GAO Standards for Internal Controls in the Federal Government Performance acceptable when no more than 5% deviation from the standard.

· Cycle memo updates are made within 15 days of process and control changes/gaps being identified: properly document the current state environment to include complete identification of control gaps

· Test Plans are provided at least 7 days prior to test date and include detailed risk based assessment information

· Test results metrics: Metrics are provided within 30 days of testing

· Annual Statement of Assurance: accurately reflects all material weakness and significant deficiencies as reported during the SOA period

· Training: adequate and timely coverage of new/revised control assessment/testing approaches, allowing for process owners and test managers to incorporate into annual testing cycle

· Who: Government business process area/task lead.

· What: Validate documented analysis/outcomes of strategy/development/training forums/test plans of the related area.

· Where: During recurring bi-weekly reviews of work stream efforts.

· When: bi-weekly

· How: Review a representative sample of documentation and any known issues/concerns reported to the COR, in a written documented fashion, when performance thresholds are not met.

· Memorandums of agreement/understanding, to include related control information, are updated in “draft ready for coordination” form within 30 days of receiving updates/new controls from service providers. The updated MOAs/MOUs should reflect necessary updates for specific roles and responsibilities and reliance/dependencies (to include specifically addressing related CUECs).

· Who: Government business process area/task lead.

· What: MOU/MOA documentation, and control catalogs

· Where: As documented in MOU/MOA and related control information

· When: During recurring bi-weekly reviews of work stream efforts.

· How: Review a representative sample of documentation. Reported to the COR, in a written documented fashion, on at least a bi-weekly basis when performance thresholds are not met.

· Who: Government business process area/task lead.

· What: Monitoring Reports.

· Where: As documented in monitoring reports

· When: During recurring bi-weekly reviews of work stream efforts.

· How: Review a representative sample of documentation. Reported to the COR, in a written documented fashion, on at least a bi-weekly basis when performance thresholds are not met.

· Who: SAF/FMF government managers and/or program managers.

· What: Meeting minutes documentation from each bi-weekly meeting. Action plans resulting for risk areas and potential issues addressed at related meetings.

· Where: Bi-weekly management meeting.

· How: 100% assessment and review of meeting minutes in comparison to management’s known related issues or areas addressed as concerns by management/others. Issues or concerns regarding performance thresholds not being met are reported to the primary COR in a written documented fashion.

Facilitate proper and timely communication with auditors and stakeholders.

(IPA Audit Liaison Support)

Performance acceptable when 95% of communication to MAJCOMs and auditors is provided within 24 hours of receipt of auditor/stakeholder requests.

Performance acceptable when 95% of audit response tool requirements meet stated objectives of the requirements.

Performance acceptable when corresponding back-up plans for any known functionality issues with automated means/tools are initiated within 24 hours, to include communication of the back-up plan to all stakeholders.

· Who: Government business process area/task lead.

· What: Validate timeliness of response out to stakeholders. Validate audit response tool requirements analysis and tool functionality. Assessment of back-up plan initiation.

· Where: weekly reviews of audit requests. Periodic reviews of audit response tool functional requirements, system development and testing documentation.

· When: Within 2 weeks of auditor requests and completion of functional operational capabilities testing.

· How: 100% review of documentation. Reported to the COR, in a written documented fashion, on at least a bi-weekly basis when performance thresholds are not met.

“Ready for review draft” system change requests identifying key control changes are established within 30 days of identifying control gaps and related necessary systems changes.

Within 30 days of known business process changes impacting IT systems/ initiatives, documents the necessary control requirements and related key information to support the service development and delivery.

· Who: Government business process area/task lead.

· What: System change requests and SDDP process initiative documents

· Where: As documented in critical IT system change information and new IT system initiatives

· When: During recurring bi-weekly reviews of work stream efforts.

· How: Review a representative sample of documentation. Reported to the COR, in a written documented fashion, on at least a bi-weekly basis when performance thresholds are not met.

Reference: PWS paragraph XX Performance is acceptable when:

a) Qualified key personnel are on the job at contract start, unless previously negotiated by the CO.

b) Vacancies are filled with qualified key personnel within 21 calendar days of vacancy, unless approved in writing or otherwise directed in advance by the CO

AND

There is no mission impact due to position vacancies or unqualified personnel.

· Provide and retain qualified key personnel

Reference: PWS paragraph XX Performance is acceptable when:

a) 95% of deliverable requirements are met and received on time AND Critical information is accurate.

· Deliverables / Schedule Management

Small Business (SB) Participation Maintain minimum Small Business Subcontracting Requirements IAW contract Section 4, paragraph 4a-7 OR proposed goals, whichever is greater for each category.

Performance is acceptable when all criteria are met. Not meeting the overall SB Requirement of 25% will be considered a Major Nonconformance.

· Small Business (SB) Participation

· What: Accepts completed Monthly Status Report(s)

· When: Upon receipt (NLT COB Eastern Time)

· How: COR and FIAR Support PMO acknowledge receipt of the report via e-mail. The COR reviews report for accuracy and accepts on behalf of the Government via e-mail

Details: Detail trip scope, actions/findings, resources used, and provide a summary to leadership

· What: Accepts completed Trip Reports

· When: Upon receipt (NLT five business days after the Contractor returns from travel)

· How: FIAR Support PMO and COR acknowledges receipt of the report via e-mail. The COR reviews Trip Report for accuracy and accepts on behalf of the Government via e-mail