Appendix-2C-Performance-Management.pdf

PDF 148 KB Posted

Attached to
RFP Enterprise Resource Planning Suite and System integrator Services
Solicitation number
RFP 26-00268-AHAC
Issued by
Philadelphia County, Philadelphia City, Pennsylvania

About this file

This document is a Performance Management appendix (Appendix 2C) for SEPTA's (Southeastern Pennsylvania Transportation Authority) Enterprise Resource Planning (ERP) System Integrator services contract in Pennsylvania. The appendix establishes six Service-Level Requirements (SLRs) to measure the System Integrator's performance, including three critical SLRs subject to financial penalties: Project Release/Milestone Completion-Timeliness (100% of milestones completed within 110% of agreed timeframe), Project Release/Milestone Completion-Budget (100% of milestones completed within 110% of agreed budget), and Deliverable Quality-Rejection Rate (less than 5% of deliverables rejected). The measurement periods are primarily quarterly, with performance reporting required by the 10th business day of each month following the measurement period.

The fee reduction structure places 15% of the applicable annual services fee at risk for each ERP project release, with penalties escalating from 5% for the first critical SLR failure to 15% for the third failure within the same measurement period. If 50% of the annual at-risk fee reduction is reached within a twelve-month rolling period, the agreement is deemed in default. SEPTA retains sole discretion to designate any SLR as critical with 60 days' written notice and may allow the System Integrator to earn back credits if issues are rectified to SEPTA's satisfaction. The three non-critical SLRs cover Resource Quality-Rejection Rate, Resource Management, and Requirements Coverage (100% for required/must-have requirements, 95% for preferred requirements). Service-level exceptions apply for SEPTA-owned system component failures, SEPTA-approved service reductions, and wilful misconduct by SEPTA or third-party contractors.

View the file

Other files

Show all 12

On GovTribe

Work with this file

  • Download the original file
  • Contacts named in this file
  • Similar government files
  • Ask GovTribe AI about this file

Text version

Appendix 2C – Performance Management

Contents

1. Overview

1.1. Introduction

1.2. Definitions

1.2.1. Service-Level Requirements (SLRs)

1.2.2. Critical and Non-Critical SLRs

1.2.3. Fee Reductions

1.2.4. Earn Back

1.2.5. Measurement Period

1.2.6. Milestone Payment Charge

1.2.7. Monthly Service Report

1.2.8. Service-Level Exceptions

1.2.9. New Service Levels

1.3.1. Measurement and Reporting of Measured Services

1.3.2. List of SLRs

1.3.3. SLR Summary Table

Service-Level Requirements (SLR Details)

1.3.3.1. SLR 1 – Project Release/Milestone Completion – Timeliness

1.3.3.2. SLR 2 – Project Release/Milestone Completion – Budget

1.3.3.3. SLR 3 – Deliverable Quality – Rejection Rate

1.3.3.4. SLR 4 – Resource Quality – Rejection Rate

1.3.3.5. SLR 5 – Resource Management

1.3.3.6. SLR 6 – Requirements Coverage

1. Overview

1.1. Introduction

This section outlines the circumstances under which the System Integrator (SI) will be subject to fee reductions for failure to achieve the critical service level requirements (SLRs). For the purposes of this section, "failure" shall mean (a) with respect to any SLR, the failure to meet the specified performance target for the SLR for the applicable measurement interval. This document describes the methodologies associated with measurement of and reporting on the results achieved with regards to the service levels defined below. It sets out remedies for critical service level failures and describes the way in which measured services and service-level requirements may be established or changed.

1.2. Definitions

1.2.1. Service-Level Requirements (SLRs)

Each SLR set forth in this document identifies key performance measures that will be used to evaluate the SI’s delivery of the requested Services. The overarching goal in developing SLRs is to support SEPTA’s objective to manage the SI’s services by monitoring and measuring performance on SEPTA’s critical business requirements for the ERP project. In no event, unless mutually agreed, will the service levels or the fee reductions set forth herein be reduced below the levels at which they are set on the effective date.

1.2.2. Critical and Non-Critical SLRs

Critical SLRs are deemed to carry a penalty for failure to achieve the SLR. On a quarterly basis (every 90 days), SEPTA may unilaterally classify any SLRs as critical, and thus, subject to fee reductions. SEPTA will provide the SI sixty (60) days prior written notice before any new SLR(s) are designated to be critical.

1.2.3. Fee Reductions

The apportionment of “at risk” fee reductions amount for each release of ERP project for failure to meet agreed SLRs is 15% of the then applicable annual services fee.

SEPTA and the SI acknowledge that critical service levels have been set to meet the organization’s minimum business requirements and therefore when a critical service level is missed, fee reductions will apply as follows:

• First occurrence – For the first service level failure for a critical SLR during a measurement period, a 5% credit of the milestone payment charges will be calculated and retained for yearly reconciliation.

• Second occurrence – For the second service level failure for a critical SLR during the same measurement period, an additional 5% credit (for a total of 10%) of the milestone payment charges will be calculated and retained for yearly reconciliation.

• Third occurrence – For the third service level failure for a critical SLR during the same measurement period, an additional 5% credit (for a total of 15%) of the milestone payment charges will be calculated and retained for yearly reconciliation.

Should 50% of the annual “at risk” fee reduction be reached prior to the end of a twelve (12) month rolling period, the Agreement shall be deemed to be in default, and such other provisions will apply as outlined in the Agreement.

SEPTA expects to develop new SLRs to reflect changing needs or new projects, and SLRs may be added to or deleted from, and critical classification of SLR’s may be modified at SEPTA’s sole discretion.

In the absence of any modifications, the performance targets, SLRs and measurement intervals therein shall apply to all contract years.

1.2.4. Earn Back

At its sole discretion, SEPTA may allow the SI to earn back the credits if all issues are rectified to SEPTA’s satisfaction within the timeframe and any other conditions as agreed to between SEPTA and the SI are met.

1.2.5. Measurement Period

Measurement period means the time during which a service level is to be measured. If the “measurement period” is designated as “monthly,” it shall mean the period commencing 12:00 a.m. on the first day of each month and ending 12:00 a.m. on the first day of the following month and if the “measurement window” is designated as “annually,” it shall mean the period commencing 12:00 a.m. on the first day of each contract year and ending 12:00 a.m. on the first day of the following contract year.

1.2.6. Milestone Payment Charge

Milestone payment charge means, for any given agreed payment milestone, the actual dollar amount of all fees billed to SEPTA for services provided for such milestone pursuant to Statements of Work for the ERP project. For clarity, the milestone payment charge does not include any fees related to Application Management Services.

1.2.7. Monthly Service Report

Monthly performance report means the SI will measure metrics reasonably required by SEPTA to determine the SI’s performance services against the target performance measurements. The SI will maintain complete and accurate logs of all such data for the duration of the agreement and will provide access to such logs forthwith upon SEPTA’s request.

Note – any SLRs for which SEPTA does not receive the SLR performance report by the 10th business day of the month following are deemed to have been not attained and subject to SLR fee reductions.

1.2.8. Service-Level Exceptions

In addition to the force majeure and other provisions which excuse or mitigate the SI’s obligations under the Agreement, the SI shall not be responsible for a failure to meet any service level to the extent that such failure is directly caused by any of the following:

a. Fee reductions will not be in effect for service outages and missed service levels due to system components owned or controlled by SEPTA. SEPTA and the SI will conduct a root cause analysis to determine reasons for outages.

b. Wilful misconduct or violations of law by SEPTA or their third-party SIs.

c. Service reductions requested or approved by SEPTA and agreed to by the parties through an Amendment; provided that the SI has previously notified SEPTA in writing, as part of such process, that the implementation of such request would result in such failure to meet the service level.

1.2.9. New Service Levels

The parties may agree to add or otherwise make changes to the service levels in accordance with the change process (as evidenced in Attachment 02 –Background, Scope and Proposal Instructions). In respect of a service to be added to the services pursuant to the change process, the parties will discuss and agree upon the status of the added service as a service level, the measurement tools and the methods of calculation to be used for monitoring and reporting on such service, the service levels applicable to such service and, if the added service is to be a service level, the termination triggers for such termination measured service.

When setting a new service level, the performance target for the new service level will be set as follows (in order):

a. By mutual agreement between SEPTA and the SI; or

d. Engaging a third party to identify a commercially common target and measurement calculation aligned with the agreement; or

e. Observing three (3) months of performance and setting the target to the average performance.

At SEPTA’s request, the SI will provide to SEPTA performance data recorded by the SI in connection with the services for the purpose of assisting SEPTA with the implementation of any such changes.

1.3. Service Level Monitoring and Measurement

The SI will continuously monitor the systems and the services in order to identify, report and correct service level failures and to ensure that the SI is meeting or exceeding the service levels as required hereunder. The SI will give notice to SEPTA immediately if the SI knows that the SI has failed or will fail to achieve a service level.

1.3.1. Measurement and Reporting of Measured Services

The SI will measure all data reasonably required by SEPTA to determine the SI’s performance of the measured services against the applicable service levels set out in Attachment 02 – Background, Scope and Proposal Instructions or subsequent Statements of Work (SOWs) under the Agreement. Without limiting the foregoing, the SI will keep complete and accurate logs of all such data for no less than duration of the agreement and will provide SEPTA with access to such logs forthwith upon SEPTA’s request.

On or before the tenth calendar day of each calendar month or as otherwise requested by SEPTA, SI will deliver to SEPTA a report (a “monthly performance report”), in a form and format approved by SEPTA, containing:

a. For each measured service and with respect to the immediately preceding calendar month, all data relating to the provision of the service during the applicable month.

b. For each measured service during the immediately preceding calendar month, details of the SI’s performance as measured against the service levels for such service during the applicable month.

c. Details of any excusable event the SI believes has impacted the measured services during the applicable month; and

d. Any other information reasonably requested by SEPTA from time to time.

For any service levels with a measurement period of longer than a month, the provision of item

b. above shall apply for the calendar month on which the final date of the measurement period for such service falls.

Upon SEPTA’s request for data and details for a measured service in respect of a day, the SI will provide to SEPTA a report, in a form and format approved by SEPTA, containing, for each measured service:

a. All data relating to the provision of the measured service during the applicable day.

b. Details of the SI’s performance as measured against the service levels during the applicable day.

c. Details of any measured services that were supposed to be performed during the applicable day that were not fully performed as required; and

d. Details of any measured services that were supposed to have been performed during a previous day but that were not fully performed as required on that day, and the status of such measured services.

As required (for SI owned data), the SI will provide SEPTA with an electronic feed of all data, immediately upon collecting the data, in a form and format that will enable SEPTA to use, copy, sort, manipulate, modify, analyse, extract, translate, and load the data without a requirement that SEPTA undertake modifications to the data or the form or format in which it was delivered in order to do so, or in any other form and format mutually agreed to by the parties.

In generating data for reports provided by the SI, the SI will use, for each service level, the measurement tools and methodologies needed to adequately measure each service level, or such other means as reasonably required by SEPTA to confirm the SI’s compliance with the service levels.

The monthly performance reports, daily reports, raw data, detailed supporting information, and any other data or information provided will constitute confidential information of SEPTA, in accordance with the confidentiality provisions of the Agreement and applicable public records laws.

1.3.2. List of SLRs

The Service-Level Requirements (SLRs) set forth in this section define the performance standards that the System Integrator (SI) is required to measure, report, and consistently achieve commencing upon the effective date of the Agreement.

SI must consistently meet the following SLRs.

1.3.3. SLR Summary Table

The table below provides a summary of all SLRs, indicating their designated criticality:

# SLR Name Criticality 1 Project Release /Milestone Completion - Timeliness Critical 2 Project Release/Milestone Completion – Budget Critical 3 Deliverable Quality – Rejection Rate Critical

4 Resource Quality – Rejection Rate Non-Critical

5 Resource Management Non-Critical

6 Requirements Coverage Non-Critical

Service-Level Requirements (SLR Details)

1.3.3.1. SLR 1 – Project Release/Milestone Completion – Timeliness Project Release/ Milestone Completion - Timeliness SLR Service Measure Performance Target

Project Release/ Milestone Completion within agreed timeframe

Percentage of Project Release/Milestone completed within agreed time frame

100% of Milestones completion within 110% of agreed time frame.

Formula Performance (%) is based on the number of milestones completed within 110% of timeframe divided by total number of milestones in measurement period

Measurement Interval

Measure Quarterly

Reporting Period Report Quarterly Measurement Tool/Source Data

TBD

1.3.3.2. SLR 2 – Project Release/Milestone Completion – Budget Project Release/ Milestone Completion - Budget

Project Release / Milestone Completion within Budget

Percentage of Project Release/Milestone completed within Budget

100% of Milestones completion within 110% of agreed budget.

Formula Performance (%) is based on the number of milestones completed within 110% of budget divided by total number of milestones in measurement period

Measurement Interval

Measure Quarterly

Reporting Period Report Quarterly Measurement

1.3.3.3. SLR 3 – Deliverable Quality – Rejection Rate

Deliverable Quality – Rejection Rate

Deliverable Quality – Rejection Rate

% of deliverables during the review period that have been rejected due to incompleteness or other quality issues

Less than 5% of deliverables

Formula Performance % is based on (X/Y) where Y is the number of deliverables due in the assessed period and X is the number of deliverables that were rejected due to quality issues.

Measurement Interval Measure Quarterly Reporting Period Report Quarterly Measurement

1.3.3.4. SLR 4 – Resource Quality – Rejection Rate

Resource Quality – Rejection Rate

Resource Quality

– Rejection Rate

% of resources requested to be replaced by SEPTA in measurement period

Less than 5% of resources

Formula Performance % is based on (X/Y) where X is the number of resources requested to be replaced by SEPTA, and Y is the total number of resources

Measurement Interval Measure Quarterly Reporting Period Report Quarterly Measurement

1.3.3.5. SLR 5 – Resource Management

Resource Management SLR Service Measure Performance Target Notice of Resource Change

Time frame for the SI to inform SEPTA prior to changing resources

100% within 90 calendar days

Resource Issue Responsiveness

Time frame taken by the SI to respond to SEPTA’s request to replace a resource

100% within 5 business days

Replacement Resource Availability

Time frame taken by the SI to propose a replacement resource upon agreeing to remove any resource

100% within 15 business days

Formula Performance (%) is based on the number of agreed actions that are completed within the target dates, divided by the total number of agreed actions in the measurement interval

Measurement Interval Measure Quarterly Reporting Period Report Quarterly Measurement Tool/Source Data TBD

1.3.3.6. SLR 6 – Requirements Coverage

Requirements Coverage

Requirements Coverage

% of business requirements successfully delivered and tested

100% for required, must have requirements 95% for preferred requirements

Formula Number of requirements delivered and successfully tested (i.e., passed all associated test cases) divided by total number of approved business requirements in the measurement interval

Measurement Interval Measure Monthly (interval may be more or less frequent depending on project phase)

Reporting Period Report Monthly (reporting may be more or less frequent depending on project phase)

Measurement Tool/Source Data TBD

File details come from the government source that posted it. Updated .