Atch 5- Tunner Performance Metrics.pdf

METHODOLOGY FOR TUNNER PERFORMANCE METRICS

1. A concerted effort shall be made to minimize the amount of reconciliation of the data collected by both the Contractor and the Government without sacrificing reliability of the TSSA rating system.

All metrics will be regional, with four regions: East, West, CONUS‐South and CONUS‐North;

every Tunner operating base is assigned by the Government to one of the four regions, defined as follows:

CONUS-North: Within the 48 contiguous United States, north of 37.0 degrees north latitude

CONUS-South: Within the 48 contiguous United States, south of 37.0 degrees north latitude

Eastern: Outside of the 48 contiguous United States, east of 85.0 degrees west longitude and west of 60.0 degrees east longitude

Western: Outside of the 48 contiguous United States, west of 85.0 degrees west longitude and east of 60.0 degrees east longitude

2. The Government will provide a list of all active Tunner locations by region to the Contractor and will revise the list as required. The required minimum TSSA for each region per the user Operational Requirements Document (ORD) is 72 percent. The Contractor will be evaluated for compliance with the monthly 72 percent TSSA requirement for each of the four geographic regions.

3. Data Adjustments:

a. The data from the USAF’s Defense Property Accountability System (DPAS) is subject to occasional errors. Sometimes field maintainers report the odometer mileage readings in lieu of the engine hour meter readings; report work orders, jobs, or parts orders multiple times; claim Not Mission Capable for Supply (NMCS) status before they order parts; and sometimes bases will inconsistently enter data into DPAS. The Tunner team (Government and Contractor) jointly analyzes and reconciles the data each month to correct reporting errors of operating hours (engine-on time); duplication of work orders, jobs, and/or part orders; NMCS times; and the Government contacts bases that have not reported. Any other errors discovered during this process are also addressed. The Government is the final approval authority for adjustments to the data.

b. For loaders not reported, the Government will calculate the monthly Elapsed Time Indicator

(ETI) values based on any other available information (such as field reports). Lacking that, the Government will set the ETI reading to the prior month’s value, resulting in zero hours for the month.

4. TSSA Requirement Adjustment from 72% to 68%: Review of historical data reveals the post‐ reconciliation number is still affected negatively approximately 2% due to remaining data errors.

Therefore, the requirement is adjusted downward by 2% in lieu of further data corrections due to the excessive investigation time required to correct these remaining errors. The Government has also determined, from review of historical data, that maintainers are not regularly reporting minor maintenance work orders separately as they should using AF Form 1827 as was assumed when identifying the requirement of 72%; therefore, the requirement is adjusted downward by another 2%. This results in the contractual TSSA requirement of 68% as follows:

TSSA requirement of 72% ‐ 2% for errors ‐ 2% for not using minor maintenance work orders = contractual TSSA requirement of 68%.

5. TSSA definitions:

a. TSSA is defined as: TSSA = ETI / (ETI + NMCS + DL) X 100%

Where:

ETI: Elapsed Time Indicator (accumulated operating hours (engine-on time)) NMCS: Not Mission Capable for Supply (accumulated time in hours) DL: Direct Labor (actual accumulated time in hours spent performing unscheduled maintenance; all other maintenance downtime is not counted since the Contractor has no control over Government maintenance priorities)

(All times are accumulated for one month)

The calculated TSSA number shall be rounded off to the nearest tenth (i.e., 71.94% is 71.9%, and 71.96% is 72%).

b. Other Definitions.

i. Failure: event, or inoperable state, in which any item does not or did not perform as intended

ii. Field Data Inputs: data used to calculate metrics shall come from DPAS and the Contractor’s metric database

iii. Not Mission Capable for Maintenance (NMCM): the total clock time (24 hours per day) the system is rendered not mission capable while maintenance is being performed

iv. Not Mission Capable for Supply (NMCS): the total clock time (24 hours per day) the system is rendered not mission capable while awaiting parts; same as vehicle down for parts; applies only when NMCS status is declared by the Government and entered into DPAS; if Saturday, Sunday or holiday delivery of an NMCS causing part was possible but refused by the Government, the NMCS end date will be amended as if it was delivered on that Saturday, Sunday or holiday; if an attempted delivery on any given day of an NMCS causing part at a Government base or port was not accepted and was documented by a third party, the NMCS end date will be amended as if the part was delivered that day

v. DPAS: a Government information management system used at each maintenance facility to track vehicles, fleet operations, vehicle dispatch operations, maintenance cost, and utilization data

vi. Scheduled Maintenance: periodic prescribed inspection and/or servicing of loader accomplished on a calendar, mileage, or hours of operation basis

vii. Unscheduled Maintenance: any maintenance activity required as a result of random failures of the loader and not of a periodic or scheduled basis

viii. Vehicle Down for Parts (VDP): another term for NMCS

ix. Work order: the DPAS form used to record maintenance data

6. Each Month - Hours and TSSA Determination:

a. By the 5th working day of the month (“working days” are defined as excluding weekends (Saturday and Sunday) and Federal holidays): The Contractor shall make available to the Government all data for parts ordered in the previous month, including:

i. Part Number

ii. Loader for which the part was ordered (identified by Air Force registration number)

iii. Work order number

iv. Date and time order was received by the Contractor

v. Date and time parts ordered were received by the Government customer

b. By the 10th working day of the month:

i. The Government will receive data from DPAS from the field operating bases for each loader, including information on operating hours, work orders, jobs, and parts ordered in the previous month.

ii. The Government will process the received data to correct significant errors.

c. By the 13th working day of the month:

i. The Government will provide the processed DPAS data from the field operating bases to the Contractor.

(This data, as of the 10th working day of the month, will be considered the total of all field reports, and will not be updated further throughout the monthly analysis process. Any reports from field operating bases received by the Government after the 10th working day of the month will only be used for final calculation of evaluation period TSSA numbers [see para. 7.c. below])

d. From the 13th–16th working days of the month:

i. The Contractor shall perform analysis of the DPAS data provided by the Government, to include operating hours, NMCS hours, and direct labor hours. The data will be analyzed for each loader. Details below:

ii. Operating hours:

NOTE: “operating hours” are defined in this document as the elapsed time recorded on the Engine Time Indicator (ETI). Each Tunner loader is equipped with an ETI (part of the tachometer; see TO 36M2-3-35-14, Figure 85, Index 76/3). The ETI is the only source of operating hours accepted by the Government.

a) For loaders reported in DPAS, the initial assumption will be that the DPAS ETI data is correct. However, the Contractor may compare DPAS data with Contractor ETI information from work orders and field service technician reports.

b) For loaders not reported in DPAS, actual operating hours for each loader will be estimated based on other (non-DPAS) sources, such as field technician ETI reports or work order ETI records.

c) Or, lacking such information for a loader, zero (0) hours will be used as the operating hours for that loader for that month.

d) Engine hours accumulated while loaders are in overhaul status (from induction at the

Contractor’s facility until delivery to the Government) will not be used for calculating TSSA. This is because no direct labor hours for maintenance required when received due to field neglect will be included in the DPAS. The Contractor shall provide the government program office with the actual ETI readings at the point of entering and exiting the overhaul process at the Contractor’s overhaul facility.

iii. NMCS hours:

a) The Contractor shall consider the NMCS data in DPAS to be accurate. Only work order entries with NMCS declared in DPAS shall be considered for NMCS calculations.

b) Exception: The Contractor may propose to the Government that the NMCS data be revised when the TSSA for a region is below the contractual threshold (adjusted 68%).

Such revision will be based on the actual date and time the order is placed, and the actual date and time the part is delivered to the unit (as documented in the Contractor’s records). Proposed revisions to NMCS shall be calculated using:

• the latter of either the date and time when the USAF ordered the part from the

Contractor or the date and time when the USAF declared NMCS in DPAS (starts NMCS clock)

• and the earlier of either the date and time of signature/receipt at the operating base, or the date and time when the USAF declares the end of NMCS in DPAS (stops NMCS clock).

(Convert all times to a single standard time zone, and use for all NMCS calculations, to ensure actual elapsed time is recorded.)

iv. Direct Labor hours:

NOTE: Direct Labor hours are maintenance man-hours charged for unscheduled maintenance not related to accidents or abuse. The Contractor may communicate obvious reporting errors in the DPAS data to the Government. There shall be no Contractor effort to adjust those hours on the WOs; however, the Government may choose to investigate obvious errors.

a) Incidents to be assessed as accident-caused or abuse-caused will be identified by combining the work order numbers coded “accident” and “associated jobs” or coded “abuse” in DPAS, with those declared “accident” or “abuse” when the part was ordered and reported in incident reports from the field or call center reports as “accident” or “abuse”. No determination of root cause or proof beyond these "first-hand" reports will be investigated. Note: Parts ordered/replaced because of Government loss or misplacement shall be considered “abuse”.

b) Reported Direct Labor hours shall exclude all hours of work performed under the following work order codes: All 43 (except 43AA, which will be included), all 34, all 35, 01HX, routine 05LT, and all 29R system codes. However, there could be cases in which it is appropriate to include some other 43 system codes besides 43AA. A Time Compliance Technical Order (TCTO) and the associated base-level road testing may be included if the Government determines the primary purpose of the TCTO is to correct a Contractor-caused deficiency.

c) Reported Direct Labor hours shall exclude all hours for repairs accomplished because of the use of biodiesel fuel. The following examples are provided to illustrate the type of repair actions to be excluded: (1) repairs to cab heaters or any related components, such as cab heater fuel tanks and lines, due to the use of biodiesel (Note: Biodiesel is not authorized for use in the cab heater); (2) biodiesel-related repairs to loaders containing biodiesel, which are stored in WRM (Level A), active storage (Level B or C), low-use, or cold-weather location. Collaborating evidence must be provided and root cause determination confirming a biodiesel failure must be approved by the Government.

d) Reported Direct Labor hours shall exclude all hours (and/or NMCS hours) directly associated with the DLSP-160 Tunner/dock interface. The DLSP-160 is a system that synchronizes the high-line dock conveyor speed with the Tunner conveyor speed and operates the two systems from a remote cable that can reach both the Tunner deck and high-line dock.

e) Reported Direct Labor hours shall exclude System Codes beginning with “33” (Engine tune-up is a requirement of the scheduled inspection at 1500 hours, or every 3 years;

any tune-ups accomplished in addition to this schedule shall be chargeable).

f) Where the Government agrees that sufficient documentation exists, maintenance direct labor hours that were expended due to the incorrect field installation of a TCTO are to be excluded. Examples would be “failed to hook up sensor,” “did not fully seat a connector disturbed during the installation,” etc. (these are obvious maintainer-induced issues and should not be chargeable to the Tunner TSSA).

g) Reported Direct Labor hours shall exclude Work Orders created to repair off-Tunner items in local spare parts inventory. Such items may include tires, manifolds, conveyor assemblies and like items for which the Air Force has the skills, data and resources to effect repair of such commodities.

e. No later than close of business on the 16th working day of the month:

i. The Contractor shall determine, and provide to the Government:

a) The Contractor’s assessment of the operating hours (engine-on time) for each Tunner loader in the preceding month. This assessment may compare Government-provided DPAS data with Contractor information from work orders and field service technician reports.

b) If applicable, any Contractor-proposed revisions to the DPAS NMCS data.

c) If applicable, any Contractor-proposed revisions to the DPAS Direct Labor data.

f. Between the 16th working day of the month and close of business on the 25th of the month

(not 25th working day)

i. The Contractor shall work with the Government representative to come to mutually agreed hours for the previous month, for all four regions and all three metrics (operating hours, NMCS hours, and Direct Labor hours).

ii. The Government will use the final hours to determine the TSSA for each region for the previous month.

(The Government is the final authority on hours for each month.)

g. The final monthly report for each month, issued by the Government, of operating hours, NMCS hours, and Direct Labor hours will be reported by the four regions, not by base or by Tunner. There shall be no minimum hours of usage addressed.