J.7_Sample_NPMRDS_Quarterly_Validation_Report.pdf

National Performance Management Research Data Set

DTFH61-13-R-00002

Data Quality Validation

Quarterly Report Prepared For

Federal Highway Administration (FHWA)

Prepared By

Chen-Fu Liao University of Minnesota

500 Pillsbury Drive, SE Minneapolis, MN 55455

October 2016

FHWA NPMRDS Data Validation TOC-i

Table of Contents

Executive Summary .......................................................................................................................... i

1. Introduction

2. Summary of Data

2.1 HERE Data

2.2 Reference Data

2.2.1 Assumption and Limitation

2.2.2 Weigh-In-Motion (WIM) Data

2.2.3 Microwave and Inductive Loop Data

2.2.4 Bluetooth Travel Time Data

2.3 Data Preparation

3. Data Validation Metrics

3.1 Threshold Targets

3.2 Average Absolute Speed Error (AASE)

3.3 Standard Error of the Mean (SEM)

4. Validation Results

5. Calibration

FHWA NPMRDS Data Validation TOC-i

Executive Summary

Data validation was performed on the FHWA National Performance Management Research

Data Set at 15 geographic locations selected throughout the U.S. in a mix of urban and rural locations where reference data collected by equipment at stationary points was available. The validation process in this quarter included 149,964 samples of probe vehicle data, which each consist of an average travel time along a Traffic Message Channel (TMC) roadway segment during a unique 5-minute interval. This validation covers 53.8 miles of TMC roadway segments.

Weigh-In-Motion (WIM), microwave, and Bluetooth data at reference sites were obtained from state DOT-owned devices. Each location was analyzed during the morning peak period, evening peak period, and off-peak period to study accuracy during varying levels of congestion and volume. Average Absolute Speed Error (AASE) and Standard Error of the Mean (SEM) are used to compare the reference data with the probe data set. Speed accuracy and error in four speed ranges (0-30 MPH, 30-45 MPH, 45-60 MPH, and ≥ 60 MPH) in each time period were calculated.

Statistics of speed bin with data size less than 5 records in a time period were excluded due to relatively small sample size. The analysis performed for this quarterly report covers data from

August 2016.

One limitation of the reference data used for this validation is that these data are collected from a fixed location within each TMC segment. Because the reference data is from a fixed location/point, it may not fully represent travel time across the full TMC. Reported travel time is based on instantaneous probe speeds reported across the full TMC, so the comparison to reference data is an approximation. Factors such as entry/exit points, weigh stations, rest areas and steep grade may influence the speeds recorded across a TMC.

ES Tables 1-3 summarize the averages of the comparison between the probe vehicle data and the reference data for all vehicles, freight vehicles and passenger vehicles for freeway segments during the above noted time periods. The AASE is the average absolute value of the difference between the mean speed computed from probe vehicle data and the reference mean speed for each epoch (5-minute) time period. Standard Error of the Mean (SEM) is the standard deviation of the error in the average probe vehicle speed relative to the mean of reference speed. SEM is an estimate of how close to the mean of reference speed that the mean of probe vehicle speed is likely to be. For example, an AASE value of 4.5 means the average reported speed is 4.5 MPH higher or lower than the reference speed in a particular time period. AASE below 10 MPH are usually considered as meeting specifications and AASE below 5 MPH are considered exceptional quality.

FHWA NPMRDS Data Validation ii

ES Table 1: As shown, the AASE and SEM are within specification for all speed bins for all vehicles.

ES Table 2: As shown, the AASE and SEM are within specification for all speed bins for freight vehicles.

ES Table 1 Summary Data Quality Measures for All Roadway Segments Tested (All Vehicles)

All Vehicles AM Peak Mid-Day PM Peak

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph 1.44 1.79 452 2.91 1.83 706

30 - 45 mph 5.05 2.12 1,328 2.45 1.76 4,121 3.63 2.28 1,214

45 - 60 mph 5.36 1.43 4,370 5.77 1.61 9,850 5.10 1.63 3,988

> 60 mph 2.96 1.01 8,851 3.25 0.96 22,199 3.48 1.16 9,351

All Speed 3.41 1.22 15,001 3.33 1.18 36,876 3.53 1.37 15,299

ES Table 2 Summary of Data Quality Measures for All Roadway Segments Tested (Freight Vehicles)

Trucks AM Peak Mid-Day PM Peak

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph 2.86 1.28 2,912 3.36 1.79 8,081 2.29 1.38 3,280

> 60 mph 2.70 0.72 5,271 2.33 0.63 13,284 1.99 0.72 5,122

All Speed 2.71 0.95 8,479 2.71 0.89 21,435 2.35 1.01 8,447

FHWA NPMRDS Data Validation iii

ES Table 3: As shown, the AASE and SEM are within specification for all speed bins for all passenger vehicles.

ES Table 3 Summary of Data Quality Measures for All Roadway Segments Tested (Passenger Vehicles)

Cars AM Peak Mid-Day PM Peak

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph 6.91 1.93 1,636 6.64 2.05 2,281 6.49 1.71 1,222

> 60 mph 3.26 1.18 8,055 3.20 1.07 22,405 3.41 1.24 8,828

All Speed 3.50 1.28 9,691 3.43 1.15 24,686 3.60 1.27 10,050

This report provides information on the dataset and reference data, the methodology and metrics used, and results of the analysis.

FHWA NPMRDS Data Validation 1

1. Introduction HERE North America, LLC (formerly known as Nokia/NAVTEQ) was selected by FHWA to provide the National Performance Management Research Data Set (NPMRDS). The NPMRDS dataset is derived based on passenger vehicle data from HERE probe sources and truck data from the

American Transportation Research Institute (ATRI).

As with any technical analysis that employs a large dataset from multiple sources, it is necessary to perform data validation analyses to ensure that the data is accurate and irregularities are minimized and mitigated. Data quality analyses were performed to compare the dataset to a variety of reference data. The objective of this validation analysis is to ensure users that the data provided to users is within acceptable error tolerances.

The analysis includes 15 geographic locations as validation test segments. Each location is analyzed during the morning peak period, evening peak period, and off-peak period to study accuracy in varying levels of congestion and volume.

Average Absolute Speed Error (AASE) and Standard Error of the Mean (SEM) are used to evaluate speed accuracy and error in four speed ranges (0-30 MPH, 30-45 MPH, 45-60 MPH, and ≥ 60 MPH) in each time period. Statistics of speed bin with data size less than 5 records in a time period were excluded due to relatively small sample size.

2. Summary of Data

2.1 HERE Data

The August 2016 FHWA National Performance Management Research Data Set (NPMRDS) was received from HERE for data validation. A Traffic Message Channel (TMC) file contains TMC segment geometry information. A database file set includes average travel times of passenger, freight and combined for identified roadways geo-referenced to TMC segment IDs.

The TMC Static data file includes the following information:

TMC ID

Country

State

County

Distance (length of TMC in miles)

Road Number

Road Name

Latitude

Longitude

Road direction

FHWA NPMRDS Data Validation 2

The Travel Time data file includes the following information:

TMC ID

Date (MMDDYYYY)

EPOCH (5 minute increment, in the range 0-287)

Travel Time – all vehicles (seconds)

Travel Time – Passenger vehicles (seconds)

Travel Time – Freight vehicles (seconds)

2.2 Reference Data

The analysis includes 15 geographic locations, illustrated in Figure 1, as validation test segments. The 15 test segments were selected throughout the U.S. in a mix of urban and rural locations, where reference data is available based on the following criteria:

• Traffic volume (greater than 8000 vehicles per day)

• Within 2 miles of a WIM station or available reference data source

• Roadway type (interstate, state highway, arterial, etc.)

• Roadway geometry (grade < 6% and curve radius > 100 m)

Each location is analyzed during the morning peak period, evening peak period, and off-peak period to study accuracy in varying levels of congestion and volume. The analysis performed in this quarter includes 149.964 samples of probe data, which is an average travel time of a TMC segment for a 5-minute interval, from August 2016 and covers 53.8 miles of roadway segments.

FHWA NPMRDS Data Validation 3

Figure 1 Map of Data Validation Sites

2.2.1 Assumption and Limitation

With the assistance of FHWA, the data validation team was able to receive WIM and other types of reference data from state DOTs. It is assumed that the reference data received from public agencies are correct, although the Research Team will monitor the data closely for anomalies. If reference data looks suspicious, further investigation of source data may be conducted.

One limitation of the reference data used for this validation is that these data are collected from a fixed location within each TMC segment. Because the reference data is from a fixed location/point, it may not fully represent travel time across the full TMC. Reported travel time is based on instantaneous probe speeds reported across the full TMC, so the comparison to reference data is an approximation. Factors such as entry/exit points, weigh stations, rest areas and steep grade may influence the speeds recorded across a TMC.

Existing reference data are often collected from locations (for example, interstate or state highways in urban or suburban areas) where traffic volumes are relatively high. Currently, the reference data sources on rural arterials with low traffic volume are very limited. The data

FHWA NPMRDS Data Validation 4 validation team recognizes this limitation and will work with FHWA to identify locations with a variety of attributes from which the team can collect reference data. The data validation team will continuously explore ways to obtain or collect reference data in rural and low traffic volume locations.

2.2.2 Weigh-In-Motion (WIM) Data

Weigh-In-Motion (WIM) sensors are installed for roadway pavement management. WIM data that includes speed, class, and weight information of each individual vehicle are great reference data to validate speed performance for passenger and freight vehicles. WIM data with vehicle class 9 and above is compared with freight probe vehicle data. WIM speed with vehicle class less than 9 is compared to the passenger vehicle speed.

The WIM data files obtained from State DOTs include the following key information:

FIPS State Code

Station ID

Direction of Travel Code

Lane of Travel

Year of Data

Month of Data

Day of Data

Hour of Data

Minute of Data

Vehicle Class

Vehicle Speed

Total Weight of Vehicle

Number of Axles, Axle Spacing, Axle Weight and others

2.2.3 Microwave and Inductive Loop Data

Reference data from calibrated microwave sensors and loop detectors (no vehicle classification information) was used to validate speed performance for all vehicle types in urban and congested areas.

The microwave and loop detector reference data includes the following key information:

METRO_NAME

AGENCY_ABBR

SENSOR_ID

DIRECTION_ABBR

LANE_TYPE_DESC

FHWA NPMRDS Data Validation 5

LATITUDE

LONGITUDE

FIVE_MIN_START

SPEED

2.2.4 Bluetooth Travel Time Data

Reference data from Bluetooth readers (no vehicle classification information) was used to validate speed performance for all vehicle types in urban and congested areas. The Bluetooth travel time data is derived from a pair of readers. It includes the following key information:

Pair ID

Updated Time

Road Name

Origin ID & Description

Destination ID & Description

Latitude

Longitude

Travel Time

Travel Speed

Free Flow Speed

2.3 Data Preparation

All probe vehicle data and reference data in text format were loaded to a PostgreSQL database server. Several SQL scripts were written to prepare reference data in a consistent format for data validation. No data filtering was made to either the reference data or the probe vehicle data received from HERE.

Each reference site is spatially joined with a nearby TMC segment in the same traffic direction using the ArcGIS software. Corresponding length of the identified TMC segment is then used to compute average probe vehicle speed in that particular roadway segment.

3. Data Validation Metrics Average Absolute Speed Error (AASE) and Standard Error of the Mean (SEM) are the metrics used in the report and are similar to those used in other probe quality analyses. AASE is used to evaluate speed accuracy and error in four speed ranges (0-30 MPH, 30-45 MPH, 45-60 MPH, and ≥ 60 MPH) in each time period. Data validation is performed in the following three time periods.

AM Peak (6AM – 9 AM or EPOCH 72 - 107)

Morning Off-Peak (9AM – 4PM or EPOCH 108 - 191)

FHWA NPMRDS Data Validation 6

PM Peak (4PM – 7PM or EPOCH 192 - 227)

The average probe vehicle speed in an epoch is assigned to one of the speed bins for validation using the follow criteria.

0-30 MPH bin: 0 < 𝑉_𝑝𝑟𝑜𝑏𝑒𝑖 < 30

30-45 MPH bin: 30 ≤ 𝑉_𝑝𝑟𝑜𝑏𝑒𝑖 < 45

45-60 MPH bin: 45 ≤ 𝑉_𝑝𝑟𝑜𝑏𝑒𝑖 < 60

≥ 60 MPH bin: 𝑉_𝑝𝑟𝑜𝑏𝑒𝑖 ≥ 60

3.1 Threshold Targets

The data quality threshold selected for Average Absolute Speed Error (AASE) is 10 MPH based on the limitation of reference data as described in section 2.2. AASE below 10 MPH are usually considered as meeting specifications and AASE below 5 MPH are considered exceptional quality. The data quality threshold selected for Standard Error of the Mean (SEM) is 5 MPH.

SEM below 5 MPH is usually considered as meeting specifications.

3.2 Average Absolute Speed Error (AASE)

The AASE is defined as the mean absolute value of the difference between the mean speed computed from the HERE travel time data and the reference mean speed for each epoch (5-minute) time period. The validation team uses AASE as the primary accuracy metric.

The speed data from the probe vehicles shall have a maximum average absolute error of 10 miles per hour (MPH) in each of four speed ranges: 0-30 MPH, 30-45 MPH, 45-60 MPH, and ≥

60 MPH. The AASE in the lower two speed bands have proven to be the critical specification

(and most difficult) to attain.

For each speed bin, the AASE is calculated as follows.

𝐴𝑆𝐸𝑖 = |𝑉_𝑝𝑟𝑜𝑏𝑒𝑖 − 𝑉_𝑏𝑒𝑛𝑐ℎ𝑚𝑎𝑟𝑘𝑖| Eq. (1)

𝐴𝐴𝑆𝐸𝑝 =

∑ 𝐴𝑆𝐸𝑖𝑝

𝑁𝑝 ⁄ Eq. (2)

Where, 𝐴𝐴𝑆𝐸𝑝 is the AASE in time period p, i is the ith epoch (5-minute interval), 𝑉_𝑝𝑟𝑜𝑏𝑒𝑖 is the average probe vehicle speed in epoch i, 𝑉_𝑏𝑒𝑛𝑐ℎ𝑚𝑎𝑟𝑘𝑖 is the average reference vehicle speed in epoch i, 𝐴𝑆𝐸𝑖 is the absolute vehicle speed error in epoch i, p is the AM/PM peak or morning off-peak time period, FHWA NPMRDS Data Validation 7

∑ 𝐴𝑆𝐸𝑖𝑝 is the sum of absolute vehicle speed errors in time period p, and

𝑁𝑝 is the number of epochs in time period p.

3.3 Standard Error of the Mean (SEM)

The Standard Error of the Mean (SEM) is the standard deviation of the error in the average probe vehicle speed relative to the mean of reference speed. SEM is estimated by the probe vehicle speed standard deviation divided by the square root of the sample size.

𝑆𝐸𝑀𝑖 =

𝑆𝐷𝑖

√𝑆𝑖 ⁄ Eq. (3)

Where, 𝑆𝐸𝑀𝑖 is the SEM in epoch i, 𝑆𝐷𝑖 is the speed standard deviation in epoch i, and

𝑆𝑖 is the number of samples in epoch i.

FHWA NPMRDS Data Validation 8

4. Validation Results A list of validation sites is displayed in Table 1. Four of the 15 sites are located in urban areas, three in suburban and the other sites are in rural areas. The TMC code and the Annual Average Daily Traffic (AADT) associated with each sensor station are included in the table.

Table 1 Summary of Validation Sites

Site

TMC ID

Length (Mile)

Dir State Sensor

ID

Sensor Type

Latitude Longitude

AADT

(2012)

Urban/ Rural

Sensor Location Information

1 129P04189 4.78045 N Massachusetts 10189 Bluetooth 42.14977 -70.8423 68,199 Urban Rte 3 NB from Rte 139 to Rte 53, S of Boston, MA

2 102N05093 6.06232 S Florida 729905 WIM 30.13464 -81.5344 88,484 Urban SR-9/I-95,2.5 MI S OF I-295

3 114P04712 5.04883 N Oregon 1507 WIM 42.2193 -122.716 24,200 Rural Ashland NB POE 1507, 0.31 mile north of Eagle Mill

4 108P04181 2.9713 N Michigan 829699 WIM 42.10899 -83.2414 66638 Sub Urban

I-75 NB TOTAL @ VREELAND

RD. OVERPASS, Detroit

5 102P09479 5.86564 N Florida 729905 WIM 30.1346 -81.5344 88,484 Rural

SR-9/I-95,2.5 MI S OF I-295 S

of Jacksonville, FL

6 108P04370 3.01144 N Michigan 829209 WIM 42.30814 -83.4424 91512 Sub Urban

I-275 NB at S, of Cherry Hill Road

7 106N05121 1.62401 S California 15 WIM 33.70022 -117.775 271,000 Urban I-5 SB 1.6 MI S of Rte 261 in Irvine, CA

8 114N04585 3.60701 E Washington EW24 WIM 47.68817 -117.069 47000 Rural

I-90 1.42 MI. W OF IDAHO

STATE LINE

9 110N08804 4.33639 S Virginia 40291 WIM 37.5296 -77.6963 34,383 Rural

1.5 MI N of US-60 on Rte 288

in Midlothian

10 114N04947 3.18836 W Oregon 2306 WIM 44.279 -117.209 8,600 Rural Farewell Bend WB POE 2306,

1.58 miles south of Baker City

11 120P13838 6.01159 W New York 9631 WIM 41.9266 -74.8634 9,318 Rural NY 17, 0.6 MI E RT 206

12 129P04430 2.89164 E Massachusetts 10360 Bluetooth 42.35701 -71.1262 132304 Urban I-90 EB from Newton Corner to Beacon Park, W of Downtown Boston, MA

FHWA NPMRDS Data Validation 9

13 118P04408 0.71361 N Minnesota 40 WIM 44.89203 -93.0665 53,000 Sub Urban

ON US-52 .5 MI N OF CSAH14

IN West ST PAUL

14 102N05358 1.66526 S Florida 8112 Bluetooth 27.8621 -82.7 63,000 Sub Urban

US-19 from CR 611/49th St to Gandy Blvd in St. Petersburg

15 102P05359 2.05158 N Florida 8113 Bluetooth 27.84102 -82.6852 63,000 Sub Urban

US-19 from Gandy Blvd to CR 611/49th St in St. Petersburg

FHWA NPMRDS Data Validation 10

Massachusetts BT10189 (Site #1)

Bluetooth_Pair_10189N_TMC129P04189 The reference data at this location is collected from Bluetooth sensors. This site is located on Rte-3 NB from Rte 139 to Rte 53 about 30 miles S. of Downtown Boston, MA. Table 2 summarizes the data quality measures obtained as a result of comparison between probe vehicle and Bluetooth speeds. AASE below 10 MPH meet target specifications. AASE below 5 MPH are considered good quality. As shown, the AASE for all vehicle group in AM/PM peak and off-peak periods are within specification for all speed bins.

Table 2 Data Quality Measures for a Roadway Segment in Boston, MA (All Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph 5.07 2.28 1,288 4.07 2.73 338

> 60 mph 4.19 1.42 1,036 5.33 1.62 1,216 6.30 2.28 703

All Speed 4.19 1.42 1,036 5.20 1.96 2,504 5.55 2.43 1,041

FHWA NPMRDS Data Validation 11

Florida WIM 729905S (Site #2)

WIM9905S_TMC_102N05093

The reference data at this location is collected from WIM sensors. This site is located on SR-9/I- 95, 2.5 miles south of I-295 S interchange in Florida. Table 3 summarizes the data quality measures obtained as a result of comparison between probe vehicle and WIM speeds. AASE below 10 MPH meet target specifications. As shown, the AASE for freight vehicle, passenger vehicle and all vehicle groups in AM/PM peak and off-peak periods are within specification for all speed bins.

Table 3(a) Data Quality Measures for a Roadway Segment in Florida (All Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph

> 60 mph 1.40 0.91 1,114 2.41 0.70 2,604 3.66 1.00 1,116

All Speed 1.40 0.91 1,114 2.41 0.70 2,604 3.66 1.00 1,116

Table 3(b) Data Quality Measures for a Roadway Segment in Florida (Freight Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph 1.64 1.06 31

> 60 mph 3.64 0.78 1,094 3.13 0.46 2,591 1.57 0.76 1,072

All Speed 3.64 0.78 1,094 3.13 0.46 2,591 1.58 0.76 1,103

Table 3(c) Data Quality Measures for a Roadway Segment in Florida (Passenger Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph

> 60 mph 3.27 0.97 1,090 4.13 0.72 2,596 4.27 1.05 1,113

All Speed 3.27 0.97 1,090 4.13 0.72 2,596 4.27 1.05 1,113

FHWA NPMRDS Data Validation 12

Oregon WIM 1507N (Site #3)

WIM1507N_TMC114P04712

The reference data at this location is collected from WIM sensors. This site is located on I-5 about 0.2 miles NW of Ashland, OR. Table 4 summarizes the data quality measures obtained as a result of comparison between probe vehicle and WIM speeds. AASE below 10 MPH meet target specifications. As shown, the AASE and SEM for freight vehicle, passenger vehicle and all vehicle groups in AM/PM peak and off-peak periods are within specification for all speed bins.

Table 4(a) Data Quality Measures for a Roadway Segment in Oregon (All Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph 6.01 0.74 1,099 4.12 0.82 2,595 4.84 0.82 1,078

> 60 mph 3.00 0.94 31

All Speed 6.01 0.74 1,099 4.12 0.82 2,595 4.79 0.82 1,109

Table 4(b) Data Quality Measures for a Roadway Segment in Oregon (Freight Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph 2.05 0.61 1,044 2.56 0.58 2,549 2.88 0.59 1,085

> 60 mph

All Speed 2.05 0.61 1,044 2.56 0.58 2,549 2.88 0.59 1,085

Table 4(c) Data Quality Measures for a Roadway Segment in Oregon (Passenger Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph 7.12 1.35 403 4.35 1.32 1,187 5.63 1.17 596

> 60 mph 5.03 1.29 432 2.67 1.13 1,161 3.68 1.17 425

All Speed 6.07 1.32 835 3.51 1.22 2,348 4.82 1.17 1,021

FHWA NPMRDS Data Validation 13

Michigan WIM 829699N (Site #4)

WIM829699N_TMC108P04181

The reference data at this location is collected from WIM sensors. This site is located on I-75 NB about 24 miles south of Detroit, MI. Table 5 summarizes the data quality measures obtained as a result of comparison between probe vehicle and WIM speeds. AASE below 10 MPH meet target specifications. As shown, the AASE for freight vehicle, passenger vehicle and all vehicle groups in AM/PM peak and off-peak periods are within specification for all speed bins.

Table 5(a) Data Quality Measures for a Roadway Segment in Detroit (All Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph

> 60 mph 0.72 0.72 1,098 1.15 0.82 2,599 1.75 0.94 1,113

All Speed 0.72 0.72 1,098 1.15 0.82 2,599 1.75 0.94 1,113

Table 5(b) Data Quality Measures for a Roadway Segment in Detroit (Freight Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph 3.65 1.14 91

> 60 mph 2.19 0.36 1,061 2.14 0.33 2,445 2.17 0.43 1,078

All Speed 2.19 0.36 1,061 2.19 0.36 2,536 2.17 0.43 1,078

Table 5(c) Data Quality Measures for a Roadway Segment in Detroit (Passenger Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph

> 60 mph 1.69 0.98 1,036 2.07 1.00 2,519 2.13 1.15 1,076

All Speed 1.69 0.98 1,036 2.07 1.00 2,519 2.13 1.15 1,076

FHWA NPMRDS Data Validation 14

Florida WIM 729905N (Site #5)

WIM729905N_TMC102P09479

The reference data at this location is collected from WIM sensors. This site is located on I-95 about 16 miles SE of Jacksonville, FL. Table 6 summarizes the data quality measures obtained as a result of comparison between probe vehicle and WIM speeds. AASE below 10 MPH and SEM below 5 MPH both meet target specifications. AASE below 5 MPH are considered good quality.

As shown, the average absolute speed error (AASE) for freight vehicle, passenger vehicle and all vehicle groups in AM/PM peak and off-peak periods are within specification for all speed bins.

Speed Error Mean (SEM) values are all within the 5 MPH threshold.

Table 6(a) Data Quality Measures for a Roadway Segment in Florida (All Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph

> 60 mph 1.11 0.88 1,108 1.01 0.74 2,604 1.22 0.77 1,116

All Speed 1.11 0.88 1,108 1.01 0.74 2,604 1.22 0.77 1,116

Table 6(b) Data Quality Measures for a Roadway Segment in Florida (Freight Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph

> 60 mph 3.49 0.48 1,088 4.03 0.37 2,564 3.39 0.38 1,096

All Speed 3.49 0.48 1,088 4.03 0.37 2,564 3.39 0.38 1,096

Table 6(c) Data Quality Measures for a Roadway Segment in Florida (Passenger Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph

> 60 mph 1.68 1.03 1,088 1.58 0.81 2,599 1.53 0.87 1,111

All Speed 1.68 1.03 1,088 1.58 0.81 2,599 1.53 0.87 1,111

FHWA NPMRDS Data Validation 15

Michigan WIM 829209N (Site #6)

WIM829209N_TMC108P04370

The reference data at this location is collected from WIM sensors. This site is located on I-275 NB about 25 miles west of Detroit, MI. Table 7 summarizes the data quality measures obtained as a result of comparison between probe vehicle and WIM speeds. AASE below 10 MPH meet target specifications. As shown, the average absolute speed error (AASE) for passenger vehicle, freight vehicle, and all vehicle groups in AM/PM peak and off-peak periods are within specification for all speed bins. Speed Error Mean (SEM) values are all within the 5 MPH threshold.

Table 7(a) Data Quality Measures for a Roadway Segment in Michigan (All Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph

> 60 mph 2.97 0.96 1,028 2.46 1.02 2,532 2.51 1.24 1,065

All Speed 2.97 0.96 1,028 2.46 1.02 2,532 2.51 1.24 1,065

Table 7(b) Data Quality Measures for a Roadway Segment in Michigan (Freight Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph 3.20 0.93 194 3.40 0.99 374 3.90 1.52 225

> 60 mph 1.99 0.64 639 2.11 0.61 1,677 2.28 0.76 497

All Speed 2.25 0.71 833 2.34 0.68 2,051 2.78 0.99 722

Table 7(c) Data Quality Measures for a Roadway Segment in Michigan (Passenger Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph

> 60 mph 4.09 1.03 1,001 3.35 1.12 2,475 2.85 1.32 1,021

All Speed 4.09 1.03 1,001 3.35 1.12 2,475 2.85 1.32 1,021

FHWA NPMRDS Data Validation 16

California WIM015S (Site #7)

WIM015S_TMC106N05121

The reference data at this location is collected from WIM sensors. This site is located on I-5 SB,

1.6 miles south of RTE-261 in Irvine, California. Table 8 summarizes the data quality measures obtained as a result of comparison between probe vehicle and WIM speeds. AASE below 10 MPH meet target specifications. As shown, the AASE for freight, passenger and all vehicle

Table 8(a) Data Quality Measures for a Roadway Segment in California (All Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph 4.60 1.97 915 7.97 1.95 246 6.54 1.82 551

> 60 mph 4.22 1.06 179 5.75 1.14 2,342 6.86 1.41 553

All Speed 4.54 1.82 1,094 5.96 1.21 2,588 6.70 1.62 1,104

Table 8(b) Data Quality Measures for a Roadway Segment in California (Freight Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph 3.53 2.50 296 2.28 2.55 70 5.75 3.17 45

45 - 60 mph 1.74 1.70 254 1.74 1.31 1,281 2.19 2.56 306

All Speed 2.64 2.10 550 1.76 1.37 1,351 2.78 2.66 351

Table 8(c) Data Quality Measures for a Roadway Segment in California (Passenger Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph 4.45 2.00 913 7.72 1.97 245 6.21 1.84 489

> 60 mph 3.87 1.12 176 5.43 1.14 2,329 6.04 1.47 611

All Speed 4.36 1.86 1,089 5.64 1.22 2,574 6.12 1.64 1,100

FHWA NPMRDS Data Validation 17

Washington WIMEW24 (Site #8)

WIMEW24E_TMC114N04585

The reference data at this location is collected from WIM sensors. This site is located on I-90,

1.4 miles west of Idaho state line. Table 9 summarizes the data quality measures obtained as a result of comparison between probe vehicle and WIM speeds. AASE below 10 MPH meet target specifications. As shown, the AASE for freight vehicle, passenger vehicle and all vehicle groups in AM/PM peak and off-peak periods are within specification for all speed bins. Speed Error Mean (SEM) values are all within the 5 MPH threshold.

Table 9(a) Data Quality Measures for a Roadway Segment in Washington (All Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph

> 60 mph 1.04 0.73 1,041 0.74 0.82 2,534 0.88 1.11 1,058

All Speed 1.04 0.73 1,041 0.74 0.82 2,534 0.88 1.11 1,058

Table 9(b) Data Quality Measures for a Roadway Segment in Washington (Freight Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph 2.31 1.12 45 1.93 1.16 292 2.14 1.49 432

> 60 mph 0.78 0.39 774 0.96 0.45 1,761 1.22 0.57 431

All Speed 0.87 0.43 819 1.09 0.55 2,053 1.68 1.03 863

Table 9(c) Data Quality Measures for a Roadway Segment in Washington (Passenger Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph

> 60 mph 1.26 0.85 913 0.87 0.92 2,331 1.11 1.23 941

All Speed 1.26 0.85 913 0.87 0.92 2,331 1.11 1.23 941

FHWA NPMRDS Data Validation 18

Virginia WIM40291S (Site #9)

WIM40291S_TMC110N08804

The reference data at this location is collected from WIM sensors. This site is located on SR-288

1.5 MI north of US-60 in Midlothian, VA. Table 10 summarizes the data quality measures obtained as a result of comparison between probe vehicle and WIM speeds. AASE below 10 MPH meet target specifications. As shown, the AASE and SEM for freight vehicle, passenger

Table 10(a) Data Quality Measures for a Roadway Segment in Virginia (All Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph

> 60 mph 0.81 0.72 955 0.85 0.71 2,391 1.28 0.79 1,027

All Speed 0.81 0.72 955 0.85 0.71 2,391 1.28 0.79 1,027

Table 10(b) Data Quality Measures for a Roadway Segment in Virginia (Freight Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph 6.87 1.05 19 6.47 3.12 19

> 60 mph 4.06 0.92 391 4.02 0.75 1,346 3.21 0.80 502

All Speed 4.22 0.93 410 4.05 0.78 1,365 3.21 0.80 502

Table 10(c) Data Quality Measures for a Roadway Segment in Virginia (Passenger Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph

> 60 mph 1.19 0.77 879 1.17 0.80 2,235 2.29 0.84 958

All Speed 1.19 0.77 879 1.17 0.80 2,235 2.29 0.84 958

FHWA NPMRDS Data Validation 19

Oregon WIM2306W (Site #10)

WIM2306W_TMC114N04947

The reference data at this location is collected from WIM sensors. This site is located on I-84 about 2 miles S of Farewell Bend State Park, OR. Table 11 summarizes the data quality measures obtained as a result of comparison between probe vehicle and WIM speeds. AASE below 10 MPH meet target specifications. As shown, the AASE for freight vehicle, passenger

Table 11(a) Data Quality Measures for a Roadway Segment in Oregon (All Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph 8.29 1.18 729 8.02 0.98 1,860 8.80 1.09 789

> 60 mph 6.03 1.03 287 6.82 0.95 689 6.62 0.99 268

All Speed 7.66 1.14 1,016 7.69 0.97 2,549 8.25 1.07 1,057

Table 11(b) Data Quality Measures for a Roadway Segment in Oregon (Freight Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph 2.53 1.25 950 1.58 0.95 2,457 1.82 1.08 952

> 60 mph 1.27 0.46 28 0.55 0.69 58

All Speed 2.53 1.25 950 1.58 0.94 2,485 1.75 1.06 1,010

Table 11(c) Data Quality Measures for a Roadway Segment in Oregon (Passenger Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph 9.35 2.48 39 7.17 2.23 108 8.79 2.47 101

> 60 mph 4.21 1.82 500 4.15 1.62 1,507 4.89 1.60 484

All Speed 4.64 1.87 539 4.36 1.67 1,615 5.54 1.75 585

FHWA NPMRDS Data Validation 20

New York WIM 9631W (Site #11)

WIM9631W_120P13838

The reference data at this location is collected from WIM sensors. This site is located on NY-17 about 70 miles E of Binghamton, NY. Table 12 summarizes the data quality measures obtained as a result of comparison between probe vehicle and WIM speeds. AASE below 10 MPH meet target specifications. As shown, the AASE and SEM for freight vehicle, passenger vehicle and all vehicle groups in AM/PM peak and off-peak periods are all within target specification for all speed bins.

Table 12(a) Data Quality Measures for a Roadway Segment in New York (All Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph

> 60 mph 4.40 1.49 650 4.61 1.16 2,012 5.32 1.33 689

All Speed 4.40 1.49 650 4.61 1.16 2,012 5.32 1.33 689

Table 12(b) Data Quality Measures for a Roadway Segment in New York (Freight Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph 0.97 2.22 6 4.04 4.33 27

> 60 mph 2.76 1.47 224 2.29 1.17 836 2.19 1.16 316

All Speed 2.71 1.49 230 2.36 1.28 863 2.19 1.16 316

Table 12(c) Data Quality Measures for a Roadway Segment in New York (Passenger Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph

> 60 mph 4.60 1.82 551 5.33 1.33 1,789 6.69 1.71 537

All Speed 4.60 1.82 551 5.33 1.33 1,789 6.69 1.71 537

FHWA NPMRDS Data Validation 21

Massachusetts BT10360 (Site #12)

Bluetooth_Pair_10360E_TMC129P04430 The reference data at this location is collected from Bluetooth sensors. This site is located on I- 90 EB from Newton Corner to Beacon Park, W of Downtown Boston, MA. Table 13 summarizes the data quality measures obtained as a result of comparison between probe vehicle and Bluetooth speeds. AASE below 10 MPH meet target specifications. AASE below 5 MPH are considered good quality. As shown, the AASE for all vehicle group in AM/PM peak and off-peak periods are within specification for all speed bins. Seed Error Mean (SEM) values are all within the 5 MPH threshold.

Table 13 Data Quality Measures for a Roadway Segment in Boston, MA (All Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph 1.58 1.49 1,099 2.40 1.61 2,589 1.74 2.16 1,110

All Speed 1.58 1.49 1,099 2.40 1.61 2,589 1.74 2.16 1,110

FHWA NPMRDS Data Validation 22

Minnesota WIM 40 (Site #13)

WIM40_TMC118P04408

The reference data at this location is collected from WIM sensors. This site is located on US-52 about 6 miles S of St. Paul, MN. Table 14 summarizes the data quality measures obtained as a result of comparison between probe vehicle and WIM speeds. AASE below 10 MPH meet target specifications. As shown, the AASE and SEM for freight, passenger vehicle, and all vehicle

Table 14(a) Data Quality Measures for a Roadway Segment in Minnesota (All Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph 6.71 1.42 453 7.05 2.00 1,272 4.64 1.15 122

> 60 mph 5.71 1.17 355 4.63 0.93 676 2.42 1.07 612

All Speed 6.26 1.31 808 6.19 1.62 1,948 2.79 1.09 734

Table 14(b) Data Quality Measures for a Roadway Segment in Minnesota (Freight Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph 3.25 1.35 400 4.91 2.52 991 1.46 1.41 249

> 60 mph 1.02 1.12 36 1.35 0.95 72

All Speed 3.25 1.35 400 4.72 2.45 1,027 1.44 1.30 321

Table 14(c) Data Quality Measures for a Roadway Segment in Minnesota (Passenger Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph

30 - 45 mph

45 - 60 mph 6.72 1.89 281 7.34 2.70 741 5.31 1.36 36

> 60 mph 5.01 1.32 389 4.41 1.14 864 2.07 1.24 551

All Speed 5.67 1.54 670 5.73 1.85 1,605 2.25 1.24 587

FHWA NPMRDS Data Validation 23

Florida BT8112 (Site #14)

Bluetooth_Pair_8112S_TMC102N05358 The reference data at this location is collected from Bluetooth sensors. This site is located on US-19, an arterial segment with traffic signals, from CR 611/49th St to Gandy Blvd in N. of St.

Petersburg, FL. Table 15 summarizes the data quality measures obtained as a result of comparison between probe vehicle and reference speeds. AASE below 10 MPH meet target specifications. As shown, the AASE and SEM for all vehicles group in AM/PM peak and off-peak periods are within specification for all speed bins.

Table 15 Data Quality Measures for a Roadway Segment St. Petersburg, FL (All Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph 1.44 1.79 452 3.02 1.73 624 2.45 1.92 746

30 - 45 mph 5.09 2.20 505 2.13 1.80 1,797 3.51 2.43 252

45 - 60 mph

All Speed 3.47 2.02 957 2.36 1.78 2,421 2.75 2.06 998

FHWA NPMRDS Data Validation 24

Florida BT8113 (Site #15)

Bluetooth_Pair_8113N_TMC102P05359 The reference data at this location is collected from Bluetooth sensors. This site is located on US-19, an arterial segment with traffic signals, from Gandy Blvd to CR 611/49th St in N. of St.

Petersburg, FL. Table 16 summarizes the data quality measures obtained as a result of comparison between probe vehicle and reference speeds. AASE below 10 MPH meet target specifications. As shown, the AASE and SEM for all vehicles group in AM/PM peak and off-peak periods are within specification for all speed bins.

Table 16 Data Quality Measures for a Roadway Segment St. Petersburg, FL (All Vehicles)

Speed Bins AASE SEM Size AASE SEM Size AASE SEM Size

0 - 30 mph 2.80 1.93 82

30 - 45 mph 5.01 2.04 823 2.76 1.72 2,324 3.75 2.14 962

45 - 60 mph 5.00 1.79 75

All Speed 5.01 2.02 898 2.76 1.73 2,406 3.75 2.14 962

FHWA NPMRDS Data Validation 25

5. Calibration Data validation results from 15 locations in each time period and speed bin are within target specification. No data calibration is needed.