Attachment 3_Sample Drive Test PWS.pdf

ATTACHMENT 3:

SAMPLE DRIVE TEST

INSTRUCTIONS & PERFORMANCE WORK STATEMENT (PWS)

Overview/Instructions

As a part of its technical and pricing evaluation, the Government will evaluate the Offeror’s ability to plan a sample drive test and the Offeror’s proposed cost of executing the proposed drive test plan. To facilitate this evaluation, the Offeror will review the sample drive test request included below and submit a Drive Test Plan describing the approach for performing testing within the defined sample area and a Drive Test Cost Proposal documenting the cost to execute the Drive Test Plan.

Sample Drive Test Plan

The Drive Test Plan must address all requirements described in Section 4.2.2 of the PWS. The

Offeror should include details for each of the elements of the methodology used to develop the

Drive Test Plan, documenting all key assumptions and best practices used to enable the government to effectively evaluate the technical approach. Key elements to be clearly documented include, but are not limited to, the following:

• Make and model of all devices/cellular handsets used to capture the data

• Make and model of RF Scanner, including documented alignment with the technical characteristics outlined in PWS Exhibit 2 – RF Scanner Technical Compliance Matrix

• Name of each rate plan selected for each provider and associated technical details (e.g., data limits)

• Map or other documentation of the planned routes (e.g., map(s), listing of the order

Hexes will be tested, etc.)

• Approach and assumptions used to develop the drive test routing, including any unique methods, tools, or best practices

• Approach and assumptions used to determine the number of labor hours and drive testing days required to complete the sample test (e.g., time spent driving, time spent taking stationary tests, other non-testing time, etc.)

• Documentation of the labor categories and number of personnel to be used for the planning phase, field testing team, and reporting phase of the Drive Test effort.

NOTE: No dollar values or pricing of any kind shall be included in the Drive Test Plan. The

Drive Test Plan shall document the technical approach and assumptions only – all pricing shall be provided in the separate Excel pricing workbook (Attachment 4).

Sample Drive Test Cost Proposal

The drive test cost proposal should address the labor and material costs required to complete the sample drive test (refer to Section 4.2.3 of the PWS for additional information). While each actual drive test task order will also require an estimate of proposed travel costs, the Sample

Drive Test Cost Proposal does not require a travel estimate, as costs for travel will vary week to week or month to month depending on when the drive test is conducted and may not be directly comparable across Offeror proposals.

The Offeror shall use the pricing template (Attachment 4) to document the proposed cost for the sample drive test. The Offeror must provide detailed assumptions behind the cost build for each input used. Offerors may provide an accompanying written narrative as part of the cost proposal describing key cost assumptions used in developing the proposed costs in the Drive Test Cost

Proposal (Excel template, solicitation Attachment 4). While reasonable round trip travel time from Offeror's point of origin (e.g., primary office) to the area of the drive test (e.g., Lincoln

County, OK) would be billable for an actual drive test, for the purposes of pricing the Sample

Drive Test, hours spent travelling to and from the drive test area should not be included in the labor cost estimate, as these hours will vary based on each Offeror’s point of origin. However, all work hours required while in the test area should be included in the labor cost estimate.

The Offeror is encouraged to provide as much supporting detail as necessary to ensure all key assumptions underpinning the cost estimate are clear and the Government is able to make a determination that the proposed costs are fair and reasonable and in alignment with current market pricing. Please refer to PWS Section 4.2.3 and the Excel Pricing template for additional guidance, however, key elements of the cost proposal to be clearly documented include, but are not limited to, the following:

Labor

• Documentation of the labor categories and number of personnel to be used for the planning phase, field testing phase, and reporting phase of the Drive Test effort.

• Proposed fully loaded hourly rates for each labor category

• Approach and assumptions used to determine the number of labor hours and drive testing days required to complete the sample test (e.g., time spent driving, time spent taking stationary tests, other non-testing time, etc.)

• Total proposed hours by labor category to complete the testing, inclusive of planning and reporting time

Materials

• Assumptions used to determine the number of devices / rate plans required in order to complete the testing

• Details on device and RF scanner specification (e.g., make/model of devices)

• Cost for cellular handsets and RF scanner rental for the drive test period including:

o Details of equipment make/model to be used o Assumptions used to develop the rental cost for the proposed equipment

The following is an example of a drive test request for Lincoln County, Oklahoma.1 The map below shows specific locations within the county that will require tests. The locations are listed using the open-source H3 geospatial indexing system that is used throughout the FCC’s Mobile

Challenge and Verification processes.2 The table below shows the four providers that require testing and the technology for each provider (5G for AT&T, T-Mobile, and Verizon; 4G for US

Cellular). It lists the hexagon index where tests must be taken and the center of the hexagon (the hexagon boundary is roughly 0.5 km from the center).

For the active service performance test portion of the drive test, performed with test smartphones running upload and download speed tests using the FCC speed test application, the type of test required within each hexagon is listed for each provider (blank if not required). Stationary tests mean the test must be taken outside of the vehicle with the tester holding the device(s) standing in a stationary position. In-vehicle tests must be done from inside the vehicle. The vehicle can be in motion during an in-vehicle test, but the test must be completed while the device is within the hexagon. For this request, at least one test must be completed in each hexagon.3 While the vehicle is traveling between hexagons, an in-vehicle test should be run for each provider every two minutes.

For the passive RF coverage measurement test portion of the drive test, performed with the RF

Scanner hardware and software, the RF scanner testing should begin at the first hexagon at the start of the drive route according to the drive route plan, and end at the final tested hexagon at the end of the drive route according to the drive route plan. The operators and technologies to be tested by the RF scanner, for the purposes of this example drive test, should cover all deployed

RF bands by the same operators listed above for active service performance testing.

Please refer to Attachments 3a and 3b for additional information and data files related to the sample drive test.

1 This is not meant to imply that Lincoln County is any more or less likely to be audited once the drive test contract has been awarded. It was chosen as a good representative of what a drive test area could look like when a drive test is requested.

2 Isaac Brodsky, H3: Uber’s Hexagonal Hierarchical Spatial Index, (June 27, 2018), https://eng.uber.com/h3/.

3 In practice, most drive test requests will require multiple tests at different times in each hexagon.

https://eng.uber.com/h3/

Figure 1:

Selected hexagons for testing in Lincoln County, OK

Figure 2:

A region within Lincoln County, Oklahoma with selected hexagons that require testing.

Table 1: Hexagons selected for testing with type of testing required.

h3index latitude of hexagon center longitude of hexagon center

AT&T

5G

T-Mobile

5G

USCellular

4G

Verizon

5G

8826ea46bdfffff 35.46653138 -96.67289369 In-Vehicle In-Vehicle In-Vehicle Stationary

8826ea4e07fffff 35.47137586 -96.89128895 In-Vehicle Stationary Stationary Stationary

8826ea488bfffff 35.47707025 -97.02477098 In-Vehicle In-Vehicle Stationary

8826ea4f29fffff 35.47766691 -96.98219292 In-Vehicle Stationary In-Vehicle Stationary

8826ea4509fffff 35.48747589 -96.80710339 In-Vehicle In-Vehicle Stationary

8826ea445bfffff 35.48874453 -96.70078428 In-Vehicle Stationary In-Vehicle 8826ea48e5fffff 35.49148096 -97.0682942 In-Vehicle Stationary In-Vehicle Stationary

8826ea4f65fffff 35.49253919 -96.99376217 In-Vehicle Stationary In-Vehicle Stationary

8826ea4561fffff 35.49465124 -96.83414359 In-Vehicle In-Vehicle 8826ea49c1fffff 35.49844581 -97.10604131 In-Vehicle In-Vehicle In-Vehicle

8826ea48c9fffff 35.507111 -97.02663152 In-Vehicle Stationary In-Vehicle Stationary

8826ea41b1fffff 35.50842597 -96.93081619 In-Vehicle Stationary Stationary Stationary

8826ea41abfffff 35.52329911 -96.94237859 In-Vehicle In-Vehicle Stationary

8826ea409dfffff 35.52467651 -96.83594999 In-Vehicle Stationary In-Vehicle Stationary

8826ea462bfffff 35.52608287 -96.71894459 In-Vehicle Stationary Stationary 8826ea0925fffff 35.5266845 -96.66578343 In-Vehicle Stationary In-Vehicle 8826ea482dfffff 35.52848752 -97.10792543 In-Vehicle Stationary Stationary

8826ea4aadfffff 35.52956282 -97.03335315 In-Vehicle In-Vehicle Stationary Stationary

8826ea40a9fffff 35.5317112 -96.87364795 In-Vehicle In-Vehicle 8826ea0929fffff 35.5343627 -96.6502764 In-Vehicle Stationary In-Vehicle 8826ea485bfffff 35.53699598 -97.03914509 In-Vehicle Stationary Stationary Stationary

8826ea4adbfffff 35.53802706 -96.96459292 In-Vehicle In-Vehicle Stationary Stationary

8826ea41e5fffff 35.54560571 -96.95972944 In-Vehicle Stationary Stationary Stationary

8826ea41e1fffff 35.54574858 -96.9490809 In-Vehicle Stationary Stationary Stationary

8826ea41d9fffff 35.54644879 -96.89584668 In-Vehicle In-Vehicle Stationary

8826ea4133fffff 35.55304041 -96.96551498 In-Vehicle In-Vehicle Stationary Stationary

8826ea41cbfffff 35.55374682 -96.91227273 In-Vehicle Stationary Stationary 8826ea4127fffff 35.56761821 -96.99839399 In-Vehicle In-Vehicle In-Vehicle Stationary

8826ea55a7fffff 35.57047868 -96.7748044 Stationary 8826ea4b07fffff 35.57338313 -97.12141356 In-Vehicle Stationary Stationary

8826ea4b03fffff 35.57353949 -97.11075359 In-Vehicle Stationary Stationary

8826ea415dfffff 35.59835526 -96.946975 In-Vehicle Stationary 8826c19693fffff 35.61083944 -97.12910808 In-Vehicle Stationary Stationary

8826ea59b5fffff 35.61130454 -97.09711759 In-Vehicle Stationary

8826ea58bbfffff 35.61264865 -97.0011762 In-Vehicle Stationary In-Vehicle Stationary

8826ea58a3fffff 35.61978725 -97.02828787 In-Vehicle In-Vehicle 8826ea4339fffff 35.6210744 -96.93237246 In-Vehicle Stationary Stationary

8826ea59a1fffff 35.62616122 -97.10872368 In-Vehicle Stationary Stationary hexagon center longitude of hexagon center

AT&T

5G

T-Mobile

5G

USCellular

4G

Verizon

5G

8826ea5899fffff 35.62794354 -96.98078693 In-Vehicle Stationary Stationary Stationary

8826ea59e5fffff 35.64859773 -97.11547249 In-Vehicle In-Vehicle In-Vehicle Stationary

8826ea436bfffff 35.6509431 -96.94486709 In-Vehicle Stationary Stationary

8826ea556bfffff 35.65279643 -96.79570614 In-Vehicle

8826ea5459fffff 35.65412269 -96.6785873 Stationary Stationary

8826ea58c1fffff 35.6576663 -97.00396075 In-Vehicle Stationary In-Vehicle Stationary

8826ea51b7fffff 35.6589243 -96.90802378 In-Vehicle Stationary In-Vehicle Stationary

8826ea59c9fffff 35.66421283 -97.07374619 In-Vehicle Stationary Stationary Stationary

8826ea5ab1fffff 35.6655247 -96.97776942 In-Vehicle In-Vehicle In-Vehicle

8826ea591bfffff 35.67148943 -97.09021721 In-Vehicle Stationary Stationary

8826ea5827fffff 35.67164024 -97.07954928 In-Vehicle Stationary Stationary Stationary

8826ea5abdfffff 35.67295483 -96.98356314 In-Vehicle In-Vehicle In-Vehicle Stationary

8826ea50a3fffff 35.67471813 -96.84499722 In-Vehicle Stationary Stationary

8826ea5615fffff 35.67678278 -96.66394192 In-Vehicle Stationary

8826ea592bfffff 35.67830217 -97.13870372 In-Vehicle In-Vehicle Stationary

8826ea5853fffff 35.68752712 -97.01648396 In-Vehicle In-Vehicle In-Vehicle Stationary

8826ea5a85fffff 35.68795573 -96.98448906 In-Vehicle In-Vehicle In-Vehicle

8826ea5867fffff 35.69422053 -97.07562394 In-Vehicle Stationary Stationary Stationary

8826ea575bfffff 35.69875013 -96.71318277 In-Vehicle

8826ea560dfffff 35.69909727 -96.68123454 In-Vehicle Stationary

8826ea5ae1fffff 35.70281364 -96.99608117 In-Vehicle In-Vehicle In-Vehicle Stationary

8826ea50c5fffff 35.71239815 -96.83127512 In-Vehicle Stationary Stationary

8826eacdb3fffff 35.71373988 -96.71407024 In-Vehicle Stationary Stationary

8826ea51cdfffff 35.71904891 -96.90102241 In-Vehicle Stationary In-Vehicle Stationary

8826ea5035fffff 35.71931334 -96.87969827 In-Vehicle Stationary In-Vehicle Stationary

8826ea5b3dfffff 35.7239233 -97.09884928 In-Vehicle Stationary Stationary

8826ea5b39fffff 35.72407338 -97.08817573 In-Vehicle Stationary Stationary

8826ea5b1bfffff 35.72451792 -97.05615846 In-Vehicle Stationary Stationary Stationary

8826ea5127fffff 35.72566154 -96.97080373 In-Vehicle Stationary Stationary Stationary

8826ea5039fffff 35.72700565 -96.86416122 In-Vehicle Stationary In-Vehicle Stationary

8826eacd95fffff 35.72884414 -96.70430493 In-Vehicle Stationary In-Vehicle

8826ea501dfffff 35.73469493 -96.84862324 In-Vehicle Stationary In-Vehicle

8826ea52a5fffff 35.73494918 -96.82730178 In-Vehicle Stationary Stationary

8826ea502dfffff 35.7416053 -96.89706187 In-Vehicle Stationary In-Vehicle Stationary

8826c52cdbfffff 35.74604397 -97.12695566 In-Vehicle Stationary Stationary

8826ea5167fffff 35.74822326 -96.96685603 In-Vehicle Stationary Stationary

8826ea510dfffff 35.74849767 -96.94551898 In-Vehicle Stationary In-Vehicle Stationary

8826ea5063fffff 35.74929813 -96.88152145 In-Vehicle Stationary Stationary Stationary

8826eacce7fffff 35.75171987 -96.66834567 In-Vehicle In-Vehicle In-Vehicle hexagon center longitude of hexagon center

AT&T

5G

T-Mobile

5G

USCellular

4G

Verizon

5G

8826ea5b47fffff 35.7540703 -97.09005865 In-Vehicle Stationary Stationary

8826ea506dfffff 35.76415769 -96.89309977 In-Vehicle Stationary In-Vehicle Stationary

8826eacdedfffff 35.76590099 -96.74382302 In-Vehicle In-Vehicle Stationary

8826c524b5fffff 35.77036522 -96.99492261 In-Vehicle In-Vehicle Stationary In-Vehicle

8826c52493fffff 35.77091766 -96.95223595 In-Vehicle Stationary Stationary

8826c525bdfffff 35.77693224 -97.06477677 In-Vehicle Stationary In-Vehicle

8826ea5311fffff 35.77927718 -96.88334565 In-Vehicle Stationary

8826ea5325fffff 35.78604341 -96.94248645 In-Vehicle Stationary Stationary

8826ea5303fffff 35.78657544 -96.89980504 In-Vehicle Stationary Stationary

8826ea5221fffff 35.78709228 -96.85713275 In-Vehicle Stationary

8826ea5219fffff 35.78771697 -96.80380528 In-Vehicle Stationary Stationary

8826eacc25fffff 35.78866716 -96.71851136 In-Vehicle In-Vehicle

8826eacc03fffff 35.78911951 -96.67587834 In-Vehicle Stationary Stationary

8826c52ed7fffff 35.79133519 -97.10843462 Stationary

8826c524adfffff 35.792642 -97.01232854 In-Vehicle In-Vehicle In-Vehicle In-Vehicle

8826eacc57fffff 35.79677501 -96.66033364 In-Vehicle Stationary Stationary Stationary

8826c524e7fffff 35.80020749 -97.00745576 In-Vehicle In-Vehicle In-Vehicle In-Vehicle

8826c524e5fffff 35.80763211 -97.0132596 In-Vehicle In-Vehicle In-Vehicle In-Vehicle

8826eacc59fffff 35.81186222 -96.65055615 In-Vehicle Stationary Stationary

8826ea5245fffff 35.81731368 -96.83761179 In-Vehicle Stationary

8826c52535fffff 35.82132015 -97.11032451 Stationary Stationary

8826eac8bbfffff 35.82535571 -96.79005753 In-Vehicle

8826c526b9fffff 35.83100478 -96.94525025 In-Vehicle In-Vehicle

8826eace15fffff 35.83448721 -96.63588578 In-Vehicle Stationary Stationary Stationary

8826c5242bfffff 35.83732632 -97.03648466 In-Vehicle Stationary In-Vehicle In-Vehicle

8826eacf2bfffff 35.8409232 -96.73762165 In-Vehicle Stationary

8826c52553fffff 35.84446272 -97.06365984 In-Vehicle In-Vehicle In-Vehicle

8826c526a9fffff 35.84572008 -96.96752837 In-Vehicle Stationary Stationary Stationary

8826c52455fffff 35.85273281 -97.0053726 In-Vehicle Stationary In-Vehicle In-Vehicle

8826c52447fffff 35.86001629 -97.02186185 In-Vehicle Stationary In-Vehicle In-Vehicle

8826c526e5fffff 35.86056801 -96.97913402 In-Vehicle Stationary In-Vehicle Stationary

8826c52445fffff 35.8674384 -97.02767032 In-Vehicle Stationary In-Vehicle In-Vehicle

8826eac9e9fffff 35.86917969 -96.88882441 In-Vehicle Stationary

8826eac831fffff 35.87723368 -96.84123835 In-Vehicle Stationary

8826eac91bfffff 35.8842853 -96.87906044 In-Vehicle Stationary

8826c5209dfffff 35.88869137 -97.11992618 In-Vehicle Stationary

8826c52625fffff 35.88998236 -97.02372813 In-Vehicle Stationary In-Vehicle In-Vehicle

8826eac821fffff 35.89196227 -96.86349971 In-Vehicle Stationary Stationary

8826eac82bfffff 35.89208664 -96.85282238 In-Vehicle Stationary Stationary hexagon center longitude of hexagon center

AT&T

5G

T-Mobile

5G

USCellular

4G

Verizon

5G

8826eac1abfffff 35.89372793 -96.7034004 Stationary Stationary Stationary

8826eac183fffff 35.8939472 -96.68206371 Stationary Stationary

8826c5208bfffff 35.89610962 -97.12574584 In-Vehicle Stationary

8826c52729fffff 35.89669417 -97.08298138 In-Vehicle Stationary Stationary Stationary

8826c52753fffff 35.89740336 -97.02953839 In-Vehicle Stationary In-Vehicle Stationary

8826eac829fffff 35.89951248 -96.85861586 In-Vehicle Stationary Stationary

8826eacad7fffff 35.90082104 -96.74119171 In-Vehicle Stationary Stationary

8826c520dbfffff 35.9039682 -97.09948916 In-Vehicle Stationary

8826c52663fffff 35.9052389 -97.00328744 In-Vehicle Stationary Stationary Stationary

8826c52609fffff 35.90551078 -96.98191548 In-Vehicle In-Vehicle Stationary

8826c5266bfffff 35.91279668 -96.99840919 In-Vehicle Stationary Stationary Stationary

8826eac859fffff 35.91509451 -96.80613489 In-Vehicle Stationary Stationary

8826eac137fffff 35.92333322 -96.73719458 Stationary Stationary Stationary

8826c535b1fffff 35.92736249 -97.03140751 In-Vehicle Stationary Stationary

8826c534bbfffff 35.92844202 -96.94590357 In-Vehicle Stationary Stationary

8826c53493fffff 35.92870235 -96.92453326 In-Vehicle Stationary Stationary

8826eacacdfffff 35.93053331 -96.764329 In-Vehicle Stationary Stationary

8826eac117fffff 35.93109602 -96.7109565 In-Vehicle Stationary

8826eac031fffff 35.93163495 -96.6575986 In-Vehicle Stationary Stationary

8826c522b9fffff 35.93393034 -97.10137845 In-Vehicle Stationary Stationary

8826c53495fffff 35.93599486 -96.94102172 In-Vehicle Stationary Stationary

8826eacb1bfffff 35.93713046 -96.844869 In-Vehicle In-Vehicle Stationary

8826eaca11fffff 35.93784463 -96.78079305 In-Vehicle Stationary Stationary Stationary