Attachment_0006_Benchmark_procedures_v1_2_(15_June_2016).pdf

Benchmark Procedures

Load

Windows 10

(Page 2)

Windows OS

Preparation

(Page 2)

Run Passmark performance Test

(Page 3)

Run SYSMark

(Page 4)

Platform

Run MobileMark

(Optional)

(Page 5)

Evaluation

Completed

Desktop

Non-Desktop

Load & Prepare Microsoft Windows

For standard, performance and integrated desktops, mainstream, performance and ruggedized notebooks, slates and slates with detachable keyboards, benchmarks will be executed under Microsoft Windows 10 Enterprise with system administrator privileges.

All Windows installations will be fully licensed and activated copies; this software bundle will not function if the OS is not activated.

Boot off the media and perform a default installation of the operating system. Since installation methods may differ from medium to medium, follow all prompts and defaults where possible to ensure a consistent load to establish a baseline. Ensure the following parameters are conducted throughout the installation and initial setup:

Format the medium (SSD OR HDD) upon which the OS will be installed.

Ensure the proper time zone and time are correct and reflect the test location.

For systems with a wireless device, turn on wireless capability when prompted to, even if the device cannot or is not yet connected to a wireless network.

Ensure the hostname of the device being tested appropriately identifies the machine model.

Leave passwords blank when possible to avoid failure of benchmark tools when run.

For Windows Update, use recommended settings and ensure system is patched and up-to-date.

Leave applications such as Windows Firewall or Malware Detection with their default settings.

Load any vendor-specific drivers that will ensure optimum performance of the system, such as video card, chipsets/motherboard, host controllers, disk controllers, network, etc. To the greatest extent possible, use installed drivers that are Microsoft-approved and/or signed.

Windows OS Preparation For All Benchmarks

Use the following procedures:

Navigate to the system properties screen (use shortcut windows key + pause/break key).

Select “Advanced system settings” on the upper left margin. Select the Advanced tab and select “Settings…” under the performance heading.

Next navigate to the “Advanced” tab and press the “change…” button under the

Virtual Memory heading.

Uncheck “Automatically Manage Paging File Size…”

Select “Custom Size” and enter 2048 for the initial size and 4096 for the maximum size.

Click on “Set” to save setting and then OK to complete process.

Reboot System for settings to take effect.

Passmark Performance Test v8 (latest build) Benchmark

Installation & Setup procedures:–

Install Performance Test v8 using the Setup Wizard with default settings for both the folder and program’s shortcut.

Launch benchmark entering the appropriate User and Key information.

Type in the search entry area, next to the Windows icon,“optimize drive”.

This will provide the option to select “Defragment and Optimize Drives”.

Select “change settings’ in the scheduled optimization section.

De-select “Run on a schedule”.

Click “OK”

Select C drive, assure it is highlighted.

Then click on the “Optimize” button. The initial defrag after the benchmark load can take 5 to 10 minutes to complete.

Wait till procedure is complete before proceeding.

Reboot system.

Benchmark Execution procedures:

Click Windows icon then select the following: > All Apps > Performance Test >

Performance Test V8.

Once window is open, wait a minimum of 5 minutes for the system to reach an idle state (indicated by minimal actively on hard drive).

Then select “Run Benchmark” to start benchmark.

The benchmark procedure takes about 6 to 8 minutes to complete. When complete transfer results for: CPU Mark, 2D Graphics Mark, 3D Graphics Mark, Memory Mark, Disk Mark, CD Mark and Passmark into attached spreadsheet.

Repeat Benchmark Execution for a total of 10 runs. Enter the required results for each of the 10 runs in the section under the appropriate heading. Results will be automatically be averaged reflecting the final platform results.

BAPCo SYSmark 2014 Benchmark (Desktop and Notebooks)

BAPco SYSmark 2014 can be run from either DVD or USB flash drive. Use the appropriate steps depending on the medium used.

For DVD Disc Installations:

Insert disc 1 of the SYSmark 2014 software into the optical disc drive.

Select “Run SYSmark 2014_Setup.exe” from the AutoPlay menu.

Obey prompts asking for administrative rights or those confirming execution of the program.

At the SYSmark 2014 Setup Wizard click “Next” to continue.

At the prompt enter the license key.

Proceed when prompted, use all default information.

Insert second disk when instructed.

Initial load can take up to 1.5 hours.

For Flash Drive Installations:

Insert the SYSmark 2014 software flash drive into a USB port.

Select “Open folder to view files” from the AutoPlay menu.

Navigate to the root folder of the drive.

Open the “Disc1” directory.

Run “SYSmark2014_Setup.exe”

Obey prompts asking for administrative rights or those confirming execution of the program.

At the SYSmark 2014 Setup Wizard click “Next” to continue.

At the prompt enter the license key.

Proceed when prompted, using all default information.

The initial load can take up to 1.0 hours.

To run the SYSmark 2014 program use the following procedures:

Hover the mouse pointer over “SYSmark 2014” icon, then right click selecting

“Run as administrator”.

Select “Configuration” from menu on right side of window.

Apply all DEFAULT settings.

Also ensure sound is set to MUTE.

Restart the computer.

Configuration information:

Input project name in text field.

Ensure all three tests have been selected.

Set 3 iterations and ensure “Perform Conditioning Run” is checked.

Click “Run Benchmark” to begin execution of a three iteration benchmark run.

Execution (or a pass) of 3 iterations takes about 9 to 10 hours.

A total of three passes will be conducted for the benchmark results. Over the course of the benchmarks, the system may reboot several times. It is important to not to disturb or manipulate the system. This includes use of the device inputs (keyboard, mouse, etc.).

When saving a benchmark on SYSmark 2014, assure the selected file type is “pdf”. This file type is preferred as the files are smaller and can be read on virtually any Army system. All nine values will be used in the spreadsheet for record.

BAPCo MobileMark Benchmark (Notebooks, Slates, Tablets & Handhelds)

Before running MobileMark 2014 determine if adjustment to screen brightness is needed.

Set the screen brightness to 60 nits (cd/m2). The measurement can be determined by reading the luminosity of the screen with a light meter equipped with spot meter or by reviewing the screen’s spec sheet. Identify the screen’s maximum luminosity and adjust the screen brightness to 60 nits. Record the adjustment values from minimum and/or maximum brightness for record and future use. In the case a light meter is not available or the maximum luminosity cannot be determined, set the system to its maximum luminosity before proceeding.

Install MobileMark 2014 using the Setup Wizard and default settings; the process for installation is similar to the SYSmark 2014 installation. Enter the license key when instructed, and follow all prompts and keep all default values. The total benchmark load takes up to 15 minutes.

Right click on the “MobileMark 2014” icon, then select “Run as administrator”. Select

“Office Productivity”. Leave all other values on the main page as well as the configuration screen at default.

After a conditioning run, the application will prompt user to unplug computer to begin execution. Adjust screen brightness quickly after unplugging the system. Once execution is complete system will automatically turn itself off. Plug system in and reboot platform. Once benchmark is complete and platform has been rebooted, record results for “Battery Life Rating” and “Performance Qualification” in the spreadsheet. Repeat this process 2 more times for a total of three record values.

Example output

Microsoft Excel

Worksheet