HEDC_SMaC_PWS_V3-10_Jan_2019.pdf

PERFORMANCE WORK STATEMENT (PWS)

for

HILL ENTERPRISE DATA CENTER SUSTAINMENT, MODERNIZATION AND

CONSOLIDATION

8 January 2019

75TH AIR BASE WING (75 ABW) COMMUNICATIONS DIRECTORATE

Hill AFB, UT 84056-5825

DISTRIBUTION STATEMENT A. Approved for public release; distribution is unlimited.

TABLE OF CONTENTS

1 INTRODUCTION

1.1 PURPOSE

1.2 SCOPE OF WORK

2 CONTRACTOR TASKING REQUIREMENTS

2.1 HILL ENTERPRISE DATA CENTER CAPACITY PLANNING

HILL ENTERPRISE DATA CENTER HOSTING SUSTAINMENT

ACTIVITIES

HILL ENTERPRISE DATA CENTER ADVANCED SERVICES

2.2 EVOLVE APPLICATIONS AND ARCHITECTURE ON HEDC HOSTING

PLATFORMS

ORACLE

MICROSOFT

IBM

VMWARE

RED HAT

BMC SOFTWARE

DELL EMC

HEWLETT PACKARD ENTERPRISE (HPE)

F5 NETWORKS

SIEMENS

INTEL

CISCO

OTHER TECHNOLOGIES

SUBJECT MATTER EXPERTS (SME)

HOSTED APPLICATIONS

2.3 DESIGN, IMPLEMENT, AND OPTIMIZE ENTERPRISE ARCHIVE AND

BACKUP SOLUTIONS FOR ON-PREMISE AND CLOUD

2.4 DATACENTER IT OPERATIONS AND SUSTAINMENT SUPPORT

CONSOLIDATE SYSTEMS ADMINISTRATION AND ORACLE

DATABASE ADMINISTRATION

PRODUCTION OPERATIONAL SUPPORT

SUPPORT HEDC PORTABLE OPERATING DATA CENTERS (POD) . 21

2.5 MODERNIZATION, STANDARDIZATION, CONSOLIDATION AND

OPTIMIZATION

2.6 CONSOLIDATE APPLICATIONS TO HEDC APPLICATION HOSTING

PLATFORMS

2.7 SYSTEM ONBOARDING

2.8 HEDC BUSINESS OFFICE

2.9 HEDC ITIL PROCESS OWNER

2.10 IMPLEMENT ENTERPRISE MONITORING, SERVICE LEVEL AND

SHOWBACK REPORTING

2.11 IMPLEMENT AND SUPPORT PRODUCTION DIELECTRICALLY COOLED

PORTABLE OPERATING DATA CENTERS (POD) HARDWARE AND

SOFTWARE CONTENTS

3 ENGINEERING REQUIREMENTS

3.1 SYSTEMS ENGINEERING

3.2 ARCHITECTURE AND SYSTEM DESIGN

FEDERAL DESKTOP CORE CONFIGURATION (FDCC)

3.3 REQUIREMENTS MANAGEMENT SYSTEM

3.4 CONFIGURATION MANAGEMENT

3.5 CHANGE MANAGEMENT PROCESSES

3.6 TESTING

PRODUCT/SYSTEM INTEGRATION TESTING

OPERATIONAL TESTING AND VULNERABILITY MITIGATION

3.7 INFORMATION ASSURANCE

SYSTEM IA

CONTRACTOR TRAINING AND CERTIFICATION

3.8 RESOURCE MANAGEMENT

4 CONTRACTOR PROJECT MANAGEMENT

4.1 INFORMATION ASSURANCE PROJECT MANAGER

4.2 SUSTAINMENT PROJECT MANAGER

4.3 INFRASTRUCTURE PROJECT MANAGER

4.4 ONBOARDING PROJECT MANAGER

5 CONTRACTUAL REQUIREMENTS

5.1 HOURS OF OPERATION

5.2 GOVERNMENT FACILITIES AND EQUIPMENT

ACCESS TO FACILITIES AND PROPERTY

GOVERNMENT FURNISHED FACILITIES

GOVERNMENT FURNISHED EQUIPMENT, MATERIALS, AND

SOFTWARE

CONTRACTOR REPRESENTATION AND PRESENTATION

5.3 PROGRAM MANAGEMENT

GOVERNMENT PROGRAM MANAGEMENT

GOVERNMENT CONTRACT MANAGEMENT

SERVICES DELIVERY SUMMARY

ORDERING PROCEDURES

GOVERNMENT PROVIDED SERVICE PLAN

DOCUMENTATION AND DATA MANAGEMENT

RECORDS, FILES, AND DOCUMENTS

CONTRACTOR EMPLOYEES

MANPOWER REPORTING

PERSONNEL SECURITY

TRAVEL

5.4 INHERENTLY GOVERNMENT FUNCTIONS/PERSONAL SERVICES

5.5 NON-PERSONAL SERVICES

5.6 MEETINGS

5.7 TRANSPORTATION

5.8 REPORTING

5.9 DATA CALL

5.10 DATA RIGHTS

5.11 DATA RIGHTS AND NON-COMMERCIAL COMPUTER SOFTWARE

5.12 INFORMATION ASSURANCE AND PROTECTION

5.13 CONFIDENTIALITY

5.14 QUALITY ASSURANCE PROGRAM

5.15 QUALITY ASSURANCE

5.16 CONTRACTING OFFICER REPRESENTATIVE (COR)

5.17 RECORDS

5.18 GOVERNMENT OBSERVATIONS

5.19 PARTICIPATION AND GOVERNMENT ACTIVITIES

5.20 TRAINING

CONTINUING TRAINING

GOVERNMENT PROVIDED TRAINING

5.21 ADHERENCE

5.22 SECTION 508 OF THE REHABILITATION ACT

5.23 CONTINUATION OF ESSENTIAL CONTRACTOR SERVICES DURING CRISIS

DECLARED BY THE PRESIDENT OF THE UNITED STATES, THE

SECRETARY OF DEFENSE, OR OVERSEAS COMBATANT COMMANDER . 44

5.24 PHASE-OUT PERIOD

6 SERVICES DELIVERY SUMMARY

6.1 PERIOD OF PERFORMANCE

6.2 REQUIRED SERVICES

6.3 SERVICES SUMMARY

7 SECURITY AND SAFETY REQUIREMENTS

7.1 SECURITY REQUIREMENTS

7.2 DAMAGE TO GOVERNMENT PROPERTY AND/OR BASE SUPPORT

MAJOR MISHAP

INVESTIGATION

SUBCONTRACTOR COOPERATION

7.3 ACCESS TO THE BASE NETWORK

7.4 REQUIRED NETWORK TRAINING

7.5 DISABLING ACCOUNTS

7.6 CHECKLISTS

7.7 COMPUTER CONNECTIVITY

7.8 VIRTUAL PRIVATE NETWORK (VPN)

7.9 VOLUNTARY PROTECTION PROGRAM (VPP)

7.10 OSHA COMPLIANCE

7.11 SUBCONTRACTOR FLOW DOWN

7.12 CONTRACTOR KEY PERSONNEL

7.13 FREEDOM OF INFORMATION ACT (FOIA)

7.14 NON-DISCLOSURE

7.15 LOCK COMBINATIONS

7.16 EMERGENCY SERVICES

OPERATIONS SECURITY

OPSEC Training

8 APPLICABLE STANDARDS AND REFERENCES

8.1 PUBLICATIONS

8.2 INTERNAL OPERATING PROCEDURES

8.3 RECORDS, FILES, DOCUMENTS AND WORK PAPERS

8.4 CONSERVATION OF UTILITIES

8.5 ENVIRONMENTAL PROTECTION AND SAFETY

9 DATA DELIVERABLES

9.1 CDRLs

9.2 GENERAL MARKING INSTRUCTIONS

9.3 RECORD RETENTION

APPENDIX 1

APPENDIX 2

APPENDIX 3

APPENDIX 4

LIST OF TABLES

Table 6-1 Services Summary

Table 9-1 CDRLs

1 INTRODUCTION

1.1 PURPOSE

The purpose of this effort is to provide Information Technology (IT) Professional Subject Matter

Expertise (SME) in Enterprise Architecture, Engineering and Services support including engineering, infrastructure architecture design, technology counsels, modernization, consolidation, hosting, Business Case Analysis (BCAs), Economic Analysis (EA), Analysis of

Alternatives (AOAs), Conference Room Pilots (CRPs), information assurance, and technical and program/project management support services to the 75th Air Base Wing Communications and

Information Directorate (75 ABW/SC) at Hill Air Force Base (HAFB), Utah and 16 other

Continental United States (CONUS) Hill Enterprise Data Center (HEDC) Wide Area Network

(WAN) Point of Presence (POP) Portable Operating Data Center (POD) locations for current

HEDC workload.

This effort also provides Information Technology (IT) Professional Support and Engineering

Services for modernization efforts for the 309th Maintenance Complex at HAFB. The IT

Directorate is responsible for facilitating the installation and implementation of the commercial off-the-shelf (COTS) Depot Maintenance and Logistics system Modernization effort within the

Hill Enterprise Data Center (HEDC).

This effort includes the creation/update and implementation of management policies, organizational structure, systems and procedures necessary to support the Department of Defense

(DoD) onboarding, administration, performance tuning, disaster recovery planning, enterprise networking, and technical management necessary to support current customer applications in the

HEDC and HEDC-Classified;hosted cloud environments potentially moving to commercial clouds, or a hybrid of both when course of action (COA) approved.

1.2 SCOPE OF WORK

The scope of this contract is to provide engineering, continual architecture design and sustainment, application onboarding, operations support, and program/project management services to continue HEDC Lifecycle support and evolve the HEDC’s current application hosting

Platform-as-a-Service (PaaS), Software-as-a-Service (SaaS), traditional and cloud native application on-boarding, architecture design, engineering modernization, and quality/configuration management in both the classified and unclassified enclaves. The

Government requires that the contractor provide full time equivalency (FTE) employees for each service area outlined above in this scope of work, or as otherwise defined in this document.

Service requirements include Subject Matter Expertise in the following areas: Oracle and

Windows database engineering, storage area network, VMware Server Virtualization & Cloud

Infrastructure, and Red Hat Enterprise Virtualization (RHEV). The HEDC hosting environment supports applications, database systems, file, print, and web services for a wide variety of Air

Force customers, including depot maintenance and logistics operations customers. These services host and sustain a variety of functional platforms and systems in both classified and unclassified enclaves.

Enforcement of National Defense Authorization Act (NDAA) 2012, Public Law 112-81, has forced compliance to consolidate applications per the Office of Management and Budget (OMB) directives of Cloud First and Federal Data Center Consolidation Initiative (FDCCI). With the closure and consolidation of under-performing data centers and the optimization of the data centers remaining in the Federal inventory, considerable funds will be saved. The Data Center

Optimization Initiative (DCOI) established in OMB Memorandum M-16-19 supersedes the

FDCCI and fulfills the data center requirements of the Federal Information Technology

Acquisition Reform Act (FITARA). The DCOI requires agencies to:

Develop and report on their data center strategies

Transition to more efficient infrastructure, such as cloud services and inter-agency shared services

Leverage technology advancements to optimize infrastructure

Provide quality services for the public good.

As the certified Hill AFB Installation Processing Node (IPN), the HEDC will need to continually develop plans for the onboarding and consolidation of applications/systems for these new customers. The Performance Work Statement (PWS) Optional Task Orders will facilitate contractor cost estimates for new customer application/system onboarding and consolidation requirements on premises and in commercial clouds.

The HEDC is comprised of world class data centers managed by the 75 ABW/SC hosting over

1200 physical and virtual servers servicing 150+ applications.

2 CONTRACTOR TASKING REQUIREMENTS

The Contractor shall provide Information Technology Professional EA, Engineering and

Services support for current HEDC lifecycle sustainment.

The Contractor shall furnish professional and technically qualified personnel to perform assigned tasking. Included are all tasks related to continuous PaaS, SaaS, application hosting, systems, storage, virtualization and network support which will continue through the term of the contract.

In addition, are those tasks specific to sustain the level of service provided to current and future customers. HEDC utilizes extensive capabilities based on software ELAs to provide securely managed software-defined application service offerings at the central HEDC sites and Portable

Operating Data centers (PODs) managed by the central site. Specific Subject Matter Expertise, extensive, proficient knowledge and experience is required in leading-edge and emerging technologies supporting all disciplines of Enterprise Applications hosted in a hybrid physical, virtual, and commercial cloud environment.

2.1 HILL ENTERPRISE DATA CENTER CAPACITY PLANNING

The contractor shall develop and maintain a capacity planning strategy, to support sustainment, modernization, and onboarding activities, to ensure the HEDC will be able to meet the workload demands of its current and future customers Capacity planning should include computing resources, power load, footprint, and cooling capacity. The contractor shall perform capacity planning in accordance with the ITIL Capacity Management Process.

HILL ENTERPRISE DATA CENTER HOSTING SUSTAINMENT

ACTIVITIES

The Contractor shall use the following architecture, engineering processes, and activities to complete the following requirements supporting securely hosting anywhere for existing customers:

1. Continuously refine architecture, engineering and sustainment of current cloud infrastructure to implement both a virtual and physical environment for large, complex application workloads supporting Enterprise Resource Planning (ERP), Product Lifecycle

Management (PLM), Enterprise Asset Management (EAM), Enterprise Performance

Management (EPM), Enterprise Portfolio and Performance Management (EPM/EPPM), Business and IT Service Management (BSM/ITSM), complex Maintenance Repair and

Overhaul (cMRO), and other COTS and GOTS applications and their supporting technology stacks.

2. Continually improve, scale out, and refresh application systems to support End of Life

(EOL) End of Service (EOS) replacement.

3. Strategize proper architecture/configuration/optimization for the continued growth of the enterprise platforms, associated technology stacks, and applications in a non-disruptive upgrade and operations mode.

4. Ensure seamless inter-operability between all elements of the technology stack that comprise the platform through the integration and automation through the entire lifecycle including remediation of security vulnerabilities where possible.

5. Continuous engineering and testing of the application platform to reside across multiple availability zones (multiple data centers) so as to provide work load survivability, elasticity, and mobility while security policies are automatically enforced at all locations.

6. Maintain a continuous improvement cycle that supports constant, demonstrable improvement of the application platform and the application services provided to our customer. In particular, this cycle must address quantifiable improvements in security, time-to-value, performance, and reduced application latency while reducing costs.

Follow industry-recognized quality assurance methods to perform regular data-driven analysis of processes, including regular benchmarks that do full-depth tests of system performance and recoverability including Central Processing Unit (CPU), memory, disk, network connectivity, application performance, recovery time objectives (RTO), recovery point objectives (RPO) and responsiveness to users while compliance is being met for applicable Service Level Agreements (SLAs). Testing will be conducted in coordination with application owners and common service providers.

7. Document and diagram architecture plans and system configurations. Where possible, artifacts must be produced through policy-driven automation and enforcement provided by elements of the technology stack.

8. Engineer the best solution to fit the unique customer and DoD requirements utilizing industry best practices and Air Force/DoD regulatory guidance such as Defense

Information Systems Agency (DISA) Security Technical Implementation Guide (STIG)

Compliance. This process involves re-factoring customer systems to be successfully deployed into the HEDC PaaS, a designated commercial cloud environment, or a hybrid of the two. This will provide a reasonable balance between expedient system deployment, application modernization, and unwavering security continuous compliance.

9. Set up application systems for safe and rapid deployment into new or existing HEDC controlled engineered environments while those environments are continually improved, scaled out, and refreshed to support End of Life (EOL) End of Service (EOS) replacement.

HILL ENTERPRISE DATA CENTER ADVANCED SERVICES

The Contractor shall provide advanced services to current hosted applications which require a higher level of support for sustainment. Advanced services include, but are not limited to:

1. Agile/Rapid Release Upgrade Model

The contractor shall provide resources to support frequent software deployments and upgrades as necessary to meet mission needs. These requirements may be considered beyond the scope of traditional sustainment and will be identified accordingly.

2. Increased Support Resources

The contractor shall provide additional resources for complex and/or labor intensive application support as necessary to meet mission needs. These requirements may be considered beyond the scope of traditional sustainment and will be identified accordingly.

Advanced services requirements may include, but are not limited to: frequent software deployments, continuous server service management requiring frequent administrator interaction, and direct customer support to meet customer demand.

2.2 EVOLVE APPLICATIONS AND ARCHITECTURE ON HEDC HOSTING

PLATFORMS

The Contractor shall provide service for current hosted applications services available in the

HEDC’s continuously evolving service catalog. The Contractor shall provide a comprehensive project team to support the architecture and entire customer service lifecycle. This is referred to as application services and architecture sustainment. Service offerings currently include, but are not limited to:

1. Storage Service

a. Edge/WAN PoP File Services

b. MS SharePoint Service

c. Performance Tier Storage

d. Object Storage

e. Near-Line Tier Storage

f. Archive-Tier Storage

g. Production Tier Copy Data Management (CDM) into minor Tiers (Environment as a Service (EaaS))

2. Backup & Recovery Service

a. Enterprise NetBackup Service

b. Oracle Active Data Guard

c. Oracle Flashback Recovery

d. Snapshot Replication

e. VMware Continuous Data Protection (CDP)

3. Relational Database Service

a. Oracle Database Enterprise Edition -

b. Microsoft SQL Server

c. PostgresSQL

d. MySQL

4. Security Service

a. RMF sustainment (A&A)

b. Security Compliance Engineering to improve security posture of HEDC infrastructure and hosted systems.

c. System categorization of HEDC infrastructure and hosted systems in order to provide appropriate Confidentiality, Integrity, and Availability (CIA).

d. Tailoring cyber security controls to hosted systems.

e. Continuous automated monitoring of compliance to implemented cyber security controls.

f. Risk Assessment

g. Threat and Vulnerability Assessment and Remediation

h. Security Baselines

i. CCRI Preparation

j. Develop Enterprise Security Architecture

k. Static Application Security Testing

l. Dynamic Application Security Testing

m. Penetration Testing

n. Cybersecurity Liaison duties

o. Software Baseline Testing

p. Hardware and Software Baseline Management

q. Security Analytics SecOPs

r. Encryption

i. Format Preserving Encryption (FPE)

ii. Encryption-At-Rest

iii. Encryption-In-Flight

iv. Encryption Key Management

s. Security Incident Handling

5. Analysis Support

a. Analysis of Alternatives (AoA) Service

b. Business Case Analysis (BCA)

c. Economic Analysis (EA)

d. Product Evaluations

e. Business Impact Analysis (BIA)

6. Rapid Conference Room Pilot (CRP) Proof of Concept (PoC) Service

7. Enterprise Applications Service

a. Business Intelligence Services

b. Enterprise Resource Planning (ERP)

c. Complex Maintenance Repair and Overhaul (cMRO)

d. Product Lifecycle Management (PLM)

e. Enterprise Asset Management (EAM)

f. Enterprise Performance Management (EPM)

g. Enterprise Project and Portfolio Management (EPPM)

h. Data Quality (DQ)

8. Engineered Platform-as-a-Service (PaaS)

a. Microsoft Ecosystem

b. Oracle Enterprise Ecosystem

c. Red Hat Linux

d. Java and Java Virtual Machine

e. Continuity of Operations (COOP)

f. Docker, LXC and other Container Ecosystems

g. Pivotal Cloud Foundry

9. Equipment Purchase and Tracking Support

a. Assist with developing Rough order of Magnitudes (ROMs), Brand Name

Justifications (BNJs), and Justification and Authorizations (J&As)

b. Track procurement deliveries and verify completeness

ORACLE

The Contractor shall monitor, administrate, and ensure recoverability and adherence of Oracle technical infrastructure and application environments. The Contractor shall provide personnel who possess specific technical and functional expertise and knowledge of Oracle products, including but not limited to:

Oracle Active Data Guard version 11.x-12.x

Oracle Active Data Guard version 11g-18c

Oracle Advanced Security versions 11g-18c

Oracle Audit Vault and Database Vault Firewall version 12.x

Oracle Business Intelligence Enterprise Edition + version 11.x

Oracle Business Intelligence Enterprise Edition + versions 11x-12x

Oracle Business Intelligence Publisher version 12x

Oracle Compute Cloud Service

Oracle Database Backup Cloud Service

Oracle Database Cloud Service

Oracle Database Enterprise Edition version 11.x-12.x

Oracle Database Enterprise Edition versions 11g-18c

Oracle Database Vault version 12x

Oracle E-Business Suite ERP and verticals versions 12.x

Oracle Enterprise Manager Cloud Control version 13c with Diagnostics, Tuning, Middleware

Management, Database Lifecycle Management, Data Masking and Sub-setting Packs

Oracle Enterprise Project Portfolio Management (EPPM) version 16-18 with Oracle

WebCenter Content version 11.1.1.9

Oracle Forms and Reports version 11.x

Oracle Forms and Reports versions 11x

Oracle Fusion Middleware version 10.x - 12.x

Oracle Fusion Middleware versions 11g-12c

Oracle Hyperion Planning EPM version 11

Oracle Identity and Access Management Suite version 11.x-12.x

Oracle Identity and Access Management Suite version 11g -18c

Oracle Internet Directory (OID) version 11x-12x

Oracle Internet Directory (OID), Single Sign-On (SSO) and Portal version 10.x-11.x

Oracle Java Runtime Environment (JRE) and Java Development Kit (JDK) version 8 and higher

Oracle Java Cloud Service

Oracle partitioning versions 11g-18c

Oracle Primavera Portfolio Management (OPPM) version 16-18

Oracle Pro-C

Oracle Real Application Clusters version 11.x-12.x

Oracle Real Application Clusters version 11g-18c

Oracle Service-Oriented Architecture (SOA) version 11.x

Oracle Service-Oriented Architecture (SOA) version 11x

Oracle Storage Cloud Service

Oracle Data Integrator

The Contractor shall have the appropriate certifications to satisfy DoDD 8140 Cybersecurity

Workforce Management compliance for personnel as identified in DoDD 8570.01-M for IAT, IAM, IASAE, and CND positions.

MICROSOFT

The Contractor shall monitor, administrate, and ensure recoverability and adherence of Microsoft technical infrastructure and application environments. The Contractor shall provide personnel who possess specific technical and functional expertise and knowledge of Microsoft products, including but not limited to:

Microsoft Azure Stack version 1-2

Microsoft Dynamics CRM software versions 2013-2016

Microsoft Server 2008R2-2016

Microsoft SharePoint versions 2010-2016

Microsoft SQL Server versions 2008R2-2016

Microsoft System Center versions 2012-2016

Microsoft Team Foundation Server versions 2012-2019

Microsoft Windows 10 and higher

IAM, IASAE, and CND positions.

IBM

The Contractor shall monitor, administrate, and ensure recoverability and adherence of IBM technical infrastructure and application environments. The Contractor shall provide personnel who possess specific technical and functional expertise and knowledge of IBM products, including but not limited to:

IBM Collaborative Lifecycle Management (CLM) versions 5-6

IBM DB2 Advanced Enterprise Edition versions 10-11

IBM HTTP Server version 8.x

IBM Maximo ERP/EAM software versions 7-8

IBM MQueue version 7

IBM Rational Reporting Development Tools version 5-6

IBM Rational Reporting version 5-6

IBM Rational Team Concert Client version versions 5-6

IBM v840 and SVC

IBM WebSphere Application Server versions 8.x

IAM, IASAE, and CND positions.

VMWARE

The Contractor shall monitor, administrate, and ensure recoverability and adherence of VMWare technical infrastructure and application environments. The Contractor shall provide personnel who possess specific technical and functional expertise and knowledge of VMWare products, including but not limited to:

VMware Cloud Platform

VMware Sphere version 5.x-6.x including NSX, vRealize Suite Cloud Management

Platform and Horizon View

VMware vSphere version 6.x including all products supporting the vCloud Air Network

(vCAN) program (HEDC is enrolled in the VMware Service Providers Program (VSPP))

IAM, IASAE, and CND positions.

RED HAT

The Contractor shall monitor, administrate, and ensure recoverability and adherence of Red Hat technical infrastructure and application environments. The Contractor shall provide personnel who possess specific technical and functional expertise and knowledge of Red Hat products, including but not limited to:

Red Hat Atomic LXC/Docker Container environment

Red Hat CloudForms version 3.x-4.x

Red Hat Enterprise Linux Advanced Platform version 5.x-7.x

Red Hat Enterprise Linux Advanced Platform version 6-7

Red Hat Enterprise Linux OpenStack Platform version 4

Red Hat Enterprise Virtualization (RHEV) version 3.x and Red Hat Virtualization

(RHV) version 4.x

Red Hat Identity Policy Audit (IPA) versions 3-4

Red Hat JBoss Enterprise Application Platform (JBoss EAP) version 5.x-7.x

Red Hat JBoss version 6

Red Hat OpenShift Platform version 4

BMC SOFTWARE

The Contractor shall monitor, administrate, and ensure recoverability and adherence of BMC technical infrastructure and application environments. The Contractor shall provide personnel who possess specific technical and functional expertise and knowledge of BMC products, including but not limited to:

BMC Atrium Core version 9.1 and higher

BMC Client Management version 12.8 and higher

BMC Digital Workplace version 18.02 and higher

BMC Discovery version 11.3 and higher

BMC Remedy Action Request System version 9.1 and higher

BMC Remedy IT Service Management version 9.1 and higher

BMC Remedy Single Sign-On version 18.02 and higher

BMC Remedy with Smart IT version 18.02 and higher

BMC Service Request Management version 9.1 and higher

BMC TrueSight Operations Management version 11.3 and higher

BMC TrueSight Server Automation version 8.9 and higher

DELL EMC

The Contractor shall monitor, administrate, and ensure recoverability and adherence of EMC technical infrastructure and application environments. The Contractor shall provide personnel who possess specific technical and functional expertise and knowledge of EMC products, including but not limited to:

EMC Connectrix DS-300B FC Switch (Brocade FC Switches resold by EMC)

EMC Connectrix FC Directors generations 5 and 6 (Brocade FC Directors resold by EMC)

EMC Connectrix G620-G630 (Brocade FC Directors resold by EMC)

EMC DSSD D5 NVMe Fabric Storage Array cluster configuration and storage zoning

EMC Unity including models Unity 350 all-flash array (AFA), Unity 450 AFA, Unity 500, Unity 600 AFA with both FC and IP infrastructure connectivity and with file and block replication services

EMC VNX2 and Unity Storage Arrays with Fibre Channel and IP infrastructure connectivity

EMC VNX2 including models 5200, 5400, 5600, and 5800 with both FC and IP infrastructure connectivity and file replication services

HEWLETT PACKARD ENTERPRISE (HPE)

The Contractor shall monitor, administrate, and ensure recoverability and adherence of HPE technical infrastructure and application environments. The Contractor shall provide personnel who possess specific technical and functional expertise and knowledge of HPE products, including but not limited to:

HPE 3PAR Software Suite including Thin Provisioning, Thin Conversion, Thin Persistence, Full Copy, Thin Copy Reclamation, Autonomic Rebalance, System Tuner, Management

Console, Host Explorer, Virtual Copy software, Remote Copy software, Quorum Witness, Reporting Software Suite

HPE 3PAR Storage Array and HPE 3PAR Operating System Software for 3PAR models

7450 - 9450

HPE 3PAR StoreServ Storage 7450-9450 including implementing vSphere Metro

Storage Cluster using Peer Persistence

HPE Fortify version 17

HPE Network Security Processor (NSP)

HPE Recovery Manager Central (RMC) version 4

HPE SecureDataVoltage version 5

HPE Server models DL360, DL380, DL385, DL580, DL585, DL980

HPE StoreOnce CloudBank version 3

HPE StoreOnce model 6600

HPE StoreOnce Virtual Storage Appliance (VSA)

HPE WebInspect version 17

F5 NETWORKS

The Contractor shall monitor, administrate, and ensure recoverability and adherence of F5 technical infrastructure and application environments. The Contractor shall provide personnel who possess specific technical and functional expertise and knowledge of F5 products, including but not limited to:

F5 BIG-IP Local Traffic Manager (LTM), Access Policy Manager (APM), Application

Security Manager (ASM) version 11.x-12.x

F5 Big-IP Software Suite versions 12-13: Local Traffic Manager (LTM), DNS, Access

Policy Manager (APM), Application Security Manager (ASM), Advanced Firewall

Manager (AFM), Application Acceleration Manager (AAM), Policy Enforcement

Manager (PEM), Carrier-Grade NAT, and Secure Web Gateway Services

F5 Viprion application delivery controller model 4800 and virtual edition (VE)

SIEMENS

The Contractor shall monitor, administrate, and ensure recoverability and adherence of Siemens technical infrastructure and application environments. The Contractor shall provide personnel who possess specific technical and functional expertise and knowledge of Siemens products, including but not limited to:

Siemen’s TeamCenter PLM software versions 9 and 11

Siemens NX versions 8 and 11

INTEL

The Contractor shall monitor, administrate, and ensure recoverability and adherence of Intel technical infrastructure and application environments. The Contractor shall provide personnel who possess specific technical and functional expertise and knowledge of Intel products, including but not limited to:

Intel NVMe Adapters models 750, 3500, 3608, 3700, half-height/half-length (HHHL) and

U.2 form factors

Intel NVMe SSD DC P3700 Series

Intel QuickAssist Technology (Intel QAT) Adaptor model 8950 and on Xeon D-2100

CISCO

The Contractor shall monitor, administrate, and ensure recoverability and adherence of Cisco technical infrastructure and application environments. The Contractor shall provide personnel who possess specific technical and functional expertise and knowledge of Cisco products, including but not limited to:

Cisco Application Policy Infrastructure Controller Enterprise Module (APIC-EM) model apl-g-k9

Cisco Nexus 3k and 9k leaf/spine IP fabric architecture switches in application centric infrastructure (ACI) mode

Cisco Nexus 7k-5k-2k legacy IP fabric switches

Cisco Tetration Analytics (TA) appliance version 2.x and software/hardware sensors including active enforcement

Cisco UCS Sever models C220, C240, and C420

OTHER TECHNOLOGIES

The Contractor shall monitor, administrate, and ensure recoverability and adherence of technical infrastructure and application environments comprised of various technologies. The Contractor shall provide personnel who possess specific technical and functional expertise and knowledge of the following products, including but not limited to:

Anark 3D Publishing version 4.5x

Apache HTTP Server

Apache Software Foundation Open Source Projects and Libraries

Apache Tomcat

Atlantis/HiveIO Fabric and USX Hyper-Converged Infrastructure (HCI) software version 4-

Blancco Secure Erasure Software version 5

Brocade DCX Gen5 - Gen6

Brocade Fabric Operating System versions 7-8

Cohesity model C2510-2515 4-node block HCI Secondary Storage 5.0 utilized for

Environment-as-a-Service (EaaS) for Oracle eBS environments

CommScope Multiple-Fiber Push-On/Pull-Off (MPO) fiber array versions om3–om4 cabling

Contrast Assess 4 and Protect 4

Elastic Cloud Enterprise (ECE) version 6.x including x-packs and machine learning

Micron Solid-State Drives (SSD) 500 and 5100 series

Nagios System Monitoring Software version 3

NetScout Network Security Appliances nGenius Infinistream 6980 and Infinistream 9800

(both physical and virtual appliances)

NexSan Storage Array model E18VT, E60VT and BT60

Nvidia graphic processing units (GPUs) models K1, K2 and P100

OWASP ZAP 2.x

Patriot Excalibur (ePEX) version 5

Process Order Distributor and Display System (PODDS) version 3

QLogic Host Bus Adapter (HBA) models 2742 FCA and 2692 FCA in both source and target mode

RedFish software versions 1.x (BMC/IPMI integration across HPE, Cisco, and SuperMicro

Servers)

Servers Built for Immersion (SBI) (Custom SuperMicro SOC and Dual-Socket Servers for submersion in dielectric fluid solution provided by GRC)

Single Sign-On (SSO) and Portal versions 10x-11x

SolarFlare SolarCapture and SolarSecure software running on XtremeScale HBAs

SolidWorks Enterprise Project Data Management (EPDM) version 2017

SpectraLogic Tape Library models T-Finity and T380 including robotic automation and backup and recovery software integration

Tenable Nessus 6-7 including Security Center 5

Veritas NetBackup version 7.x-8.x including OpsCenter and OpsCenter Analytics, Storage Lifecycle Policies (SLP), Bare Metal Restore (BMR), Physical to Virtual (P2V) and Instant Recovery for VMware

Veritas NetBackup versions 7–8 including OpsCenter and OpsCenter Analytics, Storage

Lifecycle Policies (SLP), Bare Metal Restore (BMR), Physical to Virtual (P2V) and Instant

Recovery for VMware

SUBJECT MATTER EXPERTS (SME)

The Contractor shall provide personnel who possess specific technical and functional Subject

Matter Expertise in the following areas:

Maintenance Repair and Overhaul (MRO)

Material Requirements Planning (MRP)

Product Lifecycle Management (PLM)

Enterprise Resource Planning (ERP)

HOSTED APPLICATIONS

The application list below provides a sampling of applications currently sustained within the

HEDC architecture. The Contractor shall possess the specific technical and functional expertise and knowledge to continue sustainment of these applications. The list is not comprehensive and is subject to change.

309th Maintenance Group Teamcenter

84 RADES

A-10 TeamCenter

Air Combat Command (ACC)

Air Force Civil Engineering Center Portal (AFCEC)

Air Force Global Strike Command (AFGSC)

CMNet

ETOOLS (Alexys, ETIMS, PODDS)

Facilities and Equipment Management (FEM)

GeoBase (AFMC GIS)

IBM Collaborative Lifecycle Management (IBM CLM)

Information Technology Investment Portfolio System (ITIPS)

Inspector General Evaluation Management System (IGEMS)

Integrated Missile Database (IMDB)

Intercontinental Ballistic Missile (ICBM) Teamcenter

Jira

Maintenance MRO Business System Modernization (MABSM)

Maintenance, Repair, and Overhaul Initiative (MROi)

Management Internal Control Toolset (MICT)

NLIGN (Analytics Platform)

Program and Budget Execution System

Training and Scheduling System (TSS)

2.3 DESIGN, IMPLEMENT, AND OPTIMIZE ENTERPRISE ARCHIVE AND

BACKUP SOLUTIONS FOR ON-PREMISE AND CLOUD

Data archiving and successful backup and recovery of information are critical to support system requirements and ensure continuation of operations in the event of an emergency or disaster

(natural or man-made). The Contractor shall ensure these activities are properly accomplished.

The Contractor shall ensure the on-premise backup and restore solution is compatible with Linux

NFS and Windows CIFS/SMB Protocols ensuring that they support Fiber Channel, Internet

Small Computer System Interface (iSCSI) interfaces, Network Data Management Protocol

(NDMP) and VMware vStorage API for Data Protection (VADP) and are certified to operate on the current Enterprise SAN infrastructure. Contractor must continually be validating Recovery

Point Objective (RPO) and acceptable Recovery Time Objective (RTO) within applicable SLAs.

The Contractor shall ensure the cloud backup and restore solution is compatible with VMware onsite and VMC Virtual Private Clouds that are supported by the VMware Service Provider

Program (VSPP). The target RTO and RPO for all virtualized OEs must be less than one hour.

Ideally, tier one virtualized OEs RTO/RPO is less than five minutes. Certified and approved

FISMA moderate CSP object storage, such as Amazon S3, will be destaged into from on-site edge appliances. FIPS 140-2 Level 3 encryption will be employed of IL 4 and IL 5 data prior to cloud destage and will not hydrate outside of the DoD network. Information Lifecycle

Management must be employed to ensure the data retention policies of all HEDC tenant are compliant with their associated SLA. Monthly fire drills must be automated to a dynamically created VPC for each application. Yearly entire HEDC recovery fire drills must be accomplished and artifacts published to Government Program Manager and FISMA requirements updated.

2.4 DATACENTER IT OPERATIONS AND SUSTAINMENT SUPPORT

CONSOLIDATE SYSTEMS ADMINISTRATION AND ORACLE DATABASE

ADMINISTRATION

The Contractor shall coordinate with the 75 ABW/SC systems administration personnel (organic and contracted) as required in sustainment of the Linux and Windows based servers. For this effort, the Contractor shall provide personnel who possess knowledge of commercial best practices and Air Force security policies for system management. Systems administration includes support of both hardware and operating system; and maintenance of the applications running on the servers. The Contractors shall coordinate Oracle Data Base Administration tasks.

Examples of these tasks include installing security patches; completing backups, completing restores and rebuilding database tables; software installs and version upgrades; and correction/recovery of corrupted files.

PRODUCTION OPERATIONAL SUPPORT

The Contractor shall provide personnel for support of all productions systems to meet the CIA

Triad methodology. Tasks include but are not limited to: patching, STIGing, monitoring server health and performance, ?? Operational support tasks pertain to the list of applications in section

3.2.15. The Contractor shall provide full time equivalency (FTE) employees so that Operational

Support services are provided concurrently with other services, including but not limited to:

engineering, onboarding, sustainment, and project management.

The Contractor shall provide full time equivalency (FTE) personnel for the day-to-day operational support of the IT infrastructure and systems operating within the HEDC and its remote POD environments. The objectives of this function are to maintain day-to-day process and activity stability, identify ways to improve service, maintain stability and reduce costs.

1. The Contractor shall provide technical staff that can apply operational skills to quickly diagnose and resolve failures in the areas of Server Management, Network Management, Storage Management, Database Management, Virtualization Management, Power and

Cooling Systems to maximize stability and uptime.

2. The Contractor shall provide Operations Management to perform the IT Operations

Control functions of Console Monitoring, Job Scheduling, Backup and Restore, Clock

Management, Service Startup/Shutdown Management, Print and Output, Capacity

Management, Availability Management, Security Management, File Transfer and Control

Management, Archive Management, E-Mail relay and Message Queue Management, and

Event and Performance monitoring of the infrastructure components, systems, and applications.

3. The Contractor shall perform the Service Operations functions of Event Management, Incident Management, Problem Management, Request Fulfillment, and Access

Management utilizing the established IT Service Management and Configuration

Management System using ITIL best practices and organization processes.

4. The Contractor shall assist the Service Transition functions of Transition Planning and

Support, Change Management, Service Asset and Configuration Management, Release and Deployment Management, and Knowledge Management utilizing the established IT

Service Management and Configuration Management System using ITIL best practices and organization processes.

5. The Contractor shall perform the function of HEDC Service Desk to handles and own incidents, manage and own service requests, interface with Problem Management, answer questions, communicate with users, and provide an interface for other Service

Management activities utilizing the established IT Service Management and

Configuration Management System using ITIL best practices and organization processes.

This function includes a) managing calls for incidents, service requests, questions/information, feedback, b) managing incidents and service requests, c) providing first-line investigation and diagnosis, d) resolving incidents and service requests, e) escalating incidents and service requests that cannot be resolved within agreed time scales, f) closing all resolved incidents, service requests, and other calls, g) communications, h) updating the Configuration Management System, i) providing metrics for Key Performance Indicators.

6. The Contractor shall perform hardware, software, and firmware updates to the HEDC infrastructure based on organization-approved change management processes for security, reliability, and supportability purposes. This includes operating system patches and database patches.

SUPPORT HEDC PORTABLE OPERATING DATA CENTERS (POD)

The Contractor shall meet the objective of this effort, which is to install, maintain, configure, monitor and ensure recoverability and adherence of the technical infrastructure and application hosting environment of both HAFB local and 14 remote AFB PODs. These PODs include the same hosting capabilities, hardware and software of the HEDC primary sites but in an appliance, form managed 100% from the central HEDC site.

2.5 MODERNIZATION, STANDARDIZATION, CONSOLIDATION AND

OPTIMIZATION

The Contractor shall use the following architecture, engineering processes, and activities to complete the following requirements supporting securely hosting anywhere:

1. Architect/modernize current cloud infrastructure to implement both a virtual and physical environment for large, complex application workloads supporting Enterprise

Resource Planning (ERP), Product Lifecycle Management (PLM), Enterprise Asset

Management (EAM), complex Maintenance Repair and Overhaul (cMRO), Enterprise Performance Management (EPM), Enterprise Portfolio Management, Business and IT Service Management (BSM/ITSM), and other COTS and GOTS applications and their supporting technology stacks.

2. Engineer the best solution to fit the unique customer and DoD requirements utilizing industry best practices and Air Force/DoD regulatory guidance such as Defense

Information Systems Agency (DISA) Security Technical Implementation Guide

(STIG) Compliance. This process involves re-factoring customer systems to be successfully deployed into the HEDC PaaS, a designated commercial cloud environment, or a hybrid of the two. This will provide a reasonable balance between expedient system deployment, application modernization, and unwavering security continuous compliance.

3. Set up application systems for safe and rapid deployment into new or existing HEDC controlled engineered environments while those environments are continually improved, scaled out, and refreshed to support End of Life (EOL) End of Service

(EOS) replacement.

4. Strategize proper architecture/configuration/optimization for the continued growth of the enterprise platforms, associated technology stacks, and applications.

5. Ensure seamless inter-operability between all elements of the technology stack that comprise the platform through the integration and automation through the entire lifecycle.

6. Continuous engineering, implementation, and testing of the application platform to reside across multiple availability zones (multiple data centers) so as to provide work load survivability, elasticity, and mobility.

7. Maintain a continuous improvement cycle that supports constant, demonstrable improvement of the application platform and the application services provided to our customer. In particular, this cycle must address quantifiable improvements in time-to-value, performance, and reduced application latency while reducing costs. Follow industry-recognized quality assurance methods to perform regular data-driven analysis of processes including regular benchmarks that do full-depth tests of system performance including Central Processing Unit (CPU), memory, disk, network connectivity, application performance, and responsiveness to user. Testing will be conducted in coordination with application owners and common service providers.

8. Document and diagram architecture plans, implementation activities and system configurations. Where possible artifacts must be produced through policy-driven automation and enforcement provided by elements of the technology stack.

2.6 CONSOLIDATE APPLICATIONS TO HEDC APPLICATION HOSTING

PLATFORMS

The Contractor shall migrate customers into the HEDC utilizing the services available in the

HEDC continuously evolving service catalog. The Contractor shall provide a comprehensive project team to support the entire customer service lifecycle. This is referred to as application services onboarding and system maintenance. Service offerings currently include, but are not limited to:

1. Storage Service

a. Edge/WAN PoP File Services

b. MS SharePoint Service

c. Performance Tier Storage

d. Object Storage

e. Near-Line Tier Storage

f. Archive-Tier Storage

g. Production Tier Copy Data Management (CDM) into minor Tiers (Environment as a Service (EaaS))

2. Backup & Recovery Service

a. Enterprise NetBackup Service

b. Oracle Active Data Guard

c. Oracle Flashback Recovery

d. Snapshot Replication

e. VMware Continuous Data Protection (CDP)

3. Relational Database Service

a. Oracle Database Enterprise Edition

b. Microsoft SQL Server

c. PostgresSQL

d. MySQL

4. Security Service

a. RMF sustainment (A&A)

b. Security Compliance Engineering to improve security posture of HEDC infrastructure and hosted systems.

c. System categorization of HEDC infrastructure and hosted systems in order to provide appropriate Confidentiality, Integrity, and Availability (CIA).

d. Tailoring cyber security controls to hosted systems.

e. Continuous automated monitoring of compliance to implemented cyber security controls.

f. Risk Assessment

g. Threat and Vulnerability Assessment and Remediation

h. Security Baselines

i. CCRI Preparation

j. Develop Enterprise Security Architecture

k. Static Application Security Testing

l. Dynamic Application Security Testing

m. Penetration Testing

n. Cybersecurity Liaison duties

o. Software Baseline Testing

p. Hardware and Software Baseline Management

q. Security Analytics SecOPs

r. Encryption

i. Format Preserving Encryption (FPE)

ii. Encryption-At-Rest

iii. Encryption-In-Flight

iv. Encryption Key Management

s. Security Incident Handling

5. Analysis Support

a. Analysis of Alternatives (AoA) Service

b. Business Case Analysis (BCA)

c. Economic Analysis (EA)

d. Product Evaluations

e. Business Impact Analysis (BIA)

6. Rapid Conference Room Pilot (CRP) Proof of Concept (PoC) Service

7. Enterprise Applications Service

a. Business Intelligence Services

b. Enterprise Resource Planning (ERP)

c. Complex Maintenance Repair and Overhaul (cMRO)

d. Product Lifecycle Management (PLM)

e. Enterprise Asset Management (EAM)

f. Enterprise Performance Management (EPM)

g. Enterprise Project and Portfolio Management (EPPM)

h. Data Quality (DQ)

8. Engineered Platform-as-a-Service (PaaS)

a. Microsoft Ecosystem

b. Oracle Enterprise Ecosystem

c. Red Hat Linux

d. Java and Java Virtual Machine

e. Continuity of Operations (COOP)

f. Docker, LXC and other Container Ecosystems

g. Pivotal Cloud Foundry

9. Equipment Purchase and Tracking Support

a. Assist with developing ROMS, Brand Name Justifications (BNJ), and

Justification and Authorizations (J&A)

Track procurement deliveries and verify completeness

2.7 SYSTEM ONBOARDING

The contractor shall consolidate and onboard applications/systems to the HEDC. The Contractor may be responsible for planning and executing the onboarding of programs that desire to consolidate into the HEDC and have been approved to do so by HEDC management, Requirements Review Board (RRB), Technical Review Board (TRB), Software Review Board

(SRB) and Change Advisory Board (CAB). System onboarding may also be required for the modernization of currently hosted application/systems for functional enhancement and cost efficiency improvements of that specific system which are not included in infrastructure upgrades or improvements. The Contractor shall provide full time equivalency (FTE) employees so that System Onboarding services are provided concurrently with other services, including but not limited to: operations, sustainment, and project management.

To onboard new applications, requirements may include: transition from other ALCs, consolidation of the application and database servers in a virtual environment in the HEDC, and design of the application lifecycle management system for implementation as a new information system. This will entail a delineated seven step process including:

1. Defining the workload

2. Provisioning cloud resources

3. Establishing a connectivity bridge

4. Deploying the workload

5. Ensuring seamless two-way access

6. Testing and validating

7. Discontinuing the old service

Included will be those tasks specific to the planning and execution of onboarding applications which have been designated for consolidation into the HEDC. Enforcement of PL 112-81 has forced compliance to consolidate applications per the OMB directives of Cloud First and FDCCI.

The closure and consolidation of under-performing data centers and the optimization of the data centers in the Federal inventory will save billions of taxpayer dollars. HEDC, the HAFB

Installation Processing Node (IPN), will be required to continually develop plans for the execution of the onboarding of these new customers.

The below projects are a sampling of those applications:

1. Oracle EPPM Staging and Production

a. Primavera P6 Enterprise Project Portfolio Management

b. Primavera P6 Progress Reporter

c. Primavera P6 Analytics

d. Primavera P6 Team Member Module

e. Primavera P6 Cloud Connect

f. Primavera Unifier

g. Primavera Gateway

h. Primavera P6 Enterprise Project Portfolio Management Web Services

i. Project Portfolio Management Integration Pack for Primavera P6

j. Oracle User Productivity Kit User Productivity Kit Professional

k. Oracle user Productivity Kit for Primavera P6 Enterprise Project Portfolio

Management Media Pack

l. Oracle User Productivity Kit for Primavera Unifier Platform Media Pack

m. Oracle Enterprise Database 12c (P6 and Unifier warehouse instances)

2. 309th TeamCenter Staging, Production

3. AFCEC File Services including edge PODs for all CONUS locations

4. ACC Collaboration Environment (ACE) Upgrade to SP 2016

5. LogCop Support

6. Item Master

7. Gating Initiative for MABSM

8. Cloud Migration of new or existing workload

9. Migration from ACC to AMC for Holloman AFB

10. File Services Expansion at ACC bases

11. Atlassian-JIRA Ecosystem for NWRM

12. ACPS Consolidation

13. IMDB Teamcenter

14. Program and Budget Enterprise System (PBES)

2.8 HEDC BUSINESS OFFICE

The contractor shall be responsible to support and assist the HEDC GPM in establishing the processes and artifacts that are required for standardizing interactions with current and potential customers, management, and vendors. The contractor shall be responsible to support and assist the HEDC GPM in creating documentation and agreements required of HEDC customers, including but not limited to: Service Level Agreements (SLAs), Memorandums of Agreement

(MOAs), Memorandums for Record (MFR), User Level Agreements (ULAs).

2.9 HEDC ITIL PROCESS OWNER

The contractor shall be responsible to provide ITIL Process Owner support for HEDC customers.

The contractor shall field phone calls, submit and assign Work Orders and Incident tickets in a government provided system, and manage and prioritize tickets with input from project managers and the HEDC GPM.

2.10 IMPLEMENT ENTERPRISE MONITORING, SERVICE LEVEL AND

SHOWBACK REPORTING

To optimize and improve information systems security, operations, performance, and associated cost, the Contractor shall ensure…