OIT-StdTelecomSpacesPgs64-67.pdf

OFFICE OF INFORMATION AND TECHNOLOGY

INFRASTRUCTURE STANDARD FOR TELECOMMUNICATIONS SPACES| 64

· Floor to ceiling height

· Design redundancy levels maintained

Implementation Guidance Environmental control of VA data center spaces shall be based on the IT equipment requirements and not cooled for human comfort. Significant energy intensity reductions can be made by modifying these environmental control parameters and ensuring appropriate airflow paths and systems are designed, operated, and maintained. Retrofit all VA data center spaces for maximal energy savings as rapidly as feasible. Operate CRAC units only as required to maintain prescribed operational parameters.

4.3.7 Monitoring

Table 26: Monitored Conditions

Primary Attribute Secondary Attribute Specification

Monitored Conditions

Fire and Smoke Detection

· All VA data centers shall have a fire and smoke detection system in all data and infrastructure spaces as prescribed by National Fire Protection Association (NFPA) standards, Local Fire Codes, the AHJ, and/or CFM

· The fire and smoke detection system may be incorporated into an automatic fire suppression system

· Where allowed by the AHJ, fire and smoke detection shall use an early-warning Aspirated Smoke Detection (ASD) system such as Very Early Smoke Detection Apparatus (VESDA)

Water Detection

All CDCs, CSCs, and MSC shall install a liquid water detection system in all data and infrastructure spaces (not required for NSCs). Required in:

· Raised floor spaces

· IT spaces where water sources exist in or above electronic equipment

· HVAC chiller rooms

· Fire suppression system areas (pumps and controls)

Power

All VA data centers shall monitor continuity and quality of:

· Utility power delivery

· UPS power output

· Auxiliary generator power output

· Branch circuit power output

Temperature - Equipment Cabinets

· All VA data centers shall monitor air temperatures at multiple points in IT equipment cabinets. Exact quantity and placement of sensors shall be determined according to the design and implementation of airflow management measures to ensure an adequate supply of cooling air

INFRASTRUCTURE STANDARD FOR TELECOMMUNICATIONS SPACES| 65

Primary Attribute Secondary Attribute Specification

· All equipment cabinets in facilities lacking best-practice airflow management shall have at least four sensors per cabinet as per Sensor Location specification below

Temperature - CRACs

All VA data centers shall monitor supply air and return air temperatures:

· Supply air temperature shall be monitored at the output of each physical infrastructure device supplying cold air, whether the device is active or not

· Return air temperature shall be monitored at the intake of each physical infrastructure device supplying cold air, whether the device is active or not

Humidity - CRACs

All VA data centers shall monitor supply air and return air Relative Humidity (RH):

· Supply air RH shall be monitored at the output of each physical infrastructure device supplying cold air, whether the device is active or not

· Return air RH shall be monitored at the intake of each physical infrastructure device supplying cold air, whether the device is active or not

IT Equipment Cabinets

Temperature and Humidity Sensors

To ensure an adequate supply of cooling air, all IT cabinets in facilities lacking best-practice airflow management shall have at least four temperature sensors per cabinet and one humidity sensor as per Sensor Location specification below IT Cabinets in facilities with best-practice airflow management may use fewer sensors, meeting the following minimum criteria:

· Sensors in cabinets at the ends of a contiguous row/string

· Sensors in every third cabinet in the middle of a contiguous row/string

· At least two sensors per monitored cabinet

· Temperature sensors in the FM and RT locations

· Humidity sensor in the FM location

INFRASTRUCTURE STANDARD FOR TELECOMMUNICATIONS SPACES| 66

Primary Attribute Secondary Attribute Specification

Sensor Locations

IT Equipment Cabinet temperature sensor locations shall correspond to VA modified ASHRAE-recommended monitoring locations:

· Front Top (FT): Centered horizontally, inside the front door, no more than 1 ft from the top of the cabinet

· Front Middle (FM): Centered horizontally, inside the front door, 4 ft +/- 6 in. from the finished floor surface

· Front Bottom (FB): Centered horizontally, inside the front door, no more than 1 ft from the finished floor surface

· Rear Top (RT): Centered horizontally, inside the rear door, no more than 1 ft from the top of the cabinet

One humidity sensor in the FM location

Communication Protocols

IT Devices

Monitored IT Devices shall use the Simple Network Communication Protocol (SNMP), configured in a secure mode as required by the TRM.

Implementations shall adhere to the VA LAN Security Standard:

· SNMPv3 secured using SSL

· SSL using Secure Hash Algorithm (SHA-1) authentication

· Advanced Encryption Standard (AES)

Encryption, at 128-bit or the highest level supported by the attached hardware

Monitoring Systems

To support data stream integration, monitoring systems shall support Secured SNMP v3.0 for upstream communication and at least one of the following industrial communication protocols to receive sensor data:

· BACnet or BACnetIP

· Modbus or Modbus IP

· CANbus or CANbus IP

· Fieldbus or Fieldbus-IP

Monitoring Devices

Monitoring devices and systems shall be capable of communication using at least one of the following protocols:

· Secured SNMP v3.0

· BACnet or BACnetIP

· Modbus or Modbus IP

· CANbus or CANbus IP

· Fieldbus or Fieldbus-IP

INFRASTRUCTURE STANDARD FOR TELECOMMUNICATIONS SPACES| 67

Primary Attribute Secondary Attribute Specification

Physical Infrastructure Devices

Infrastructure device communication modules shall support at least one of the following protocols:

· Secured SNMP v3.0

· BACnet or BACnet IP

· Modbus or Modbus IP

· CANbus or CANbus IP

· Fieldbus or Fieldbus-IP

Evaluation Factors

· Facility actively monitors all required monitoring points

· IT equipment rack temperature/humidity sensors installed as described in Standard

· Water detection system design § Point leak detection units § Zone leak detection panels § Linear detection systems § Wire-free sensors § DCIM integration

· Monitoring systems and equipment comply with communications protocol requirements Implementation Guidance

Monitoring shall be defined as continual real-time observation of a condition or set of conditions affecting computing spaces.

Connect all vertical rPDU to the rPDU monitoring system. Maximize connectivity of facility equipment within the data center to the rPDU monitoring system.

Provide output feeds from the system to the Facilities Management Service (FMS) building monitoring system for remote monitoring capabilities.

Functional definitions of monitoring and metering shall not be interpreted to require separate systems; a single sensor, device, or system may support multiple monitoring and metering functions.

Detection, alerting, and alarming functions, as well as automatic triggering of interventions, shall be considered part of a monitoring system.

Monitoring systems collect forensic data during a period when a detection threshold has been exceeded.

Alerts are communicated when a condition threshold has been reached or exceeded. Alert triggers shall be set to provide sufficient reaction time to respond to, investigate, and correct the underlying cause of the condition.

Alarming systems shall communicate when an absolute limit has been exceeded.

4.2.10.2.2 Site Infrastructure Energy Efficiency Rating

4.4.11.2 Inter-building

5.2.1.3 Unshielded Twisted Pair, Fiber, and Power Cabling Guidance

5.2.2 Management of Airflow