2018_BAA_Video_and_Sensor_Data_Reduction_SOO_L.pdf

Video and Sensor Data Reduction

Statement of Objectives BAA 18-02/Call 0001/SOO L

April 1, 2019 Science and Technology Directorate (S&T) Department of Homeland Security (DHS)

BAA 18-02/Call 0001/ SOO L Video and Sensor Data Reduction

Table of Contents

Contents

1.0 Problem Statement

2.0 Purpose and Scope

3.0 Background Environment

3.1 Mission Scenarios

4.0 Potential Solution Attributes

5.0 Solution Capabilities and Requirements

5.1 Must Have Requirements

5.2 Desirable Capabilities or Characteristics

6.0 System Support

6.1 Contractual Requirements

6.1.1 Period and Place of Performance

6.1.2 System Affordability

6.1.3 Regulatory/Legal Requirements

6.1.4 Contract Deliverables

6.2 Solution Support

6.2.1 Training

6.2.2 Storage and Maintenance

1.0 Problem Statement

In Project Responder 4 (PR4), first responders identified the need “to seamlessly and dynamically connect multiple persons or entities and convey meaningful and actionable information to all relevant parties”1 as a major capability gap. Currently, first responders face information overload from video and other sensor feeds, with far more video and sensor points than can be transmitted, much less processed and analyzed. An example that responder stakeholders referenced is live maps that are completely saturated with information, such as the Department of Transportation Services Parking Maps, or “dots” application.2

At the 2018 First Responder Resource Group (FRRG) conference, first responder subject matter experts further addressed this issue, specifically requesting that DHS S&T pursue development of technology that transmits usable video data over reduced bandwidth while simultaneously reducing cognitive load on video viewers.

2.0 Purpose and Scope

This new technology will filter out uninformative video details (through machine interpretation) users classify as “unnecessary.” It will result in smart reduction of both resolution and frame rates (to provide summary views of the video, such as in thumbnail views) as well as entire clip censoring (if “nothing is happening here” on the video stream). Additionally, the technology will utilize video interpretation and filtering technologies that are currently on the market or that will be produced (those at a proof of concept stage or in development) in the near future. With the ability to filter out unnecessary visual data, this would substantially reduce the data overload sent to first responder agencies.

3.0 Background Environment

Filtering out the important data and creating an actionable process is not only an issue on a consumer level, but also in the first responder community. Several information feeds are available to first responders and public safety departments including: video surveillance streams, analytics, geo-alarms and Chemical, Biological, Radiological, Nuclear, and Explosives (CBRNE) sensors.

With the constant influx of information occurring on a daily basis, first responder agencies are having a difficult time trying to determine what information is pertinent to their daily operations and what is not. In addition, this leads to longer response times and the inability to allocate the resources needed to respond to incidents effectively. The need to filter down to mission critical data which

1 Department of Homeland Security, Security and Technology Directorate, “Project Responder 4: 2014 National Technology Plan for Emergency Response to Catastrophic Incidents,” Page 57.

https://www.dhs.gov/sites/default/files/publications/Project%20Responder%204_1.pdf

2 The Department of Transportation Services, Parking Maps & Aps https://www.dots.umd.edu/maps&apps.html https://www.dhs.gov/sites/default/files/publications/Project%20Responder%204_1.pdf will create meaningful situational awareness (that can be shared) that triggers an actionable response is the dilemma that these agencies are facing.

3.1 Mission Scenarios

This solution will substantially reduce information overload coming in to first response agencies by only relaying actionable video data. It will also greatly improve capabilities to recognize and get the specific information (video and other feeds) needed to inform near-real time decision-making, as well as information needed in after-action reporting. Additionally, it is broadly applicable for all missions with large numbers of video and other sensor feeds coming in – both from agency-controlled assets and from large numbers of civilian cameras (feeds posted to YouTube, Instagram, etc., and which can be queried using geo-fencing techniques).

4.0 Potential Solution Attributes

This technology will transmit video data while filtering out unnecessary data feeds to prevent information overload for first responders. Responders can reduce information overload and will have better access to real-time relevant information from a variety of sources. The reduction of data should facilitate the ability of data to be converted into actionable intelligence. The central focus on providing the information necessary for better tactical and operational decision-making in real-time while minimizing/removing extraneous information will greatly impact the first responder community in a positive way.

Additionally, the technology should use existing video interpretation and filtering technologies that are commercially available now or are expected to exist in the near future. The technology should also permit archiving of the full length of video, at least at the local site of the camera.

5.0 Solution Capabilities and Requirements

5.1 Must Have Requirements (Key Performance Parameters)

The proposed solution must:

• Use video interpretation and filtering technologies that either exist now or are expected to exist in the near term.

• Permit archiving of the full video, at least at the local site of the camera.

• Be suitable for data reduction needs to support being tailored for different types of missions, with filters created and tailored as appropriate to give users the specific “dots” they need – and ideally only those dots o When possible, needs to permit switching feeds between nothing/low-resolution viewing to higher-resolution video/signal if something "operationally relevant" occurs.

o Will make use of existing subject matter expert knowledge of what is needed in various response situations to provide business rules to guide the data reduction.

5.2 Desirable Capabilities or Characteristics

The proposed solution should:

• Be tailorable for agency and mission, bringing in different types of filters and reduction mechanisms for different types of missions.

• Integrate and attribute incoming video and other data feeds into existing live maps and other command and field responder displays.

6.0 System Support

6.1 Contractual Requirements

6.1.1 Period and Place of Performance

The length of time of the contract shall be between 15-18 months and shall not exceed 18 months.

All developmental activities will be performed at the contractor-designated site(s). DHS may require the contractor to perform critical design reviews and/or product presentations at DHS-specified locations.

6.1.2 System Affordability

The solution will be cost-effective so first responders from a wide variety of jurisdictions will be able to afford it. First responders’ budgets are limited and should be taken into consideration when developing and determining a price per unit cost model.

6.1.3 Regulatory/Legal Requirements

DHS is committed to providing information regarding the availability of their technology to the first responder community by requiring the project performer to submit applications to be added to the DHS Federal Emergency Management Agency (FEMA) Authorized Equipment List and the Inter- Agency Board for Equipment Standardization and Interoperability Standardized Equipment List as a final deliverable.

6.1.4 Contract Deliverables

DHS is committed to ensuring the success of the technology. Project performers will be required to provide at a minimum three prototype deliverables, which will be used for post-contract testing and evaluation.

DHS is also committed to ensuring that the technology will also be used by the first responder community. DHS requests that the project performer provide documented metrics regarding product sales and estimated production costs for the first three years after commercialization. Additionally, the project performer may be requested by DHS to participate in operational exercises, demonstrations, and conferences for the first three years after commercialization in order to promote first responder technology awareness.

6.2 Solution Support

6.2.1 Training

Training information, as required, shall be provided on any specialized equipment and shall include how to properly store, clean, deploy, and maintain the basic ensemble/unit. Any specialty requirements of personnel conducting maintenance, storage, extraction, or delivery will be identified including certification requirements. Training material shall be available initially in hard-copy, and subsequently in soft-copy format.

6.2.2 Storage and Maintenance

The contractor shall identify all necessary storage and maintenance requirements for the proposed solution including: the required maintenance schedule, identification of the specific components of the ensemble that requires maintenance, the type of maintenance required, and whether the maintenance can be performed in the field by operational personnel or if it will be required to be returned to the manufacturer for the required maintenance.