Attachment 2 - Evaluation Criteria.pdf

US Department of Agriculture (USDA)

Attachment 2 - Evaluation Criteria

Contents Section 1: Evaluation Methodology Section 2: Evaluation Factors

2.1 Factor 1: Skills

2.1.1 Subfactor 1: Training

2.1.2 Subfactor 2: Certification

2.1.3 Subfactor 3: Geospatial Science

2.1.4 Subfactor 4: Data Integration and Analysis of Defensive Actions

2.1.5 Subfactor 5: Analysis of National Fire Incident Reporting System

2.1.6 Subfactor 6: Analysis of Structure Separation Distance

2.1.7 Subfactor 7: Creating Input File for the Fire Dynamics Simulator (FDS)

2.1.8 Subfactor 8: Integrating Data from Large Outdoor Fires

2.2 Factor 2: Experience

2.2.1 Subfactor 1: LIDAR Building Footprint and Vegetation Extraction

2.2.2 Subfactor 2: Recreating a WUI Fire Event Timeline

2.2.3 Subfactor 3: Creating, Documenting and Publishing WUI Databases

2.2.4 Subfactor 4: Using ArcGIS Online to Develop ESRI Storymap of WUI Fire

2.2.5 Subfactor 5: Creating and Implementing Electronic Field Data Collection System

2.2.6 Subfactor 6: Integrating and Analyzing Defensive Action Information

2.2.7 Subfactor 7: Analysis of National Fire Incident Reporting System

2.2.8 Subfactor 8: Analysis of Structure Separation Distance

2.2.9 Subfactor 9: Creating Input File for the Fire Dynamics Simulator (FDS)

2.2.10 Subfactor 10: Integrating Data from Large Outdoor Fires

2.3 Factor 3: Past Performance

2.3.1 Past Contracts or Experiences of Contractor

Subfactor 1: LIDAR Building Footprint and Vegetation Extraction Subfactor 2: Recreating a WUI Fire Event Timeline Subfactor 3: Creating, Documenting and Publishing WUI Databases Subfactor 4: Using ArcGIS Online to Develop ESRI Storymap of WUI Fire Subfactor 5: Creating and Implementing Electronic Field Data Collection System Subfactor 6: Integrating and Analyzing Defensive Action Information Subfactor 7: Analysis of National Fire Incident Reporting System Subfactor 9: Creating Input File for the Fire Dynamics Simulator (FDS) Subfactor 10: Integrating Data from Large Outdoor Fires

2.4 Factor 3: Examples of Products

2.4.1 Peer-Reviewed Journal Articles

2.4.2 Federal Organization Reports

2.4.3 Published WUI and Large Outdoor Databases

2.4.4 ArcGIS Online Storymaps and Datasets

2.4.5 FDS File Creation Demonstrations and Tools

2.4.6 Post-Fire WUI Assessment Electronic Field Data Collection System

Evaluation documentation must clearly summarize and justify evaluation results. Ensure that the documentation can lead to a logical best value decision. Including a cost/price factor is a requirement of FAR 15.304. If using a trade-off process, describe the evaluation factors and their relationship to the goals of the procurement.

Section 1: Evaluation Methodology Quotes will be evaluated based on technical merit using a qualitative assessment of the applicant’s qualifications, experience, and demonstrated capabilities. Primary consideration will be given to demonstrated expertise in gathering, integrating, and analyzing geospatial and other data related to wildland-urban interface (WUI) fires, including the demonstrated ability to integrate and analyze data spanning pre-fire, active-fire, and post-fire conditions of a post-fire wildland-urban interface environment. Special emphasis will be placed on evidence of proven capability in creating tools and methods to produce input files for the Fire Dynamics Simulator (created by the National Institute of Standards and Technology) as applied to the simulation of fire behavior in the WUI. Proposals will also be assessed on the applicant’s ability to work independently as a sole contractor (i.e., single individual) with demonstrated evidence of all the evaluation criteria, considering past performance on similar projects and the technical approach's clarity, relevance, and completeness. The complicated and unique nature of the work and the need for the USFS Technical Representative to interact closely with a single individual throughout the contract.

Section 2: Evaluation Factors

2.1 Factor 1: Training and Certification-Skills

2.1.1 Subfactor 1: Training

Bachelor of Science in Natural Resource Field

2.1.2 Subfactor 2: Certification

Certification from an Accredited University in Geographic Information Systems A GISP designation from the GIS Certification Institute, having that certification for at least ten years

2.1.3 Subfactor 3: Geospatial Science

Demonstrated skills in extracting building footprints from light detection and ranging (LIDAR) data and creating vegetation datasets within the WUI. Demonstrated skills in creating spatial and tabular databases of WUI environments, including databases of defensive actions occurring during WUI fires. Demonstrated skills in creating custom algorithms for extracting building footprints and vegetation from LIDAR and other remote sensing data. Demonstrated skills in integrating, in time and space, observational data from WUI environments, including the recreation of WUI event timelines in time and space. Skills in documenting, using Federal Geographic Data Committee (FGDC) approved metadata formats, and publishing geospatial datasets of WUI environments to the United States Department of Agriculture Forest Service Research Archive and the United States Forest Service Environmental Systems Research Institute (ESRI) ArcGIS Online account. Also, demonstrated skills in utilizing ArcGIS Online to develop an ESRI story map describing the results of a post-fire WUI environment assessment. Finally, demonstrated skills in developing and implementing electronic field data applications to support data collection in a post-fire WUI environment.

2.1.4 Subfactor 4: Data Integration and Analysis of Defensive Actions Demonstrated skills using numerous data sources, including post-fire remote sensing data, to identify the locations of defensive actions and assess the consequences of those actions to the survival of buildings at WUI fires—demonstrated skills in summarizing and presenting the results of these data integrations and analysis in writing.

2.1.5 Subfactor 5: Analysis of National Fire Incident Reporting System Demonstrate skills using the National Fire Incident Reporting System (NFRIS) to extract and examine exposure fires (that spread beyond the origin) spanning periods greater than ten years. These skills should include geolocating primary residential structures (i.e., incident type code = 111 and property use code – 419) and associating these geolocated point locations with geospatial datasets of building footprints across the United States—demonstrated skills in summarizing and presenting the results of these data integrations and analysis in writing.

2.1.6 Subfactor 6: Analysis of Structure Separation Distance

Demonstrate skills in assessing structure separation distance at WUI fires. Demonstrated skills supporting experiments related to structure separation experiments—demonstrated skills in summarizing and presenting the results of these data integrations and analysis in writing.

2.1.7 Subfactor 7: Creating Input File for the Fire Dynamics Simulator (FDS) Demonstrate skills in creating input files for the Fire Dynamics Simulator (FDS) from geospatial datasets of buildings, vegetation, fuel breaks, and other data. Demonstrated skills in creating custom geospatial applications to create FDS input files in WUI environments.

2.1.8 Subfactor 8: Integrating Data from Large Outdoor Fires

Demonstrate skills in integrating and assessing the quality of meteorological observations, measures of heat fluxes, vegetation datasets, and other data at large outdoor fires (either prescribed fires or wildland fires). Demonstrated skills in publishing datasets of remote sensing, vegetation, ignition locations, and other data from large outdoor fires to the USDA Forest Service Research Archive. Demonstrated skills in presenting the integration and quality assessment of data from large outdoor fires in the USFS ArcGIS Online platform.

2.2 Factor 2: Experience

Describe experience in activities that are similar or equivalent to those required to complete the tasks in the work to be funded.

2.2.1 Subfactor 1: LIDAR Building Footprint and Vegetation Extraction Demonstrated experience extracting building footprints and vegetation from Light Detection and Ranging Data (LIDAR) in WUI environments. This experience should have occurred in at least two WUI fires.

2.2.2 Subfactor 2: Recreating a WUI Fire Event Timeline

Demonstrated experience integrating data from numerous sources to recreate an event timeline for WUI fires.

2.2.3 Subfactor 3: Creating, Documenting and Publishing WUI Databases Demonstrated experience creating, documenting (using FGDC-approved metadata formats), and publishing geospatial datasets representing WUI environments' pre-fire, active-fire, and post-fire conditions. Publication experience must be related to publication on the USDA Forest Service Research Archive and the USDA Forest Service ArcGIS Online platform.

2.2.4 Subfactor 4: Using ArcGIS Online to Develop ESRI Storymap of WUI Fire Demonstrated experience creating an ESRI storymap documenting the results of a WUI post-fire assessment on the USDA Forest Service ArcGIS Online platform.

2.2.5 Subfactor 5: Creating and Implementing Electronic Field Data Collection System Demonstrated experience creating and implementing an electronic field data collection system to support the assessment of post-fire WUI environments.

2.2.6 Subfactor 6: Integrating and Analyzing Defensive Action Information Demonstrated experience using numerous data sources, including post-fire remote sensing data, to identify the locations of defensive actions and assess the consequences of those actions to the survival of buildings at WUI fires— demonstrated experience in summarizing and presenting the results of these data integrations and analysis in writing.

2.2.7 Subfactor 7: Analysis of National Fire Incident Reporting System Demonstrate experience using the National Fire Incident Reporting System (NFRIS) to extract and examine exposure fires (that spread beyond the origin) spanning periods greater than ten years. This experience should include geolocating primary residential structures (i.e., incident type code = 111 and property use code – 419) and associating these geolocated point locations with geospatial datasets of building footprints across the United States—demonstrated experience in summarizing and presenting the results of these data integrations and analysis in writing.

2.2.8 Subfactor 8: Analysis of Structure Separation Distance

Demonstrate experience in assessing structure separation distance at WUI fires. Demonstrated experience supporting experiments related to structure separation experiments—demonstrated experience in summarizing and presenting the results of these data integrations and analysis in writing.

2.2.9 Subfactor 9: Creating Input File for the Fire Dynamics Simulator (FDS) Demonstrate experience in creating input files for the Fire Dynamics Simulator (FDS) from geospatial datasets of buildings, vegetation, fuel breaks, and other data. Demonstrated experience in creating custom geospatial applications to create FDS input files in WUI environments.

2.2.10 Subfactor 10: Integrating Data from Large Outdoor Fires Demonstrate experience in integrating and assessing the quality of meteorological observations, measures of heat fluxes, vegetation datasets, and other data at large outdoor fires (either prescribed fires or wildland fires).

Demonstrated experience in publishing datasets of remote sensing, vegetation, ignition locations, and other data from large outdoor fires to the USDA Forest Service Research Archive. Demonstrated experience in presenting the integration and quality assessment of data from large outdoor fires in the USFS ArcGIS Online platform.

2.3 Factor 3: Past Performance

2.3.1 Past Contracts or Experiences of Contractor

Provide descriptions of past Government and commercial contracts or contractor experience that funded work like the work proposed (i.e., required similar skills and experience) for each of the evaluation criteria presented below

Subfactor 1: LIDAR Building Footprint and Vegetation Extraction Demonstrated past contracts where the contractor successfully extracted building footprints and vegetation from Light Detection and Ranging Data (LIDAR).

Subfactor 2: Recreating a WUI Fire Event Timeline Demonstrated past contracts integrating data from numerous sources to recreate an event timeline for WUI fires.

Subfactor 3: Creating, Documenting and Publishing WUI Databases Demonstrated past contracts creating, documenting (using FGDC-approved metadata formats), and publishing geospatial datasets representing WUI environments' pre-fire, active-fire, and post-fire conditions. Past contracts must be related to publication on the USDA Forest Service Research Archive and the USDA Forest Service ArcGIS Online platform.

Subfactor 4: Using ArcGIS Online to Develop ESRI Storymap of WUI Fire Past contracts creating an ESRI storymap documenting the results of a WUI post-fire assessment on the USDA Forest Service ArcGIS Online platform.

Subfactor 5: Creating and Implementing Electronic Field Data Collection System Past contracts or experience creating and implementing an electronic field data collection to support the assessment of post-fire WUI environments.

Subfactor 6: Integrating and Analyzing Defensive Action Information Past contracts involve integrating numerous data sources, including post-fire remote sensing data, to identify the locations of defensive actions and assess the consequences of those actions to the survival of buildings at WUI fires— past contracts involve summarizing and presenting the results of these data integrations and analysis in writing.

Subfactor 7: Analysis of National Fire Incident Reporting System Past contracts using the National Fire Incident Reporting System (NFRIS) to extract and examine exposure fires (that spread beyond the origin) spanning periods greater than ten years. These contracts should include geolocating primary residential structures (i.e., incident type code = 111 and property use code – 419) and associating these geolocated point locations with geospatial datasets of building footprints across the United States—contracts involve summarizing and presenting the results of these data integrations and analysis in writing.

Subfactor 9: Creating Input File for the Fire Dynamics Simulator (FDS) Past contracts in creating input files for the Fire Dynamics Simulator (FDS) from geospatial datasets of buildings, vegetation, fuel breaks, and other data. Contracts involve creating custom geospatial applications to create FDS input files in WUI environments.

Subfactor 10: Integrating Data from Large Outdoor Fires Past contracts involve integrating and assessing the quality of meteorological observations, measures of heat fluxes, vegetation datasets, and other data at large outdoor fires (either prescribed or wildland fires). Contracts involve publishing datasets of remote sensing, vegetation, ignition locations, and other data from large outdoor fires to the USDA Forest Service Research Archive. Contracts involve presenting the integration and quality assessment of data from large outdoor fires in the USFS ArcGIS Online platform.

2.4 Factor 4: Technical Capability-Examples of Products

Provide examples of products from past contracts or contractor experience that funded work like the work proposed (i.e., required similar products). The specific requirements for products are listed below.

2.4.1 Peer-Reviewed Journal Articles

Products demonstrating the skills and experience discussed in the sections above must include publishing as a lead author at least one peer-reviewed journal article related to identifying and assessing defensive actions in a WUI environment, one peer-reviewed journal article pertaining to the extraction of building footprints from LIDAR data, and one peer-reviewed journal article assessing NFIRS exposure fires and structure separation distance in some of those exposure fires.

2.4.2 Federal Organization Reports

Products demonstrating the skills and experience discussed in the sections above must include at least two reports published from United States Federal organizations where the contractor was first or second author documenting the results of post-fire WUI assessments and the recreation of the WUI fire event timeline. An author on at least one United States Federal Government report related to an experiment on structure separation distance.

2.4.3 Published WUI and Large Outdoor Databases

Products demonstrating the skills and experience discussed in the sections above must include the publication and documentation of at least two geospatial databases representing data collected and derived from WUI post-fire assessments on the USDA Forest Service Research Archive. Additionally, products demonstrated the publication of remote sensing datasets representing active-fire conditions from large outdoor fires, pre-fire and post-fire conditions at large outdoor fires, and pre-fire vegetation maps.

2.4.4 ArcGIS Online Storymaps and Datasets

Products demonstrating the skills and experience discussed in the sections above must include the publication of at least two ESRI Storymaps and datasets representing the results of post-fire WUI assessments. Also, at least one ESRI Storymap describing integrated quality assessment of large outdoor fire datasets was published.

2.4.5 FDS File Creation Demonstrations and Tools

Products demonstrating the skills and experience discussed in the sections above must include at least one report, peer-reviewed journal article, or other media demonstrating the integration of geospatial data in a WUI setting to create FDS input files and at least one example tool that performs the integration of data to support the creation of FDS input files in WUI and large outdoor fire environments.

2.4.6 Post-Fire WUI Assessment Electronic Field Data Collection System Products demonstrating the skills and experience discussed in the sections above must include at least one report, peer-reviewed journal article, or other media documenting developing and implementing an electronic field data collection system to support post-fire WUI assessments.