NF-FS7300-23-02013 DRAFT Performance Work Statement 06.28.23.pdf

Performance Work Statement (PWS) National Oceanic and Atmospheric Administration (NOAA)

National Marine Fisheries Service (NMFS) Alaska Fisheries Science Center (AFSC)

Marine Mammal Laboratory (MML)

PINNIPED RESEARCH AND PROTECTED SPECIES MANAGEMENT COORDINATION

IN THE RUSSIAN FAR EAST

BACKGROUND

The Marine Mammal Laboratory (MML) conducts research on Steller sea lions, a species listed as endangered (western stock) under the U.S. Endangered Species Act (ESA) and on northern fur seals, a species listed as depleted under the Marine Mammal Protection Act (MMPA). Both species range across the North Pacific Ocean rim from Japan to southern California, thus an important component of the studies includes the collection, analyses, and interpretation of data on populations outside the United States. Steller sea lions in the Commander Islands, Russia, are genetically related to sea lions in the western stock of Alaska, and there is movement of sea lions between Russia and Alaska. These movements indicate that even temporary immigration could influence abundance estimates in either area and suggest that population demographics should be examined throughout the range, not just in the United

States. Combined with ecological similarities and contrasts between the two areas, MML has contracted for collaborative studies to understand Steller sea lion abundance, trends, and vital rates in Russia during 2009-2023.

The MML seeks assistance involving protected species pinniped research and management in

Russia and Alaska, conducted from the United States. This work involves the interpretation, translation, analysis, and presentation of results (as publishable manuscripts and conference presentations) originating from past field data collected at Steller sea lion rookeries in Russia;

maintenance of remote cameras installed at Steller sea lion rookeries in Alaska; development of an automated method for reviewing remote camera images of Steller sea lions; facilitation of cross-border cooperation of Steller sea lion and other marine mammal studies; presentation of results in publications and at professional meetings; and optionally, development of an automated method of counting fur seals from images collected by uncrewed aerial vehicles

(UAV), and installation of new camera systems at Marmot Island, Alaska.

This work continues studies that improve understanding of Steller sea lion populations in Russia and Alaska. The primary data sources are images recorded from over 40 remote cameras placed on rookeries in Russia, and 41 cameras (as of July 2022) placed on rookeries throughout the western stock Steller sea lion range of Alaska (Table 1). Rookery sites can be viewed at:

https://noaa.maps.arcgis.com/home/webmap/viewer.html?webmap=72140ac3ce1844f9a1f89 c97a93df4ca

The early stages of this work have been completed on images collected prior to 2022, but additional work is necessary to process and analyze data from more recent images. As with

Steller sea lions, abundance estimates of northern fur seals are needed to address potential threats to recovery across the range

Table 1. Distribution of remote cameras among Steller sea lion sites in Alaska.

Region Rookery site Number of cameras

Western Aleutian Islands Attu Is. / Cape Wrangell 6

Agattu Is. / Gillon Point 6

Agattu Is. / Cape Sabak 3

Alaid Is. 2

Central Aleutian Islands Kiska Is. / Cape St. Stephens 2

Kiska Is. / Lief Cove 2

Ulak Is. / Hasgox Point 7

Eastern Aleutian Islands Ugamak Is. / North 5

Ugamak Is. / Ugamak Bay 5

Ugamak Is. / Round Is. 1

Eastern Gulf of Alaska Sugarloaf Is. 2 https://noaa.maps.arcgis.com/home/webmap/viewer.html?webmap=72140ac3ce1844f9a1f89c97a93df4ca https://noaa.maps.arcgis.com/home/webmap/viewer.html?webmap=72140ac3ce1844f9a1f89c97a93df4ca

The United States and Russia coordinate joint research through the United States Government

Project 02.05-61, “Marine Mammals,” under Area V of the U.S./Russia Agreement on

Cooperation in the Field of Environmental Protection and Natural Resources, and the working group’s main purpose is to promote cooperative studies and exchange scientific information to better manage and conserve marine mammal species shared by both countries. The functional status of this group is unclear due to U.S. and Russia governmental relations; but as part of this solicitation an established Russian-speaking marine mammal scientist is sought to serve as a liaison between U.S. and Russian scientists trusted (by both governments) to facilitate Project meetings should they occur.

TASKS

Key tasks include the following; the contractor shall:

Task 1: Estimate vital rates, movements, and counts of Steller sea lions in Russia and Alaska.

This task utilizes image data collected from over 40 remote camera installations on rookeries in the Russian portion of the western stock, and from data cards collected from 41 cameras in western Alaska. This task continues to develop protocols and methods for extracting and collating the image data from camera data cards, an automated method to review, filter, and identify images for brand identification by developing and testing a software program to automate extraction and image analysis, and provide that information to MML scientists for the purpose of vital rates analyses.

A. Images shall be available that have been recording images since 2022 and are expected to be retrieved in summer of 2023. Extract images from camera cards collected from the western Alaska cameras during the summer of 2023.

B. Images from cameras in the Kuril Islands, Commander Islands, and northern sea of

Okhotsk were downloaded in 2022 and are currently in the United States; also, any new images contained on data cards potentially collected in the summer of 2023 shall be included. Extract all images from camera cards collected from the Russian Steller sea lion rookery cameras in 2022 and 2023, if available.

C. Run extracted images through the algorithm, and revise machine learning algorithms to improve the detectability of marked sea lions from remote images.

D. Manually review images to search for branded Steller sea lions and use those images to train a machine learning algorithm to complete an image processing methodology capable of selecting a minimum of 90% of the images with branded sea lions present.

Task 2: Maintain the network of remote digital camera installations at Steller sea lion haulouts and rookeries within the Steller sea lion western range (41 cameras as of May 2023, plus any added).

A. In association with MML or USFWS vessel-based trips service, repair, or replace remote camera installations to maintain year-round functionality. Retrieve/replace data cards.

In 2024 potentially an early-season (May-June) voyage with USFWS departing from

Homer, Alaska would allow visits to Sugarloaf and Ugamak Islands, with debarkation in

Dutch Harbor, Alaska. Visits to Aleutian Island sites would occur with MML/FWS in June-

July originating in Adak and ending in Adak or Dutch Harbor.

Task 3: Serve as a liaison between United States and Russian scientists to assist with facilitating meetings of the United States Government Project 02.05-61, “Marine Mammals,” under Area V of the U.S./Russia Agreement on Cooperation in the Field of Environmental Protection and

Natural Resources. The contractor shall provide logistical and organizational expertise in setting up meetings and language translation, and document results of meetings and conference calls.

The working group’s main purpose is to promote scientific collaboration and to exchange scientific information to better manage and conserve marine mammal species shared by both countries. Because work under this task may be impacted or modified by pandemic status, travel advisories and governmental relations between the U.S. and Russia, it is presumed these activities shall be virtual should they occur.

Task 4: Communication and publications

A. Present research results at the 2024 Alaska Marine Science Symposium, in Anchorage, Alaska.

B. Prepare a draft manuscript describing the spatial distribution and movement of Steller sea lions along the Asian Coast.

C. Provide support to MML users of algorithms.

D. Provide monthly reports.

Task 1 – Optional: Estimate vital rates, movements, and counts of Steller sea lions in Russia and

Alaska. This task utilizes image data collected from over 40 remote camera installations on rookeries in the Russian portion of the western stock, and from data cards collected from 41 cameras in western Alaska. This task continues to develop protocols and methods for extracting and collating the image data from camera data cards, an automated method to review, filter, and identify images for brand identification by developing and testing a software program to automate extraction and image analysis, and provide that information to MML scientists for the purpose of vital rates analyses.

A. Extract images from camera cards collected from Alaska cameras retrieved in summer of

2024.

B. Extract all images from camera cards collected from the Russian cameras collected through 2024, if available.

C. Run extracted images through the algorithm, and revise machine learning algorithms to improve the detectability of marked sea lions from remote images.

D. Manually review images to search for branded Steller sea lions and use those images to train a machine learning algorithm to complete an image processing methodology capable of selecting a minimum of 90% of the images with branded sea lions present.

Task 2 – Optional: Maintain the network of remote digital camera installations at Steller sea lion haulouts and rookeries within the Steller sea lion western range. This shall include 41 cameras as of May 2023, plus any additional cameras.

A. In association with MML or USFWS vessel-based trips service, repair, or replace remote camera installations to maintain year-round functionality. Retrieve/replace data cards.

In 2025 potentially an early-season (May-June) voyage with USFWS departing from

Homer, Alaska would allow visits to Sugarloaf and Ugamak Islands, with debarkation in

Dutch Harbor, Alaska. Visits to Aleutian Island sites would occur with MML/FWS in June-

July originating in Adak and ending in Adak or Dutch Harbor.

Task 3 – Optional: Serve as a liaison between United States and Russian scientists to assist with facilitating meetings of the United States Government Project 02.05-61, “Marine Mammals,” under Area V of the U.S./Russia Agreement on Cooperation in the Field of Environmental

Protection and Natural Resources. The contractor shall provide logistical and organizational expertise in setting up meetings and language translation, and document results of meetings and conference calls. The working group’s main purpose is to promote scientific collaboration and to exchange scientific information to better manage and conserve marine mammal species shared by both countries. Because work under this task may be impacted or modified by pandemic status, travel advisories and governmental relations between the U.S. and Russia, it is presumed these activities will be virtual should they occur.

Task 4 – Optional: Communication and publications

B. Present research results at the 2025 Alaska Marine Science Symposium, in Anchorage, Alaska.

C. Complete manuscript describing the spatial distribution and movement of Steller sea lions along the Asian Coast.

D. Provide support to MML users of algorithms.

E. Provide monthly reports.

Task 5 – Optional

A. Develop a computer algorithm to automate the counting of northern fur seals from images captured by uncrewed vehicles

1. Use a provided data set of images collected by an uncrewed aerial vehicle (UAV) from northern fur seal rookeries in Russia and the United States (Pribilof Islands and Bogoslof Island) to create and refine a model for automating counts of northern fur seals on rookeries in Alaska. Also include analysis that compares and contrasts results for different rookery substrates (e.g. rock, grass, sand). This algorithm is separate from that of Task 1C.

2. Work with MML scientists to assist in the analyses, image preparation, and counting of northern fur seals from images collected on the Pribilof Islands since

2021.

B. D Design and build 13 remote camera boxes for installation at Marmot Island, AK. The vendor shall acquire all necessary cameras, solar panels, batteries, boxes, and associated supplies to build the functioning cameras and provide three (3) to five (5) personnel to construct and install the cameras over a three (3) day period. The government shall provide vessel access and camera installation supplies (lumber, hardware).

DELIVERABLES

Task 1: Contractor shall develop automated methods that can be used to estimate vital rates, movements, and counts of Steller sea lions in Russia and Alaska. Deliverables:

A. Provide a draft manuscript detailing the techniques developed for submission to a peer-reviewed journal (by end of option year 1)

B. Develop a machine learning algorithm to complete an image processing methodology capable of selecting a minimum of 90% of the images with branded sea lions present

C. Extract all images from camera cards collected from the Russian SSL rookery cameras through 2023.

D. Extract images from camera cards collected from the Aleutian Island cameras in 2023.

E. Monthly progress report to include, but not necessarily be limited to, the following:

accomplishments, issues encountered, travel (including purpose, significant outcomes, action items), and recommendations, if applicable

Task 2: Contractor shall maintain and expand network of remote camera installations.

Deliverables:

A. Maintain existing Alaska remote camera assemblies to be capable of running autonomously for up to 3 years and collect images at a rate of 1 image per 15 minutes during all daylight hours

B. Monthly progress report to include, but not necessarily be limited to, the following:

Task 3: The contractor shall serve as a liaison between United States and Russian scientists to assist with facilitating meetings. Deliverables:

A. Provide summaries of meetings and calls relating to the US-Russia Marine Mammal Working Group.

B. Provide translations of meeting documents.

C. Monthly progress report to include, but not necessarily be limited to, the following:

Task 4: Contractor shall communicate progress and results. Deliverables:

A. Present research results at the Alaska Marine Science Symposium and provide abstracts, posters, and/or slides of presentations.

B. Provide draft manuscripts intended to be scientific publications.

C. Submit monthly progress reports to include, but not necessarily be limited to, the following: accomplishments, issues encountered, travel (including purpose, significant outcomes, action items), and recommendations, if applicable.

D. Monthly progress report to include, but not necessarily be limited to, the following:

Task 1 – Optional: Contractor shall develop a computer algorithm to automate the counting of northern fur seals. Deliverables:

A. Provide an algorithm that can identify northern fur seal sex/age classes (pup, juvenile, adult female, adult male) and counts of each to within 95% accuracy of counts made by human observers.

B. Provide a report that compares traditional northern fur seal survey methods (e.g. bull counts, visual pup counts, shearing mark-recapture estimates, etc.) to the automated count computer algorithm using aerial images, including ability of algorithm to detect seals among different rookery substrates.

C. Provide a draft manuscript detailing the techniques developed for submission to a peer-reviewed journal.

D. Monthly progress report to include, but not necessarily be limited to, the following:

Task 2 – Optional: Contractor shall develop a computer algorithm to automate the counting of northern fur seals. Deliverables:

A. Construct and install thirteen remote camera assemblies capable of running autonomously for up to 3 years and collecting images at a rate of 1 image per 15 minutes during all daylight hours.

B. Monthly progress report to include, but not necessarily be limited to, the following:

action items), and recommendations, if applicable.

Schedule of Deliverables The following is a schedule of all deliverables, including administrative deliverables, required during the period of performance of this contract

Item Description Quantity Due Date Deliver to Reference

Task 1 Draft manuscript 1 End of Option Period

COR Deliverable 1A

Task 1 Machine learning algorithm

1 By end of award COR Deliverable 1B

Task 1 Extract Aleutian Island sea lion images

Varies By end of Base Year MML project staff

Deliverable 1C

Task 1 Extract Russian sea lion images

Varies By end of Base Year MML project staff

Deliverable 1D

Task 2 Remote cameras maintenance

Varies During field work MML project chief scientist

Deliverable 2A

Task 3 Meeting summaries Varies Within two (2) weeks of meeting

COR Deliverable 3A

Task 3 Translations Varies Within one (1) month of receipt

COR Deliverable 3B

Task 1 Optional

Machine learning algorithm

1 By end of award COR Deliverable

OT1A

Task 4 AMSS presentations Varies Within one (1) week of presentation

COR Deliverable 4A

Task 4 Draft manuscripts Varies By end of award COR Deliverable 4B

Task 4 Monthly report 12 per year

By first week of each month

COR Deliverable 4C

Task 1 Optional

Report 1 By end of award COR Deliverable OT1B

Task 1 Optional

Draft manuscript 1 By end of award COR Deliverable OT1C

Task 2 Optional

Remote camera installation

13 During field work MML project chief scientist

Deliverable

OT2A

QUALIFICATIONS

● The contractor shall provide expertise related to interpreting and analyzing existing and newly-collected data on Russian Steller sea lion ecology, publish peer-reviewed manuscripts in professional scientific journals, and present work at scientific meetings.

● The contractor shall also provide expertise with conducting marine mammal science in

Russia, familiarity with relevant eastern Russian marine mammal permitting processes, scientific institutions and researchers, and with working with U.S.-Russian scientific agreements and protocols.

● Contractor shall also have fluency in Russian and English, provide expertise with the use of databases and software for analyses (e.g. R programming language), machine learning/artificial intelligence programming methods (such as a convolutional neural network like U-Net), or similar network architecture that is capable of counting animals from photographic images and provide skills to construct and install cameras for marine mammal observation in remote areas of the North Pacific.

The contractor shall provide interdisciplinary expertise related to program and project management, business processes, best practices and procedures, database management, and meeting facilitation. The contractor shall have knowledge and expertise of NOAA Fisheries policies and programs, as well as experience with planning, and Federal financial management and operations.

PERFORMANCE REQUIREMENTS SUMMARY

This contract includes a Performance Requirements Summary (PRS) and Quality Assurance

Surveillance Plan (QASP). The PRS plays an integral role in the administration of the contract. In addition to any applicable inspection clauses or other related terms and conditions contained in the contract, the PRS shall serve as a primary tool for inspection and acceptance of services as facilitated by the Contracting Officer’s Representative (COR). Evaluation of the Contractor’s overall performance shall be in accordance with the performance standards set forth in the

PRS, and shall be conducted by the COR. The PRS constitutes a material aspect of the contract and shall not be changed or otherwise modified without prior written approval of the

Contracting Officer.

Required Service and Designation

Desired Outcome

Performance Standard

Acceptable Quality Level

Monitoring Method

Incentive/ Disincentive

Task 1 Machine-learning algorithm

Deliverable 1B

Develop a machine learning algorithm to complete image processing to identify marked sea lions

Methodology capable of selecting a minimum of 90% of the images with branded sea lions present

COR shall solicit feedback from contractor and MML users

Material-positive performance evaluations / poor performance evaluations;

corrective action plan

Task 1 Image extraction from Alaska cameras

Deliverable 1C

Extract images from camera cards downloaded from the Aleutian Island cameras for the period 2019 - 2022

Performance standard met at least 95% of time

COR shall solicit feedback from contractor and MML users

Material-positive performance evaluations / poor performance evaluations;

corrective action plan

Task 1 Image extraction from Russian cameras

Deliverable 1D

Extract all images from camera cards collected from the Russian SSL rookery cameras in 2020 and 2021

Performance standard met at least 95% of time

COR shall solicit feedback from contractor and MML users

Material-positive performance evaluations / poor performance evaluations;

corrective action plan

Task 4 Monthly reports

Deliverable 5C

Reports submitted by end of first week of the next month

Performance standard met at least 95% of time

COR

tracking

Material-positive performance evaluations / poor performance evaluations;

corrective action plan

Task 1 Optional fur seal counting algorithm

Deliverable 4A

Algorithm detects and counts fur seals in images.

Algorithm detects fur seals with 95% accuracy of counts made by human observers

COR shall solicit feedback from contractor and MML users

Material-positive performance evaluations / poor performance evaluations;

corrective action plan

CONFIDENTIALITY AND DATA PRIVACY

This contract may require that services contractors have access to Privacy Information. Service contractors are responsible for maintaining confidentiality of all subjects and materials and may be required to sign and adhere to a Non-disclosure Agreement (NDA).

GOVERNMENT FURNISHED RESOURCES

The Contractor shall use Government furnished facilities, property, equipment and supplies only for the performance of work under this contract, and shall be responsible for returning all

Government furnished facilities, property, and equipment in good working condition, subject to normal wear and tear.

PLACE OF PERFORMANCE

Work shall be conducted on-site at the NMFS Alaska Fisheries Science Center in Seattle, Washington, and at other than the government facility (i.e. off-site) and in the field in Alaska. In cases of shutdown or furlough (or in other instances which cause the Government facility to be closed), contact the COR for guidance.

OVERTIME, TRAVEL, AND TRAINING

Travel is anticipated for this order. The consultant shall travel to Steller sea lion rookeries and haulouts in Alaska, in association with MML vessel-based studies to support this requirement.

Travel costs not-to-exceed $12,000 for the initial twelve-month period and for the twelve-month option period. Travel shall be reimbursed in accordance with the Federal Travel

Regulations, and all contractor travel must be approved by the COR, prior to the actual travel, using the NMFS Travel Authorization Form. Any travel conducted prior to the receipt of proper written authorization from the COR shall be done at the Contractor’s own risk and expense.

Training is authorized for NMFS/NOAA/DOC specific systems and requirements. Completion certificates must be submitted to the COR no later than 3 business days after the start of the contract/task order or completion of courses after authorization. The following training is currently required to be completed under this task order. The COR may authorize additional training that is necessary for the task order and not commercially available.

● NOAA IT security

● NOAA Safety training

● Sexual Assault/Sexual Harassment Prevention and Response Training IAW NAM 1330-

52.222-70(b)(6)

● Records Management 101

Additional commercial or non-task order specific training may be permitted under the following circumstances: 1) prior written approval is obtained from the COR, 2) there is no additional cost to the Government for attendance, 3) the time is not billed to the Government, and 4) there is no relief/change for deliverable due dates.