AMEND_2.pdf

Offers must acknowledge receipt of this amendment prior to the hour and date specified in the solicitation or as amended, by one of the following methods:

(a) By completing items 8 and 15, and returning or (c) By separate letter or electronic communication which includes a reference to the solicitation and amendment numbers. FAILURE OF YOUR ACKNOWLEDGMENT TO BE RECEIVED AT THE PLACE DESIGNATED FOR THE RECEIPT OF OFFERS PRIOR TO THE HOUR AND DATE SPECIFIED MAY RESULT IN REJECTION OF YOUR OFFER. If by virtue of this amendment you desire to change an offer already submitted, such change may be made by letter or electronic communication, provided each letter or electronic communication makes reference to the solicitation and this amendment, and is received prior to the opening hour and date specified.

E. IMPORTANT: Contractor is not is required to sign this document and return copies to the issuing office.

AMENDMENT OF SOLICITATION/MODIFICATION OF CONTRACT 1. CONTRACT ID CODE

2. AMENDMENT/MODIFICATION NUMBER 3. EFFECTIVE DATE 4. REQUISITION/PURCHASE REQUISITION NUMBER 5. PROJECT NUMBER (If applicable)

7. ADMINISTERED BY (If other than Item 6) CODE

STANDARD FORM 30 (REV. 11/2016)

Prescribed by GSA FAR (48 CFR) 53.243

FACILITY CODE

9A. AMENDMENT OF SOLICITATION NUMBER

9B. DATED (SEE ITEM 11)

10A. MODIFICATION OF CONTRACT/ORDER NUMBER

10B. DATED (SEE ITEM 13)

11. THIS ITEM ONLY APPLIES TO AMENDMENTS OF SOLICITATIONS

The above numbered solicitation is amended as set forth in Item 14. The hour and date specified for receipt of Offers is extended. is not extended.

12. ACCOUNTING AND APPROPRIATION DATA (If required) copies of the amendment; (b) By acknowledging receipt of this amendment on each copy of the offer submitted;

13. THIS ITEM APPLIES ONLY TO MODIFICATIONS OF CONTRACTS/ORDERS. IT MODIFIES THE CONTRACT/ORDER NUMBER AS DESCRIBED IN ITEM 14.

CHECK ONE A. THIS CHANGE ORDER IS ISSUED PURSUANT TO: (Specify authority) THE CHANGES SET FORTH IN ITEM 14 ARE MADE IN THE CONTRACT ORDER NUMBER

IN ITEM 10A.

B. THE ABOVE NUMBERED CONTRACT/ORDER IS MODIFIED TO REFLECT THE ADMINISTRATIVE CHANGES (such as changes in paying office, appropriation data, etc.) SET FORTH IN ITEM 14, PURSUANT TO THE AUTHORITY OF FAR 43.103(b).

C. THIS SUPPLEMENTAL AGREEMENT IS ENTERED INTO PURSUANT TO AUTHORITY OF:

D. OTHER (Specify type of modification and authority)

Except as provided herein, all terms and conditions of the document referenced in Item 9A or 10A, as heretofore changed, remains unchanged and in full force and effect.

15C. DATE SIGNED

15A. NAME AND TITLE OF SIGNER (Type or print)

16C. DATE SIGNED

16A. NAME AND TITLE OF CONTRACTING OFFICER (Type or print)

14. DESCRIPTION OF AMENDMENT/MODIFICATION (Organized by UCF section headings, including solicitation/contract subject matter where feasible.)

PAGE OF PAGES

6. ISSUED BY CODE

8. NAME AND ADDRESS OF CONTRACTOR (Number, street, county, State and ZIP Code) (X)

CODE

15B. CONTRACTOR/OFFEROR

(Signature of person authorized to sign)

16B. UNITED STATES OF AMERICA

(Signature of Contracting Officer)

Previous edition unusable

Attachment Page

PAGE 2 OF 5 1305M219QNFFM02540002

Question Responses for Req. NFFM7210-19-02915 to develop algorithms

1. How many images in the existing training data set?

1. ~150,000

2. How many videos in the existing training data set? The existing data set is a combination of still images taken from video clips linked with corresponding metadata. The still images have been annotated, but the video clips have not. If there was interest in utilizing the non-annotated video images, that could be possible.

1. What is the frame rate for the video (FPS)?

1.1. The current application records H.265 compressed 15

frames/second video data.

2. How much of it is already labeled/tagged/annotated with desired tags/concepts?

2.1. The training set is complete and has been fully annotated.

3. What is the expecting annual data size you wish to analyze?

1. We saw the noted 25 vessels, totaling 400 trips per fishing year, with annotation time 2-10 hours per video, but would need to know the following to calculate the specifics:

1.1. How many cameras in total?

1.1.1. Each vessel has 3-4 cameras and as noted in the

SOW, we are anticipating 25 participating vessels.

1.2. How many hours of recorded footage is captured per

day?

1.2.1. The entire trip duration is recorded, however, about

30-50% is actual fishing activity depending on gear type.

2. How many tags/concepts do you have already and/or plan on creating for identification of separate species?

2.1. The algorithm is expected to account for 30-50 common

species.

4. Where does the customer want this platform hosted? Commercial Cloud? Govt cloud? On prem? Edge Device?

1. The Government is seeking an algorithm that would work with EM service provider’s annotation software. The hosting platform could vary by EM service provider and program needs. The final destination of the algorithm is something that requires further discussion with the Government to fully understand the available choices and what would best suit the goals of this project.

PAGE 3 OF 5 1305M219QNFFM02540002

5. What third party tools or architectures will the solution need to integrate with, if any at all?

1. The RFP addresses this question in section C.2.2.

6. Can the work be performed remotely from the vendors facility?

1. Yes, the expectation is the provider would work remotely and communicate with the Government according to the communication schedule as noted in the RFP sections; C.4.1, C.4.2, and C.5.0.

Conference calls and several in-person meetings will be required as part of the contract.

7. The RFQ mentions a number of software solutions for EM review, but which ones are currently in use for EM under NEFSC? Are these solutions to be extended by this contract, or may they be changed?

1. Currently software being used for EM review include Engagement (TeemFish), an open source tool by Chordata LLC (Saltwater Inc), and a modified version of the Chordata LLC software (Integrated Monitoring). A solution that integrates machine learning could interface with these platforms, or be a modified version of the platform(s).

8. What features in the currently used software solution are deemed missing or inadequate for gathering training data for machine learning?

1. The current software solution utilized by the Government is owned and maintained by 3rd party EM service providers. While the EM service providers are pursuing training data sets in support of machine learning, that work is outside the Government’s purview. EM service providers are utilizing the current software solutions to detect and automate fishing activity, but to the Government’s knowledge are not pursuing the automation of species detection, identification, and length (i.e., software does not lend itself to annotations with bounding boxes or allow for the export of bounding box style information).

9. Are we making all system or as part of some larger system? If as part of a large system - will there be integration?

1. Under this contract the vendor will be responsible for designing and developing an algorithm that would detect, identify, and provide a length estimation for fish. The vendor is not responsible for developing a software application to annotate video. Rather, the vendor’s solution will work in coordination, as part of, the software solutions and applications developed by the EM service providers for the groundfish fishery.

10. Can we use third party libraries/tools or it’s expected to write everything ourselves from scratch? Yes, the use of well documented, public (open source) and supported libraries is acceptable. And has been a component of previous projects.

11. On what equipment will all this be done? Tablets/Phones/ PC/Servers /etc?

PAGE 4 OF 5 1305M219QNFFM02540002

1. EM review is now conducted by analysts at desks in offices using desktop computers. This would be expected to interface with program current run on PC (or in a way that software run on PCs could interface with).

12. Which side will be responsible for the implementation of the system? Will it be necessary to go somewhere or introduce?

1. The vendor is responsible for the development of the algorithm software application. The Government will be responsible for the introduction and implementation of the system in coordination with current practices and EM service providers. The contractor will work in coordination with the Government to assist with implementation. See section C.4.2.2 for more information regarding a communication strategy with stakeholders.

13. What technical resources will be available (cameras,servers,test,data)?

1. An annotated image data set of the species of interest will be available.

Additionally, video footage collected as a portion of the previous image library project.

14. Is there any bad experience already,have there been attempts to create this system? Which companies ? Why are you flipping ? Can we rely on those developments/ estimate compiled by previous companies ?

1. There have not been previous attempts at this task. This project is a follow up to the previous image library creation project.

15. Will there be an expert scientist on your part to determine the criteria to recognising fish models ? Are there any recognition criteria for fish ? If there is an expert scientist on there part ,there should be a knowledge transfer to our developers from a scientist .

1. The NEFSC has a number of projects that utilize recognition. Experts who have experience in this domain will be available to help facilitate the project. Additionally, a limited set of developers who work on related projects will be available.

16. Is UI/UX available for platforms? How does customer see this ?

1. There are a number of existing EM review software platforms that the products from this RFP could interface with (please see the RFQ for examples). These systems have existing UI. Determining the most efficient level of integration (and the details of the interaction) with these systems would be developed as a component of this projecct.

17. Are those only movies recorded during trips?

1. The data collected was built from video clips, however, key frame images were selected and paired with metadata for species identification (please refer to attachment 1). The annotated images are what would be supplied to the vendor for algorithm development. There may be an opportunity to utilize the initial video footage, however, that is raw un-annotated data and is not the intended purpose of this contract.

PAGE 5 OF 5 1305M219QNFFM02540002

18. How many movies/pictures do you have (amount in hours)?

1. Please see response above, the raw video data is not the training set the vendor would utilize for algorithm development. In all, we estimate 150,000 annotated images.

19. Is there any standardization in obtaining movies/images (how does the location of cameras look like, are the measuring locations made/placed in the same manner?)?

1. Please see attachment 1 for the initial study for a description of the camera locations and pictures of the measuring locations.

20. Quality of data: movies/pictures obtained during night/day, different weather conditions?

1. The imagery was collected at a frame rate of 15 in a closed wet lab, provided with lighting, and not largely subject to weather conditions.

21. Is data annotated? (species, sizes, etc)?

1. The data set for training is annotated and includes 30-50 priority species. See question #2 for size of data set

2. systems would be developed as a component of this project.

1.2

C:\PERFORM\FORMS\S30.FRP

Forms Management

C:PERFORMFORMSS30.FRP

Acrobat PDFWriter 2.01 for Windows D:19971010095222 D:19990614133004 Offers must acknowledge receipt of this amendment prior to the hour and date specified in the solicitation or as amended, by one of the following methods:(a) By completing items 8 and 15, and returning or (c) By separate letter or electronic communication which includes a reference to the solicitation and amendment numbers. FAILURE OF YOUR ACKNOWLEDGMENT TO BE RECEIVED AT THE PLACE DESIGNATED FOR THE RECEIPT OF OFFERS PRIOR TO THE HOUR AND DATE SPECIFIED MAY RESULT IN REJECTION OF YOUR OFFER. If by virtue of this amendment you desire to change an offer already submitted, such change may be made by letter or electronic communication, provided each letter or electronic communication makes reference to the solicitation and this amendment, and is received prior to the opening hour and date specified.

E. IMPORTANT: Contractor is not is required to sign this document and return copies to the issuing office.

AMENDMENT OF SOLICITATION/MODIFICATION OF CONTRACT

1. CONTRACT ID CODE

2. AMENDMENT/MODIFICATION NUMBER

3. EFFECTIVE DATE

4. REQUISITION/PURCHASE REQUISITION NUMBER

5. PROJECT NUMBER (If applicable)

7. ADMINISTERED BY (If other than Item 6)

CODE

STANDARD FORM 30 (REV. 11/2016) Prescribed by GSA FAR (48 CFR) 53.243

FACILITY CODE

9A. AMENDMENT OF SOLICITATION NUMBER

9B. DATED (SEE ITEM 11)

10A. MODIFICATION OF CONTRACT/ORDER NUMBER

10B. DATED (SEE ITEM 13)

11. THIS ITEM ONLY APPLIES TO AMENDMENTS OF SOLICITATIONS

The above numbered solicitation is amended as set forth in Item 14. The hour and date specified for receipt of Offers is extended.

is not extended.

12. ACCOUNTING AND APPROPRIATION DATA (If required) copies of the amendment; (b) By acknowledging receipt of this amendment on each copy of the offer submitted;

13. THIS ITEM APPLIES ONLY TO MODIFICATIONS OF CONTRACTS/ORDERS. IT MODIFIES THE CONTRACT/ORDER NUMBER AS DESCRIBED IN ITEM 14.

CHECK ONE

A. THIS CHANGE ORDER IS ISSUED PURSUANT TO: (Specify authority) THE CHANGES SET FORTH IN ITEM 14 ARE MADE IN THE CONTRACT ORDER NUMBER IN ITEM 10A.

B. THE ABOVE NUMBERED CONTRACT/ORDER IS MODIFIED TO REFLECT THE ADMINISTRATIVE CHANGES (such as changes in paying office, appropriation data, etc.) SET FORTH IN ITEM 14, PURSUANT TO THE AUTHORITY OF FAR 43.103(b).

C. THIS SUPPLEMENTAL AGREEMENT IS ENTERED INTO PURSUANT TO AUTHORITY OF:

D. OTHER (Specify type of modification and authority) Except as provided herein, all terms and conditions of the document referenced in Item 9A or 10A, as heretofore changed, remains unchanged and in full force and effect.

15C. DATE SIGNED

15A. NAME AND TITLE OF SIGNER (Type or print)

16C. DATE SIGNED

16A. NAME AND TITLE OF CONTRACTING OFFICER (Type or print)

14. DESCRIPTION OF AMENDMENT/MODIFICATION (Organized by UCF section headings, including solicitation/contract subject matter where feasible.)

PAGE OF PAGES

6. ISSUED BY

CODE

8. NAME AND ADDRESS OF CONTRACTOR (Number, street, county, State and ZIP Code) (X)

CODE

15B. CONTRACTOR/OFFEROR

(Signature of person authorized to sign)

16B. UNITED STATES OF AMERICA

(Signature of Contracting Officer) Previous edition unusable

200 GRANBY STREET

NORFOLK VA 23510