AMENDMENT A004.pdf

�����6������

����������6��������� �� ������

78��9:;<=>?@>A��)�

?:7@C:7@>�<D�E<F9G9>?>9<@H:<C9D9G?>9<@�<D�G<@>=?G> � ��)�+0&")0�#-�)�-'I ��"/'+-/'+0J/�-#!#)"0#�+�+%/�'& K ��'!!')0#1'�-"0' L ��&'M%#4#0#�+J3%&)2"4'�&'M%#4#0#�+�+%/�'& � ��3&�5')0�+%/�'&�NOP�QRRSTUQVSWXY ��"-/#+#40'&'-��(�NOP�Z[\W]�[\Q̂�O[W_�̀X )�-'

E>?@C?=C�D<=:�ab�c=7d8�eeHfbegh�3�������������.4"�!"&��L��)!&���K ILK

!")#$#0(�)�-' �i" ��"/'+-/'+0��!�4�$#)#0"0#�+�+%/�'&i� ��-"0'-�Njkk�Olkm�nnX�o" ��/�-#!#)"0#�+��!�)�+0&")0J�&-'&�+%/�'&�o� ��-"0'-�Njkk�Olkm�npXee8��>q9E�9>7:�<@Fr�?;;F97E�><�?:7@C:7@>E�<D�E<F9G9>?>9<@E���������0��� ��6��

���������������������� ���������� ����s � � ��s �

�I ��"))�%+0#+.�"+-�"33&�3&#"0#�+�-"0"�NOP�]WtuT]WvX ���������� ��� w��������

�����6����������

������� ��) ��-"0'�4#.+'-��" ��+"/'�"+-�0#0$'��!�4#.+'&�Nl{RW�Z]�R]T̂[X ��) ��-"0'�4#.+'-��" ��+"/'�"+-�0#0$'��!�)�+0&")0#+.��!!#)'&�Nl{RW�Z]�R]T̂[X �L ��-'4)&#30#�+��!�"/'+-/'+0J/�-#!#)"0#�+���]}Q̂T�Wv�V{�����|WU[TẐ�\WQvT̂}|~�T̂USuvT̂}�|ZSTUT[Q[TẐ�UẐ[]QU[�|uV�WU[�_Q[[W]��\W]W�PWQ|TVSW�X

3".'�������!����3".'4� ��#44%'-��( )�-' � ��+"/'�"+-�"--&'44��!�)�+0&")0�&�N�u_VW]~�|[]WW[~�UZû[{~�j[Q[W�Q̂v��O���ZvWX ���

��� ��)�+0&")0�&J�!!'&�&NjT}̂Q[u]W�ZP�RW]|Ẑ�Qu[\Z]T�Wv�[Z�|T}̂X ��� ��%+#0'-�40"0'4��!�"/'&#)"NjT}̂Q[u]W�ZP��Ẑ[]QU[T̂}��PPTUW]X�]W�TZu|�WvT[TẐ�ûu|QVSW

��������� ¡��� �¢�£ ¤�¤�¥¦�¡�������������������£��§�¡�¦̈�¢¥�¤©�©�� �ª§¢¤«���§��¬¡£¥¢¡̈�¬ £¤�� �� ¤�¢ª��� ¡��§��� ®£ª£�¢�£ ¤̄�£¤ª ¡° ¡¢���ª§¢¤«���� ��§����¢��¥�¤�� ��± ¡²̄�£¤ª ¡° ¡¢���ª§¢¤«���� ��§��¢©©�¤©�¥�� ���³���́��µ¤��¡�ª�£ ¤��� �¶���¡ ¡�́ ¥¥�¡ª£¢®�µ��¥�̄�¢¤©��·��¤©��§��©���©¢���� ¡��� �¢�£ ¤�³����¡�¤ª���§��¢��¢ª§�©�°¢«���� ¡�¢¥�¤©¥�¤��©��¢£®�³�

�¢�£ ¤¢®�µ¤��£����� ��̧�¢¤©¢¡©��¢¤©�¹�ª§¤ ® «̈�º¢£�§�¡�¦�¡«̄�»����¼½½ ����������́��́��½��

�»¢̈��¾̄�����

1. The Primary Point of Contact for this solicitation is hereby changed as follows:

DELETE: Carol Wood

Carol.wood@nist.gov

ADD: Billy Wong hingpan.wong@nist.gov

2. In the Statement of Work, Qualification Requirements, Additional Personnel is hereby amended as follows:

DELETE:

Additional Personnel

This contract will require a team of personnel with a comprehensive range of capabilities, encompassing all experience and expertise identified below.

The Contractor must have the resources to establish and maintain a technical team, throughout the life of the contract, who, collectively, possess expertise and experience with all of the following:

-Strong background and understanding of the technical field of AI model evaluations and assessments including the latest methodologies, testing approaches, and prompting elicitation strategies, including previous experience developing or implementing one or more of the tasks in List A.

Background and understanding assessing the capabilities and risks of Al models for procurement in vertical sectors such as healthcare, industrial production, or pharmaceutical development is not considered applicable.

- At least one team member with 3-5 years of experience working in biology, chemistry, and/or computational fields in order to inform the effort to elicit, evaluate, and benchmark the Relevant Model Capabilities in List B.

-Demonstrated experience in the evaluation of chemical and/or biological capabilities of frontier AI systems

-Ability to implement all relevant tasks to assess frontier AI model chemical and biological capabilities and risks.

-Ability to handle, manage and protect government furnished information and property.

ADD:

Additional Personnel

This contract will require a team of personnel with a comprehensive range of capabilities, encompassing all experience and expertise identified below.

The Contractor must have the resources to establish and maintain a technical team, throughout the life of the contract, who, collectively, possess expertise and experience with all of the following:

-Strong background and understanding of the technical field of AI model evaluations and assessments including the latest methodologies, testing approaches, and prompting elicitation strategies, including previous experience developing or implementing one or more of the tasks in List A.

Background and understanding assessing the capabilities and risks of Al models for procurement in vertical sectors such as healthcare, industrial production, or pharmaceutical development is not considered applicable.

- At least one team member with 3-5 years of experience working in biology, chemistry, and/or computational fields in order to inform the effort to elicit, evaluate, and benchmark the Relevant Model Capabilities in List B , with demonstrated knowledge in relevant biological subdisciplines including synthetic biology, virology, bacteriology, and molecular biology.

mailto:Carol.wood@nist.gov mailto:hingpan.wong@nist.gov

-Demonstrated experience in the evaluation of chemical and/or biological capabilities of frontier AI systems

-Ability to implement all relevant tasks to assess frontier AI model chemical and biological capabilities and risks.

-Experience integrating evaluation methodologies with technical frameworks, including the ability to develop compatible code, datasets, and protocols for the Inspect open-source evaluation framework that is used by

NIST. This open-source evaluation set is available at https://github.com/UKGovernmentBEIS/inspect_ai

-Ability to handle, manage and protect government furnished information and property.

- Established mechanisms to engage qualified subject matter experts through direct team expertise, subcontracting arrangements, or professional affiliations to provide expert validation of model outputs and expert-level responses across relevant chemical and biological domains.

-The Contractor must demonstrate the ability to engage experts with advanced degrees (PhD or equivalent) and published research in relevant fields for assessment and validation activities as required by BOA orders.

3. In the section titled Addendum to 52.212-1, Overall Arrangement of the Quotation, Section 2

Technical Quotation, for the purpose of evaluation of Management Plan, requirements are hereby amended as follows:

DELETE:

For the purpose of evaluation of Management Plan:

-Quoters must submit a staffing plan that identifies proposed key personnel and any additional individuals proposed to perform services under the BOA.

-Documentation must address all qualification requirements in the statement of work.

-Quoters describe the responsibilities of each staffing plan function.

-Quoters must submit a resume for proposed key personnel.

ADD:

For the purpose of evaluation of Management Plan

-Quoters must submit a staffing plan that identifies proposed key personnel and any additional individuals proposed to perform services under the BOA. Documentation must address all qualification requirements in the statement of work.

-A discussion of the processes and networks that will be utilized to recruit and secure personnel and experts to provide: (1) Expert validation of model outputs; (2) Expert-level responses across relevant chemical and biological domains; (3) Experts with Advanced Degrees; and (4) Demonstrated knowledge in relevant biological subdisciplines including synthetic biology, virology, bacteriology, and molecular biology.

-A discussion of the quoter’s affiliations with industry, academia, and/or laboratories, that could be utilized to provide required expertise and experts;

-Quoters must describe the responsibilities of each staffing plan function.

-Quoters must submit a resume for proposed key personnel.

https://github.com/UKGovernmentBEIS/inspect_ai

4. The due date for quotations is hereby extended as follows:

The due date and time for quotations is hereby extended to Tuesday, June 17, 2025, at 3:30 PM Eastern Time.