JAIC TE RFP Questions and Response 26Feb21.xlsx
XLSX spreadsheet 44 KB Posted
- Attached to
- Joint Artificial Intelligence Center Test and Evaluation Blanket Purchase Agreement Request for Proposal
- Solicitation number
- W52P1J21R0029
About this file
This solicitation requests proposals for a Blanket Purchase Agreement to provide Test and Evaluation services for artificial intelligence to the Joint Artificial Intelligence Center, Department of Defense, and other government agencies. Offerors must demonstrate experience with automated testing, test campaigns, test software creation, and evaluating AI, autonomy, software and systems. Proposals are due by March 12, 2021 and will be evaluated on a pass/fail basis. The agreement period is for one year with four option years. Pricing will be determined at the task order level.
View the file
Other files
Show all 13
On GovTribe
Work with this file
- Download the original file
- Contacts named in this file
- Similar government files
- Ask GovTribe AI about this file
Text version
Q and A
| W52P1J-21-R-0029 Questions and Government Response - Released with Amendment 0001 on 26 February 2021 | ||||||
| QUESTION # | DOCUMENT | SECTION | PARAGRAPH | PAGE | QUESTION/COMMENT | ACC-RESPONSE |
| 1 | Questionnaire | Page 1 | Will the Government allow a CTA member to provide past performance that supports this questionnaire? | The Government is not requesting past performance. The Government is requesting examples of work per the questionnaire. The examples must be work performed by the entities of the contractor team submitting as a prime under this BPA. For example: Company A and B are in a teaming agreement. Examples from either Company A or Company B can be submitted. However, Offerors cannot submit examples of work performed by a subcontractor in which no teaming agreement exists. | ||
| 2 | Questionnaire | Page 1 | Will the Government allow for the second Past Performance to come from a teaming partner? We would like to recommend that the Gov't allow primes to include teammate relevant experience. | The Government is not requesting past performance. The Government is requesting examples of work per the questionnaire. The examples must be work performed by the entities of the contractor team submitting as a prime under this BPA. For example: Company A and B are in a teaming agreement. Examples from either Company A or Company B can be submitted. However, Offerors cannot submit examples of work performed by a subcontractor in which no teaming agreement exists. | ||
| 3 | PWS | Organizational Conflict of Interests (OCI). Could you provide a bit more clarity, or specific examples for how we may avoid OCIs such that we do not preclude other parts of our company from participating in future call orders? Does this restriction apply only to work where the Contractor develops specifications of statements of work? | Using this vehicle, a vendor is not allowed to conduct Independent Testing and Evaluation of a system it is developing under a different contract. Example: Vendor A is developing a Computer Vision AI algorithm with monthly algorithm deliveries to the Government under the terms of a contract. Vendor A cannot be tasked to conduct Testing and Evaluation of Vendor A's AI Algorithm using the T&E BPA. This restriction applies when the contractor is significantly involved in the development of the system under test. |
Ex: 2: Vendor B helped the Government write the system requirements for a desired computer vision AI system. The Government tasked Vendor C with the development of the AI Algorithm. Vendor B can respond to a Call Order requesting Test and Evaluation of Vendor C's AI Algorithm.
| 4 | Questionnaire | 1 thru 6 | Because Other Transaction Authority (OTA) Contracts are on the increase, General Services Administration (GSA) and other Government Contracting Organizations have allowed us to use OTA efforts that were awarded to us under the OTA Consortium to be considered as prime efforts. Although not explicitly stated, we assume that work being performed exclusively by a company under an OTA Contract is considered “prime” work for this solicitation. Please confirm. | Yes. | |
| 5 | Questionnaire | 1 thru 6 | Although not explicitly stated, we assume that work awarded to a Joint Venture that is being led by the Managing Partner and Team Member of that Joint Venture is also considered “prime” work. Please confirm. | Yes. | |
| 6 | Questionnaire | 4 | Fundamentally, DevOps brings together two large siloed teams together to allow for quicker software releases while Agile is focused on getting smaller teams to collaborate with each other. For this reason, DevOps is sometimes considered to be distinct from Agile methodologies. However, for the purposes of question #4 of the BPA Questionnaire, would the Government accept "DevOps" as an answer? Or is the Government only looking for formal Agile methodologies? | DevOps is an acceptable response. | |
| 7 | Questionnaire | 4 | In answer to question #4 of the BPA Questionnaire, are SCRUM, Extreme Programming, Kanban, and SAFe acceptable? Or is the Government seeking further specificity, than this? | Yes, these are acceptable. | |
| 8 | Questionnaire | 1 thru 6 | For the BPA Questionnaire, can example contracts come from subcontractors, in addition to the Prime Contractor? | The examples must be work performed by the entities of the contractor team submitting as a prime under this BPA. For example: Company A and B are in a teaming agreement. Examples from either Company A or Company B can be submitted. However, Offerors cannot submit examples of work performed by a subcontractor in which no teaming agreement exists. | |
| 9 | Questionnaire | 2 | Will the Government confirm if Offerors must provide examples of work that only have involved T&E of Artificial Intelligence? Or, are Offerors permitted to provide examples of non-AI related T&E in support of Autonomy Testing, Software Testing, Human-Machine Testing, System Integration Testing, Operational Testing, and Explainability Testing? The current requirement as written appears to be ambiguous in the response necessary. | Offerors may provide work that demonstrates the capability to conduct any of the listed types of testing (T&E of AI and/or Software Testing, and/or Autonomy testing, etc.). Examples can include non-AI related T&E in support of the other types of testing listed in the question. | |
| 10 | Instructions and Eval Criteria | 3.2 | The document states: "Each support document within this PDF shall have a Cover Page stating the name of the support document, and the question number it supports". Can support documentation be used to answer more than one question, e.g., if we are listing the same contract as relevant past work in response to more than one question? In that case, can the responder list multiple addressed questions on the Cover Page for the support document? | Offerors shall provide a cover page for each question individually per the Attachment 0003, Instructions and Eval Criteria , paragraph 3.2, Section 3. Cover pages do not count towards the page limit. | |
| 11 | Instructions and Eval Criteria | 3.2 | The page limit for Section 3 is 12 pages. The instructions state that "Each support document within this PDF shall have a Cover Page". This means that we will not be able to combine paragraphs of support documentation on the same page, because each support document requires its own Cover Page. This restricts us to no more than 12 support document snippets. However, if we have 3 examples of relevant past performance for each of the BPA questionnaire items #1, 2, 3, 5, and 6, we would need at least 3*5=15 support document snippets. We request permission to combine support documentation for multiple items supporting a question on the same page so that we can conform to the page limit. An alternative would be to allow one page of support documentation per support document per contract listed, so that a Cover Page can accompany each one. | Offerors shall provide a cover page for each question individually per the Attachment 0003, Instructions and Eval Criteria , paragraph 3.2, Section 3. Cover pages do not count towards the page limit. | |
| 12 | Questionnaire | 1 | The BPA questionnaire states: "Provide at least two but no more than three examples of work your company has performed ...". Large companies have multiple entities/organizations with different DUNS numbers and CAGE codes. Does all of the past performance need to be for the company entity leading the bid (unique DUNS/CAGE), or can past performances from other organizations in the same company but different DUNS/CAGE codes be included? | The Government is not requesting past performance. The Government is requesting examples of work per the questionnaire. If the company has multiple DUNS/Cage Codes, please reference the DUNS/Cage Code next to the company name when submitting an example. | |
| 13 | Instructions and Eval Criteria | 1 | 1 | Would the Government allow submission via DoD SAFE upload as an alternative to an email submission; to maintain compliance with our Company's Information Security Management System (ISMS)Plan-compliant to ISO 27001:2013? | Submissions shall be via email. There shall be no proprietary or classified information included in Offeror's proposals. |
| 14 | Instructions and Eval Criteria | 2 | 4 | per JAIC T&E BPA Questionnaire. The requested documentation, by question, in the JAIC T&E BPA Questionnaire shall be submitted as a single PDF, entitled: Section 3 Offeror Name Support Documentation. Each support document within this PDF shall have a Cover Page stating the name of the support document, and the question number it supports. The Cover Page of each support document shall be limited to one (1) 8.5x11 inch page, single-spaced with 1-inch margins, using Arial size 12-point font. The support document itself can be provided in its current format, if already produced. Otherwise, it shall be provided using 8.5x11 inch page, single-spaced with 1-inch margins, using Arial size 12-point font. Tables and illustrations may use a reduced font size, no less than Arial size 8 point, if necessary. Support documentation must not exceed 12 pages. The Cover pages will not count against the page limit." |
| Is the 12 page limit pertain to the individual questionnaire question or the entire PDF of consolidated "support documentation?" | The entire PDF for ALL questions is limited to 12 pages. Please note that cover pages do not count towards the page limit per the Attachment 0003, Instructions and Eval criteria, paragraph 3.2, Section 3. | |||
| 15 | Questionnaire | All | Questions 1, 2, 3, 5, 6, each state: “Provide at least two but no more than three examples of work your company has performed that demonstrated capability in at least one or more of the following areas:….” |
If each example has supporting documents each with a Cover Page, that is a potential maximum of 15 cover pages. Each Cover Page is a separation between supporting documents. If each supporting document is a single page, that leads to 15 potential pages of supporting documentation, eclipsing the 12 page limitation.
| Request total number of pages for supporting documentation be raised to 15, at least one page per example. | Each question shall have a cover page. Attachment 0003, Instructions and Eval Criteria, has been amended to state that each question shall have a Cover Page instead of each support document. | |||
| 16 | 4. Appendix A T and E LCAT Table | Line 5 | From the Federal Acquisition Institute: https://www.fai.gov/certification/program-and-project-managers-fac-ppm |
“Defense Acquisition Workforce Improvement Act (DAWIA) For program and project manager professionals coming from DoD, a valid, current Defense Acquisition Workforce Improvement Act (DAWIA) certification is equivalent to a FAC-P/PM at the same certification level, provided the FAC-P/PM experience and continuous learning requirements have been met and the agency ACM approves the certification. When applying for a FAC-P/PM, the individual is responsible for providing their agency acquisition career manager with the documentation supporting their DAWIA certification, education, and continuous learning history.
| Question: Does the Program Manager need both the DAWA Level III and the FAC P/PM Level 3? Based on the above the Federal Acquisition Institute reciprocity, it shows the DAWAI Level III Program Manager Certification is basically the same as the FAC P/PM Level 3. Please clarify. | No. DAC-P/PM is an example of Project Management Certification. Industry equivalents are acceptable. | |||||
| 17 | 4. Appendix A T and E LCAT Table | Line 5 | If a FAC P/PM Level 3 is required for the Program Manager; is this certification available to Government personnel only? | No. DAC-P/PM is an example of Project Management Certification. Industry equivalents are acceptable. | ||
| 18 | Instructions and Eval Criteria | 11 | 3 | ITO Pg. 3 - 11) Acknowledgement of any Amendment to this solicitation, to include signed copies attached to the Cover Letter (Will not count against the two-page limit.) |
| Question: The Government references “to include signed copies attached to the cover letter.” To what copies are the Government referring, signed copies of what? | Signed copies of the Standard Form 1449 (page 1) to acknowledge the Amendment. These do not count against the page limit. | ||||
| 19 | Instructions and Eval Criteria | Note | 3 | ITO Pg. -3 NOTE *Note: The business size and socioeconomic status of each teaming partner in the cover letter shall be identified based upon self-certification at the time of solicitation closing. |
| Question: The Government references the “socioeconomic status of each teaming partner”; however, there appears to be no teaming and small socioeconomic business stated in the solicitation documentation at the BPA level, only at the call order level. If this is correct, and the Offeror chooses to build teams for the call orders (once the work scope is known), can the Government remove this requirement from the BPA cover letter? | If there is a teaming arrangement for the Offeror to be qualified for the BPA, then it shall be stated in the Cover Letter. However, if an Offeror can independently answer all questions on the questionnaire without a teaming arrangement, then the Offeror is only required to list its information. Teaming Agreements and subcontracting can be done at the call order level as needed. | ||||
| 20 | Instructions and Eval Criteria | 8 | 7 | Section b., paragraph 8 states: "Although the Government anticipates 15 to 25 BPAs, the Government reserves the right to make more or less than the intended number of awards, if warranted by the quality and quantity of proposal submissions." |
| Question: Considering that the evaluation criteria is acceptable/unacceptable, how will the Government determine a cutoff for awards even if there are several additional acceptable-rated proposals? | All Offerors who submit a qualified proposal will be issued a BPA. | ||||
| 21 | PWS | 11 | 1 | Section 4.1 of the PWS states: "The Contractor shall propose a plan to manage the BPA and subsequent individual Call Orders. This includes management and oversight of all activities performed by the Contractor personnel including subcontractors to satisfy the requirements identified in this Performance Work Statement (PWS) and subsequent Call Order work statements." |
| Question: Can the Government please confirm that there is no "BPA Management Plan" due with Offerors' proposals? If a "BPA Management Plan" is required as part of Offerors' proposals, can the Government please provide instructions for the plan (i.e., file name, page limits, etc.)? | There is no BPA Management Plan due with the Proposal. | |||||
| 22 | Instructions and Eval Criteria | 3 | 1 | 4 | Section 3.2 states: "Support documentation must not exceed 12 pages. The Cover pages will not count against the page limit." |
| Question: Can the Government please confirm that each set of Support Documentation has its own 12-page limit versus a 12-page limit for all support documentation? For example, Offerors relevant experience support document for Question 1 can be up to 12 pages and their relevant experience support document for Question 2 can also be up to 12 pages. | The entire PDF for ALL questions is limited to 12 pages. Please note that cover pages do not count towards the page limit per the Attachment 0003, Instructions and Eval criteria, paragraph 3.2, Section 3. | ||||
| 23 | Admin | Question: Is there a file size limit for proposal submissions via the Government-provided email? If so, please confirm that Offerors are permitted to submit their proposals in multiple emails (i.e., 1 of 3, 2 of 3, 3 of 3). | Yes. Multiple emails will be accepted. | ||
| 24 | RFP Q&A | 6 | Question number six asked: "…will contractors be permitted to add subcontractors post BPA award…" The Government's answer was "Yes. An updated subcontracting plan would be required with the addition of new subs." However, there is no Subcontracting Plan required with the BPA submission. |
| Follow-on Question: Can the Government please confirm that no Subcontracting Plan is required as part of Offerors' BPA proposals? | No sub-contracting plan is required for the BPA. Subcontracting plans will be required at the call order level for large businesses. | |||||
| 25 | Instructions and Eval Criteria | 3.2 | 11 | 3 | Item 11 states that the Cover Letter shall include: ‘11) Acknowledgement of any Amendment to this solicitation, to include signed copies attached to the Cover Letter (Will not count against the two-page limit.)’ |
| Question: While the Offeror is familiar with the requirement to acknowledge RFP amendments as part of submission, we are unsure what is meant by 'include signed copies'. Please clarify what signed documents must be included in the submission to satisfy this requirement. | Signed copies of the Standard Form 1449 (page 1) to acknowledge the Amendment. These do not count against the page limit. | |||||
| 26 | Instructions and Eval Criteria | 3.2 | 12 | 3 | Item 12 states that the Cover Letter shall include: ‘12) Acknowledgement of any representations and certifications required (Will not count against the two-page limit.)’ |
Question1: Please clarify what is meant by 'acknowledgement' of representations and certifications in the Cover Letter.
| Question2: Should the Offeror complete the representations and certifications in the document 'W52P1J21R0029.pdf' and include the document, either in part or in full, in its submission? | The Government is requesting Offerors to acknowledge that its reps and certs are correct in beta.sam.gov. Attachment 0003, Instructions and Eval Criteria has been updated. | |||
| 27 | RFP Q&A | 25 | The Government's answer to Question #25 states that 'A T&E BPA Manager must be identified by all contractors who are part of the T&E BPA. This individual shall be included in the Cover Letter of the Offeror's proposal.' |
| Follow-on Question: Please confirm that no additional information beyond the proposed T&E BPA Manager's name is required. | Attachment 0003, Instructions and Eval Criteria has been updated to include the BPA manager. Name, title, e-mail address and phone number are required. | |||
| 28 | RFP Q&A | 73 | The Government's answer to Question #73 states that 'The Government is requesting examples of work including supporting documentation with relevant excerpts from the Statement of Work or Unclassified Description of the Work.' |
| Follow-on Question: Can the Offeror include Statements of Work from contracts at the IDIQ level? | No; however, an example can be provided of the task or delivery order under the IDIQ. | |||||
| 29 | PWS | 1.2 | 3 | 3 | Section 1.2 of the PWS states: 'The PWS includes the acquisition of commercial AI tools and services, the development of new AI tools and services, the integration of AI tools and services into environments, the operation and support of AI tools and services, and the use of AI tools and services to conduct AI testing on AI models and software applications.' |
| Question: Please confirm that the Government will consider acquisition/use of contractor-developed AI tools and services in subsequently issued JAIC T&E Call Orders. | Requirements will be determined at the call order level. | |||||
| 30 | PWS | 3.2 | 1 | 9 | Section 3.2 of the PWS states: 'There is one exception that pertains to Contractor personnel with an interim security clearance for contractors providing support in the NCR.' |
| Question: Please confirm that 'NCR' refers to the 'National Capital Region' located in Washington DC as the support location. | Yes. | ||||
| 31 | Instructions and Eval Criteria | A | 6 | Section 2.a. states: "The responses to the questions will be used to assess the Offeror’s capabilities It is the responsibility of the Offeror to answer each question in its entirety prior to proposal submission." |
| Question: Does the Government desire for Offerors to answer the BPA Questionnaire with narrative describing their relevant experience (questions 1, 2, 3, 5 & 6) or should Offerors only include the stated information (i.e., contract number (if applicable), period of performance, and customer/Agency) and supporting documentation? | Per Attachment 1, the Government requires support documentation with relevant excerpts from the statement of work or an unclassified description of the work. Also, please refer to Attachment 0003, paragraph 3.2, Instructions by Section, Section 3. | ||||||
| 32 | Instructions and Eval Criteria | Attachment 0003 (Instructions & Eval Criteria) makes no mention of Attachment 0002 (PWS). How does the Government intend to use Attachment 0002 in its evaluation? | Attachment 002 is not used in the evaluation. All evaluations are based on the questions asked in Attachment 0003 and the Offeror's response. | ||||
| 33 | SF1449 / W52P1J-21-R-0029 | Block 20 | 2 of 39 | 20. Supplies/ Services Schedule See Schedule | Block 20 (Schedule of Supplies/Services) instructs the bidder to "See Schedule". Block 20 does not refer to Attachment 0004 (BPA LCATS) as the Schedule nor provides any instruction that Offerors should price those LCATS (listed in Attachment 4). Please confirm that Offerors should (or should not) provide a Schedule of T&M rates for these LCATS. | No pricing rates are required in the Offeror proposal. LCATS are provided to Offerors as a reference for the type of labor the Government may request in call orders under this BPA. | |
| 34 | Instructions and Eval Criteria | 3.2 | Section 3 | 4 | "Section 3: Support Documentation per JAIC T&E BPA Questionnaire. The requested documentation, by question, in the JAIC T&E BPA Questionnaire shall be submitted as a single PDF, entitled: Section 3 Offeror Name Support Documentation. Each support document within this PDF shall have a Cover Page stating the name of the support document...Support documentation must not exceed 12 pages. The Cover pages will not count against the page limit." |
| Please confirm that the limit of 12 pages is per contract reference per question. | The entire PDF for ALL questions is limited to 12 pages. Please note that cover pages do not count towards the page limit per the Attachment 0003, Instructions and Eval criteria, paragraph 3.2, Section 3. | |||||
| 35 | Questionnaire | 4 | Would the Government accept supporting documentation for the Agile Methodology in order to allow Offerors to provide diagrams that will not fit in the provided text box? | No. | ||
| 36 | Questionnaire | 4 | We would like to make an appeal to be able to include additional collateral to help explain HOW we use both humans and digital testing tools to build ethics into AI. Contractors have very different approaches to this problem. By making this a Yes/No question, JAIC will never be able to see HOW contractors believe they can help JAIC be responsible stewards of AI. | No. | ||
| 37 | PWS | 4.2.-4.4 | Task 4 | Will the Government only award Offerors with solutions that meet all requirements listed in Section 4, or will solutions that only satisfy individual or a partial requirement list be considered for award? | To be eligible for the selection process, Offerors shall submit a completed Questionnaire with responses to all questions. Each question is a “gate” which the Offeror must receive an “acceptable,” in order to proceed to the next question/”gate” and continue to be considered for BPA award. If an Offeror receives an “unacceptable” for any question/gate, the Government will not evaluate any further questions and the Offeror will no longer be considered for award of an agreement. | |
| 38 | General | Is there application under this BPA for aircraft systems test and evaluation systems which utilize AI for failure and part consumption analysis? I do see a section in the SOW for new technologies, products and development efforts, but wasn’t sure if this type of solutions would fit. | This BPA is designed for the testing of AI systems. | |||
| 39 | General | I wanted to confirm that you are not seeking a rate list at this time and |
rates will only be requested once task orders are issued against BPAs.
| The Government is not requiring rates for the labor categories. | |||
| 40 | General | Is there a required facility clearance? | The is no required facility clearance at the BPA level; it was removed from the draft requirement. Security clearance levels will be handled at the call order level . |
41 PWS 1.9 Will award of the "T&E BPA" (Solicitation W52P1J-21-R-0029) be an OCI concern for the upcoming "DRAID BPA"? Companies will be allowed to participate in both DRAID and T&E BPAs. Companies that have contracts under DRAID will not be allowed to T&E their own contracts to avoid OCIs but can T&E other contractors DRAID contracts.
| 42 | Instructions and Evaluation Criteria 11 February 2021 | 3 | N/A | 4 | You state; "Support documentation must not exceed 12 pages. The Cover pages will not count against the page limit" Please clarify that 12 pages is total for all of support documentation minus cover pages or 12 pages is per question. | The entire PDF for ALL questions is limited to 12 pages. Please note that cover pages do not count towards the page limit per the Attachment 0003, Instructions and Eval criteria, paragraph 3.2, Section 3. | |
| 43 | Instructions and Evaluation Criteria 11 February 2021 | 3.2 | N/A | 3 | In the cover page requirement you ask to list Subcontractors "6) Teaming arrangements and/or subcontractors name" For this solicitation is there a requirement to have teammates finalized or can we leave it blank if teaming isn't finalized? | If there is a teaming arrangement for the Offeror to be qualified for the BPA, then it shall be stated in the Cover Letter. However, if an Offeror can independently answer all questions on the questionnaire without a teaming arrangement, then the Offeror is only required to list its information. Teaming Agreements and subcontracting can be done at the call order level as needed. | |
| 44 | Instructions and Evaluation Criteria 11 February 2021 | 4 | 4 | Please clarify how the SF 1449 should be filled. This from is for unit pricing. Since there is nothing being solicited with this response other than contractor experience. Not clear on what you want on this form. " Signed and completed SF1449. All information on appropriate clauses as stated in the solicitation shall be filled-in on the SF1449. For any fill-ins that are not applicable, the Offeror must acknowledge by indicating “N/A”. The SF1449 shall be submitted as a PDF, entitled: Section 4 Offeror Name SF1449." | The Government is not requesting unit pricing. Blocks 12, 23, and 24 do not need to be completed. The Government is only requesting signature from the Offeror (page 1) and all information on appropriate clauses as described in paragraph 3.2, section 4 of the Attachment 0003. | ||
| 45 | Attachment 0001 - JAIC TE BPA Questionnaire 11 Feb 21 | Questions 1, 2, 4, 5, 6 | same | 1 through 3 | May the Offeror include a brief introduction to excerpts from a statement of work (SOW)? The questionnaire states: “Please also provide support documentation with relevant excerpts from the Statement of Work or an Unclassified Description of the Work.” This instruction may be understood to mean only Classified examples should be summarized with an Unclassified description of the work. However, the answer to Question 99 from the Questions Matrix may imply that an Unclassified description of the work may be provided in all cases. Briefly introducing excerpts from a SOW will concisely connect the broad, general language contained in many SOWs with the specific requirements listed in Questions 1, 2, 3, 5, and 6. | Relevant excerpts from the SOW and/or an unclassified description of the work are acceptable. | |
| 46 | JAIC T&E BPA Solicitation: W52P1J-21-R-0029 | ||||||
| Instructions and Evaluation Criteria | 3.2 Specific Instructions by Section | 3 | 4 | What is expected/allowable on the cover page for each response? | See the RFP Attachment 0003, paragraph 3.2, section 3. | ||
| 47 | JAIC T&E BPA Solicitation: W52P1J-21-R-0029 | ||||||
| Instructions and Evaluation Criteria | 3.2 Specific Instructions by Section | 3 | 4 | #3 Creation of test and evaluation software (example?) | Please refer to the Attachment 0001 JAIC TE BPA Questionnaire, Question #3. | ||
| 48 | 3-BPA Instructions and Eval Criteria | 2 | b | 6 | Can an Offeror, who is submitting as a prime, submit work done as a subcontractor if the SOW/PWS demonstrates comparable scope? | Yes. The prime can submit work in which they were the subcontractor on. | |
| 49 | Attachment 0003 | 3.2, Section 3 | Page 4, Paragraph 3 | Each support document within this PDF shall have a Cover Page stating the name of the support document, and the question number it supports. Question: Can the cover page include more information (i.e., narrative that contributes to the supporting documentation) beyond just the name of the support document and the question number it supports? | No. | ||
| 50 | W52P1J-21-R-0029 SF 1449, Continuation Sheets | Contract Clauses | Page 20, Paragraph Contract Clauses | FAR.222-46 requires the submittal of the Contractor Compensation Plan. Was this FAR provision included erroneously as compensation plan information was not required in the instructions to Offerors? | The clause is applicable at the call order level when the contract amount is expected to exceed $750,000. A compensation plan is not required at the BPA level. | ||
| 51 | W52P1J-21-R-0029, SF 1449, Continuation Sheets | 52.212-4(I)(1)(D) 1 & 2 | Page 10, Paragraph Contract Clauses | Under FAR 52.212-4 (I) (1) Payments, Subparagraph (ii) Materials, (D) Other Costs are Contractors expected to replace the “N/A” for ODCs and Indirect Costs percentage on a call order basis and leave the fields as “N/A” in our submittal for the BPA? | Yes, leave them as N/A on the submittal for the BPA. | ||
| 52 | W52P1J-21-R-0029, SF 1449, Continuation Sheets | 252.204-7021 | Page 20, Paragraph Contract Clauses | Was DFARS 252.204-7021 CMMC Requirements included in error? To our knowledge, this BPA has not been identified as one of the 15 pilot programs that will be subject to CMMC requirements in 2021. If this clause is being included in anticipation of CMMC requirements in future call orders, could the clause be added at the call order level only when required? | This clause has been removed from the solicitation | ||
| 53 | Attachment 0001-JAIC TE BPA Questionnaire | Sections 1-6 | Pages 1-3 | Please confirm that the corporate experience of the Offeror/Prime may include that of its wholly-owned subsidiaries whose resources may be used in the performance of BPA call orders. | Yes. | ||
| 54 | Attachment 0002 JAIC T&E BPA PWS | 1.1 Background | 1.1 Background | 3 | How much of this is AI test tools, capabilities and services (note test and tooling around testing) rather than AI capabilities via infrastructure and software? | The T&E BPA is designed to allow the Government to procure T&E of AI Tools and T&E of AI Services. Specific requirements will be provided at the call order level. | |
| 55 | Attachment 0002 JAIC T&E BPA PWS | 1.0 Introduction | 1.1 Background | 3 | T&E Services list - these do not appear to be our areas of focus or core competencies Could we qualify new technology under Identifying new technologies, products, or development efforts? | To be eligible for the selection process, Offerors shall submit a completed Questionnaire with responses to all questions. Each question is a “gate” which the Offeror must receive an “acceptable,” in order to proceed to the next question/”gate” and continue to be considered for BPA award. If an Offeror receives an “unacceptable” for any question/gate, the Government will not evaluate any further questions and the Offeror will no longer be considered for award of an agreement. | |
| 56 | Description Section on Beta.SAM | How do we provide hw/sw for JCF, which is the DoD’s AI platform? Where is the JCF, which is initially be built and operated in the DoD enterprise cloud. | Specific details will be provided at the Call Order level based on the unique requirements of the ordering agency. | ||||
| 57 | Attachment 0002 JAIC T&E BPA PWS | this BPA can support up to a Top Secret (SCI/SAP) level classification. Do we need to have cleared people? It seems so based on: When responding to a requirement, proposed personnel shall possess at least the minimum security clearance required for that call order prior to proposal submission or being issued a Common Access Card (CAC). There is one exception that pertains to Contractor personnel with an interim security clearance for contractors providing support in the NCR | The BPA can support work at all classification levels. The specific classification level will be identified at the call order level. | ||||
| 58 | Attachment 0002 JAIC T&E BPA PWS | Is the BPA for T&E more directed and suited towards a large FSI similar or global service provider similar to LMCO or NGC? | The BPA is open to all business including traditional and non-traditional defense contractors. | ||||
| 59 | JAIC Data T and E Draft RFP Questions Matrix 11Feb21 | Rows 18, 38, 76 | N/A | N/A | The Government responses to the Draft RFP questions/comment state that only the "Prime" past performance references be allowed for the BPA Questionnaire. For a Small Business Contractor Teaming Agreement (CTA), the privity of the contract lies with each team member and each team member can interact with the federal government. Would the Government please clarify that all past performance reference for a CTA can be used for the BPA questionnaire and supporting documentation? | The Government is not requesting past performance. The Government is requesting examples of work per the questionnaire. The examples must be work performed by the entities of the contractor team submitting as a prime under this BPA. For example: Company A and B are in a teaming agreement. Examples from either Company A or Company B can be submitted. However, Offerors cannot submit examples of work performed by a subcontractor in which no teaming agreement exists. | |
| 60 | Attachment 0003- JAIC TE BPA Instructions and Eval Criteria 11Feb21.pdf | 3.2 Specific Instructions by Section | Section 2: Completed JAIC T&E BPA Questionnaire | 4 | Offeror has relevant experience with commercial customers, but due to terms of non-disclosure agreements with those customers, Offeror cannot identify the customer in any supporting reference materials. Will the Government allow support documentation for corporate experience where the customer/agency’s identifying information has been redacted/genericized? | Yes. State that the name of the customer/agency cannot be provided due to a non-disclosure agreement within the questionnaire and supporting documentation. | |
| 61 | Attachment 0003- JAIC TE BPA Instructions and Eval Criteria 11Feb21.pdf | 3.2 Specific Instructions by Section | Section 3: Support Documentation | 4 | Please clarify that the 12 page limit is in reference to individual supporting documents for each reference (12 pages allowed for each reference) and not the total page limit of all documentation combined for all references in the Questionnaire. | The entire PDF for ALL questions is limited to 12 pages. Please note that cover pages do not count towards the page limit per the Attachment 0003, Instructions and Eval criteria, paragraph 3.2, Section 3. | |
| 62 | Attachment 0004 Appendix A T and E LCAT Table | Row 5 / Program Manager Category | Minimum Education Level | N/A | Will the government consider and approve an IDIQ PM with a valid, current Defense Acquisition Workforce Improvement Act (DAWIA) certification, which is equivalent to a FAC-P/PM at the same certification level? | Yes, the LCAT table has been amended accordingly. | |
| 63 | Attachment+0001-JAIC+TE+BPA+Questionnaire+11Feb21 Page 1 | Considering the complex research and development nature of this acquisition, will the Government allow Contractor Teaming Arrangements (CTAs) in accordance FAR Part 9, subpart 9.6? | Yes. CTAs are allowed. | ||||
| 64 | Attachment 0002, Section 2.1, Page 7 | Please confirm that no resume is required for the BPA T&A Manager at the BPA level. | No resume required. | ||||
| 65 | Attachment 003 Evaluation criteria | If the same project references are given for questions 1, 2, 3 , 5 and 6 , is it acceptable? It is technically possible to have a single project that may have all the features that will qualify as appropriate response. | It is acceptable to reference the same projects across multiple questions if applicable. | ||||
| 66 | Attachment 003 Evaluation criteria | We are currently executing several SBIR Phase 1 and Phase 2 projects in areas including Verification & validation, building robust AI applications, hypersonic image detection among others. Are these projects acceptable as project references? It is not clear which projects are acceptable? | Yes. Any experience the Offeror has in these areas is acceptable. | ||||
| 67 | Attachment 003 Evaluation criteria | Question 4 - You simply state "Nationally recognized methodologies" - which ones are accepted as per your standards. It is too vague and subject to misuse by vested interests. You should give us a partial list at the very least. Something like Scrum, Kanban, Extreme Programming. | Nationally recognized is defined as recognition from an organization at the federal, national, or international level as stated with the question. The Government is asking for experience with industry standard Agile methods. Scrum, Kanban and Extreme Programming are acceptable examples. | ||||
| 68 | Attachment 003 Evaluation criteria | If the project references are from our teaming partners, are they acceptable or it has to be from the prime contractors? | Yes. The examples must be work performed by the entities of the contractor team submitting as a prime under this BPA. For example: Company A and B are in a teaming agreement. Examples from either Company A or Company B can be submitted. However, Offerors cannot submit examples of work performed by a subcontractor in which no teaming agreement exists. | ||||
| 69 | Attachment 0003-JAIC TE BPA Instructions and Eval Criteria 11Feb21; |
JAIC Data T and E Draft RFP Questions Matrix 11Feb21.xlsx 3.2 Specific Instructions by Section;
Q27 Section 1: Cover Letter, item 9;
Column F 3;
page 23 in print preview "Section 1: Cover Letter. The Cover Letter shall be limited to two (2) 8.5x11 inch pages, single-spaced with 1-inch margins, using Arial size 12-point font with each page numbered. Tables and illustrations may use a reduced font size, no less than Arial size 8 point, if necessary. The Cover Letter shall be submitted in PDF, entitled: Section 1 Offeror Name Cover Letter. The Cover Letter shall include the following information:
1) Solicitation number
2) A statement that the proposal is valid for 120 days after proposal submission date of proposal
3) Contractor name
4) DUNS number
5) CAGE code
6) Teaming arrangements and/or subcontractors name
7) Business size and socioeconomic status of prime and any teaming arrangements (if applicable)*
8) Complete business mailing address
9) Point(s) of Contact (POC) designated to represent the Offeror in this acquisition (Name, title, e-mail address, and phone number)"
"The government is not requiring resumes for Key personnel. A T&E BPA Manager must be identified by all Contractors who are part of the T&E BPA. This individual shall be included in the Cover Letter of the Offeror's proposal."
| Please confirm that it is acceptable to name the T&E BPA Manager as one of the POCs in item 9. | Attachment 0003, Instructions and Eval Criteria has been updated to include the BPA manager. Name, title, e-mail address and phone number are required. | |
| 70 | W52P1J21R0029 11Feb21 |
Attachment 0003-JAIC TE BPA Instructions and Eval Criteria 11Feb21; Title Block: SOLICITATION/CONTRACT/ORDER FOR COMMERCIAL ITEMS
3.2 Specific Instructions by Section; instructional statement; Block 12, Block 23, Block 24
Section 4: Signed and completed SF1449. 1
4 "SOLICITATION/CONTRACT/ORDER FOR COMMERCIAL ITEMS
Offeror To Complete Block 12, 17, 23, 24, & 30"
12. Discount Terms
23. Unit Price
24. Amount
"Section 4: Signed and completed SF1449. All information on appropriate clauses as stated in the solicitation shall be filled-in on the SF1449. For any fill-ins that are not applicable, the Offeror must acknowledge by indicating “N/A”. The SF1449 shall be submitted as a PDF, entitled: Section 4 Offeror Name SF1449."
| Please confirm it is sufficient to fill in blocks 12, 23, and 24 with "N/A" | Correct. Blocks 12, 23, and 24 do not need to be completed. The Government is only requesting signature from the Offeror (page 1) and all information on appropriate clauses as described in paragraph 3.2, section 4 of the Attachment 0003. | ||||||
| 71 | Attachment+0001-JAIC+TE+BPA+Questionnaire+11Feb21 Page 1 | Is there a limit to the number of CTA members or teaming? | There is no limit. | ||||
| 72 | Attachment 0001, Page 1 | Please confirm we can include a contract that has a Period of Performance of 9 months. | Yes. | ||||
| 73 | Attachment 0002, Page 7 | Please indicate where within the response contractors can provide BPA Manager's Name, if required. The Government has indicated we need to provide qualifications; please confirm you do not require a resume and/or letter of intent. Please specify requirement. | The BPA Manager's name shall be provided in the Cover Letter as referenced in the amended Attachment 0003. No resume is required. | ||||
| 74 | Can the Government please provide an extension beyond the Offer Due Date of 05March? | Yes, the due date has been extended to 12 March. Please see the amended Attachment 0003. | |||||
| 75 | BAP Instructions and Eval Criteria | Section 3 | 1 | 4 | The BPA instructions state, "The requested documentation, by question, in the JAIC T&E BPA Questionnaire shall be submitted as a single PDF, entitled: Section 3 Offeror Name Support Documentation. Each support document within this PDF shall have a Cover Page stating the name of the support document, and the question number it supports." It further sates, "Support documentation must not exceed 12 pages." Please confirm, since one PDF file is permitted per question for submission, the file will include information for multiple contract examples. | The entire PDF for ALL questions is limited to 12 pages. Please note that cover pages do not count towards the page limit per the Attachment 0003, Instructions and Eval criteria, paragraph 3.2, Section 3. | |
| 76 | BAP Instructions and Eval Criteria | Section 3 | 1 | 4 | The BPA instructions state, "The requested documentation, by question, in the JAIC T&E BPA Questionnaire shall be submitted as a single PDF, entitled: Section 3 Offeror Name Support Documentation. Each support document within this PDF shall have a Cover Page stating the name of the support document, and the question number it supports." It further sates, "Support documentation must not exceed 12 pages." Please confirm since the cover page shall state the name of the support document, the name should be generic in nature because with more than one contract example, a name associated with a specific contract would not be representative of different contracts. | Yes. | |
| 77 | BAP Instructions and Eval Criteria | Section 3 | 1 | 4 | The BPA instructions state, "The requested documentation, by question, in the JAIC T&E BPA Questionnaire shall be submitted as a single PDF, entitled: Section 3 Offeror Name Support Documentation. Each support document within this PDF shall have a Cover Page stating the name of the support document, and the question number it supports." It further sates, "Support documentation must not exceed 12 pages." Please confirm that support documentation, described as a single PDF per question, the associated 12 page limit is related to each file and not a composite of information for all questions combined. | The entire PDF for ALL questions is limited to 12 pages. Please note that cover pages do not count towards the page limit per the Attachment 0003, Instructions and Eval criteria, paragraph 3.2, Section 3. | |
| 78 | Does a company cover page count against the two pages outlined for the Cover Letter? | Yes. | |||||
| 79 | If graphics or charts are being taken from existing documentation and are not conducive to being enlarged or shrunken, may they still be utilized as a substantiating record if clearly readable and/or visible? | Yes. Attachment 0003 paragraph 3.2, section 3 has been updated accordingly. | |||||
| 80 | Does the use of an acronym page(s) count against the 12 pages total permitted for support documentation? | Yes. | |||||
| 81 | Attachment 0003 - JAIC TE BPA Instructions and Eval Criteria 11Feb21 | 3.2 Specific Instructions by Section | Section 3 | 4 | The requirement states "Support Documentation per JAIC T&E BPA Questionnaire. The requested documentation, by question, in the JAIC T&E BPA Questionnaire shall be submitted as a single PDF, entitled: Section 3 Offeror Name Support Documentation. Each support document within this PDF shall have a Cover Page stating the name of the support document, and the question number it supports. The Cover Page of each support document shall be limited to one (1) 8.5x11 inch page, single-spaced with 1-inch margins, using Arial size 12-point font. The support document itself can be provided in its current format, if already produced. Otherwise, it shall be provided using 8.5x11 inch page, single-spaced with 1-inch margins, using Arial size 12-point font. Tables and illustrations may use a reduced font size, no less than Arial size 8 point, if necessary. Support documentation must not exceed 12 pages. The Cover pages will not count against the page limit." |
Is it the Government's intent that "Support Documentation per JAIC T&E BPA Questionnaire" not exceed 12 pages for:
a. total Proposal Section 3 submission (12 pages total);
b. per JAIC T&E BPA Questionnaire question requiring documentation (Q1,2,3,5, 6 = 5 questions * 12 pages each = not exceed 60 pages total); or,
| c. per reference submitted per question (5 questions * up to 3 references * up to 12 pages each = up to 180 pages)? | The entire PDF for ALL questions is limited to 12 pages. Please note that cover pages do not count towards the page limit per the Attachment 0003, Instructions and Eval criteria, paragraph 3.2, Section 3. | |||||
| 82 | Attachment 0001-JAIC TE BPA Questionnaire | Sections 1-6 | Pages 1–3 | The Government has encouraged teaming at the BPA level in order to benefit from the wide range of experiences and capabilities that the Offeror’s teaming partners/subcontractors can bring to performance. In light of this strategy and to recognize the strength of the overall team will the Government reconsider its position and permit experience qualifications from teaming partners/subcontractors to be submitted in the Questionnaire? | Yes. The examples must be work performed by the entities of the contractor team submitting as a prime under this BPA. For example: Company A and B are in a teaming agreement. Examples from either Company A or Company B can be submitted. However, Offerors cannot submit examples of work performed by a subcontractor in which no teaming agreement exists. | |
| 83 | Attachment 0003- JAIC TE BPA Instructions and Eval Criteria 11Feb21 | Section 3.b. Instructions to Offeror and Section 3.1.d. General | Page 2, Paragraph 6 and Page 3, Paragraph 2 | The RFP states ,"Offers shall not contain classified data," and "Any part of the Offeror’s proposal that it considers proprietary shall be marked as so." |
| Please confirm supporting documentation marked FOUO is permissible? | Yes. | ||||||
| 84 | Attachment 0002 JAIC T&E BPA PWS | 4 | 4.2 Task 1 | 11 | Should AI T&E solutions be built with open source libraries/tools only? | This depends on the ordering agencies unique requirement. This will be specified at the Call Order Level. | |
| 85 | N/A | N/A | N/A | N/A | Are there any restrictions/requirements for academic publications resulting from work through this BPA? | Not at the BPA level. Restrictions or requirements may be placed at the Call Order level. | |
| 86 | N/A | N/A | N/A | N/A | Does the Government foresee potential conflicts between this JAIC procurements and others? | See OCI language for description of what work is permitted. | |
| 87 | Attachment 0002 JAIC T&E BPA PWS | 3.2 | 1 | 9 of 15 | If the Offeror were to include subcontractors on the team, are the subcontractors required to hold facility clearance as well? | The BPA can support work at all classification levels. A facility clearance is not required at the BPA level. The specific classification level will be identified at the call order level. | |
| 88 | N/A | N/A | N/A | N/A | Where is the Place of Performance for this contract going to be? | Place of performance will be identified at the call order level. | |
| 89 | Question#1 – Program Manager | ||||||
| Attachment#004, identifies DAWIA Level III Program Management certification as a qualification for the Program Manager position. Only government employees may take courses towards this certification. This requirement limits competition and creates a competitive disadvantage for small business firms. Would the government consider removing this certification requirement and instead rely on industry equivalents such as Project Management Institute (PMI) certification? | Yes, the LCAT table has been amended accordingly. | ||||||
| 90 | Question#2 – Program Manager | ||||||
| Attachment#004, identifies DAWIA Level III Program Management certification as a qualification for the Program Manager position. Only government employees may take courses towards this certification. This requirement limits competition and creates a competitive disadvantage for small business firms. Would the government consider removing this certification requirement and instead rely on experience plus program management experience? | PM Certification is a requirement. Refer to the amended LCAT table. |
| 91 | Question#3 – Past Performance | ||||||
| The solicitation does not specify whether a Contractor Teaming Agreement(Partnership or Joint Venture) under FAR 9.601 is allowed under this acquisition. Please confirm that either a Partnership or Joint Venture Contractor Teaming Agreement (CTA) is permissible. | All are permissible. | ||||||
| 92 | Test & Evaluation of AI Blanket Purchase Agreement Questionnaire | N/A | All | Can the government confirm that the Offerors examples of work can be from outside of the United States? | Yes. | ||
| 93 | Test & Evaluation of AI Blanket Purchase Agreement Questionnaire | N/A | All | Can the government confirm if the Offeror is able to submit "unnamed industry client" for the "customer/Agency" field within the table? | Yes. | ||
| 94 | JAIC Test & Evaluation Services Blanket Purchase Agreement Performance Work Statement | 1.3 | 5 | Can the government confirm if there is an existing inventory of AI and analytics solutions that are to be scaled and deployed or are solutions to be built from the ground up? | There is not. |
This is the start of the file's text. The full file is on GovTribe.
File details come from the government source that posted it. Updated .