CCG717_SOW_TypeN Microcalorimeter Low Frequency Extension Rev 2.pdf

Statement of Work Type-N Microcalorimeter Low Frequency Extension

Project Number: CCG717 19 January 2021

1. Technical Problem. The Air Force Metrology and Calibration (AFMETCAL) program recently took delivery in the Air Force Primary Standards Laboratory (AFPSL) of a Type‐N Microcalorimeter to measure absolute RF Power to state‐of‐the‐art uncertainties comparable to an upper echelon National Metrology Institute (NMI) from the National Physical Laboratory (NPL) in the United Kingdom. This system was initially procured via Calibration Coordination Group (CCG) project CCG621, and as implementation of this system has progressed toward production status in the AFPSL, additional capabilities are needed and lower uncertainties below 50 MHz are desired. This project, Type‐N Microcalorimeter Low Frequency Extension, is a follow‐on. As such, all the previous capabilities and uncertainties are being retained with new capabilities, betterments, and exceptions detailed within this Statement of Work (SOW). The successful fulfillment of this SOW will result in complete ability to calibrate the following primary RF power transfer standards organically and traceably at lowest NMI equivalent uncertainties: National Institute of Standards and Technology (NIST) CN‐Mount; Agilent 478A‐H73; Tegam M1110A, M1111A, M1130A. The paragraphs and subparagraphs below identify the technical problems requiring research and development for resolution in association with some modest hardware improvements and software changes.

1.1. The original microcalorimeter as delivered was thermally mapped to the NPL frequency list, but not to the AFMETCAL standardized frequency list. For the AFPSL to maintain continuity of NIST traceability, it is critical for the Type‐N Microcalorimeter system to be thermally characterized at the AFMETCAL standardized frequency list.

1.2. 10 kHz 7 mm RF line. The original Type‐N Microcalorimeter delivery included a 7mm RF line characterized down through 100 kHz. With a new requirement to measure RF power down through 10 kHz using this same Type‐N Microcalorimeter system, this requires research and development of a new RF line suitable down to 10 kHz and characterization of such.

1.3. 10 kHz transfer standard. In extending the low frequency of the Type‐N Microcalorimeter system down to 10 kHz, a new/second transfer standard is required. The power sensor to be included in this new transfer standard shall be a Rohde & Schwarz NRP‐18T or equivalent.

1.4. Lower the uncertainties from 50 MHz down through 10 kHz. The system as delivered initially, had uncertainties rise undesirably below 50 MHz. Missing the target uncertainties below 50 MHz is problematic. Consequently, better techniques in VNA characterizations are necessary to lower the overall RF Power uncertainties below 50 MHz to achieve target uncertainties.

1.5. Currently the AFPSL has no traceable method of characterizing DUT’s for magnitude & phase for the purpose of gamma correction from 10 kHz to 100 kHz. VNA’s usually have typical specs below 300 kHz. Correlation of RF power calibrations performed below 100 kHz down through 10 kHz have not been traceably verified respective to accurately known standards, methodologies, and artifacts.

1.6. RF high power source. The RF source currently being utilized in the Type‐N Microcalorimeter system is inadequate of producing high enough power output to ensure the necessary power level of +10 dBm is achieved in the microcalorimeter.

2. Objectives. The following are objectives of this project.

2.1. The Type‐N Microcalorimeter system shall have the insertion of a new RF line for frequency range from 10 kHz to 18 GHz and this line shall be characterized at both the AFMETCAL and NPL standardized frequency lists at +10 dBm. This is expected to ensure continuity of traceability coverage from the AFMETCAL Type‐N Microcalorimeter system to both NIST and NPL. (The original RF line installed in the calorimeter was not characterized at the AFMETCAL standardized frequency list. However, due to risk factors this RF line will not be removed and re‐characterized at AFMETCAL standardized list, but will remain untouched in the calorimeter as previously characterized at the NPL frequency list.)

2.2. Research and develop VNA characterization techniques for the RF line components, power splitters and power sensors to lowest uncertainties. At 50 MHz down through 10 kHz, new standards and techniques have been developed that are expected to lower the overall uncertainties of the calibrations within this frequency range.

2.3. Extend the frequency range of the Type‐N Microcalorimeter from 100 kHz down through 10 kHz.

This will allow the AFPSL to perform RF power calibrations on their Type‐N primary transfer standards at NMI uncertainty levels from 10 kHz through 18 GHz. This frequency extension down to 10 kHz is being driven by recent OEM specifications on RF power sensors into the low kHz regions and even down to DC. It is an objective of this project to quantitatively provide conclusive evidence which AFMETCAL will have to determine if RF power calibrations are necessary and prudent below 100 kHz.

2.4. Develop and characterize a new RF line functional from 10 kHz to 18 GHz.

2.5. Build a new/second transfer standard. The frequency range for new transfer standard shall be from 10 kHz through 18 GHz.

2.6. Perform a comparison of Power Measurements at low frequency (10 kHz through 1 MHz) between Microcalorimeter and DC/LO based methodologies. Respective to this objective, the RF power calibrations made on DUT RF power sensors (thermally using the Microcalorimeter) shall be tested for agreement with dedicated traceable DC/LO standards, methodologies, techniques and artifacts with a Test Uncertainty Ratio (TUR) greater than 4:1. Among the DUT RF power sensors to be included in this determination shall be an M1130A supplied by AFMETCAL and a NRP‐18T (or equivalent) to be acquired with this project, and any others deemed appropriate by Contractor with concurrence from AFMETCAL.

2.7. Final uncertainty target objectives (k=2) of the RF power calibrations made using the updated Type‐N Microcalorimeter system are as follows: at 10 kHz with U = 0.6%, to 50 MHz with U = 0.18%, to 18 GHz with U = 0.58%.

2.8. Upgrade of the RF high power source. A new RF high power source is required as part of this project because the RF source currently being used in the Type‐N Microcalorimeter system cannot produce the necessary +10 dBm into the microcalorimeter.

2.9. Develop technical documentation and test reports detailing the expertise. This is so the AF may be self‐sufficient regarding operational certification and periodic maintenance of the system in the future.

2.10. Acceptance, demonstration, and training of the system shall then be accomplished in the

AFPSL.

3. Expected Products. Since the Type‐N Microcalorimeter was originally delivered, significant improvements have been realized in measurement techniques respective to Vector Network Analyzer

(VNA) characterizations of components. The RF DUT artifacts shall be characterized using the new/best VNA standards/techniques (that produce the lowest overall uncertainties) at the AFMETCAL standardized frequency lists.

3.1. The frequency extension of the Microcalorimeter down to 10 kHz. Which consists of the following components (which shall operate from 10 kHz to 18 GHz, operate at +10 dBm, and utilize the AFMETCAL Standard Frequency List):

3.1.1. A second 7 mm RF line to be developed, characterized and installed.

3.1.2. A new transfer standard to be provided. If a power sensor is used, it shall be a Rohde & Schwarz NRP‐18T or equivalent.

3.1.3. A new check standard to be provided. It shall be a Rohde & Schwarz NRP‐18T or equivalent.

3.1.4. The original Type‐N Microcalorimeter shall be mapped/re‐mapped and characterized at +10 dBm from 10 kHz to 18 GHz in accordance with the AFMETCAL standardized frequency lists.

3.1.5. RF High Power Source, and if necessary an amplifier. The new RF high power source shall be a Rohde & Schwarz SMA100B‐B120‐K33‐B34‐B92 or equivalent. The objective here is to provide +10 dBm of power from 10 kHz to 18 GHz at the Microcalorimeter, and power level increment suitable for system use.

3.2. Testing. A Tegam M1130A & the check standard provided in step 3.1.3 will be used to verify the N‐Type Calorimeter. One of these should also be compared to the N‐Type Calorimeter owned by NPL as a verification of performance.

3.3. Software. The existing software for the N‐Type Calorimeter will be modified (if necessary) to accommodate any changes necessary based on the implementation of this statement of work.

Software is to be installed on controller listed in 3.10 Modifications to software include:

3.3.1. Implement new RF High Power Source

3.3.2. Implement new transfer standard.

3.3.3. Implement new check standard.

3.3.4. Update frequency based on frequency extension down to 10 kHz.

3.3.5. Update Historical spreadsheet for new system range.

3.3.6. Validation & Verification of any changes.

3.4. A new controller with Windows 10 Professional (or greater, 64 bit, latest version release) with all necessary executable(s) fully working shall be delivered with the system. The controller must meet or exceed Microsoft Windows 10 Professional hardware requirements and the following:

3.4.1. Memory: Minimum 8 GB system Memory;

3.4.2. Hard Drive: 500 GB (Minimum) Hard Disk Drive;

3.4.3. DVD‐ROM: Internal DVD +/‐ RW;

3.4.4. USB: Minimum of three integrated USB ports, 2.0 or 3.0 compatible;

3.4.5. Ethernet: One 10/100/1000 BaseT Ethernet port.

3.5. Target Uncertainties: 10 kHz: 0.6%, 50 MHz: 0.18%, 18 GHz: 0.58%. Estimated at 95% confidence level.

3.6. Documentation Update. Update existing documentation (Operation Manual, Software Operation, Theory of Operation, Hardware and Maintenance Manual) to capture any changes implemented by this statement of work.

3.6.1. Procedures shall be provided in updated technical data set that detail step‐by‐step sequence for performing these new/best VNA characterizations resulting in lowest overall uncertainties using an ultra‐low frequency VNA. Information shall be provided detailing setting up the standards (including defining the calibration kit in the VNA), methodologies, and techniques, and uncertainties in updated technical documentation. Documentation of these techniques and uncertainties shall be provided only for the specific VNA used by contractor, and AFMETCAL will modify as needed based on a future VNA that may be procured, if required. Advice on the tools and techniques to use particularly in determining VNA uncertainties shall also be included.

3.6.2. Procedures shall be provided in updated technical data set that detail step‐by‐step sequence of how a DUT RF power sensor calibrated on the Type‐N Microcalorimeter system is best verified from 10 kHz up though 1 MHz shall be provided using the best DC/LO approach as determined in paragraphs 3.6.1.

3.7. Software data rights. Application source code shall be delivered as part of the product delivery.

The Air Force shall be granted unrestricted rights to access and/or modify the software application source code and freely distribute the resulting software package. This shall include but is not limited to: use, duplication, modification, distribution, and disposition of the software application source code.

3.8. Study.

3.8.1. Conduct a study which determines the best traceable methods/techniques for characterizing DUT’s and splitters (from 10 kHz to 1 MHz) for use in gamma correction of the final calibration factor. Some of the possible techniques could be:

3.8.1.1. Possibly direct measurement of items via a complex impedance analyzer such as a 4294A OPT 1D5. This may result in elevated uncertainties. Currently the AFPSL has the 42030A Four Terminal Resistor Set calibrated by Keysight for AC Resistance from 1 to 13 MHz.

3.8.1.2. Possibly direct measurement of DC/LO R, L, C artifacts via complex impedance analyzer such as a 4294A and transferring those measurements/artifacts into calibration of a VNA or other another instrument. Using a VNA or other instrument may be employed in measuring both reflection coefficient and conceivably RF power calibration factors.

3.8.1.3. Determine if possibly calibrating at DC with an added uncertainty is adequate up to 100 kHz. And the theory/explanation to why this is still a traceable technique.

3.8.2. Technical Report: A technical report shall be included to summarize the various RF/MW &

DC/LO techniques investigated. It will recommend the technique NPL believes to be the best for establishing traceability and uncertainties. It is expected some discussion with AFMETCAL will be needed for this portion due to equipment the AFPSL may or may not have.

The report should include:

3.8.2.1. Techniques Considered.

3.8.2.2. Equipment & standards needed for each technique.

3.8.2.3. Uncertainty Comparisons.

3.8.2.4. Take‐away observations and overarching conclusions.

3.8.2.5. Suggested standards & equipment needed to achieve the desired solution. (Note:

Not to be procured in this project.)

3.8.2.6. For purposes of testing and validation, evaluation and verification, the following frequencies shall be evaluated as a minimum subset from the AFMETCAL standardized list specified herein and any others deemed appropriate by Contractor upon concurrence from AFMETCAL: 10 kHz, 20 kHz, 30 kHz, 40 kHz, 50 kHz, 60 kHz, 70 kHz, 80 kHz, 90 kHz, 100 kHz, 500 kHz, 1 MHz.

3.9. For purposes of testing, thirty‐six points shall be sufficient. The following subset of frequencies from the AFMETCAL standardized frequency list shall be used at a minimum: 10 kHz; 20 kHz; 30 kHz; 40 kHz; 50 kHz; 60 kHz; 70 kHz; 80 kHz; 90 kHz; 100 kHz; 500 kHz; 1 MHz; 5 MHz; 10 MHz;

50 MHz; 100 MHz; 500 MHz; 1000 MHz; 1090 MHz; 2 GHz; 3 GHz; 4 GHz; 5 GHz; 6 GHz; 7 GHz; 8 GHz; 9 GHz; 10 GHz; 11 GHz; 12 GHz; 13 GHz; 14 GHz; 15 GHz; 16 GHz; 17 GHz; 18 GHz. Other frequencies may be added at Contractors discretion with concurrence from AFMETCAL.

3.10. Training in the AFPSL (with materials). Full hands‐on “drive‐the‐system” training shall be provided for four (4) total AFMETCAL and AFPSL personnel, and “over‐the‐shoulder” lecture training shall be provided for ten (10) total personnel. Training materials are to be supplied in hardcopy and modifiable electronic format for ten (10) total personnel. Training shall include background theory, calculations, normal maintenance, troubleshooting sequence, etc. with primary focus on automated system operation, uncertainty, and changes from original delivery.

3.10.1. Training shall also include new/best VNA characterization techniques for transfer standards (including power splitter and power sensor) as required. Details shall be limited to complete VNA part number with unique options, full description of calibration kit devices by part number (with polynomial models or database quantification procedures), step‐by‐ step sequence for defining a user calibration kit in the VNA if appropriate, special unique setups of the VNA and/or associated cabling, determination of overall VNA uncertainties, and exporting of data and format compatible for direct importing into Type‐N Microcalorimeter system or driving table. If the AFPSL does not have an ultra‐low frequency VNA, training may consist of “driving” a VNA that the AFPSL does have down to the lowest frequency it supports and then discussion from the updated manual set with question and answers instead of hands‐on driving, to include user‐defined calibration standard(s).

3.10.2. Training shall also include whatever is uniquely required respective to certifying a RF power sensor low frequency extension calibrations. This shall include transferring the DC/LO standards and/or artifacts properties, setups, and uncertainties into usable form in the

RF/MW equipment or transfer standards (calibration kit definitions or similar) or formats (including adapter effects if any) or formulas.

3.10.3. Length of training shall total between twenty‐four and forty hours, in regular eight hour work days.

3.11. Warranty and Technical Support. Contractor shall provide a two‐year warranty which shall consist of 80 hours of follow‐on technical support throughout that warranty period following delivery, installation, and training. Such technical support shall include, but is not limited to, phone calls, emails, code revisions, etc.

4. Benefits. The following are several expected benefits of the Type‐N Microcalorimeter Low Frequency

Extension:

4.1. The AFPSL will receive an updated N‐Type Microcalorimeter System with the following benefits:

4.1.1. Frequency extension down to 10 kHz.

4.1.2. An improved RF High Power RF Source that is capable of producing the needed power.

4.1.3. The addition of a check standard.

4.1.4. Implementation of the AFMETCAL Standard Frequency List.

4.1.5. Improved uncertainties below 50 MHz.

4.2. A study will be conducted to determine the most suitable technique in characterizing system components from 10 kHz to 50 MHz. Currently most VNA’s are only warranted above 100 kHz.

The report/procedure from this study will establish a methodology at the AFPSL where one does not currently exist.

4.3. Onsite training from NPL on the use of the N‐Type Microcalorimeter System.

5. Major Tasks. The Type‐N Microcalorimeter Low Frequency Extension shall be developed in phases and milestones. The major tasks are assigned into an appropriate phase that specifically defines the work required and the major tasks highlight expected deliverables at the end of that phase. Sequential ordering of the phases have been determined to facilitate development and resolution of potential technical issues respective to successful overall project accomplishment and management. The major tasks are essentially separated into different phases based upon feasibility of task, focus of task, complexity of task, sequential order of task, proof‐of‐concept performance, cost, and timelines. Other considerations impacting the different phases may include: equipment acquisition, hardware fabrication/assembly, software development, system hardware and software integration, testing, documentation, delivery, acceptance testing, and training. Project management and performance review of the work agreed upon for that phase shall be performed at critical points within phase by Contractor and upon concurrence with AFMETCAL. A meeting or teleconference shall also occur between AFMETCAL and Contractor to review work and proof of concept performed at the end of that phase and to discuss/agree on a course of next action, before proceeding with next phase. If determination is made to continue the project into the next phase, a Memorandum of Agreement (MOA) shall be coordinated with the Contractor summarizing the decisions arrived at during the project review meeting or teleconference, and AFMETCAL will issue a contract modification that formally provides guidance to the Contractor of the activities and work authorized in the next phase.

Phases not contingent upon successful completion of other/previous phases and may be worked concurrently. However, milestones shall be met and programmatic reviews/teleconferences must be performed and formally agreed via contract modification before advancing into further phases.

5.1. Phase 1 – AFMETCAL ship system and artifact(s) and equipment acquisition.

5.1.1. This phase is dedicated to purchasing of equipment. This may entail acquisition of either Commercial Off‐The‐Shelf (COTS) equipment or specially designed unique jigs/fixtures (kept to minimum). A controller and necessary software may also be procured as needed. The following tasking’s are also important ones which need to be accomplished in this phase.

5.1.2. The calorimeter system and artifacts M1130A will also be shipped to Contractor during this phase and two NRP‐18T power sensors procured within this phase. Reference paragraph 3.2 among others.

5.1.3. A new RF high power source shall be acquired (see paragraph 3.1.5).

5.1.4. If required, procurement of a 10 kHz to 1 MHz metrology‐grade RF amplifier.

5.1.5. An ultra‐low frequency VNA shall not be procured as part of this project. AFMETCAL may acquire this equipment independently in the future after delivery of the system into the AFPSL, if necessary.

5.1.6. The deliverables for Phase 1 are:

5.1.6.1. Report of the equipment procured (including P/N‐opt & S/N) for project.

5.2. Phase 2 – Hardware and Software Development: This phase is dedicated to the development, installation, and testing of the new RF thermal line into the microcalorimeter. This phase is also dedicated to updating the software/drivers to accommodate the second RF line of the microcalorimeter.

5.2.1. Add new 7mm thermal line 10 kHz through 18 GHz into calorimeter. (See paragraph 3.)

5.2.2. Characterize the new 7mm thermal line within its appropriate frequency range at the AFMETCAL standardized frequency list at optimum power level suited for operation within the calorimeter. (Reference paragraph 3.1.1)

5.2.3. Extend spreadsheet to include Type‐N microcalorimeter system operational for AFMETCAL standardized frequency list at +10 dBm from 10 kHz through 18 GHz.

5.2.4. Change software/drivers as needed respective to the below system equipment betterments. All changes to software and implementation of new equipment within software shall operate seamlessly throughout all functions of system operation such that target uncertainties are achieved respective to final measurands reported.

5.2.4.1. Use of either RF line in microcalorimeter.

5.2.4.2. Use of either transfer standard outside microcalorimeter.

5.2.4.3. Integration of new RF high power source.

5.2.4.4. Integration of new metrology grade amplifier if necessary.

5.2.5. The deliverables for Phase 2 are:

5.2.5.1. Images of completed new thermal line before and after insertion into the calorimeter.

5.2.5.2. Data confirming the new thermal line is characterized and operating as intended.

5.2.5.3. Report of testing shall clearly show new spreadsheet includes low frequency extension.

5.3. Phase 3 – Thermally remap microcalorimeter and procure needed components for new transfer standard. This phase is dedicated to remapping the microcalorimeter at the AFMETCAL standardized frequency list at +10 dBm from 10 kHz through 18 GHz. This shall include all characterizations as appropriate respective to use of either RF line or transfer standard. The AFMETCAL standardized frequency list is included in Appendix A.

5.3.1. Perform proof of concept measurements manually as needed using the new components installed in the microcalorimeter and the new transfer standard. Verify performance against existing NMI facility primary standard(s) using power sensor DUT artifacts M1130A and NRP‐18T. Using the AFMETCAL standardized frequency list. The AFMETCAL standardized frequency list is included in Appendix A. (Also reference paragraphs 3 and 5.3.2.)

5.3.2. Manually test for better or best uncertainties from 10 kHz through 18 GHz similar with current NPL uncertainties (best effort) but approximately at 10 kHz with U of 0.6% (k=2) to 50 MHz with U of 0.18% (k=2) to 18 GHz with U of 0.58% (k=2). Use the AFMETCAL standardized frequency lists. The AFMETCAL standardized frequency list is included in Appendix A.

5.3.3. Develop new 10 kHz to 18 GHz transfer standard from discrete components. Reference paragraph 3.1.2.

5.3.4. The deliverables for Phase 3 are:

5.3.4.1. Data showing manual proof of concept calibrations using stated artifacts are as expected by comparison to Contractor NMI primary Type‐N Microcalorimeter and within historical agreement (where history on artifacts is available).

5.3.4.2. Data sets are required showing proof of concept using all combinations of RF thermal lines and transfer standards for all DUT RF power sensors referenced above establishing full functionality.

5.3.4.3. Data confirming the transfer standard is characterized and operating as intended.

5.4. Phase 4 –System Integration. This phase is dedicated to full‐scale system integration, formal testing and validation, evaluation and verification, and final uncertainties budget determination.

5.4.1. Fully integrate Type‐N Microcalorimeter System validating functionality and verifying performance against highest level primary standard of NMI with test report. Include testing of DUT power sensor artifacts M1130A and NRP‐18T. These DUT artifacts are to be calibrated by the AFMETCAL Type‐N Microcalorimeter system and compared to NMI primary standard, as well as for agreement with artifact history where available.

5.4.1.1. Testing and evaluation shall be expanded to include comparison of both RF lines inside the microcalorimeter as well as both transfer standards when in system use.

The same DUT M1130A and NRP‐18T power sensor artifacts shall be tested at same frequency points on the power meter NRP‐2 with power sensors NRP‐Z51 and NRP‐ 18T for agreement. All testing and evaluation shall be verified using AFMETCAL standardized frequency list itemized in paragraph 3.9 and any others deemed appropriate by Contractor upon concurrence from AFMETCAL at +10 dBm showing agreement with target uncertainty goals and history where available. Agreement shall be within the following target uncertainties: at 10 kHz with U of 0.6% (k=2) to 50 MHz with U of 0.18% (k=2) to 18 GHz with U of 0.58% (k=2). The same tests and frequency points may also be performed in the AFPSL during acceptance testing for agreement and repeatability.

5.4.2. Final uncertainty budget(s) shall be determined for the Type‐N Microcalorimeter system from 10 kHz through 18 GHz. The target uncertainties are: 10 kHz with U of 0.6% (k=2) to 50 MHz with U of 0.18% (k=2) to 18 GHz with U of 0.58% (k=2). These final uncertainty budget(s) shall include the best VNA characterization techniques and are expected to show reductions in overall uncertainties below 50 MHz from original delivery. Uncertainty budget(s) shall be reported for each of differing line components and transfer standard combinations to clearly show the optimum combination that results in the overall lowest uncertainty for preferred daily use in the AFPSL.

5.4.3. The deliverables for Phase 4 are:

5.4.3.1. Report of testing and validation, evaluation and verification for functionality and performance of Type‐N Microcalorimeter system using both line components, both transfer standards and both DUT power sensor artifacts M1130A and NRP‐18T against NMI primary standard(s) and history where available.

5.4.3.2. Report discussing performance of new source and metrology grade low frequency amplifier if necessary to be employed.

5.4.3.3. Report of final uncertainty budget(s).

5.5. Phase 5 – Quantification of Low Frequency Extension. Phase 5 shall be dedicated to determination of DC/LO approach, standards, methodologies, setups, connector interfacing, techniques, etc., and step‐by‐step procedures that result in lowest uncertainties and most accurate quantification of RF calibration factors from 1 MHz down through 10 kHz. (Reference paragraph 3.8 and subparagraphs.) Phase 5 shall also include meticulous quantification of the DC/LO uncertainties and rigorous comparison of these against the measurements and uncertainties reported by the AFMETCAL Type‐N Microcalorimeter as well as measurements and uncertainties made using the NMI primary Microcalorimeter system from 1 MHz down through 10 kHz. The DUT power sensor artifact(s) that shall be included in this traceable accuracy comparison shall be M1130A and NRP‐18T.

5.5.1. Research DC/LO best approach, best standards, best methodologies, best setups, best connector interfacing, best techniques, etc. to determine optimum combination, most accurate quantification, and lowest uncertainties in calibrating the DUT RF power sensors;

and traceably evaluate the calibrations made from 1 MHz down through 10 kHz. The following frequencies shall be used, at a minimum, and any others deemed appropriate by Contractor upon concurrence from AFMETCAL: 10 kHz, 20 kHz, 30 kHz, 40 kHz, 50 kHz, 60 kHz, 70 kHz, 80 kHz, 90 kHz, 100 kHz, 500 kHz, 1 MHz.

5.5.2. Determination of basis for quantifying RF agreement with known DC/LO standards and artifacts in the AFPSL is required. After research required by paragraph 5.5.1 has been completed, a teleconference with AFMETCAL shall be executed to discuss recommendations, answer questions and concur if recommendations are reproducible in the AFPSL from 1 MHz down through 10 kHz. If not, discussion respective to a best alternate DC/LO approach, standards, methodologies, traceability path to primary voltage and impedance standards, available artifacts with lowest uncertainties, and what can be accomplished in the AFPSL will ensue leading to concurrence of this respective overall process. This will ensure the AFPSL can traceably validate and verify the best basis for quantifying true agreement of approaches. (Also reference paragraph 3.8)

5.5.3. A comparison procedure shall be developed that documents the most accurate step‐by‐ step quantification of calibration factors on DUT RF power sensors from 1 MHz down through 10 kHz which result in lowest uncertainties possible within the possible constraints of the AFPSL agreed in the teleconference noted in paragraph 5.5.2. The procedure shall compare the RF DUT power sensors calibrated using thermal equivalence measurements made using the AFMETCAL Type‐N Microcalorimeter against the measurements made using dedicated traceable DC/LO standards and artifacts for agreement. The frequencies noted in paragraph 5.5.1 shall be used.

5.5.4. Site Visit – The contractor shall allow for an optional site visit by AFMETCAL personnel near the end of this phase, if deemed value‐added during communication with Contractor in evaluating progress and in providing technical expertise regarding everything up to and included in this phase. The timing of the visit shall be strategically chosen to maximize visibility and input into all aspects of the project (possibly regarding the Type‐N Microcalorimeter lines, transfer standards, software and within scope desired changes, as well as the DC/LO standards and methodologies correlations). AFMETCAL would pay for their own travel and lodging in this event.

5.5.5. The deliverables for Phase 5 are:

5.5.5.1. Basic procedure for performing a best basis for comparison of power sensor calibrations using the AFMETCAL Type‐N Microcalorimeter to agreed DC/LO calibrations process including recommended standards (to include VNA, RLC, etc.), as well as other itemized directives in paragraph 3.8 and subparagraphs and 5.5 and subparagraphs.

5.5.5.2. Additionally, a report shall be generated respective to standards, test methodologies, results, uncertainties, and conclusions.

5.6. Phase 6 – Documentation, procedures, techniques, and reports.

5.6.1. The deliverables for Phase 6 are:

5.6.1.1. Updated Operation Manual. (If applicable)

5.6.1.2. Updated Maintenance Manual. (If applicable)

5.6.1.3. Updated Software Operation. (If applicable)

5.6.1.4. Updated Theory of Operation. (If applicable)

5.6.1.5. Updated System Uncertainties. (If applicable)

5.6.1.6. Procedure in sufficient detail for AFMETCAL to build a “new” transfer standard in the future if needed.

5.6.1.7. Procedure in sufficient detail for AFMETCAL to fully characterize transfer standard, and DUT reflection coefficient using best VNA techniques that result in lowest overall uncertainties.

5.6.1.8. Procedure for comparison of RF DUT power sensor calibrations to DC/LO primary standards/artifacts including recommended standards with lowest uncertainties.

5.6.1.9. Generalized uncertainties of gamma correction, where they came from and how to change them in software (globally or everywhere needed) should we need/desire to.

5.6.1.10. All technical documentation shall be provided in both hardcopy and electronic format.

5.6.1.11. Final Report:

5.6.1.11.1. Comparing AFMETCAL vs Contractor system for agreement respective to DUT measurements and uncertainties. If there are appreciable difference between the two systems at any frequency point please provide narrative as to explanation.

5.6.1.11.2. Compare the two RF lines within the AFMETCAL calorimeter against each other and provide narrative.

5.6.1.11.3. Any appreciable differences between the two transfer standards.

5.6.1.11.4. General observations regarding the two systems respective to the three DUT’s stability and measurement agreement.

5.6.1.11.5. A report of appreciable differences in calibration factor respective to 1 MHz down to 10 kHz. A narrative of the value added in routinely calibrating all power sensors warranted down to 10 kHz or lower is requested, as opposed to cutting off calibrations at 100 kHz and considering these calibration factors and uncertainties good down to 10 kHz or even possibly down to DC.

5.6.1.11.6. A report of appreciable differences in reflection coefficient measured using low frequency AC methodologies vs using standard commercially available SOLT calibration kits vs custom chosen calibration standards specifically characterized for use below 100 kHz.

5.6.1.11.7. Is ultra‐precise quantification of the calibration factors below 100 kHz necessary or is current quantification down to 100 kHz and using a blanket statement stating performance from 100 kHz down to 10 kHz as essentially being equivalent good enough?

5.7. Phase 7 – Delivery, Install and Setup, Acceptance Testing, Training.

5.7.1. The deliverables for Phase 7 are:

5.7.1.1. Shipment of complete system to the AFPSL.

5.7.1.2. Contractor install/assemble and setup calorimeter system at the AFPSL.

5.7.1.3. Acceptance testing by calibrating DUT power sensor artifacts M1130A and NRP‐ 18T previously calibrated at NMI level and uncertainties. Calibrations performed shall repeat within system uncertainties and previous calibrations of NMI primary standard and Type‐N Microcalorimeter System measurements from Phase 4. Reference paragraph 5.4.3.1.

5.7.1.4. Training. Reference paragraphs 3.10 and subparagraphs.

6. Milestone Charts. Updated milestone charts will be provided at time of award.

6.1. FY 2021 Phases and milestones:

Phase / Milestone Q3

Apr‐Jun

Q4 Jul‐Sep

Q1 Oct‐Dec

Q2 Jan‐Mar

Equipment Acquisition and AFMETCAL ship system and artifact(s).

X

Hardware and Software Development:

Develop, install, test/characterize new thermal line. Change software drivers as needed for seamless operation, update spreadsheet. Update Software.

Begin Documentation.

X

6.2. FY 2022 Phases and milestones:

Phase / Milestone Q3

Apr‐Jun

Q4 Jul‐Sep

Q1 Oct‐Dec 2021‐22

Q2 Jan‐Mar

Procure components. Remap calorimeter to include NPL and AFMETCAL standardized frequency lists at +10 dBm.

Initial manual proof of concept measurements. Develop/Characterize.

X

System Integration.

Testing and evaluation of both lines against NMI system(s).

X X

Development of Low Frequency Extension capability and procedures.

Telecon to agree on approach.

Site visit at AFMETCAL option.

Comparison of RF and LO methodologies 1 MHz through 10 kHz.

X X

Documentation, procedures, techniques, and reports Develop final uncertainties.

X

Delivery, Install and Setup, Acceptance Testing, Training.

X

7. Reviews, Meetings and Reporting Requirements.

7.1. Quarterly Progress Reports shall be provided. Quarterly reports shall include at a minimum: the project title and number, reporting period, report generation date, a summary of technical progress, any milestone problem (technical, financial, schedule), and plans for the following quarter.

7.2. End of phase teleconference.

7.3. Draft copies of required documentation shall be provided at least one week prior to any scheduled reviews/acceptance.

7.4. All documentation may be in Contractor’s format.

Appendix A – AFMETCAL Standardized Frequency List

10 KHz 75 MHz 1.8 GHz 7.4 GHz 14.4 GHz 20 KHz 80 MHz 1.85 GHz 7.6 GHz 14.5 GHz 30 KHz 85 MHz 1.9 GHz 7.8 GHz 14.6 GHz 40 KHz 90 MHz 2 GHz 8 GHz 14.75 GHz 50 KHz 95 MHz 2.1 GHz 8.2 GHz 14.8 GHz 60 KHz 100 MHz 2.2 GHz 8.4 GHz 15 GHz 70 KHz 150 MHz 2.3 GHz 8.6 GHz 15.2 GHz 80 KHz 200 MHz 2.4 GHz 8.8 GHz 15.25 GHz 90 KHz 250 MHz 2.5 GHz 9 GHz 15.4 GHz 100 KHz 300 MHz 2.6 GHz 9.2 GHz 15.5 GHz 200 KHz 350 MHz 2.7 GHz 9.4 GHz 15.6 GHz 300 KHz 400 MHz 2.8 GHz 9.6 GHz 15.75 GHz 400 KHz 450 MHz 2.9 GHz 9.8 GHz 15.8 GHz 500 KHz 500 MHz 3 GHz 10 GHz 16 GHz 600 KHz 550 MHz 3.1 GHz 10.2 GHz 16.2 GHz 700 KHz 600 MHz 3.2 GHz 10.4 GHz 16.25 GHz 800 KHz 650 MHz 3.3 GHz 10.6 GHz 16.4 GHz 900 KHz 700 MHz 3.4 GHz 10.8 GHz 16.5 GHz 1 MHz 750 MHz 3.5 GHz 11 GHz 16.6 GHz 2 MHz 800 MHz 3.6 GHz 11.2 GHz 16.75 GHz 3 MHz 850 MHz 3.7 GHz 11.4 GHz 16.8 GHz 4 MHz 900 MHz 3.8 GHz 11.6 GHz 17 GHz 5 MHz 950 MHz 3.9 GHz 11.8 GHz 17.2 GHz 6 MHz 1000 MHz 4 GHz 12 GHz 17.25 GHz 7 MHz 1030 MHz 4.2 GHz 12.2 GHz 17.4 GHz 8 MHz 1050 MHz 4.4 GHz 12.4 GHz 17.5 GHz 9 MHz 1090 MHz 4.6 GHz 12.6 GHz 17.6 GHz 10 MHz 1.2 GHz 4.8 GHz 12.75 GHz 17.75 GHz 15 MHz 1.225 GHz 5 GHz 12.8 GHz 17.8 GHz 20 MHz 1.25 GHz 5.2 GHz 13 GHz 18 GHz 25 MHz 1.3 GHz 5.4 GHz 13.2 GHz 30 MHz 1.35 GHz 5.6 GHz 13.25 GHz 35 MHz 1.4 GHz 5.8 GHz 13.4 GHz 40 MHz 1.45 GHz 6 GHz 13.5 GHz 45 MHz 1.5 GHz 6.2 GHz 13.6 GHz 50 MHz 1.55 GHz 6.4 GHz 13.75 GHz 55 MHz 1.6 GHz 6.6 GHz 13.8 GHz 60 MHz 1.65 GHz 6.8 GHz 14 GHz 65 MHz 1.7 GHz 7 GHz 14.2 GHz 70 MHz 1.75 GHz 7.2 GHz 14.25 GHz