Performance Modeling Requirements Presentation.pdf

Resolution Measurements

•FOV

•MTF

•CTF

Flat Field Temporal Response

Human Response •Machine Vision

MRC/MRT

•MRT

•MRC

Signal +Noise Characterization

•SITF

•3D Noise •Lux/Photon Transfer

Temporal Characterization •Time constant •Integration time

Alignment •Uniformity •Image Boresight •Distortion / OCLOSS •Parallax

0 0.2 0.4 0.6 0.8 1

0.2

0.4

0.6

0.8 v τ∝ ⋅

Spectral Response •IR with FTIR •VIS color accuracy •VIS spectral response

ASEF Laboratory Measurements

6 8 10 12 14 16

0.2

0.4

0.6

0.8

Wavelength [micrometers]

N or m al iz ed

R es po ns iv ity

0 10 20 30 40 500

0.2

0.4

0.6

0.8

Spatial Frequency [~/mrad]

Theory Measured

Image Shift

Laboratory Measurements Collimator set target to image at infinity Utilize 4-bar target or circular target

• Capture reference image without clip-on

• visible camera (infinity focused)

• visible source

• Use visible camera to image clip-on display

• Calculate shift and convert to angular units

• Repeat to reduce alignment errors

Shots on target vs. Lab Measurements

• Tested 9 (7 variations) sites

• 0.02 - 4.1 mrad magnitude shifts

• ~0.2 mrad median

• Good agreement both in magnitude and direction

• Agreement improved along with an increase in system resolution

Video stream

- Most standard commercial formats supported

- Custom filters available

- Open source base

Video Capture Cards

- National Instruments

- Epix

- Blackmagic DeckLink

- Active Silicon

- EDT

- Teledyne DALSA

- Euresys

Hardware communication

- SBIR

- EOI

- CI systems

Plugin architecture

- Compiled Matlab (rapid turn around)

Live Video

- “Real time” metrics

- “Best” MTF tracking

Eventually government open source ***Outputs a measured system blackbox component for NVIPM

NVLabCap

Video stream

- Most standard commercial formats supported

- Custom filters available

- Open source base

Video Capture Cards

- National Instruments

- Epix

- Blackmagic DeckLink

- Active Silicon

- EDT

- Teledyne DALSA

- Euresys

Hardware communication

- SBIR

- EOI

- CI systems

Plugin architecture

- Compiled Matlab (rapid turn around)

Live Video

- “Real time” metrics

- “Best” MTF tracking

Eventually government open source ***Outputs a measured system blackbox component for NVIPM

NVLabCap

• The notes that follow are intended to aid Offerors in submitting conforming information for the Government to use in modeling their submitted/offered sensors.

• The NVTherm IP model predicted range performance will be used by the evaluators in assessing the sample hardware and proposed systems’ capabilities to meet performance range specifications.

Offerors shall provide an NVTherm input, output and narrative file set corresponding to EACH of the various model runs. Model runs shall be provided for each sensor, mode, FOV, input atmosphere, target, etc.

See matrix provided in “General Note 9” below. For each of the identified offer input fields, Offerors MUST insert real values, specified correctly.

• Use NVTherm IP dated August 2009. Available via email to brian.p.teaney.civ@mail.mil.

• Any Offeror questions about this guide are to be directed to the Contracting Officer via IBOP.

INTRODUCTION

Modeling Input mailto:brian.p.teaney.civ@mail.mil

This guide uses illustrative screen grabs from the NVTherm IP user interface to provide tips on proper inputs for the corresponding input fields.

1. Key to abbreviations:

• CFI = Contractor Fill In

• GFI = Government Furnished Input

• N/A = Not Applicable (value present does not matter)

2. All non-integer numerical input values shall be to 4 significant figures (unless otherwise indicated).

3. The values in the fields of this document are comprised of GFI, CFI and N/A:

GFI = Value(s) to be used for all cases except as indicated CFI = Arbitrary examples are provided; intended to be replaced by real data to be provided by the Contractor. Note: These may not be realistic “default” values.

N/A = Value entered does not matter; field does not factor into calculations.

sF = Denotes number Significant Figures required for entry.

GENERAL NOTES

4. In places where narrative is required, place in a MS Word file.

5. Frame rate is the rate associated with the FPA, not the video. As a example, if the FPA is queried at 30hz and displayed at 60hz, the appropriate frame rate is 30hz with electronic interlace.

6. Electronic interlace is used for staring systems when both the FPA and video are operating with multiple (unique) fields per frame. As an example, if 480 detector rows are being displayed via RS-170, and alternate rows are read out for each of 2 video fields, electronic interlace is being applied.

7. Detector pixel dimensions used by the model are the active regions. Detector pitch will be calculated internally by the model.

8. When using Optics after the display (eyepiece), the following changes need to be made in order to account for this additional optic:

a) An additional MTF should be added to the Postsample Vertical and Horizontal MTFs, reflecting the MTF of the additional eyepiece optics.

b) If the added eyepiece optic contributes to the overall magnification of the system, the System Magnification on the System Parameters page should reflect the overall (magnification) change. In other Words, if a user resets the System Magnification on the System Parameters page back to Zero, then the magnification due to the eyepiece optic should be the newly inputted magnification divided by the calculated magnification from NVThermIP.

GENERAL NOTES - continued

GENERAL NOTES - continued

Input Files Output Files Narrative FWSI_PS_CL_MAN.txt LWTS_PS_CL_MAN.out FWSI_PS_CL_MAN.doc FWSI_PS_SM_MAN.txt LWTS_PS_SM_MAN.out FWSI_PS_SM_MAN.doc FWSI_PS_AW_MAN.txt MWTS_PS_AW_MAN.out FWSI_PS_AW_MAN.doc

LEGEND:

PS = Proposed Systems MAN = Man-size target CL = Clear SM = Smoke AW = Adverse Weather

9. Submit all files listed below and Table of Contents (TOC).xls in the NV Therm.zip

NOTE

-Files provided for Smoke modeling should contain the worst case of the listed obscurants.

LEGEND:

PS = Proposed Systems CL = Clear SM = Smoke MAN = Man-size target

Sheet1

Input Files Output Files Narrative

FWSI_PS_CL_MAN.txt LWTS_PS_CL_MAN.out FWSI_PS_CL_MAN.doc

FWSI_PS_SM_MAN.txt LWTS_PS_SM_MAN.out FWSI_PS_SM_MAN.doc

FWSI_PS_AW_MAN.txt MWTS_PS_AW_MAN.out FWSI_PS_AW_MAN.doc

LEGEND:

PS = Proposed Systems MAN = Man-size target

CL = Clear

SM = Smoke

AW = Adverse Weather

Sheet2

LWTS MWTS HWTS

Max Range 0.6 1.2 2.4

Range Increment 0.012 0.024 0.048

Sheet3

Sheet1

Input Files Output Files Narrative

LWTS_PS_CL_MAN.txt LWTS_PS_CL_MAN.out LWTS_PS_CL_MAN.doc

LWTS_PS_SM_MAN.txt LWTS_PS_SM_MAN.out LWTS_PS_SM_MAN.doc

MWTS_PS_CL_N_MAN.txt MWTS_PS_CL_N_MAN.out MWTS_PS_CL_N_MAN.doc

MWTS_PS_CL_W_MAN.txt MWTS_PS_CL_W_MAN.out MWTS_PS_CL_W_MAN.doc

MWTS_PS_SM_N_MAN.txt MWTS_PS_SM_N_MAN.out MWTS_PS_SM_N_MAN.doc

MWTS_PS_SM_W_MAN.txt MWTS_PS_SM_W_MAN.out MWTS_PS_SM_W_MAN.doc

HWTS_PS_CL_N_MAN.txt HWTS_PS_CL_N_MAN.out HWTS_PS_CL_N_MAN.doc

HWTS_PS_CL_N_VEH.txt HWTS_PS_CL_N_VEH.out HWTS_PS_CL_N_VEH.doc

HWTS_PS_CL_W_MAN.txt HWTS_PS_CL_W_MAN.out HWTS_PS_CL_W_MAN.doc

HWTS_PS_CL_W_VEH.txt HWTS_PS_CL_W_VEH.out HWTS_PS_CL_W_VEH.doc

HWTS_PS_SM_N_MAN.txt HWTS_PS_SM_N_MAN.out HWTS_PS_SM_N_MAN.doc

HWTS_PS_SM_N_VEH.txt HWTS_PS_SM_N_VEH.out HWTS_PS_SM_N_VEH.doc

HWTS_PS_SM_W_MAN.txt HWTS_PS_SM_W_MAN.out HWTS_PS_SM_W_MAN.doc

HWTS_PS_SM_W_VEH.txt HWTS_PS_SM_W_VEH.out HWTS_PS_SM_W_VEH.doc

LWTS_SH_CL_MAN.txt LWTS_SH_CL_MAN.out LWTS_SH_CL_MAN.doc

LWTS_SH_SM_MAN.txt LWTS_SH_SM_MAN.out LWTS_SH_SM_MAN.doc

MWTS_SH_CL_N_MAN.txt MWTS_SH_CL_N_MAN.out MWTS_SH_CL_N_MAN.doc

MWTS_SH_CL_W_MAN.txt MWTS_SH_CL_W_MAN.out MWTS_SH_CL_W_MAN.doc

MWTS_SH_SM_N_MAN.txt MWTS_SH_SM_N_MAN.out MWTS_SH_SM_N_MAN.doc

MWTS_SH_SM_W_MAN.txt MWTS_SH_SM_W_MAN.out MWTS_SH_SM_W_MAN.doc

HWTS_SH_CL_N_MAN.txt HWTS_SH_CL_N_MAN.out HWTS_SH_CL_N_MAN.doc

HWTS_SH_CL_N_VEH.txt HWTS_SH_CL_N_VEH.out HWTS_SH_CL_N_VEH.doc

HWTS_SH_CL_W_MAN.txt HWTS_SH_CL_W_MAN.out HWTS_SH_CL_W_MAN.doc

HWTS_SH_CL_W_VEH.txt HWTS_SH_CL_W_VEH.out HWTS_SH_CL_W_VEH.doc

HWTS_SH_SM_N_MAN.txt HWTS_SH_SM_N_MAN.out HWTS_SH_SM_N_MAN.doc

HWTS_SH_SM_N_VEH.txt HWTS_SH_SM_N_VEH.out HWTS_SH_SM_N_VEH.doc

HWTS_SH_SM_W_MAN.txt HWTS_SH_SM_W_MAN.out HWTS_SH_SM_W_MAN.doc

HWTS_SH_SM_W_VEH.txt HWTS_SH_SM_W_VEH.out HWTS_SH_SM_W_VEH.doc

LEGEND:

PS = Proposed Systems Files in "green" are based on SH submitted

CL = Clear

SM = Smoke

MAN = Man-size target

Sheet2

LWTS MWTS HWTS

Max Range 0.6 1.2 2.4

Range Increment 0.012 0.024 0.048

Sheet3

Sensor Naming Convention for this field (DO NOT put UVCTF in the Sensor Name field)

Circled are GOVT FURNISHED

INPUTS (GFI).

Type of Imager

• CFI – Cuton and Cutoff values should represent the 50% normalized spectral response for the detector, optics, and additional filters.

• CFI – If ‘0’ is entered, the magnification will be calculated within the program. Narrative is required if a system magnification other than ‘0’ is entered. (See General Note 8)

• CFI – An input deck needs to be created for each set of optical FOVs

• CFI – Narrative required.

(See General Note 5)

• GFI

• CFI – Interlace applies only to the sensor display.

(See General Note 6)

• CFI (2sF) – The Optics Blur – Spot Size should be the geometric blur only, as the program will calculate the diffraction spot size.

-- The Average Optical Transmission entry should be the transmission over the spectral cuton and cutoff, and should not include the eyepiece.

• GFI

• CFI (3sF) Recalculate for each optical field of view

• This quantity is usually the diameter of the aperture stop. It is auto-calculated using CFI f-number and focal length.

• GFI = “0”

• CFI. Optional.

However, if provided, submit narrative as to method of data collection.

• CFI (3sF)

• CFI (3sF)

• N/A

• N/A

• CFI

• CFI (3sF)

• CFI – Should use #’s from OPTICS and SYSTEM

PARAMETERS

screens. If different, narrative required as to rationale.

• GFI

• N/A

(See General Note 7)

• N/A

• CFI

• CFI for all sensor display inputs.

Interpolation is associated with spatial repeat of the detector data to increase the number of display pixels.

Electronics Interpolation

• CFI

• CFI -

E-zoom is used to increase the effective magnification of the system electronically.

Choose model used for interpolation and magnification of zoom.

• GFI = No• Display Type - For AMLCD or OLED use Flat Panel.

• CFI

• GFI = 1

• N/A

• N/A

• CFI

• CFI – Display Spot Height is the pixel size of the flat panel display. For a CRT, this value should be measured per the CRT Gaussian Dimension checked

(CFI).

-- Display Height should represent the area of the physical display used for active FWS imagery.

• CFI. Optional. However, if provided, submit narrative as to method of data collection.

narrative as to method of narrative as to method of

(See General Note 8)

• CFI. Optional.

However, if provided, submit narrative as to method of data collection.

(See General Note 8)

• GFI =

“1.0E-14”

• GFI

• GFI = “5 KM Urban”/ “US Standard 1976”

•Run with and w/o smoke

• GFI = Yes, then No (Run with and without smoke)

• N/A

• GFI = When running with Smoke (Yes) use the following parameters and report your worst performer:

• WP, α = 0.38, CL = 1.9

• HC, α = 0.02, CL = 20

• Fog Oil, α = 0.03, CL = 2

Auto-calculated by ModTran

• GFI = 2.0 degrees for man target

• GFI = 0.75

for man size target

• GFI = 1.53

cycles for Man Target

• GFI =0.02

• GFI = 3.5

degrees for all cases

• GFI –

“Gain Varies with Range”

• GFI = 300 K

• GFI = 2