Statement of work updated.pdf

SPECIFICATIONS FOR iMotions Software Suite

I. Background

The Food Quality Laboratory requires the iMotions software for sensory studies in accordance with the mission of the USDA. iMotions system is a unique, one-of-a-kind software product that works in conjunction with specific eye tracking, electrocardiography (ECG), electromyography (EMG), and electroencephalography (EEG) hardware to instantly integrate all inputs with facial expression, electrodermal inputs, and sensory perception. iMotions has exclusive properties that make it the only product on the market that can meet the minimum needs of our laboratory. The iMotions system provides the following unique features: Quickly integrate digital eye motion, real world eye motion, ECG, EMG, and EEG responses to sensory stimuli as well as easily adapt to include facial expression and electrodermal activity analysis as modular additions. This system assists with synchronization of imaging evaluation from existing Ortery/Cannon systems in our laboratory, image artificial intelligence analysis using MIPAR software also already in our laboratory, and sensory evaluations routinely performed in our laboratory with eye motion, ECG, EMG, and EEG. The iMotions system uniquely supports sensory analysis, quality evaluation of foods, consumer preference, and data acquisition that may support artificial intelligence applications. This instrument is uniquely best suited to advance the mission of FQL and to support government applications.

II. Specifications and Requirements

1) Specifications needed to meet minimal laboratory requirements

•Must fully automate the integration of digital screen eye motion, real world eye motion, ECG, EMG, EEG, facial expression, and electrodermal activity with no need for additional processing.

•Must be compatible with existing computer systems: Base: Windows 10, Intel i7 generation 3, 8G RAM, 128GB Hard drive, NIVDA 9 series 2 GB, 1920x1080 monitor, 22” monitor, USB Logitech HD pro C920 webcam.

•Software must control the entire process – from integrating time stamps of eye motion, ECG, EMG, EEG and sensory stimuli to fully automating analysis of integrated data.

•Software must be compatible with and fully integrate: Tobii Pro Fusion 120Hz, Tobii Pro Glasses 3 50 Hz, Shimmer3 ECG Unit/ Shimmer3 EMG Unit Kit, NeuroElectrics Enobio 8, NeuroElectrics Enobio 8,20,32 Forehead positions (headband and electrodes).

-Software must include: iMotions Module – CORE, iMotions Module- Screen-Based Eye Tracking, iMotions Module -Eye Tracking Glasses, iMotions Module- Affectiva, iMotions Module – GSR, iMotions Module – EEG, iMotions Analysis-Only License

• Must include 3 hours of online, instructor led training and 2 days of applied research training.

• Must include free support and upgrades for one year.

• Must include warranty and support for all equipment and software purchased.

• Must synchronize data from the following sensors of interest: Eye Tracking glasses, Screen based eye tracking, Galvanic Skin Response, Facial Expression Analysis, and EEG. Must be able to allow for data collection, synchronization, evaluation all from one PC. The software helps to reduce the complexity of carrying out multimodal research, enabling a wide array of sensors to be seamlessly connected.

• Must have moment-to-moment visualization of raw and aggregated data. Must visualize real-time recordings (both raw data and metrics) during data collection or replay the sessions as desired. Must be able to export aggregated sensor data directly from replay, completely or in part.

• Must enable multiple biosensors to be seamlessly synchronized into a single platform, ensuring that multimodal research can be carried out as simply as possible.

• Must have analysis algorithms are written in R, and completely transparent (both in Code and in written form). Must give the peer-reviewed reference for derivation of the algorithm and have R-notebook Analysis blog post for more detail on the algorithms included.

• Must have a strong onboarding process to enable our clients and make sure they’re comfortable conducting their own research. Must have a dedicated team of customer success managers who will support both the software, hardware, and integration.

• Must have Advanced Synchronization Capabilities

• Must allow for data to be stored locally on your PC and be able to do an unlimited number of studies and collect data from as many participants as you would like.

The software must allow for the following unique benefits:

• Easily collect data from multiple sensors like eye tracking, facial expression analysis, GSR, and EEG

• Automatic and real-time synchronization of all sensor data

• All operate on one single PC and in one single software application

• Allow for more advanced research done in an easier way

- Software must enable biometric researchers to setup studies, collect, analyze, and visualize data. The software must include the following functionalities:

• Study Setup & Design

• Stimulus Presentation

• Data Collection

• Analysis & Visualization Tools

-Must come with core modules that do the following:

• Study design - build advanced study designs (within- and between-subject, block, randomized etc)

• Stimuli presentation - multimedia capabilities including images, videos, live websites, surveys, mobile phone apps, software interfaces, gaming, VR, AR, etc. Up to 3 camera feeds supported

• Data collection – respondent management, real-time viewing, behavioral metrics, etc.

• Markup & annotations - create live or post-processing markers with annotations

• Data analysis - variety of automated features and easy-to-use tools

• Data export - export raw data, summary metrics, data visualizations on video and static stimuli, etc

• Data import - import external data sources for visualization / synchronization

• Face/environment camera - includes ability to record respondent’s face and / or environment from up to three different camera feeds

• Surveys - program and launch surveys in conjunction with, or separately from, biometric research

•Integrate almost any device, and send data live into iMotions for full synchronization

• Forward all synchronized events out of iMotions

• Visualize all data streams live

• TTL trigger for sending integration signals via other programs for synchronization accuracy

• LSL (Lab streaming layer) integration options for receiving timeline signals real-time from any LSL supported device. Integrate even more devices into iMotions

• Remote Control: Allows external programs to control iMotions software

-Screen based eye tracker must enable the following functions:

• Integration with 20+ eye tracking

• Advanced analytic tools for screen-based multimedia stimuli (images, videos, websites, games, software interfaces and 3D environments)

• Real-time visualization of key eye tracking metrics such as live gaze, pupil size, and distance to screen

• Website aggregation supported with Chrome, Firefox and Edge

• Static and dynamic areas of interest (AOIs) and heatmaps

• Automated and real-time metrics such as time to first fixation, time spent, ration, revisits, fixation count, mouse clicks, keystrokes etc.

• Export all raw data and metrics

• Scene video recording, segmentation, and editing

• Mobile device testing via mobile stand

• Automated gaze mapping on websites, both on screen and mobile phones for fast and automatic analysis

• Integrated quality assurance tools

-Eye tracking glasses must allow for performance of the following functions:

• Connection to eye tracking glasses such as Tobii Glasses, Pupil Lab Glasses, Viewpoint system and Argus Science ETVision

• Live streaming for qualitative insights and advanced analytic tools for insights in real-world environments

• Individual & aggregate gaze replays

• Static & dynamic areas of interest (AOIs) and heatmaps, with manual and semi-automated options

• Automated AOI generation allows for tracking of an area throughout a video

• Automated metrics such as Time to First Fixation, Time Spent, Ratio, Revisits, Fixation Count, Mouse Clicks

• Gaze mapping allows for automating aggregate views of in-person shelf testing. Calculate gaze mapping locally or in the cloud to speed up analysis of large-scale studies

• Raw data including X, Y coordinates on scenes and pupillometry

• Integrated quality assurance tools

-Software must include the following functionalities for analysis of expression:

• Connection to Affectiva Module via webcam

• Measure facial expressions towards screen-based or physical stimuli

• Import externally recorded videos for post processing of facial expressions

• Cloud-based processing for rapid analysis

• Valence: Positive, negative, or neutral response

• 7 Basic emotions: Joy, Anger, Surprise, Fear, Sadness, Disgust, Contempt

• Engagement: Overall expressiveness - is respondent neutral or engaged

• 21 Facial Expressions: Attention, Brow Furrow, Brow Raise, Inner Brow Raise, Eye Closure, Nose Wrinkle, Upper Lip Raise, Lip Suck, Lip Pucker, Lip Press, Mouth Open, Lip Corner Depressor, Chin Raise, Smirk, Smile

• 33 Facial Landmarks: Geometrical mapping of the face

• Interocular Distance: Distance between two outer eye corners for estimation of distance from screen

• Head Orientation: Head rotation as yaw (up/down), pitch (left/right), and roll

• Integrated quality assurance tools

-GSR electrodermal inputs must allow for the following:

• Connection to Shimmer3 GSR+ sensor, BIOPAC / Bionomadix GSR sensor, or Empatica E4

• Galvanic Skin Response (GSR) and Heart Rate capture via finger electrodes or wrist-based sensor

• Collect, visualize, and export raw signals

• Battery level and signal strength visualizations

• Automatic GSR Peak Detection

• Connect up to 5 Shimmer devices on one iMotions software license

• For BIOPAC: enables use of multiple sensors for capture and export of raw ECG, EMG, and Respiration data

• For Shimmer, enables additional channels: accelerometer, magnetometer, ambient temperature, and pressure

• For Empatica, a specific dongle is needed for using Empatica with iMotions. This is included if purchasing Empatica through iMotions. iMotions can source this dongle for already owned Empatica devices

• Integrated quality assurance tools

-EEG module must allow for the following:

• Connection to a variety of leading electroencephalogram (EEG) headsets

• Access raw signals and automated analysis tools

• Battery level, signal strength, and impedance visualizations

• Integrated quality assurance tools

-System must allow for remote analysis of data: Enables all analysis capabilities except post processing capabilities of Affectiva Facial Expression Analysis

Module. Allows user to create and preview studies that can then be transferred to the iMotions Core. Can be used remotely from iMotions core.

-Tobii eye tracking bar must include:

1. Sampling rate: 120Hz

2. Screen size: 24" (16:9 aspect ratio)

3. Connection type: USB Type-C

4. Dimensions: 374 mm L × 18 mm H × 13.7 mm W (14.72“ × 0.70“ × 0.53“)

5. Operating Distance: 50–80 cm

6. Head motion box: 30 cm × 25 cm (11.81” × 9.84”) at 65 cm

7. Accuracy: approximately 0.4° at optimal conditions

8. USB port system requirements: USB Type-C, USB 2.0 Type-A port

9. Tracking technique: binocular, pupil and corneal reflection eye tracking with dark and bright pupil tracking

10. Pupil diameter: yes

-Tobii glasses must include:

Sampling rate: 50 Hz

FOV: 95 deg. horizontal / 63 deg. vertical

Camera: 1920 ×1080 at 25 fps

Dimensions (Frame): 153 x 168 x 51 mm Dimensions (Recording unit): 130 x 85 x 27 mm

Eye tracking technique: Corneal reflection, dark pupil, stereo geometry

Pupil measurement: Absolute measure

- Shimmer ECG/EMG must include:

Summary: The Shimmer3 EMG (Electromyogram) sensor measures and records the electrical activity associated with muscle contractions, assesses nerve conduction, muscle response in injured tissue, activation level, or can be used to analyze and measure the biomechanics of human or animal movement.

The Shimmer3 EMG sensor is non-invasive (Surface) EMG and therefore is a representation of the activity of the whole muscle. It’s an efficient wireless solution for access to a host of muscle, gait, and posture data analysis.

Key Specs:

Sampling rate: up to 8000 SPS

Connection: Wireless

Certification: All Hospital-Grade 1mm Touchproof IEC/EN 60601-1 DIN42-802 jacks

EMG Capacity: 2 Muscles

EMG analog filtering: None

The kit includes:

1 Shimmer3 ECG/EMG Unit

1 Shimmer3 Dock

5 9” Biophysical Leads

2 18” Biophysical Leads

5 1M Biophysical Leads

3 EMG/ECG Electrodes Pack (50 in pack)

2 Alcohol Swabs pack (20 in pack)

1 Shimmer Wrist strap with Clip

1 Shimmer Waist strap with Clip

4GB USB stick

1 Kit Carrying Case

- NeuroElectrics EEG module must include:

Summary: Enobio is a wearable, wireless electrophysiology sensor system for the recording of EEG.

Using the superb Neuroelectrics Cap, Enobio 8 is ideal for out-of-the-lab applications.

Key Specs:

Channels: 8 EEG-channels

Sampling rate: 500 Hz

Connection: Wireless (Wi-Fi) or Wired (USB 2.0)hours

Weight: 65g

Operating type: 16 hours

Weight: 65g

Kit includes: Wearable and wireless 8-channel EEG recording system 1 x [NE009] ENOBIO 8 CH

NECBOX

1 x [NE014] CURVED SYRINGE 1 x [NE015] USB STICK WITH MANUALS & [NE001SW] NIC SW 1 x [NE016a]

ELECTRODE GEL 250g 1 x [NE017] 10 ELECTRODE CABLE 1x [NE019M] NEOPRENE HEADCAP SIZE M 8 x [NE032]

NG GELTRODE 50 x [NE025] STICKTRODE 1 x [NE027] EARCLIP 1 x [NE031b] USB WIFI DONGLE 1 x [NE055] WiFi

DEVICES POWER ADAPTER 1 x [NE164] USB ISOLATOR & CABLE

- Training must include: - Sensor Configuration

- Software Settings

- Study Design

- Data Collection

- Export Options

- Analysis

- Workshop training must include:

Day 1:

- Study Design Considerations

- Protocol drafting/study creation in iMotions

- Lab Assessment

- Sensor Configuration

- Software Settings

- Study Design

- Supervised data collection

Day 2:

- Continued Data Collection

- Analysis and Exports by Modality

- Data exports

- Data aggregation

- Data analysis

- Create Data Visualizations

- Data Interpretation Discussion

- Software updates must be free/included and released every 2-4 weeks

2) Efficiency, durability

This system has tech support, with with continually updated software.

3) Essential for research

The iMotions system is essential for the food quality research conducted in our laboratory, as the product will be used for sensory studies which may lead to artificial intelligence eCommerce studies, and quality studies.