Attachment0012DataCollectionScorecard.pdf

MFLTS Technical Demonstration Data Collection Scorecard

System 1

Make / Model /OS:

Processor:

RAM QTY:

Hard Drive Size:

OFFEROR ID:_____________ DATE: _____________________

Offeror's Participates (Print):

(1)_______________________________, (2)_______________________________, (3)_______________________________, (4)_______________________________

SIGNATURES: Signature indicates offeror submits results and data for review by the Government during the pending source selection evaluation process

OFFEROR:.

______________________________________ DATE:____________

GOVERNMENT REPRESENTATIVE:

_______________________________________ DATE:____________

System 2

Make / Model /OS:

Processor:

RAM QTY:

Hard Drive Size:

LANGUAGE: ___________________________________________

C. File-Type Check (FTC) Test Results: The FTC requires the Offeror to process a set of Govt provided documents through the proposed COTS LP.

1. Corpus 5a (Yes/No)

a. *TXT (UTF-8): _________

b. RTF: _________

c. HTML: _________

2. Corpus 5b (Yes/No)

a. **TIFF: _________

b. PNG: _________

c. JEPG: _________

d. PDF: _________

*Demonstrated during RCT Processing of Corpus 3

**Demonstrated during RCT Processing of Corpus 4

A. Reading Comprehension Test (RCT) Results: After completion of the demonstration a RCT consisting of 25 questions per Corpus aligned to the Offeror’s English language output will be prepared and administered to four (4) Test Subjects, resulting in an average RCT score for the LP to be recorded below.

1. Corpus 3 (MT, processing TXT (UTF-8 files)

a. English Translation Output:

____________(Yes/No)

b. RCT MT AVG Score:

2. Corpus 4 (OCR+MT, processing TIFF files)

a. English Translation Output:

____________(Yes/No)

b. RCT OCR+MT AVG Score:

B. Processing Speed (Words per Minute (WPM)) test and Data Collection Results: Processing Speed (WPM) metric is calculated by dividing the number of words in a Corpus by the total processing time that was recorded during this test. Word counts for all files are provided in the WPM Spreadsheet.

1. Corpus 3 (MT, processing TXT (UTF-8 files)

____________WPM

2. Corpus 4 (OCR+MT, processing TIFF files)

____________WPM

Note: The Corpus 3 and Corpus 4 Processing Speeds will become the performance requirements for Processing Speed and shall be used in the Contractor’s Qualification Test.

D. End of LP Demo Check to verify:

All Offeror generated metrics and output files are recorded and provided to Government

Backup Data and files are an exact copy of Offeror provided output

Offeror has purged Government provided Corpora from laptop computers

Data Collection Scorecard has been filled in and signed by offeror and Government representative