20170525_Attach1_rvsd-PWS_DLPT_LR-UR_v9.pdf

W9124N-17-R-0100 Attachment 1

Version date: 25 May 2017

Performance Work Statement

DLPT5 Item Development of Lower and Upper Range Items Contract FY17

C.1. INTRODUCTION

The Defense Language Institute Foreign Language Center (DLIFLC) has a need for the creation of test items. DLIFLC has developed a reading and listening test, the Defense Language Proficiency Test (DLPT5), to assess the foreign language proficiency of military and Government linguists.

C.2. SCOPE

C.2.1. The Contractor shall develop up to 2,400 DLPT5 test items that conform to DLPT item development specifications (see Technical Exhibits 9 through 2221) and cover multiple Interagency Language Roundtable language proficiency (ILR) levels in seven (7) languages during the base period, and up to 2,310 items in seven (7) languages during option period 1.

The seven (7) languages for the base period are: (1) Egyptian, (2) German, (3) Hindi, (4) Levantine, (5) Saudi, (6) Spanish, and (7) Yemeni. The seven (7) languages for the option period 1 are: (1) Cebuano, (2) Chavacano, (3) Hebrew, (4) Korean, (5) Modern Standard Arabic,

(6) Portuguese-Brazilian, and (7) Tagalog.

Due to unforeseen geopolitical events, the Government may substitute languages by modification to this contract. In such a case, the Government reserves the right to reallocate the total number of required items among the other languages on the original delivery schedule in order to accommodate the total number for the substitute language. The Government will notify the Contractor at least 60 days in advance before a change is made.

C.2.2. Three (3) of the base period languages (1) German, (2) Hindi, and (3) Spanish — shall have items for reading comprehension and listening comprehension.

Four (4) of the base period languages — (1) Egyptian, (2) Levantine, (3) Saudi, and (4) Yemeni— shall have items for listening comprehension only.

ILR Level

Language Skill Item Type

Range 10 16 20 26 30 36 40 Total

Egyptian Listening MC Lower Range

30 30 60 60 60 0 0 240

German Listening MC Lower Range

30 30 60 60 60 0 0 240

German Reading MC Lower Range

30 30 60 60 60 0 0 240

Hindi Listening MC Lower Range

30 30 60 60 60 0 0 240

Hindi Reading MC Lower Range

30 30 60 60 60 0 0 240

Levantine Listening MC Lower Range

30 30 60 60 60 0 0 240

Saudi Listening MC Lower Range

30 30 60 60 60 0 0 240

Spanish Listening MC Full Range 20 20 40 40 40 40 40 240

Spanish Reading MC Full Range 20 20 40 40 40 40 40 240

Yemeni Listening MC Lower Range

C.2.3.1. Four (4) of the option period 1 languages (1) Hebrew, (2) Korean, (3) Modern Standard Arabic, and (4) Tagalog —shall have items for reading comprehension and listening comprehension. Three (3) of the option period 1 languages — (1) Cebuano, (2) Chavacano, and (3) Portuguese-Brazilian — shall have items for listening comprehension only.

ILR Level

Language Skill Item Type

Range 10 16 20 26 30 36 40 Total

Cebuano Listening CRT Lower Range

20 20 30 30 30 0 0 130

Chavacano Listening CRT Lower Range

20 20 30 30 30 0 0 130

Hebrew Reading MC Full Range 20 20 40 40 40 40 40 240

Hebrew Listening MC Full Range 20 20 40 40 40 40 40 240

Korean Reading MC Full Range 20 20 40 40 40 40 40 240

Korean Listening MC Full Range 20 20 40 40 40 40 40 240

Modern Standard Arabic

Reading MC Full Range 20 20 40 40 40 40 40 240

Modern Standard Arabic

Listening MC Full Range 20 20 40 40 40 40 40 240

Portuguese- Brazilian

Listening CRT Lower Range

20 20 30 30 30 0 0 130

Tagalog Reading MC Lower Range

30 30 60 60 60 0 0 240

Tagalog Listening MC Lower Range

C.3. APPLICABLE DOCUMENTS

DLIFLC will provide the following documents to the successful offeror:

Exhibit Number Description of Exhibit #of Pages in Exhibit

References Technical Exhibit 1 Delivery Schedule 2

Technical Exhibit 2 Defense Language Proficiency Testing 5 Framework 86 Technical Exhibit 3 Contract Discrepancy Reports 2 Technical Exhibit 4 Defense Language Proficiency Test 5 44 Technical Exhibit 5 DLPT5-MC-LR-INTRO 13 Technical Exhibit 6 DLPT5-CRT-LR-INTRO 26 Technical Exhibit 6Technical Exhibit 7

DLPT5-CRT-LR-INTRO

Rendering Guidelines

Security Specifications

Technical Exhibit 78 NDA-Test Security/Confidentiality Agreement 1 Item Development Specifications

Technical Exhibit 89 Text Modes 2 Technical Exhibit 910 DLPT5 Lower Range Multiple-Choice Test

Specifications

Technical Exhibit

DLPT5 Lower Range Constructed-Response Test Specifications

Technical Exhibit

DLPT5 Upper Range Multiple-Choice Test Specifications

Technical Exhibit

DLPT5 Upper Range Constructed-Response Test Specifications

Technical Exhibit

Style Guide 98

Technical Exhibit

Rules for Writing Multiple-Choice DLPT Items 12

Technical Exhibit

Rules for Writing Constructed-Response DLPT Items 9

Technical Exhibit 16 Rendering Guidelines 11 Technical Exhibit 17 Consolidated Item Review Criteria- MC 5 Technical Exhibit 18 Consolidated Item Review Criteria- CRT 5 Technical Exhibit 19 IBS Manual A-DTest Specs-FLO-Language Specs 5

Documents2 Technical Exhibit 20 Test Specs-FLO-Language Specs IBS Manual A-D 25

Documents Technical Exhibit 21 Domino A-B 2

Documents

C.4. DEFINITIONS

Document Description

Confidential Information

Broadly defined, confidential information includes all information that has or could have commercial value or other utility in the business in which the Government is engaged in, and all information of which the unauthorized disclosure would be detrimental to the interests of the Government, whether or not such information is identified as confidential information by the Government.

DLPT

Defense Language Proficiency Test. A high-stakes proficiency test used by the Department of Defense to assess reading and listening comprehension in a language.

ILR Scale

Interagency Language Roundtable (ILR) language proficiency scale that provides descriptions of language proficiency levels.

Levels range from “0” (no proficiency) to “5” (equivalent to a highly educated native speaker).

Test Material

Test material refers to elements that are essential in a test and its accompanying scoring rubrics. It includes but is not limited to target-language passages, renderings, transcriptions, audio files, item sets, information regarding the origin of the target-language passages, and copyright permissions for use of the target-language passages.

Passage

The written or spoken text on which the test items are based. For reading tests, passages consist of printed text in the target language as it is customarily written. For listening tests, passages are audio files as they will be heard by examinees.

Proprietary Information

All information and any idea in whatever form, tangible or intangible, pertaining in any manner to the business of the Government or the Contractor or Subcontractor, which was produced by any Contractor or subcontractor employee in the course of the employees’ employment or otherwise produced or acquired by or on behalf of the Government.

Rendering

A rendering is a coherent communication in English of the target language passage. The English text follows, as closely as possible, the lexical and grammatical structure of the target language, yet also adheres to rules of English grammar.

Explanations in English are provided for target language meanings, words, and/or grammatical structures rendered that are unfamiliar to a native-speaker of English.

Test Item The task for which the examinee provides a response, and the means for evaluating the response. For a multiple-choice test:

one stem (i.e., question) and four response choices.

Item Set The combination of orientation statement, target language passage, English rendering, all related stems, and all options (MC only) or key ideas and credit scheme (CRT only).

Target Language The language being tested.

Range of Passages

Number of passages required per language, per level and skill.

Multiple-Choice

A multiple-choice (MC) item contains a stem and a set of options.

Examinees are required to select the best answer or answers from the set of options. In the context of DLPT5 tests, an MC item contains a stem and 4 options, one of which is the best answer or key to the question posed.

Constructed- Response

A constructed-response (CR) item contains a stem and requires examinees to generate their own response. In the context of DLPT5 test items, the response can range from a short phrase to a couple of short sentences. A list of potential Key Ideas is developed for scoring, and a Credit Scheme is included to show scorers what is required.

C.5. TECHNICAL REQUIREMENTS

C.5.1. Development of DLPT5 Items:

C.5.1.1. For the base period, the contractor shall develop and submit target-language passages, DLPT5 test items, English renderings, and ILR ratings for DLPT5s in the following seven (7) languages: (1) Egyptian, (2) German, (3) Hindi, (4) Levantine, (5) Saudi, (6) Spanish, and (7) Yemeni.

C.5.1.2. The Contractor shall follow the item development specifications and language-specific information about accent, dialect, and typeface/font provided by DLIFLC. The Contractor shall also follow the specifications listed in the ILR descriptors and Child’s text mode for ILR rating of the target-language passages and items. (See Technical Exhibit 9.) Items in all Base Year languages shall be in a multiple-choice format.

C.5.1.3. For the option period, the Contractor shall develop and submit target-language passages, DLPT5 test items, English renderings, and ILR ratings for DLPT5s in the following seven (7) languages: (1) Cebuano, (2) Chavacano, (3) Hebrew, (4) Korean, (5) Modern Standard Arabic, (6) Portuguese-Brazilian, and (7) Tagalog.

C.5.1.4. The Contractor shall follow item development specifications and language-specific information about accent, dialect, and typeface/font provided by DLIFLC. The Contractor shall also follow the specifications listed in the ILR descriptors and Child’s text mode for ILR rating of the target-language passages and items. (See Technical Exhibit 9.) Items in Hebrew, Korean, Modern Standard Arabic, and Tagalog languages shall be in a multiple-choice format. Items in Cebuano, Chavacano, and Tausug languages shall be in constructed response format.

C.5.2. Item development team and qualifications:

C.5.2.1. The Contractor shall employ a qualified and experienced item development team to perform all required work and tasks involved in the contract. The team may include but not be limited to the following personnel: Target Language Experts, Item Writers, and Project Managers.

C.5.2.2. Target Language Experts (TLEs) qualifications. The Contractor shall employ qualified target language experts (TLEs) as part of the item development team.

C.5.2.3. Target Language Proficiency. TLEs must be proficient at an ILR level equivalent to level 4 or above in reading and listening in the target language.

C.5.2.4. English Language Proficiency. TLEs must be proficient at an ILR level equivalent to level 3 or above in listening, reading, and writing in English.

C.5.2.5. Item Writer qualifications. The Contractor shall employ qualified item writers as part of the item development team. The Contractor shall submit documentation of the qualifications of the item writers for Government approval, which may include resumes and/or curriculum vitae.

C.5.2.6. Item Writing Experience. Item writers must have at least 2 years of experience in item writing for language proficiency testing. Familiarity with the ILR scale is preferred.

C.5.2.7. The Contractor’s item development team must be technologically capable of searching the Internet, using Microsoft Office applications and simple database programs, and entering text and audio into Domino.

C.5.2.8. Item development team must be technologically capable of recording and editing sound files using software.

C.5.2.9. Key Personnel: The following personnel are considered key personnel by the Government: The contractor shall provide a Project Manager who shall be responsible for the performance of the work. The name of this person and an alternate who shall act for the contractor when the manager is absent shall be designated in writing to the contracting officer.

The project manager or alternate shall have full authority to act for the contractor on all contract matters relating to daily operation of this contract. The project manager or alternate shall be available between [Insert the hours, i.e., 8:00 a.m. to 4:30p.m.], Monday thru Friday except Federal holidays or when the Government facility is closed for administrative reasons.

Qualifications for all key personnel are listed below in section C.5.2.10. The Contractor shall submit documentation of the qualifications of the Project Manager(s) for Government approval, which may include resumes and/or curriculum vitae.

C.5.2.10. Project Manager(s) Experience. Project Managers must have at least five years of experience in item writing for language proficiency testing. Familiarity with the ILR scale is preferred. Project Managers must also have at least two years of experience in item development project management.

C.5.3. Item Development:

C.5.3.1. Reading Comprehension-Base Period:

The Contractor shall provide the required number of reading passages and multiple-choice items as summarized in the table below for German and Hindi. Passages and items shall conform to item development specifications

Reading Comprehension, Multiple-Choice

ILR Level Number of items per level Max. Length of a Passage (in words)*

Range of Items per Passage

06 - - - 10 30 Up to 60 1– 2 16 30 Up to 90 1– 2 20 60 Up to 250 2– 4 26 60 Up to 250 2– 4 30 60 Up to 400 2– 4 Total 240

*Note: The number of words refers to the number of words in the English rendering of the passage (this is so as not to have large differences between agglutinating and isolating languages). Refer to C.5.4.5. for more details regarding the rendering.

The Contractor shall provide the required number of reading passages and multiple-choice items as summarized in the table below for Spanish. Passages and items shall conform to item development specifications.

ILR

Level

Number of items per level

Max. Length of a Passage (in words)*

Range of Items per Passage

06 - - - 10 20 Up to 60 1– 2 16 20 Up to 90 1– 2 20 40 Up to 250 2–4 26 40 Up to 250 2–4 30 40 Up to 400 2–4 36 40 Up to 400 2–5 40 40 Up to 500 2–5 Total 240

*Note: The number of words refers to the number of words in the English rendering of the languages). Refer to C.5.4.5. for more details regarding the rendering.

C.5.3.2. Listening Comprehension-Base Period:

The Contractor shall provide the required number of listening passages and multiple-choice items as summarized in the table below for Egyptian, German, Hindi, Levantine,Saudi, and Yemeni. Passages and items shall conform to item development specifications.

Listening Comprehension, Multiple-Choice

Number of items per level

Max. length of a Passage (seconds):

(monologues/dialogs*)

Range of Items per Passage

06 - - - - 10 30 30 45 1–2 16 30 45 60 1–2 20 60 60 80 1–2 26 60 80 100 1–2 30 60 100 120 1–2 Total 240

*Note: Dialogs refer to passages that contain at least two clearly identifiable voices, both of which contribute substantively to the core content of the passage.

The Contractor shall provide the required number of listening passages and multiple-choice items as summarized in the table below for Spanish. Passages and items shall conform to item

Number of items per level

Max. length of a Passage (seconds):

(monologues/dialogs*)

Range of Items per Passage

06 - - - - 10 20 30 45 1–2 16 20 45 60 1–2 20 40 60 80 1–2 26 40 80 100 1–2 30 40 100 120 1–2 36 40 120 140 1–3 40 40 140 160 1–3 Total 240

*Note: Dialogs refer to passages that contain at least two clearly identifiable voices, both of which contribute substantively to the core content of the passage.

C.5.3.3. Reading Comprehension-Option Period 1:

The Contractor shall provide the required number of reading passages and multiple-choice items as summarized in the table below for Hebrew, Korean, and Modern Standard Arabic.

Passages and items shall conform to item development specifications.

Number of items per level

Max. Length of a Passage (in words)*

Range of Items per Passage

06 - - - 10 20 Up to 60 1– 2 16 20 Up to 90 1– 2 20 40 Up to 250 2–4 26 40 Up to 250 2–4 30 40 Up to 400 2–4 36 40 Up to 400 2–5 40 40 Up to 500 2–5 Total 240

*Note: The number of words refers to the number of words in the English rendering of the languages). Refer to C.5.4.5. for more details regarding the rendering.

The Contractor shall provide the required number of reading passages and multiple-choice items as summarized in the table below for Tagalog. Passages and items shall conform to item

Number of items per level

Max. Length of a Passage (in words)*

Range of Items per Passage

06 - - - 10 30 Up to 60 1– 2 16 30 Up to 90 1– 2 20 60 Up to 250 2–4 26 60 Up to 250 2–4 30 60 Up to 400 2–4 Total 240

*Note: The number of words refers to the number of words in the English rendering of the passage (this is so as not to have large differences between agglutinating and isolating languages). Refer to C.5.4.5. for more details regarding the rendering.

C.5.3.4. Listening Comprehension-Option Period 1:

The Contractor shall provide the required number of listening passages and multiple-choice items as summarized in the table below for Hebrew, Korean, and Modern Standard Arabic.

Passages and items shall conform to item development specifications.

Number of items per level

Max. length of a Passage (seconds):

(monologues/dialogs*)

Range of Items per Passage

06 - - - - 10 20 30 45 1–2 16 20 45 60 1–2 20 40 60 80 1–2 26 40 80 100 1–2 30 40 100 120 1–2 36 40 120 140 1–3 40 40 140 160 1–3 Total 240

*Note: The number of words refers to the number of words in the English rendering of the passage (this is so as not to have large differences between agglutinating and isolating languages). Refer to C.5.4.5. for more details regarding the rendering.

The Contractor shall provide the required number of listening passages and multiple-choice items as summarized in the table below for Tagalog. Passages and items shall conform to item

Number of items per level

Max. length of a Passage (seconds):

(monologues/dialogs*)

Range of Items per Passage

06 - - - - 10 30 30 45 1–2 16 60 45 60 1–2 20 60 60 80 1–2

26 60 80 100 1–2 30 60 100 120 1–2 Total 240

*Note: The number of words refers to the number of words in the English rendering of the languages). Refer to C.5.4.5. for more details regarding the rendering.

The Contractor shall provide the required number of listening passages and constructed-response items as summarized in the table below for Cebuano, Chavacano, and Portuguese- Brazilian. Passages and items shall conform to item development specifications.

Listening Comprehension, Constructed-Response

Number of items per level

Max. length of a Passage (seconds):

(monologues/dialogs*)

Range of Items per Passage

06 - - - - 10 20 30 45 2 16 20 45 60 2 20 30 60 80 2 26 30 80 100 2 30 30 100 120 2 Total 130

*Note: Dialogs refer to passages that contain at least two clearly identifiable voices, both of which contribute substantively to the core content of the passage.

C.5.4. Test Material Requirements:

C.5.4.1. The Contractor is required to provide passages and items that conform to the specifications and criteria defined by the Government in the technical exhibit documents and during the orientation session.

C.5.4.2. Items submitted by the contractor that do not conform to the specifications and criteria defined by the Government will be rejected.

C.5.4.3. The Contractor is solely responsible for submitting the required number of passages and/or items in accordance with the delivery schedule (Technical Exhibit 1).

C.5.4.4. Copyright permission must be obtained from the content owner. Proof of secured copyright permission for each passage, or in lieu of permission, evidence of attempts to obtain permission from the rights holder,shall be included in a separate document provided to the

COR.

C.5.4.5. The Contractor shall provide an English rendering for each target language passage.

The rendering must be a coherent communication in English of the target language. The English text must follow, as closely as possible, the lexical and grammatical structure of the target language, yet also adhere to rules of English grammar. Explanations in English shall be provided for target language meanings, words, and/or grammatical structures rendered that are unfamiliar to a native speaker of English. Cognates and borrowings from English shall be marked as such; idioms shall be translated literally and their meaning shall follow in brackets.

(See Technical Exhibits 14 7 and 23 14 for detailed guidance.) Show to the Editor.

C.5.4.6. The Contractor shall provide an orientation statement in English for each listening and reading passage. (See Technical Exhibits 15 and 16 for Rules for Writing Items.) For listening items, the contractor is not required to provide spoken orientation statements and shall not add spoken orientation statements as part of the item sound file.

C. 5.4.7. The Contractor shall provide complete and accurate written transcriptions of the original audio texts.

C.5.5. Audio Files:

C.5.5.1. Sound clarity, background noise, and interference in audio files shall follow and conform to the specifications listed in the ILR descriptors. (See Technical Exhibit 9.)

C.5.5.2. Audio files shall be extracted from the Internet, radio, television, or recordings of live discourse intended for communicative purposes.

C.5.5.3. For Listening Comprehension passages at the Lower and Upper Range levels, a maximum of 25%, per language, of listening passages may be produced in a recording studio using unscripted scenarios developed by the item development team. The 25% maximum limit does not apply for Level 0+, Level 1, and Level 1+ passages"

C.5.5.3.1. For Reading Comprehension passages at the Lower and Upper Range levels, a maximum of 25%, per language, of reading passages may be purpose-written texts created by the item development team. The 25% maximum limit does not apply for Level 0+, Level 1, and Level 1+ passages."

C.5.5.4. All audio shall be free of any static or gaps in the audio. Authentic content may include background music, or other noise, which is factored into the assessment of the level. No video files are permitted, however, the audio portion of a video clip may be used if it is a good quality recording and the understanding or meaning of the content does not rely on the video. All audio passages shall play within a specific volume range. All audio files will be two‐channel, stereo audio and the two tracks will be in‐phase. The peak audio level will be no lower than ‐24 dB (decibels) and no higher than ‐6 dB, there will be no clipped peaks, and any DC offset (common in iPod recorded audio) will be removed. Equalization should be flat with no bass boost added.

All audio materials shall contain an audio check to ensure proper volume.

C.5.6. Test Material Delivery:

C.5.6.1. The Contractor shall deliver test material in electronic format, using a Content Management System, DOMINO, administered by the Government.

C.5.6.2. The government Content Management System, DOMINO will be accessible by individual user login account for adjudicated Contractor parties.

C.5.6.3. Test material shall be posted to the Content Management System, DOMINO by the Contractor as submissions for Government review.

C.5.6.4. For listening comprehension passages, the Contractor shall also submit one audio file per item set of the passage in MP3 format for the initial submission and subsequent resubmissions. (See Technical Exhibit 24 21for specifications regarding audio files.)

C.5.6.5. For reading comprehension passages that are taken from an authentic source, the Contractor shall submit the source passage.

C.5.6.6. After an item set has been accepted by the Government, the Contractor shall post the final version of the audio files in WAV format to the network information system. The Contractor shall ensure that the contents of the WAV file match the contents of the accepted MP3 file.

C.5.6.7. Items that are rejected by the Government can be revised and replaced by the Contractor within 30 days of receipt of feedback.

C.6. DELIVERABLES

C.6.1. Pre-performance Meeting:

A meeting, in person or by telephone, between the Government and the Contractor will take place within ten working days of the award of the contract. At the meeting, the two parties will review contract deliverables, proposed milestones, and implementation issues.

C.6.2. Additional Meetings:

Additional meetings, in person or by telephone, between the Government and the Contractor may take place as needed to review contract deliverables, proposed milestones, and implementation issues.

C.6.3. Procedural Orientation for Base Period:

Upon contract award, the Contractor shall coordinate with the Government to send key item development personnel (a minimum of 3 and a maximum of 20 personnel) to attend an initial orientation session at DLIFLC, Monterey, California lasting a minimum of three to a maximum of five days. All attendees must attend 100% of the orientation. The initial orientation session will be completed no later than 30 working days after contract award. The session includes procedural orientation, ILR text typology norming, introduction to DLPT5 item-writing guidelines, and detailed explanation of test specifications and technical exhibits. These Contractor members will then provide the same orientation information to any additional members of item development teams at the Contractor’s site. The Contractor shall take notes throughout the entire orientation session and then provide the Government a copy of those notes within seven business days after the orientation session ends.

One additional session with contract item development personnel may be conducted via telephone, on site or using Web conferencing tools if the Government determines that additional extensive discussion of test development issues is needed.

C.6.3.1. Procedural Orientation for Option Period.

Upon start of option periods, the Contractor shall coordinate with the Government to send key item development personnel (a minimum of 3 and a maximum of 20 personnel) to attend an orientation session at DLIFLC, Monterey, California lasting a minimum of three to a maximum of five days. All attendees must attend 100% of the orientation. The orientation session will be completed no later than 30 working days after start of option period. The session includes procedural orientation, ILR text typology norming, introduction to DLPT5 item-writing guidelines, and detailed explanation of test specifications and technical exhibits. These Contractor members will then provide the same orientation information to any additional members of item development teams at the Contractor’s site.

One additional session with contract item development personnel may be conducted via telephone, on site or using Web conferencing tools if the Government determines that additional extensive discussion of item development issues is needed.

C.6.4. Documentation of processes.

The Contractor shall submit documentation for item development and quality control within 45 days of contract award for Government approval.

C.6.4.1. Item Development Process.

The Contractor shall submit a flowchart or narrative detailing the process it will use to develop passages, renderings, and items.

C.6.4.2. Quality Control Plan. The Contractor shall submit a flowchart or narrative detailing the process it will use to ensure that passages, renderings, orientations, and items meet Government requirements. The Contractor shall submit a checklist that reflects these processes.

C.6.4.3. Item Development. The Contractor shall deliver passages, renderings, orientations, and items according to the tables in paragraphs C.5.3. above in accordance with schedules established by the Test Development Division at DLIFLC. (See Technical Exhibit 21: Delivery Schedule.)

C.6.4.4. For each item delivered, the Contractor shall submit the quality-control documentation for that item, including the quality-control documentation for the passage when the item is delivered. Quality-control documentation shall include, at a minimum, the review checklists that were approved in the Quality Control Plan. The completed checklists shall indicate whether the item has successfully passed all contractor-required stages of review.

C.6.4.5. Inventories of Test Material.

The Contractor shall submit monthly inventory reports of test material, following Government specifications.

C.6.4.6 Certificates of Destruction or Transfer of Test Materials.

The Contractor shall submit written certification that all test material have been cleared as defined in US DoD 5220. 22-M, Clearing and Sanitization Matrix, and that all electronic data pertaining to DLPT materials were wiped from the Contractor’s servers and backups at the conclusion of the period of performance.

C.6.5. Schedule of deliverables.

C.6.5.1. See Technical Exhibit 2 1 for a detailed schedule.

C.6.5.2. Items, and quality control checklist shall be delivered per the scheduled delivery dates per Technical Exhibit 2.

C.6.5.3. All items scheduled for a given deadline shall be delivered as specified in the schedule.

C.6.5.4. Passages and items will be reviewed by the Government per the Review Criteria. (See Technical Exhibits 17,& 18 & 19) The Government will provide feedback within 60 working days.

The 60-day period shall begin one day after delivery.

C.6.5.5. Items submitted other than those listed on the delivery schedule shall not be bound to the 60-day feedback commitment.

C.6.5.6. Feedback of reviewed items will be posted for the Contractor. The contractor shall submit invoices for accepted items only.

C.6.6. Security of Deliverables:

C.6.6.1. The Contractor shall employ personnel and shall implement procedures to safeguard the security and confidentiality of all deliverables. The Contractor shall comply with Army Regulation 611-5 (2015 revision), paragraphs 3-1 and 3-2. See https://armypubs.army.mil/epubs/DR_pubs/DR_a/pdf/web/r611_5.pdf

C.6.6.2. See DFARS 252.227-7020 for license rights requirement related to all deliverables under this contract.

C.6.7 General Security:

C.6.7.1. Adjudicated Access to Government Network Information System (if required).

Designated Contract employees who require adjudicated access to the network information system must be able to favorably pass a federal background investigation.

The level of investigation will be commensurate with the appropriate level of IT privileges.

C.6.7.2. The COR will provide the contractor with security worksheet for the Contract employee will complete and return the security worksheet to the COR. The COR will then submit the completed security worksheet to the Government Security Office.

C.6.7.3. Once the security office receives the worksheet; contact will be established with the contract employee. Proof of US citizenship or legal status will be requested from the contract employee. If the contract employee is unwilling to provide, the process will cease. Personnel without US-issued social security numbers will not be investigated.

C.6.7.4. Security initiates the investigation request. The contract employee will be provided instructions for completion of the security questionnaire via email.

C.6.7.5. Contract employees will be directed to a fingerprinting location based on the employees’ geographic location. Instructions will be provided via email.

C.6.7.6. The COR will receive regular courtesy email messages reflecting the status of each security questionnaire. Security personnel will receive courtesy copies of the same email messages.

C.7. PERSONNEL REQUIREMENTS

C.7.1. Confidentiality Agreement:

C.7.1.1. Confidentiality Agreements. The Contractor shall submit confidentiality agreements for all personnel having contact with test material prior to working on the contract. The Contractor and its subcontractor personnel shall sign a confidentiality agreement to protect the security of all foreign language testing materials provided to the Contractor by the Government. This agreement shall include agreements signed by the Contractor and each subcontractor that the individual will not, directly nor indirectly, use, make available, sell, disclose, or otherwise communicate to any third party materials or services provided under this contract with the Government. (See Technical Exhibit 8.)

C.7.1.2. In this agreement, the signatory shall acknowledge that irreparable harm would be caused to the Government if the confidential information obtained by Contractor in the performance of tasks included in this Performance Work Statement were to be revealed to third parties.

C.7.1.3. A copy of each individual’s signed confidentiality agreement must be received by the Test Development Division before that individual can begin work.

C.7.1.4. The confidentiality agreement entered into by Contractor or subcontractor personnel in connection with this contract shall be in effect indefinitely.

C.7.2. Security Procedures:

C.7.2.1. Operational Security (OPSEC) and Training. The Contractor or its subcontractor personnel shall not reveal any materials pertaining to this contract to any other person, or discuss its contents or any purpose beyond that which is reasonably necessary to perform normal work requirements according to the contract.

C.7.2.1.1. The Contractor shall practice OPSEC to protect critical information for specific government contracts and subcontracts. The Contractor will ensure that annual OPSEC training is conducted to protect DLIFLC critical information.

C.7.2.1.2. The Contractor or its subcontractor personnel shall keep all contract related materials including electronic copies under lock and key and secure at all times when not actually performing the work. Test materials including electronic copies, shall be kept in locked rooms or containers (e.g., file cabinets, desks, or bookcases) and in password protected files when not in transit or actual use. (Army Regulation 611-5, Personnel and Classification Testing, paragraph 2-4b, 9 December 2015; AR25-55, Dept. of the Army Freedom of Information Act, paragraph 4- 401, 1 November 1997; and Appendix D of Army Regulation 190-51, Security of Unclassified Army Property (Sensitive and Nonsensitive), 30 September 1993)

C.7.2.2. The Contractor or its subcontractor personnel shall not retain paper or electronic copies of any contract deliverables or contract related materials following the delivery of contract deliverables to Government, or reuse any of these materials for future private, public, or commercial use.

C.7.3. Conflict of Interest:

The Contractor shall certify that no members of the item development team have a conflict of interest or the appearance of a conflict of interest. Potential sources of conflict of interest include: being a reviewer for the DLPT in the language for which they are writing, being in a position in which they instruct people who will take the DLPT in the language for which they are writing, or being in a position in which they themselves will take the DLPT in the language for which they are writing.

C.7.4. Contractor and Subcontractor Employees:

C.7.4.1. Contractor and Subcontractor personnel shall present a neat appearance while working on Government facilities/installations and be easily recognized as Contractor employees and DLIFLC visitors.

C.7.4.2. Security on Government Installations/Facilities:

C.7.4.2.1. Antiterrorism and Physical Security. The Contractor shall comply with PoM Installation Protection Plan (IPP), ANNEX N (Physical Security) requirements, and safeguard all Contractor and U.S. Government equipment, information and property.

C.7.4.2.1. Security Passes/ID. Contractor personnel shall obtain security passes from the Security Office prior to beginning work and must carry this ID at all times while working on this project at a Government facility. Each employee must show a valid driver's license, birth certificate OR Government-issued ID card to be issued a security pass.

C.7.4.2.2. The Contractor will not stray from designated, authorized work areas and travel routes. Unless specifically tasked, the Contractor will ensure assigned personnel do not attempt to access areas of the installation that are not under the purview of the contract .

C.7.4.2.3. When assigned, the Contractor will remain with the RA/DLIFLC unit escort, and comply with installation/facility access denial during increased readiness conditions.

C.7.4.3. Security of Employees:

C.7.4.3.1. All Contractor personnel entering Government facilities/installations shall abide by all security regulations, which may be in effect during the contract period and shall be subject to such checks as, may be deemed necessary to ensure that no violations occur. The Government reserves the right to require removal from the job site any Contractor or Sub-contractor employee who endangers people, property, or whose continued employment is inconsistent with the interest of military security.

C.7.4.3.2. The Contractor agrees:

(a) To submit immediately to the Contracting Officer a complete confidential report of any information which the Contractor may have concerning existing or threatened espionage, sabotage, or subversive activity;

(b) To submit to the Contracting Officer, upon written request, any and all information the Contractor may have concerning any of its employees that are engaged in any work at the site where work under this contract is being performed; and

(c) To exclude from any site or part thereof, where work under this contract is being performed, any person or persons whom the Contracting Officer, in the interest of security, may designate so, in writing.

(d) The Contracting Officer shall consult with the Contractor before final action is taken. It is understood that the decision of the Contracting Officer pursuant to this clause applies only to work under the contract and does not otherwise relate to the employer-employee relationship between the Contractor and its workers. The cost of replacing any Contractor employee under the provisions of this clause shall be at no additional cost to the Government.

C.7.4.3.3. In any case, should the continued employment of any such person furnished by the Contractor for work under this contract be determined by the Contracting Officer to be prejudicial to the security interests of the Government, that person shall be immediately removed from that worksite and/or transferred from that particular work assignment. The decision by the Contracting Officer that such person should not be employed on work being done under this contract will be final.

C.7.4.3.4. Utilizing Electronic Mail (Email): When prime Contractor or subcontractor personnel send email messages as a part of contract performance (or otherwise relating to contract matters), each sender shall include his/her name (both first and last names), email address, and the name of the individual’s employer.

C.7.4.3.5. iWatch and Training Requirements. The contractor shall brief all employees on the local iWATCH program (training standards provided by Garrison/DLIFLC Anti-Terrorism Officer (ATO)). This locally developed training will be used to inform employees of the types of behavior to watch for and instruct employees to report suspicious activity to the COR. This training shall be completed within 30 calendar days of the performance start date and within 30 calendar days of new employees commencing performance with the results reported to the COR no later than (NLT) 15 calendar days after completion of training.

C.7.4.4. Conduct of Employees:

C.7.4.4.1. The Contractor is fully responsible for the performance and conduct of his employees (including subcontractor employees) at all times while on post performing under the contract.

C.7.4.4.2. The Contractor shall not allow any employee to perform work under the contract while under the influence of alcohol, drugs or any other incapacitating agent.

C.7.4.4.3. Military police and other law enforcement personnel on post have the right to deny entry to post or remove from post any Contractor employee for misconduct, which endangers the health or safety of people or property or for reasons of security. In addition, the Post Commander may bar an individual from entering the post under the authority of 18 U.S.C. 1382.

Removal from post of a Contractor employee in accordance with above shall not relieve the Contractor from the requirement to meet all of the terms and conditions of the contract.

C.7.4.4.4. Personnel Familiarity with Regulations.

The Contractor, whenever performing work on a military installation, must be familiar with and obey established fire, safety, environmental and security regulations.

C.7.5. Hold Harmless:

C.7.5.1. The Government, its Officers and Agents will be free from liability for any negligence occasioned by the Contractor’s operations, employees or equipment. In addition, the Contractor shall reimburse the Government for any damage and/or loss that occurs as a result of the Contractor’s negligent operations, employees or equipment.

C.7.5.2. The Contractor shall hold the Government harmless against any liability imposed by a Federal, State, or Local regulatory agency, resulting from the negligent acts or willful misconduct of the Contractor to include assessment of a civil or administrative penalty or fine.

C.7.6. CONTRACTOR VEHICLES AND ACCESS TO GOVERNMENT

FACILITIES/INSTALLATIONS

C.7.6.1. Contractor Vehicles:

C.7.6.1.1. The Contractor or its subcontractors shall provide all motor vehicles and any other transportation equipment required in the performance of this contract.

C.7.6.1.2. Temporary Vehicle Pass. The Contractor shall obtain a temporary vehicle pass, if required at a Government facility/installation where performance is to take place. To obtain a temporary vehicle pass, the Contractor must have in his/her possession at the time of application, a current vehicle registration card for each vehicle he/she wishes to register, a current valid driver’s license for each operator, and proof of insurance covering each vehicle to be registered.

C.7.6.1.3. If the Contractor changes vehicle or a new vehicle is used; a new vehicle pass shall be needed. CONTRACTOR'S SHALL NOT EXCHANGE VEHICLE PASSES

C.7.6.1.4. A violation of the Base Security Regulations or Motor Vehicle Regulations could result in the Contractor being barred from the base, and the contract terminated for default.

C.7.6.1.5. The Contractor or its subcontractors shall provide easily identifiable information (make, model, license plate) for contractor or its subcontractor vehicles.

C.7.6.2. Limited Access The Contractor shall assure that its personnel use designated parking areas only. Vehicles shall not be parked on grassy or landscaped areas.

C.7.7. If the Contractor fails or refuses to comply with paragraph C.7. above, the Contracting Officer may issue a Stop-Work Order. No part of the time lost due to any such order shall be made the subject of a Contractor claim for extension of time or for excess costs or damage.

C.7.8. Assurance of compliance with the provisions of this article by subcontractors is the Contractor’s responsibility.

C.7.9. Public Release of Information:

Contractor and subcontractor personnel shall not publicly release information, photographs, or other documents concerning any aspect of the materials or services relating to this contract or task orders without the prior written approval of the Contracting Officer.

C.7.10. The Contractor or its subcontractor personnel shall not reveal any materials pertaining to this contract to any other person, nor discuss its contents for any purpose beyond that which is reasonably necessary to perform normal work requirements according to the contract. The Contractor and its subcontractor personnel shall keep all contract related materials under lock and key at all times when not actually performing the work.

C.7.11. The Contractor or its subcontractor personnel shall not retain paper or electronic copies of any contract deliverables or contract-related materials following the delivery of contract deliverables to Government, nor reuse any of these materials for future private, public, or commercial purposes.

C.8. GOVERNMENT-FURNISHED PROPERTY (GFP) AND GOVERNMENT-FURNISHED

SERVICES OR MATERIALS (GFS OR GFM)

C.8.1. For the workshops, the Government will provide a training space on-site (Government facilities) equipped with personal computers and interactive whiteboard or projector. The Contractor and Government will discuss any other materials/equipment necessary for the workshops and decide who will be responsible for providing such materials/equipment.

C.8.2. The Government will provide operational services related to trainees, information announcements, and schedules.

C.8.3. The Government will sponsor trainers to enter the Government-training site.

C.10. TRAVEL

C.10.1. The Contractor may periodically be required to travel for the purpose of attending government-initiated meetings (including orientation at paragraph C.6.3).

C.10.2. The Contractor shall use only the minimum number of travelers and rental vehicles required to accomplish the requirement. Contractor personnel are responsible to make all arrangements for travel, lodging and local transportation without assistance of Government personnel. The Contractor shall coordinate security-related paperwork (including obtaining access to military installations) and any other requirements pertinent to this Performance Work Statement.

C.10.3. Whenever travel is determined to be necessary by the Government; Contractor personnel shall be available to travel within two weeks’ notice.

C.10.4. All travel requires Government approval/authorization and notification to the COR, prior to making travel arrangements. The Contractor will be authorized travel expenses consistent with the substantive provisions of the Joint Travel Regulation (JTR) and the limitation of funds specified in this contract.

C.10.5. The Contractor shall submit an estimated cost of Contractor attendees for in-person meetings/conferences/orientations. Included in their estimate shall be a breakdown of costs related to the travel costs and shall include as a minimum: (1) transportation costs (airfare/car rental, etc.), (2) lodging, and (3) per diem for each employee. The contractor shall use JTR rates as guidelines for expenses (these can be found at http://www.defensetravel.dod.mil/site/travelreg.cfm as of May 10, 2011).

C.10.6. The Contractor shall submit an expense report to the COR when invoicing for travel costs. This report shall contain the following, at a minimum:

A brief description of the travel to include traveler(s) name(s), dates of travel, destination and purpose of travel.

Copies of receipts for all airfare, lodging and any expense in excess of $75.00.

Claims for payment of per diem shall be accompanied by a corporate worksheet or copy of the employee’s per diem voucher listing the location, dates and per diem rate applied to the claim.

Acceptable submissions include paid receipts from airlines and hotels or copies of corporate credit / purchase card statements providing that the statement lists the date, vendor name and amount of purchase.

All backup documentation shall clearly indicate the actual date that the contractor incurred the claimed expense.

Failure to provide the required documentation may result in rejection of the contractor’s invoice as not being a proper invoice as described in FAR 32.905(b)(2).

Travel invoices shall be submitted separately from labor invoices.

C.10.7. Travel invoices shall be submitted within 60 calendar days of completion of the travel event. Failure to do so will be noted in the performance assessment.

C.11. CONTRACTOR MANPOWER REPORTING APPLICATION. Accounting for Contractor products:

The Office of the Assistant Secretary of the Army (Manpower & Reserve Affairs) operates and maintains a secure Army data collection site where the contractor will report ALL contractor manpower (including subcontractor manpower) required for performance of this contract. The Contractor is required to completely fill in all the information in the format using the following web address: https://armycmra.dmdc.osd.mil/

The Contractor shall invoice for the CMR cost on the final invoice.

The required information includes:

(1) Contracting office, Contracting Officer, Contracting Officer’s Technical Representative;

(2) Contract number (including task and delivery order number);

(3) Beginning and ending dates covered by reporting period;

(4) Contractor name, address, phone number, email address, identity of contractor employee entering data;

(5) Estimated direct labor hours (including sub-contractors);

(6) Estimated direct labor dollars paid this reporting period (including sub-contractors);

(7) Total payments (including sub-contractors);

(8) Predominant Federal Service Code (FSC) reflecting services provided by contractor (and separate predominant FSC for each sub-contractor, if different);

(9) Estimated data collection cost;

(10) Organizational title associated with the Unit Identification Code (UIC) for the Army Requiring Activity (the Army Requiring Activity is responsible for providing the contractor with its UIC for the purposes of reporting this information);

(11) Locations where contractor and sub-contractors perform the work (specified by zip code in the United States and nearest city, country, when in an overseas location, using standardization nomenclature provided on website);

(12) Presence of deployment or contingency contract language; and

(13) Number of Contractor and sub-contractor employees deployed in theater this reporting period (by country).

As part of its submission, the Contractor will provide the estimated total cost (if any) incurred to comply with this reporting requirement. Reporting period will be the period of performance not to exceed 12 months ending 30 September of each government fiscal year and must be reported by 31 October of each calendar year.