ID06170028_Attach_1_PWS_DLPT5_VLR__LR_08082017.pdf

ID06170028

Attachment 1

PERFORMANCE WORK STATEMENT

DLPT5 ITEM DEVELOPMENT OF LOWER RANGE (LR) AND

VERY LOW RANGE (VLR) ITEMS

August 8, 2017

C.1. INTRODUCTION

The Defense Language Institute Foreign Language Center (DLIFLC) has a need for the creation of test items. DLIFLC has developed a reading and listening test, the Defense Language Proficiency Test (DLPT5), to assess the foreign language proficiency of military and Government linguists.

C.2. SCOPE

C.2.1. During the base period, the Contractor shall develop 1800 DLPT5 test items that conform to DLPT item development specifications (see Technical Exhibits 9 through 19) and cover multiple Interagency Language Roundtable language proficiency (ILR) levels in seven (7) languages during the base period, and during the option perod, 2640 items in seven (7) languages. The seven (7) languages for the base period are: (1) Croatian, (2) Hindi, (3) Iraqi, (4) Levantine, (5) Serbian, (6) Turkish, and (7) Urdu. The seven (7) languages for the option period 1 are: (1) Azerbaijani, (2) Chavacano, (3) Indonesian, (4) Western Punjabi, (5) Saudi, (6) Swahili, and (7) Yemeni.

Due to unforeseen geopolitical events, the Government may ask the Contractor to provide test items in different or substitute languages. In such a case, the Government reserves the right to reallocate the total number of required items among the other languages on the original delivery schedule in order to accommodate the total number for the substitute languages. The Government will notify the Contractor at least 60 days in advance before a change is made.

C.2.2. Base Period: Four (4) of the base period languages, (1) Croatian, (2) Hindi, (3) Serbian, and (4) Turkish —shall have items for reading comprehension and listening comprehension.

Two (2) of the base period languages —(1) Iraqi, and (2) Levantine— shall have items for listening comprehension only. One (1) of the base period languages —(1) Urdu— shall have items for Reading comprehension only.

ILR Level

Language Skill ItemType Test Range

ILR

ILR

ILR

ILR

ILR

ILR

30 Total

Croatian Reading MC LR 0 20 20 30 30 30 130 Croatian Listening MC LR 0 20 20 30 30 30 130 Hindi Reading MC LR 0 30 30 60 60 60 240 Hindi Listening MC LR 0 30 30 60 60 60 240 Iraqi Listening MC LR 0 0 0 40 40 40 120 Levantine Listening MC LR 0 30 30 40 40 40 180 Serbian Reading MC LR 0 20 20 30 30 30 130 Serbian Listening MC LR 0 20 20 30 30 30 130

Turkish Reading MC LR 0 30 30 30 30 30 150 Turkish Listening MC LR 0 30 30 30 30 30 150 Urdu Reading MC VLR 40 80 80 0 0 0 200

TOTAL

MC = Multiple Choice

C.2.3.1. Option Period: Four (4) of the option period 1 languages (1) Azerbaijani, (2) Indonesian, (3) Western Punjabi, (4) and Swahili—shall have items for reading comprehension and listening comprehension. Three (3) of the option period 1 languages (1) Chavacano, Saudi, and Temeni— shall have items for listening comprehension only.

ILR Levels

Language Skill Item Type

Item Range

ILR

ILR

ILR

ILR

ILR

30 Total

Azerbaijani Listening CRT LR 30 30 60 60 60 240 Azerbaijani Reading CRT LR 30 30 60 60 60 240 Chavacano Listening CRT LR 30 30 60 60 60 240 Indonesian Listening MC LR 30 30 60 60 60 240 Indonesian Reading MC LR 30 30 60 60 60 240 Punjabi Western Listening CRT LR 30 30 60 60 60 240

Punjabi Western Reading CRT LR 30 30 60 60 60 240

Saudi Listening MC LR 40 40 60 60 60 260 Swahili Listening MC LR 30 30 50 50 60 220 Swahili Reading MC LR 30 30 50 50 60 220 Yemeni Listening MC LR 40 40 60 60 60 260

TOTAL

MC = Multiple Choice CRT = Constructed Response Test

C.3. APPLICABLE DOCUMENTS

DLIFLC will provide the following documents during the solicitation process:

Exhibit Number Description of Exhibit #of Pages in Exhibit

References Technical Exhibit 1 Delivery Schedule 2 Technical Exhibit 2 Defense Language Proficiency Testing 5 Framework 86 Technical Exhibit 3 Contract Discrepancy Reports 2

Technical Exhibit 4 Defense Language Proficiency Test 5 44 Technical Exhibit 5 DLPT5-MC-LR-INTRO 13 Technical Exhibit 6 DLPT5-CRT-LR-INTRO 26 Security Specifications Technical Exhibit 7 NDA-Test Security/Confidentiality Agreement 1 Item Development Specifications

Technical Exhibit 8 Test Specs-FLO-Language Specs 2 Technical Exhibit 9 Text Modes 2 Technical Exhibit 10 DLPT5 Lower Range Multiple-Choice Test

Specifications

Technical Exhibit 10-A DLPT5 Very Low Range Multiple-Choice Test Specifications

Technical Exhibit 11 DLPT5 Lower Range Constructed-Response Test Specifications

Technical Exhibit 12 Style Guide 98 Technical Exhibit 13 Rules for Writing Multiple-Choice DLPT Items 6 Technical Exhibit 14 Rules for Writing Constructed-Response DLPT

Items

Technical Exhibit 15 Rendering Guidelines 11 Technical Exhibit 16 Consolidated Item Review Criteria- MC 5 Technical Exhibit 17 Consolidated Item Review Criteria- CRT 5 Technical Exhibit 18 IBS Manual A-D 5 Documents Technical Exhibit 19 Domino A-B 2 Documents

C.4. DEFINITIONS

Document Description

Confidential Information

Broadly defined, confidential information includes all information that has or could have commercial value or other utility in the business in which the Government is engaged in, and all information of which the unauthorized disclosure would be detrimental to the interests of the Government, whether or not such information is identified as confidential information by the Government.

DLPT

Defense Language Proficiency Test 5. A high-stakes proficiency test used by the Department of Defense to assess reading and listening comprehension in a language.

ILR Scale

Interagency Language Roundtable (ILR) language proficiency scale that provides descriptions of language proficiency levels.

Levels range from “0” (no proficiency) to “5” (equivalent to a highly educated native speaker).

Test Material

Test material refers to elements that are essential in a test and its accompanying scoring rubrics. It includes but is not limited to target-language passages, renderings, transcriptions, audio files, item sets, information regarding the origin of the target-language passages, and copyright permissions for use of the target-language passages.

Passage

The written or spoken text on which the test items are based. For reading tests, passages consist of printed text in the target language as it is customarily written. For listening tests, passages are audio files as they will be heard by examinees.

Proprietary Information

All information and any idea in whatever form, tangible or intangible, pertaining in any manner to the business of the Government or the Contractor or Subcontractor, which was produced by any Contractor or subcontractor employee in the course of the employees’ employment or otherwise produced or acquired by or on behalf of the Government.

Rendering

A rendering is a coherent communication in English of the target language passage. The English text follows, as closely as possible, the lexical and grammatical structure of the target language, yet also adheres to rules of English grammar. Explanations in English are provided for target language meanings, words, and/or grammatical structures rendered that are unfamiliar to a native-speaker of English.

Test Item The task for which the examinee provides a response, and the means for evaluating the response. For a multiple-choice test: one stem (i.e., question) and four response choices.

Item Set The combination of orientation statement, target language passage, English rendering, all related stems, and all options (MC only) or key ideas and credit scheme (CRT only).

Target Language The language being tested.

Range of Passages Number of passages required per language, per level and skill.

Multiple-Choice

A multiple-choice (MC) item contains a stem and a set of options.

Examinees are required to select the best answer or answers from the set of options. In the context of DLPT5 tests, an MC item contains a stem and 4 options, one of which is the best answer or key to the question posed.

Constructed- Response

A constructed-response (CR) item contains a stem and requires examinees to generate their own response. In the context of DLPT5 test items, the response can range from a short phrase to a couple of short sentences. A list of potential Key Ideas is developed for scoring, and a Credit Scheme is included to show scorers what is required.

C.5. TASKS and TECHNICAL REQUIREMENTS

C.5.1. Development of DLPT5 Items:

C.5.1.1. For the base period, the contractor shall develop and submit target-language passages, DLPT5 test items, English renderings, and ILR ratings for DLPT5s in the following seven (7) languages: (1) Croatian, (2) Hindi, (3) Iraqi, (4) Levantine, (5) Serbian, (6) Turkish, and (7) Urdu.

C.5.1.2. The Contractor shall follow the item development specifications and language-specific information about accent, dialect, and typeface/font provided by DLIFLC. The Contractor shall also follow the specifications listed in the ILR descriptors and Child’s text mode for ILR rating of the target-language passages and items. (See Technical Exhibit 9.) Items in all seven (7) languages shall be in a multiple-choice format.

C.5.1.3. For the option period 1, the Contractor shall develop and submit target-language passages, DLPT5 test items, English renderings, and ILR ratings for DLPT5s in the following seven (7) languages: (1) Azerbaijani, (2) Chavacano, (3) Indonesian, (4) Western Punjabi, (5) Saudi, (6) Swahili, and (7) Yemeni.

C.5.1.4. The Contractor shall follow item development specifications and language-specific information about accent, dialect, and typeface/font provided by DLIFLC. The Contractor shall also follow the specifications listed in the ILR descriptors and Child’s text mode for ILR rating of the target-language passages and items. (See Technical Exhibit 9.) Items in Indonesian, Saudi, Swahili, and Yemeni shall be in a multiple-choice format and items in Azerbaijani, Chavacano, and Punjabi Western shall me in constructed-response format.

C.5.2. Item development team and qualifications:

C.5.2.1. The Contractor shall employ a qualified and experienced item development team to perform all required work and tasks involved in the contract. The team may include but not be limited to the following personnel: Target Language Experts, Item Writers, and Project Managers.

C.5.2.2. Target Language Experts (TLEs) qualifications. The Contractor shall employ qualified target language experts (TLEs) as part of the item development team.

C.5.2.3. Target Language Proficiency. TLEs must be proficient at an ILR level equivalent to level 4 or above in reading and listening in the target language.

C.5.2.4. English Language Proficiency. TLEs must be proficient at an ILR level equivalent to level 3 or above in listening, reading, and writing in English.

C.5.2.5. Item Writer qualifications. The Contractor shall employ qualified item writers as part of the item development team. The Contractor shall submit documentation of the qualifications of the item writers for Government approval, which may include resumes and/or curriculum vitae.

C.5.2.6. Item Writing Experience. Item writers must have at least 2 years of experience in item writing for language proficiency testing. Familiarity with the ILR scale is preferred.

C.5.2.7. The Contractor’s item development team must be technologically capable of searching the Internet, using Microsoft Office applications and simple database programs, and entering text and audio into DOMINO.

C.5.2.8. Item development team must be technologically capable of recording and editing sound files using software.

C.5.2.9. Key Personnel: The following personnel are considered key personnel by the Government: Project Manager. The contractor shall provide a Project Manager who shall be responsible for the performance of the work. The name of this person and an alternate who shall act for the contractor when the manager is absent shall be designated in writing to the contracting officer. The project manager or alternate shall have full authority to act for the contractor on all contract matters relating to daily operation of this contract. The project manager or alternate shall be available during normal business hours, Monday thru Friday except Federal holidays or when the Government facility is closed for administrative reasons. Qualifications for all key personnel are listed below in section C.5.2.10. The Contractor shall submit documentation of the qualifications of the Project Manager(s) for Government approval, which may include resumes and/or curriculum vitae.

C.5.2.10. Project Manager(s) Experience. Project Managers must have at least five years of experience in item writing for language proficiency testing. Familiarity with the ILR scale is preferred. Project Managers must also have at least two years of experience in item development project management.

C.5.3. Item Development:

C.5.3.1. Reading Comprehension-Base Period:

The Contractor shall provide the required number of reading passages and multiple-choice items as summarized in the table below for Croatian and Serbian. Passages and items shall conform to item development specifications.

Reading Comprehension, Multiple-Choice

ILR

Level

Total number of items per ILR level

Max. length of a Passage (seconds):

(monologues/dialogues*)

Number of items required per passage

10 20 Up to 60 1– 2 16 20 Up to 90 1– 2 20 30 Up to 250 2– 4 26 30 Up to 250 2– 4 30 30 Up to 400 2– 4 Total 130

*Note: The number of words refers to the number in English rendering of the passage.

The Contractor shall provide the required number of reading passages and multiple-choice items as summarized in the table below for Hindi. Passages and items shall conform to item development specifications.

ILR

Level

Total number of items per ILR level

Max. length of a Passage (seconds):

(monologues/dialogues*)

Number of items required per passage

10 30 Up to 60 1– 2 16 30 Up to 90 1– 2 20 60 Up to 250 2– 4 26 60 Up to 250 2– 4 30 60 Up to 400 2– 4 Total 240

The Contractor shall provide the required number of reading passages and multiple-choice items as summarized in the table below for Turkish. Passages and items shall conform to item development specifications.

Level

Total number of items per ILR level

Max. Length of a Passage (in words)*

Number of items required per passage

10 30 Up to 60 1– 2 16 30 Up to 90 1– 2 20 30 Up to 250 2– 4 26 30 Up to 250 2– 4 30 30 Up to 400 2– 4 Total 150

*Note: The number of words refers to the number in English rendering of the passage.

The Contractor shall provide the required number of reading passages and multiple-choice items as summarized in the table below for Urdu. Passages and items shall conform to item

ILR Level Total number of items per ILR level Max. Length of a Passage (in words)*

Number of items required per passage

06 40 Up to 40 1 10 80 Up to 60 1– 2 16 80 Up to 90 1– 2 Total 200

C.5.3.2. Listening Comprehension-Base Period:

The Contractor shall provide the required number of listening passages and multiple-choice items as summarized in the table below for Croatian and Serbian. Passages and items shall conform to item development specifications.

Listening Comprehension, Multiple-Choice

Level

Total number of items per ILR level

Max. length of a Passage (seconds):

(monologues/dialogues*)

Number of items required per passage

10 20 30 45 1–2 16 20 45 60 1–2 20 30 60 80 1–2 26 30 80 100 1–2 30 30 100 120 1–2 Total 130

*Note: Dialogues refer to passages that contain at least two clearly identifiable voices, both of which contribute substantively to the core content of the passage.

The Contractor shall provide the required number of listening passages and multiple-choice items as summarized in the table below for Hindi. Passages and items shall conform to item

Level

Total number of items per ILR level

Max. length of a Passage (seconds):

(monologues/dialogues*)

Number of items required per passage

10 30 30 45 1–2 16 30 45 60 1–2 20 60 60 80 1–2 26 60 80 100 1–2 30 60 100 120 1–2

The Contractor shall provide the required number of listening passages and multiple-choice items as summarized in the table below for Iraqi. Passages and items shall conform to item

Total number of items per ILR level

Max. length of a Passage (seconds):

(monologues/dialogues*)

Number of items required per passage

10 0 - - - 16 0 - - -

20 40 60 80 1–2 26 40 80 100 1–2 30 40 100 120 1–2 Total 120

The Contractor shall provide the required number of listening passages and multiple-choice items as summarized in the table below for Levantine. Passages and items shall conform to item

Total number of items per ILR level

Max. length of a Passage (seconds):

(monologues/dialogues*)

Number of items required per passage

10 30 30 45 1–2 16 30 45 60 1–2 20 40 60 80 1–2 26 40 80 100 1–2 30 40 100 120 1–2 Total 180

The Contractor shall provide the required number of listening passages and multiple-choice items as summarized in the table below for Turkish. Passages and items shall conform to item

Total number of items per ILR level

Max. length of a Passage (seconds):

(monologues/dialogues*)

Number of items required per passage

10 30 30 45 1–2 16 30 45 60 1–2 20 30 60 80 1–2 26 30 80 100 1–2 30 30 100 120 1–2 Total 150

C.5.3.3. Reading Comprehension-Option Period 1:

The Contractor shall provide the required number of reading passages and Constructed-Response items as summarized in the table below for Azerbaijani and Western Punjabi. Passages and items shall conform to item development specifications.

Reading Comprehension, Constructed-Response

Level

Total number of items per ILR level

Max. Length of a Passage (in words)*

Number of items required per passage

06 - - - 10 30 Up to 6 2 16 30 Up to 90 2 20 60 Up to 200 2 26 60 Up to 250 2 30 60 Up to 300 2 Total 240

*Note: The number of words refers to the number in English rendering of the passage.

The Contractor shall provide the required number of reading passages and multiple-choice items as summarized in the table below for Indonesian. Passages and items shall conform to item

Total number of items per ILR level

Max. Length of a Passage (in words)*

Number of items required per passage

06 - - - 1 30 Up to 60 1– 2 16 30 Up to 90 1– 2 20 60 Up to 250 2–4 26 60 Up to 250 2–4 30 60 Up to 400 2–4 Total 240

*Note: The number of words refers to the number in English rendering of the passage.

The Contractor shall provide the required number of reading passages and multiple-choice items as summarized in the table below for Swahili. Passages and items shall conform to item

Total number of items per ILR level

Max. Length of a Passage (in words)*

Number of items required per passage

06 - - - 1 30 Up to 60 1– 2 16 30 Up to 90 1– 2

20 50 Up to 250 2–4 26 50 Up to 250 2–4 30 60 Up to 400 2–4 Total 220

C.5.3.4. Listening Comprehension-Option Period 1:

The Contractor shall provide the required number of listening passages and constructed-response items as summarized in the table below for Azerbaijani, Chavacano, and Western Punjabi.

Passages and items shall conform to item development specifications.

Listening Comprehension, Constructed-Response

Total number of items per ILR level

Max. length of a Passage (seconds): (monologues/dialogs*)

Number of items required per passage

06 - - - - 10 30 30 45 2 16 30 45 60 2 20 60 60 80 2 26 60 80 100 2 30 60 100 120 2 Total 240

*Note: Dialogs refer to passages that contain at least two clearly identifiable voices, both of which contribute substantively to the core content of the passage.

The Contractor shall provide the required number of listening passages and multiple-choice items as summarized in the table below for Indonesian. Passages and items shall conform to item development specifications.

Total number of items per ILR level

Max. length of a Passage (seconds): (monologues/dialogs*)

Number of items required per passage

06 - - - - 10 30 30 45 1–2 16 30 45 60 1–2 20 60 60 80 1–2 26 60 80 100 1–2

The Contractor shall provide the required number of listening passages and multiple-choice items as summarized in the table below for Swahili. Passages and items shall conform to item

Total number of items per ILR level

Max. length of a Passage (seconds): (monologues/dialogs*)

Number of items required per passage

06 - - - - 10 30 30 45 1–2 16 30 45 60 1–2 20 50 60 80 1–2 26 50 80 100 1–2

Total 220

The Contractor shall provide the required number of listening passages and multiple-choice items as summarized in the table below for Yemeni and Saudi. Passages and items shall conform to item development specifications.

Total number of items per ILR level

Max. length of a Passage (seconds): (monologues/dialogs*)

Number of items required per passage

06 - - - - 10 40 30 45 1–2 16 40 45 60 1–2 20 60 60 80 1–2 26 60 80 100 1–2

Total 260

C.5.4. Test Material Requirements:

C.5.4.1. The Contractor is required to provide passages and items that conform to the specifications and criteria defined by the Government in the technical exhibit documents and during the orientation session.

C.5.4.2. Items submitted by the contractor that do not conform to the specifications and criteria defined by the Government will be rejected.

C.5.4.3. The Contractor is solely responsible for submitting the required number of passages and/or items in accordance with the delivery schedule (Technical Exhibit 1).

C.5.4.4. Copyright permission must be obtained from the content owner. Proof of secured copyright permission for each passage, shall be included in a separate document provided to the

COR.

C.5.4.5. The Contractor shall provide an English rendering for each target language passage. The rendering must be a coherent communication in English of the target language. The English text must follow, as closely as possible, the lexical and grammatical structure of the target language, yet also adhere to rules of English grammar. Explanations in English shall be provided for target language meanings, words, and/or grammatical structures rendered that are unfamiliar to a native speaker of English. Cognates and borrowings from English shall be marked as such; idioms shall be translated literally and their meaning shall follow in brackets. (See Technical Exhibits 12 & 15 for detailed guidance.)

C.5.4.6. The Contractor shall provide an orientation statement in English for each listening and reading passage. (See Technical Exhibits 13 and 14 for Rules for Writing Items.) For listening items, the contractor is not required to provide spoken orientation statements and shall not add spoken orientation statements as part of the item sound file.

C. 5.4.7. The Contractor shall provide complete and accurate written transcriptions of the original audio texts.

C.5.5. Audio Files:

C.5.5.1. Sound clarity, background noise, and interference in audio files shall follow and conform to the specifications listed in the ILR descriptors. (See Technical Exhibit 9)

C.5.5.2. Audio files shall be extracted from the Internet, radio, television, or recordings of live discourse intended for communicative purposes.

C.5.5.3. For Listening Comprehension passages at the Lower and Upper Range levels, a maximum of 25%, per language, of listening passages may be produced in a recording studio using unscripted scenarios developed by the item development team. The 25% maximum limit does not apply for Level 0+, Level 1, and Level 1+ passages"

C.5.5.3.1. For Reading Comprehension passages at the Lower and Upper Range levels, a maximum of 25%, per language, of reading passages may be purpose-written texts created by the item development team. The 25% maximum limit does not apply for Level 0+, Level 1, and Level 1+ passages."

C.5.5.4. All audio shall be free of any static or gaps in the audio. Authentic content may include background music, or other noise, which is factored into the assessment of the level. No video files are permitted, however, the audio portion of a video clip may be used if it is a good quality recording and the understanding or meaning of the content does not rely on the video. All audio passages shall play within a specific volume range. All audio files will be two‐channel, stereo audio and the two tracks will be in‐phase. The peak audio level will be no lower than ‐24 dB (decibels) and no higher than ‐6 dB, there will be no clipped peaks, and any DC offset (common in iPod recorded audio) will be removed. Equalization should be flat with no bass boost added.

All audio materials shall contain an audio check to ensure proper volume.

C.5.6. Test Material Delivery:

C.5.6.1. The Contractor shall deliver test material in electronic format, using a Content Management System, DOMINO, administered by the Government.

C.5.6.2. The government Content Management System, DOMINO will be accessible by individual user login account for adjudicated Contractor parties.

C.5.6.3. Test material shall be posted to the Content Management System, DOMINO by the Contractor as submissions for Government review.

C.5.6.4. For listening comprehension passages, the Contractor shall also submit one audio file per item set of the passage in MP3 format for the initial submission and subsequent resubmissions. (See Technical Exhibit 19 for specifications regarding audio files.)

C.5.6.5. For reading comprehension passages that are taken from an authentic source, the Contractor shall submit the source passage.

C.5.6.6. After an item set has been accepted by the Government, the Contractor shall post the final version of the audio files in WAV format to the network information system. The Contractor shall ensure that the contents of the WAV file match the contents of the accepted MP3 file.

C.5.6.7. Items that are rejected by the Government can be revised and replaced by the Contractor within 30 days of receipt of feedback.

C.5.7. Performance Requirements Summary

Task / Deliverable Performance Standard

Performance Threshold / Minimum Acceptable Standard

(MAS)

Method of Surveillance

PWS Para. C.5.1.1. For the base period, the contractor shall develop and submit target-language passages, DLPT5 test items, English renderings, and ILR ratings for DLPT5s in the following seven (7) languages: (1) Croatian, (2) Hindi, (3) Iraqi, (4) Levantine, (5) Serbian, (6) Turkish, and

(7) Urdu.

PWS Para. C.5.1.3. For the option period, the Contractor shall develop and submit target-language passages, DLPT5 test items, English renderings, and ILR ratings for DLPT5s in the following seven (7) languages:

(1) Azerbaijani, (2) Chavacano, (3) Indonesian, (4) Western Punjabi, (5) Saudi, (6) Swahili, and (7) Yemeni.

-Initial delivery and shall be accomplished two (2) months following award of contract unless otherwise specified by the contract’s binding delivery schedule.

-Subsequent deliveries will be accomplished in the quantities and on the dates of the contract’s binding delivery schedule.

PWS Para. C.5.1.4. The Contractor shall follow item development specifications and language-specific information about accent, dialect, and typeface/font provided by DLIFLC. The Contractor shall also follow the specifications listed in the ILR descriptors and Child’s text mode for ILR rating of the target-language passages and items.

Test Production and Review and Evaluation Specialists’ Feedback on Deliverables

Inspection on Delivery Review by Test Production, Review and Evaluation Specialists and Target Language Experts

C.6. DELIVERABLES

C.6.1. Pre-performance Meeting:

A meeting, in person or by telephone, between the Government and the Contractor will take place within ten working days of the award of the contract. At the meeting, the two parties will review contract deliverables, proposed milestones, and implementation issues.

C.6.2. Additional Meetings:

Additional meetings, in person or by telephone, between the Government and the Contractor may take place as needed to review contract deliverables, proposed milestones, and implementation issues.

C.6.3. Procedural Orientation for Base Period:

Upon contract award, the Contractor shall coordinate with the Government to send key item development personnel (a minimum of 3 and a maximum of 20 personnel) to attend an initial orientation session at DLIFLC, Monterey, California lasting a minimum of three to a maximum of five days. All attendees must attend 100% of the orientation. The initial orientation session will be completed no later than 30 days after contract award. The session includes procedural orientation, ILR text typology norming, introduction to DLPT5 item-writing guidelines, and detailed explanation of test specifications and technical exhibits. These Contractor members will then provide the same orientation information to any additional members of item development teams at the Contractor’s site. The Contractor shall take notes throughout the entire orientation session and then provide the Government a copy of those notes within seven business days after the orientation session ends.

One additional session with contract item development personnel may be conducted via telephone, on site or using Web conferencing tools if the Government determines that additional extensive discussion of test development issues is needed.

C.6.3.1. Procedural Orientation for Option Period.

Upon start of option periods, the Contractor shall coordinate with the Government to send key item development personnel (a minimum of 3 and a maximum of 20 personnel) to attend an orientation session at DLIFLC, Monterey, California lasting a minimum of three to a maximum of five days. All attendees must attend 100% of the orientation. The orientation session will be completed no later than 30 days after start of option period. The session includes procedural orientation, ILR text typology norming, introduction to DLPT5 item-writing guidelines, and detailed explanation of test specifications and technical exhibits. These Contractor members will then provide the same orientation information to any additional members of item development teams at the Contractor’s site.

One additional session with contract item development personnel may be conducted via telephone, on site or using Web conferencing tools if the Government determines that additional extensive discussion of item development issues is needed.

C.6.4. Documentation of processes.

The Contractor shall submit documentation for item development and quality control within 30 days of contract award for Government approval.

C.6.4.1. Item Development Process.

The Contractor shall submit a flowchart or narrative detailing the process it will use to develop passages, renderings, and items.

C.6.4.2. Quality Control Plan. The Contractor shall submit a flowchart or narrative detailing the process it will use to ensure that passages, renderings, orientations, and items meet Government requirements. The Contractor shall submit a checklist that reflects these processes.

C.6.4.3. Item Development. The Contractor shall deliver passages, renderings, orientations, and items according to the tables in paragraphs C.5.3. above in accordance with schedules established by the Test Development Division at DLIFLC. (See Technical Exhibit 1: Delivery Schedule.)

C.6.4.4. For each item delivered, the Contractor shall submit the quality-control documentation for that item, including the quality-control documentation for the passage when the item is delivered. Quality-control documentation shall include, at a minimum, the review checklists that were approved in the Quality Control Plan. The completed checklists shall indicate whether the item has successfully passed all contractor-required stages of review.

C.6.4.5. Inventories of Test Material.

The Contractor shall submit monthly inventory reports of test material, following Government specifications.

C.6.4.6 Certificates of Destruction or Transfer of Test Materials.

The Contractor shall submit written certification that all test material have been cleared as defined in US DoD 5220. 22-M, Clearing and Sanitization Matrix, and that all electronic data pertaining to DLPT materials were wiped from the Contractor’s servers and backups at the conclusion of the period of performance.

C.6.5. Schedule of deliverables.

C.6.5.1. See Technical Exhibit 1 for a detailed schedule.

C.6.5.2. Items, and quality control checklist shall be delivered per the scheduled delivery dates per Technical Exhibit 1.

C.6.5.3. All items scheduled for a given deadline shall be delivered as specified in the schedule.

C.6.5.4. Passages and items will be reviewed by the Government per the Review Criteria. (See Technical Exhibits 16 & 17) The Government will provide feedback within 60 working days.

The 60-day period shall begin one day after delivery.

C.6.5.5. Items submitted other than those listed on the delivery schedule shall not be bound to the 60-day feedback commitment.

C.6.5.6. Feedback of reviewed items will be posted for the Contractor. The contractor shall submit invoices for accepted items only.

C.6.6. Security of Deliverables:

C.6.6.1. The Contractor shall employ personnel and shall implement procedures to safeguard the security and confidentiality of all deliverables. The Contractor shall comply with Army Regulation 611-5 (2015 revision), paragraphs 3-1 and 3-2. See https://armypubs.army.mil/epubs/DR_pubs/DR_a/pdf/web/r611_5.pdf

C.6.6.2. See DFARS 252.227-7020 for license rights requirement related to all deliverables under this contract.

C.6.7 General Security:

https://armypubs.army.mil/epubs/DR_pubs/DR_a/pdf/web/r611_5.pdf

C.6.7.1. Adjudicated Access to Government Network Information System (if required).

Designated Contract employees who require adjudicated access to the network information system must be able to favorably pass a federal background investigation.

The level of investigation will be commensurate with the appropriate level of IT privileges.

C.6.7.2. The COR will provide the contractor with security worksheet for the Contract employee to complete and return to the COR. The COR will then submit the completed security worksheet to the Government Security Office.

C.6.7.3. Once the security office receives the worksheet; contact will be established with the contract employee. Proof of US citizenship or legal status will be requested from the contract employee. If the contract employee is unwilling to provide, the process will cease. Personnel without US-issued social security numbers will not be investigated.

C.6.7.4. Security initiates the investigation request. The contract employee will be provided instructions for completion of the security questionnaire via email.

C.6.7.5. Contract employees will be directed to a fingerprinting location based on the employees’ geographic location. Instructions will be provided via email.

C.6.7.6. The COR will receive regular courtesy email messages reflecting the status of each security questionnaire. Security personnel will receive courtesy copies of the same email messages.

C.7. PERSONNEL REQUIREMENTS

C.7.1. Confidentiality Agreement:

C.7.1.1. Confidentiality Agreements. The Contractor shall submit confidentiality agreements for all personnel having contact with test material prior to working on the contract. The Contractor, any subcontractor, and respective contract9or and subcontractor personnel working on this contract shall each sign a confidentiality agreement to protect the security of all foreign language testing materials provided to the Contractor by the Government, as well as material provided by the Government for the Contractor’s performance of this contract. This agreement shall include agreements signed by the Contractor and each subcontractor that the individual will not, directly nor indirectly, use, make available, sell, disclose, or otherwise communicate to any third party materials or services provided under this contract with the Government. (See Technical Exhibit 7).

C.7.1.2. In this agreement, the signatory shall acknowledge that irreparable harm would be caused to the Government if the confidential information obtained by Contractor in the performance of tasks included in this Performance Work Statement were to be revealed to third parties.

C.7.1.3. A copy of each individual’s signed confidentiality agreement must be received by the Test Development Division before that individual can begin work.

C.7.1.4. The confidentiality agreement(s) entered into in connection with this contract shall be in effect indefinitely.

C.7.2. Security Procedures:

C.7.2.1. Operational Security (OPSEC) and Training. The Contractor or its subcontractor personnel shall not reveal any materials pertaining to this contract to any other person, or discuss its contents or any purpose beyond that which is reasonably necessary to perform normal work requirements according to the contract.

C.7.2.1.1. The Contractor shall practice OPSEC to protect critical information for specific government contracts and subcontracts. The Contractor will ensure that annual OPSEC training is conducted to protect DLIFLC critical information.

C.7.2.1.2. The Contractor or its subcontractor personnel shall keep all contract related materials including electronic copies under lock and key and secure at all times when not actually performing the work. Test materials including electronic copies, shall be kept in locked rooms or containers (e.g., file cabinets, desks, or bookcases) and in password protected files when not in transit or actual use. (Army Regulation 611-5, Personnel and Classification Testing, paragraph 2- 4b, 9 December 2015; AR25-55, Dept. of the Army Freedom of Information Act, paragraph 4- 401, 1 November 1997; and Appendix D of Army Regulation 190-51, Security of Unclassified Army Property (Sensitive and Nonsensitive), 30 September 1993)

C.7.2.2. The Contractor or its subcontractor personnel shall not retain paper or electronic copies of any contract deliverables or contract related materials following the delivery of contract deliverables to Government, or reuse any of these materials for future private, public, or commercial use.

C.7.3. Conflict of Interest:

The Contractor shall certify that no members of the item development team have a conflict of interest or the appearance of a conflict of interest. Potential sources of conflict of interest include: being a reviewer for the DLPT in the language for which they are writing, being in a position in which they instruct people who will take the DLPT in the language for which they are writing, or being in a position in which they themselves will take the DLPT in the language for which they are writing.

C.7.4. Contractor and Subcontractor Employees:

C.7.4.1. Contractor and Subcontractor personnel shall present a neat appearance while working on Government facilities/installations and be easily recognized as Contractor employees and DLIFLC visitors.

C.7.4.2. Security on Government Installations/Facilities:

C.7.4.2.1. Antiterrorism and Physical Security. The Contractor shall comply with PoM Installation Protection Plan (IPP), ANNEX N (Physical Security) requirements, and safeguard all Contractor and U.S. Government equipment, information and property.

C.7.4.2.1. Security Passes/ID. Contractor personnel shall obtain security passes from the Security Office prior to beginning work and must carry this ID at all times while working on this project at a Government facility. Each employee must show a valid driver's license, birth certificate OR Government-issued ID card to be issued a security pass.

C.7.4.2.2. The Contractor will not stray from designated, authorized work areas and travel routes. Unless specifically tasked, the Contractor will ensure assigned personnel do not attempt to access areas of the installation that are not under the purview of the contract .

C.7.4.2.3. When assigned, the Contractor will remain with the RA/DLIFLC unit escort, and comply with installation/facility access denial during increased readiness conditions.

C.7.4.3. Security of Employees:

C.7.4.3.1. All Contractor personnel entering Government facilities/installations shall abide by all security regulations, which may be in effect during the contract period and shall be subject to such checks as, may be deemed necessary to ensure that no violations occur. The Government reserves the right to require removal from the job site any Contractor or Sub-contractor employee who endangers people, property, or whose continued employment is inconsistent with the interest of military security.

C.7.4.3.2. The Contractor agrees:

(a) To submit immediately to the Contracting Officer a complete confidential report of any information which the Contractor may have concerning existing or threatened espionage, sabotage, or subversive activity;

(b) To submit to the Contracting Officer, upon written request, any and all information the Contractor may have concerning any of its employees that are engaged in any work at the site where work under this contract is being performed; and

(c) To exclude from any site or part thereof, where work under this contract is being performed, any person or persons whom the Contracting Officer, in the interest of security, may designate so, in writing.

(d) The Contracting Officer shall consult with the Contractor before final action is taken. It is understood that the decision of the Contracting Officer pursuant to this clause applies only to work under the contract and does not otherwise relate to the employer-employee relationship between the Contractor and its workers. The cost of replacing any Contractor employee under the provisions of this clause shall be at no additional cost to the Government.

C.7.4.3.3. In any case, should the continued employment of any such person furnished by the Contractor for work under this contract be determined by the Contracting Officer to be prejudicial to the security interests of the Government, that person shall be immediately removed from that worksite and/or transferred from that particular work assignment. The decision by the Contracting Officer that such person should not be employed on work being done under this contract will be final.

C.7.4.3.4. Utilizing Electronic Mail (Email): When prime Contractor or subcontractor personnel send email messages as a part of contract performance (or otherwise relating to contract matters), each sender shall include his/her name (both first and last names), email address, and the name of the individual’s employer.

C.7.4.3.5. AT Level I training. This standard language is for contractor employees with an area of performance within an Army controlled installation, facility or area. All contractor employees, to include subcontractor employees, requiring access Army installations, facilities and controlled access areas shall complete AT Level I awareness training within 30 calendar days after contract start date or effective date of incorporation of this requirement into the contract, whichever is applicable and annually thereafter. The contractor shall submit certificates of completion for each affected contractor employee and subcontractor employee, to the COR or to the contracting officer, if a COR is not assigned, within five (5) calendar days after completion of training by all employees and subcontractor personnel. AT Level I awareness training is available at the following website: http://jko.jten.mil

C.7.4.3.6. Access and general protection/security policy and procedures. This standard language is for contractor employees with an area of performance within Army controlled installation, facility, or area. Contractor and all associated sub-contractors employees shall provide all information required for background checks to meet installation access requirements to be accomplished by installation Provost Marshal Office, Director of Emergency Services or Security Office. Contractor workforce must comply with all personal identity verification requirements (FAR clause 52.204-9, Personal Identity Verification of Contractor Personnel) as directed by DOD, HQDA and/or local policy. In addition to the changes otherwise authorized by the changes clause of this contract, should the Force Protection Condition (FPCON) at any individual facility or installation change, the Government may require changes in contractor security matters or processes.

C.7.4.3.7. Contractors that do not require CAC, but require access to a DoD facility or installation. Contractor and all associated sub-contractors employees shall comply with adjudication standards and procedures using the National Crime Information Center Interstate Identification Index (NCIC-III) and Terrorist Screening Database (TSDB) (Army Directive 2014-05/AR 190-13), applicable installation, facility and area commander installation/facility access and local security policies and procedures (provided by government representative), or, at OCONUS locations, in accordance with status of forces agreements and other theater regulations.

C.7.4.3.8. iWATCH Training. This standard language is for contractor employees with an area of performance within an Army controlled installation, facility or area. The contractor and all associated sub-contractors shall brief all employees on the local iWATCH program (training standards provided by the requiring activity ATO). This locally developed training will be used to inform employees of the types of behavior to watch for and instruct employees to report suspicious activity to the COR. This training shall be completed within 30 calendar days of contract award and within five (5) calendar days of new employees commencing performance with the results reported to the COR NLT 30 calendar days after contract award.

C.7.4.3.9. OPSEC Training. Per AR 530-1 Operations Security, the contractor employees must complete Level I OPSEC Awareness training. New employees must be trained within 30 calendar days of their reporting for duty and annually thereafter. OPSEC Awareness for Military Members, DoD Employees and Contractors is available at the following website:

http://cdsetrain.dtic.mil/opsec/index.htm

C.7.4.4. Conduct of Employees:

C.7.4.4.1. The Contractor is fully responsible for the performance and conduct of his employees (including subcontractor employees) at all times while on post performing under the contract.

C.7.4.4.2. The Contractor shall not allow any employee to perform work under the contract while under the influence of alcohol, drugs or any other incapacitating agent.

C.7.4.4.3. Military police and other law enforcement personnel on post have the right to deny entry to post or remove from post any Contractor employee for misconduct, which endangers the health or safety of people or property or for reasons of security. In addition, the Post Commander may bar an individual from entering the post under the authority of 18 U.S.C. 1382. Removal from post of a Contractor employee in accordance with above shall not relieve the Contractor from the requirement to meet all of the terms and conditions of the contract.

C.7.4.4.4. Personnel Familiarity with Regulations.

The Contractor, whenever performing work on a military installation, must be familiar with and obey established fire, safety, environmental and security regulations.

C.7.5. Hold Harmless:

C.7.5.1. The Government, its Officers and Agents will be free from liability for any negligence occasioned by the Contractor’s operations, employees or equipment. In addition, the Contractor shall reimburse the Government for any damage and/or loss that occurs as a result of the Contractor’s negligent operations, employees or equipment.

C.7.5.2. The Contractor shall hold the Government harmless against any liability imposed by a Federal, State, or Local regulatory agency, resulting from the negligent acts or willful misconduct of the Contractor to include assessment of a civil or administrative penalty or fine.

C.7.6. CONTRACTOR VEHICLES AND ACCESS TO GOVERNMENT

FACILITIES/INSTALLATIONS

C.7.6.1. Contractor Vehicles:

C.7.6.1.1. The Contractor or its subcontractors shall provide all motor vehicles and any other transportation equipment required in the performance of this contract.

C.7.6.1.2. Temporary Vehicle Pass. The Contractor shall obtain a temporary vehicle pass, if required at a Government facility/installation where performance is to take place. To obtain a temporary vehicle pass, the Contractor must have in his/her possession at the time of application, a current vehicle registration card for each vehicle he/she wishes to register, a current valid driver’s license for each operator, and proof of insurance covering each vehicle to be registered.

C.7.6.1.3. If the Contractor changes vehicle or a new vehicle is used; a new vehicle pass shall be needed. CONTRACTOR'S SHALL NOT EXCHANGE VEHICLE PASSES

C.7.6.1.4. A violation of the Base Security Regulations or Motor Vehicle Regulations could result in the Contractor being barred from the base, and the contract terminated for default.

C.7.6.1.5. The Contractor or its subcontractors shall provide easily identifiable information (make, model, license plate) for contractor or its subcontractor vehicles.

C.7.6.2. Limited Access The Contractor shall assure that its personnel use designated parking areas only. Vehicles shall not be parked on grassy or landscaped areas.

C.7.7. If the Contractor fails or refuses to comply with paragraph C.7. above, the Contracting Officer may issue a Stop-Work Order. No part of the time lost due to any such order shall be made the subject of a Contractor claim for extension of time or for excess costs or damage.

C.7.8. Assurance of compliance with the provisions of this article by subcontractors is the Contractor’s responsibility.

C.7.9. Public Release of Information:

Contractor and subcontractor personnel shall not publicly release information, photographs, or other documents concerning any aspect of the materials or services relating to this contract or task orders without the prior written approval of the Contracting Officer.

C.7.10. The Contractor or its subcontractor personnel shall not reveal any materials pertaining to this contract to any other person, nor discuss its contents for any purpose beyond that which is reasonably necessary to perform normal work requirements according to the contract. The Contractor and its subcontractor personnel shall keep all contract related materials under lock and key at all times when not actually performing the work.

C.7.11. The Contractor or its subcontractor…