ID06190003_SF33_Attach_1_PWS_20190603.pdf

Solicitation ID06190003 Attachment 01

Performance Work Statement DLPT5 Full Range Test Item Development Multiple Award IDIQ

June 3, 2019

C.1. INTRODUCTION

The Defense Language Institute Foreign Language Center (DLIFLC) has a need for the creation of test items. DLIFLC has developed a reading and listening test, the Defense Language Proficiency Test (DLPT5), to assess the foreign language proficiency of military and Government linguists.

C.2. SCOPE

C.2.1. The Contractor will develop DLPT5 test items that conform to DLPT item development specifications (see Technical Exhibits 6 through 18) and that cover multiple Interagency Language Roundtable language proficiency (ILR) levels, from level 06 through level 4, during each year: the base year, option year 1, option year 2, option year 3, and option year 4. For a list of languages and language dialects see section C.2.2 of the contract. The government has the right to add ten (10) additional languages that are currently not on the list. The government will determine whether the test format will be in Multiple Choice or Constructed Response for each language and dialect. The quantities of test items developed are subject to the limitations of the base contract ordering clauses and individual Task Order Requests (TOR).

C.2.1.1. Due to unforeseen geopolitical events, the Government may substitute languages by modification to this contract. In such a case, the Government reserves the right to reallocate the total number of required items among the other languages on the original delivery schedule in order to accommodate the total number for the substitute language. The Government will notify the Contractor at least 60 days in advance before a change is made.

C.2.2. List of languages and dialects

Language list Language list cont. 1 Language list cont. 2

ACHINESE

ACHOLI

ADIGEY

AFRIKAANS

AFRO-ASIAN

AKAN

AKPOSSO

ALBANIAN

ALBANIAN-GHEG

ALBANIAN-TOSK

ALEUT

AMASHI

HAYA

HAZARAGI

HEBREW

HEBREW-ANCIENT

HERERO

HILIGAYNON

HINDI

HINDUSTANI

HMONG

HO

HOPI

HUNGARIAN

PAPUAN

PERSIAN-AFGHAN

PERSIAN-IRANIAN

PIDGIN ENGLISH

PIZAR MALAY

POLISH

PONAPEAN

PORTUGUESE

PORTUGUESE-BRAZILIAN

PORTUGUESE-EUROPEAN

PROVENCAL

PULAP

AMHARIC

APACHE

ARABIC (MODERN

STANDARD)

ARABIC-EGYPTIAN

ARABIC-GULF

ARABIC-LIBYAN

ARABIC-SAUDI

ARABIC-SUDANESE

ARABIC-TUNISIAN

ARABIC-ALGER IAN

ARABIC-CHADIAN

ARABIC-CLASSICAL

ARABIC-

HASSANIYYA

ARABIC-IRAQI

ARABIC-JORDANIAN

ARABIC-LEBANESE

ARABIC-LEVANTINE

ARABIC-MAGHREBI

ARABIC-MOROCCAN

ARABIC-SYRIAN

ARABIC-YEMENI

ARAMAIC

ARMENIAN

ARTIFICIAL

ASSAMESE

ASSYRIAN

AVAR

AVESTAN

AYMARA

AZERBAIJANI

BAHNAR

BAKWERI

BALINESE

BALOCHI

BALTIC

BANTU

BASHKIR

BASQUE

BASSA

BATAK

BAULE

BEJA

BELORUSSIAN

BEMBA

IBAN

IBANAG

ICELANDIC

IJAW

ILA-TONGA

ILOCANO

INDIC

INDONESIAN

IRISH

ITALIAN

ITALIAN-

NEAPOLITAN

ITALIAN-SARDI

NIAN

ITALIAN-SICILIAN

JAPANESE

JARAI

JAVANESE

KABRE

KABYLE

KACHIN

KADAZAN-OUSUN

KAMBA

KAMBATTA

KANARESE

KANURI

KAPINGAMARANGI

KARACHAl-

BALKHAR

KAREN

KASHMIR

KASHUBIAN

KAZAKH

KERES

KHERWARI

KIKUYU

KIMBUNDU

KINYARWANDA

KIRGHIZ

KIRIBATI

KIRUNDl

KISSI

KITUBA

KlKONGO

KONKANIS

KOREAN

PUNJABI

PUNJABI-WESTERN

QUECHUA

QUECHUA- NORTHERN PASTAZA

QUECHUA-CALDERON HIGHLAND

QUECHUA-CANAR HIGHLAND

QUECHUA-CHIMBORAZO

HIGHLAND

QUECHUA-IMBABURA HIGHLAND

QUECHUA-LOJA HIGHLAND

QUECHUA-NAPO LOWLAND

QUECHUA-SALASACA HIGHLAND

QUECHUA-SANTIAGO DEL ESTERO

QUECHUA-TENA LOWLAND

RAJASTHANI

REJANG

RHADE

RHAETO-ROMANCE

ROMANCE

ROMANIAN

ROMANY

ROROTONGAN

RUSSIAN

RYUKYUAN

SAMA

SAMOAN

SANGO

SANSKRIT

SANTALI

SAOTOMENSE

SARA

SASAK

SCOTCH-GAELIC

SEDANG

SEMITIC

SENA

SERBIAN

SERBO-CROATIAN

SERER

SETI

SHAN

SHLUH

SHONA

SIDAMO

SINDHI

BENGALI

BERBER

BHILI

BICOL

BIHARI

BINI

BOSNIAN

BRAHUI

BRETON

BUGINESE-

MAKASSARESE

BURMESE

BURUSHASKI

CAJUN

CAMBODIAN

CATALAN

CEBUANO

CHALDEAN

CHAVACANO

CHECHEN

CHEROKEE

CHIGA

CHINESE-AMOY

CHINESE-ANHWEI

CHINESE-

CANTONESE

CHINESE-FUCHOW

CHINESE-FUKIENESE

CHINESE-GAN

CHINESE-HAKKA

CHINESE-HSIANG

CHINESE-MANDARIN

CHINESE-SWATOW

CHINESE-TOISHAN

CHINESE-WU

CHOCTAW

CHOKWE

CHUKCHI

CHUVASH

COMORIAN

CONTINENTAL

EURASIAN

COPTIC

CORNISH

CREE

CROATIAN

KPELLE

KRIO

KUMBO

KURDISH-KURMANJI

KURDISH-SORANI

KURUKH

KUSAIE

LADINO

LAHNDA

LAHU

LAKOTA

LAMBA

LAMNSO

LAMPUNG

LANDSMAL

LANNA

LAO

LAPP

LATIN

LATIN-

ECCLESIASTIC

LATVIAN

LINGALA

LISU

LITHUANIAN

LOLO

LOMA

LOMONGO

LOMWE

LUBA KATANGA

LUBA-KASAI

LUBU

LUGANDA1

LUNDA

LUO

LURI

LUVALE

LUYIA

MACEDONIAN

MADURESE

MAGINDANAON

MAKASSAR

MAKUA

MALAGASY

MALAY

MALAY PATIANI

SINGHALESE

SINO-TIBETAN

SLAVIC

SLOVAK

SLOVENIAN

SOGA

SOMALI

SONGE

SONINKE

SOTHO

SOUTH AMERICAN

SOUTH ASIAN

SPANISH

SPANISH-CARIBBEAN

SPANISH-CASTILIAN

SPANISH-CREOLE

SUB SAHARA AFR ICAN

SUKUMA-NYAMWEZI

SUMERIAN

SUNDANESE

SUSU

SWAHILI

SWATI

SWEDISH

SYLHETTI

SYRIAC

TADJIK

TAGALOG

TAHITIAN

TAKI-TAKI

TAMACHEK

TAMAZIGHT

TAMIL

TAPACHULA

TARIFT

TATAR

TAUSUG

TELUGU

TEMNE

TETUM

THAI

THO

TIBETAN

TIGRE

TIGRINYA

TIV

CZECH

DAKOTA

DANISH

DIMLI

DINKA

DIVEH I

DJERMA-SONGHAI

DOGRl-KANGRI

DUALA

DUTCH

DUTCH-CREOLE

DZONGKHA

EFIK

ESKIMO

ESPERANTO

ESTONIAN

EWE

EWONDO

FANA

FANG

FAROESE

FIJIAN

FINNISH

FON

FORMOSAN

FRENCH

FRENCH-CREOLE

FRISIAN

FULANI

FUTNIAN

FUUTA JALON

GA

GALICIAN

GALLA

GEORGIAN

GERMAN

GERMAN-BAVARIAN

GERMANIC

GERMAN-SWISS

GILAKI

GOGO

GONDI

GOTHIC

GREEK

GREEK-DEMOTIC

GREEK-

MALAYALAM

MALTESE

MANDINGO-

BAMBARA

MANDINGO-DIOULA

MANDINGO-

MALINKE

MANX

MAORI

MARANAO

MARATHI

MARSHALESE

MASAI

MAYA

MAZANDERANI

MEITHEI

MENDE

MERU

MINANGKABAU

MISKITO

MONGOLIAN

MORO

MOROVIN

MORTLOCKESE

MOSSI

MPONGWE

MUONG

MUSKOGEE

NAHUATL

NAURUAN

NAVAJO

NDEBELE

NEPALESE

NGBANI

NIUE

NORWEGIAN

NUBIAN

NUNG

NUPE

NYANJA

NYANKOLE

NYORO

OGIBWA

OLD NORSE

OLD SLAVONIC

ORIYA

TOKELAUAN

TONGA

TRUKESE

TSONGA

TSWA

TSWANA

TULU

TUMBUKA

TUNGUSU

TUPI

TURKISH

TURKOMAN

TUVULAN

UIGHUR

UKRAINIAN

ULITHI

UMBUNDU

URDU

UZBEK

VAI

VIETNAMESE-CENTRAL

VIETNAMESE-HANOI

VIETNAMESE-SAIGON

VISAYAN

VOLAPUK

WA

WALAMO

WALLISIAN

WARAY-WARAY

WELSH

WENDISH

WESCOS

WEST EUROPEAN

WESTER N KRAHN

WOLEAI

WOLOF

XHOSA

YAKAN

YAKUT

YAO (CHINA)

YAO (MALAWI& MOZAMBIQUE)

YAPPESE

YIDDISH

YORUBA

ZANDE

ZAPOTECO

KATHAREVOUSA

GREEK-ANCIENT

GUAMANIAN

GUARANI

GUJARATI

GUSll

HADIYYA

HAITIAN-CREOLE

HAUSA

HAWAIIAN

HAWAIIAN-CREOLE

OSSETIC

OTETELA

PACIFIC ISLANDS

PAHARI

PAKTAI

PALAUAN

PALI

PAMPANGAN

PANGASINAN

PAPIAMENTO

PAPAGO-PIMA

PASHTU

PASHTU-AFGHAN

PASHTU-

PESHAWARI

ZENAGA

ZERBA

ZULU

ZUNI

C.3. APPLICABLE DOCUMENTS

Exhibit Number Description of Exhibit # of Pages in

Exhibit Technical Exhibit 1 Delivery Schedule (Task Order Requests only) 1 pg. per

TOR

Technical Exhibit 2 Defense Language Proficiency Testing 5

Framework

Technical Exhibit 3 Contract Discrepancy Reports 2 Technical Exhibit 4 Defense Language Proficiency Test 5 Presentation 44 Technical Exhibit 5 NDA-Test Security/Confidentiality Agreement 1 Technical Exhibit 6 Text Modes &Text Typology and Item Rating - A 2 Technical Exhibit 6 Text Modes &Text Typology and Item Rating – B 66 Technical Exhibit 7 Very Low Range Multiple Choice Test

Specifications

Technical Exhibit 8 Very Low Range Constructed Response Test Specifications

Technical Exhibit 9 Lower Range Multiple Choice Test Specifications 34 Technical Exhibit 10 Lower Range Constructed Response Test

Specifications

Technical Exhibit 11 Upper Range Multiple Choice Test Specifications 30 Technical Exhibit 12 Upper Range Constructed Response Test

Specifications

Technical Exhibit 13 Abbreviated DLPT Style Guide 50 Technical Exhibit 14 Multiple Choice Rendering Guidelines 12

Technical Exhibit 15 Rules for Writing Multiple Choice DLPT items 6 Technical Exhibit 16 Rules for Writing Constructed Response DLPT items

Technical Exhibit 17 Consolidated Item Review Criteria- MC 5 Technical Exhibit 18 Consolidated Item Review Criteria- CRT 5 Technical Exhibit 19 IBS Manual A 18 Technical Exhibit 19 IBS Manual B 15 Technical Exhibit 19 IBS Manual C 23 Technical Exhibit 19 IBS Manual D 20 Technical Exhibit 19 IBS Manual E 84 Technical Exhibit 20 Test Specs-FLO-Language Specs 2 Technical Exhibit 21 Domino A 13 Technical Exhibit 21 Domino B 10 Technical Exhibit 21 Domino C 19

C.4. DEFINITIONS

Document Description

Sensitive & FOUI Information

Broadly defined, sensitive information includes all information that has or could have commercial value or other utility in the business in which the Government is engaged in, and all information of which the unauthorized disclosure would be detrimental to the interests of the Government, whether or not such information is identified as sensitive information by the Government.

DLPT

Defense Language Proficiency Test. A high-stakes proficiency test used by the Department of Defense to assess reading and listening comprehension in a language.

ILR Scale

Interagency Language Roundtable (ILR) language proficiency scale that provides descriptions of language proficiency levels.

Levels range from “0” (no proficiency) to “5” (equivalent to a highly educated native speaker).

Test Material

Test material refers to elements that are essential in a test and its accompanying scoring rubrics. It includes but is not limited to target-language passages, renderings, transcriptions, audio files, item sets, information regarding the origin of the target-language passages, and copyright permissions for use of the target-language passages.

Passage

The written or spoken text on which the test items are based. For reading tests, passages consist of printed text in the target language as it is customarily written. For listening tests, passages are audio files as they will be heard by examinees.

Proprietary Information

All information and any idea in whatever form, tangible or intangible, pertaining in any manner to the business of the Government or the Contractor or Subcontractor, which was produced by any Contractor or subcontractor employee in the course of the employees’ employment or otherwise produced or acquired by or on behalf of the Government.

Rendering

A rendering is a coherent communication in English of the target language passage. The English text follows, as closely as possible, the lexical and grammatical structure of the target language, yet also adheres to rules of English grammar. Explanations in English are provided for target language meanings, words, and/or grammatical structures rendered that are unfamiliar to a native-speaker of English.

Test Item The task for which the examinee provides a response, and the means for evaluating the response. For a multiple-choice test: one stem (i.e., question) and four response choices.

Item Set The combination of orientation statement, target language passage, English rendering, all related stems, and all options (MC only) or key ideas and credit scheme (CRT only).

Target Language The language being tested.

Range of Passages Number of passages required per language, per level and skill.

Multiple-Choice

A multiple-choice (MC) item contains a stem and a set of options.

Examinees are required to select the best answer or answers from the set of options. In the context of DLPT5 tests, an MC item contains a stem and 4 options, one of which is the best answer or key to the question posed.

Constructed- Response

A constructed-response (CR) item contains a stem and requires examinees to generate their own response. In the context of DLPT5 test items, the response can range from a short phrase to a couple of short sentences. A list of potential Key Ideas is developed for scoring, and a Credit Scheme is included to show scorers what is required.

C.5. TASKS AND TECHNICAL REQUIREMENTS

C.5.1. Development of DLPT5 Items.

C.5.1.1. The contractor shall develop and submit target-language passages, DLPT5 test items, English renderings, and ILR ratings for DLPT5s in any language requested by the government.

C.5.1.2. The Contractor shall follow the item development specifications and language-specific information about accent, dialect, and typeface/font provided by DLIFLC. The Contractor shall also follow the specifications listed in the ILR descriptors and Child’s text mode for ILR rating of the target-language passages and items. (See Technical Exhibit 6.)

C.5.2. Item development team and qualifications.

C.5.2.1. The Contractor shall employ a qualified and experienced item development team to perform all required work and tasks involved in the contract. The team may include but not be limited to the following personnel: Target Language Experts, Item Writers, Editors, and Project Managers.

C.5.2.2. Target Language Experts (TLEs) qualifications. The Contractor shall employ qualified target language experts (TLEs) as part of the item development team.

C.5.2.3. Target Language Proficiency. TLEs must be proficient at an ILR level equivalent to level 4 or above in reading and listening in the target language.

C.5.2.4. English Language Proficiency. TLEs must be proficient at an ILR level equivalent to level 3 or above in listening, reading, and writing in English.

C.5.2.5. Item Writer qualifications. The Contractor shall employ qualified item writers as part of the item development team. The Contractor shall submit documentation of the qualifications of the item writers for Government approval, which may include resumes and/or curriculum vitae.

C.5.2.6. Item Writing Experience. Item writers must have at least 2 years of experience in item writing for language proficiency testing. Familiarity with the ILR scale is preferred.

C.5.2.7. The Contractor’s item development team must be technologically capable of searching the Internet, using Microsoft Office applications and simple database programs, and entering text and audio into Domino.

C.5.2.8. Item development team must be technologically capable of recording and editing sound files using software.

C.5.2.9. Key Personnel: The following personnel are considered key personnel by the Government: The contractor shall provide a Project Manager who shall be responsible for the performance of the work. The name of this person and an alternate who shall act for the contractor when the manager is absent shall be designated in writing to the contracting officer.

The project manager or alternate shall have full authority to act for the contractor on all contract matters relating to daily operation of this contract. The project manager or alternate shall be available between 8:00 a.m. to 4:30p.m. PDT, Monday thru Friday except Federal holidays or when the Government facility is closed for administrative reasons. Qualifications for all key personnel are listed below in section C.5.2.10. The Contractor shall submit documentation of the qualifications of the Project Manager(s) for Government approval, which may include resumes and/or curriculum vitae.

C.5.2.10. Project Manager(s) Experience. Project Managers must have at least five years of experience in item writing for language proficiency testing. Familiarity with the ILR scale is preferred. Project Managers must also have at least two years of experience in item development project management.

C.5.3. Item Development.

C.5.3.1. Multiple-Choice

The Contractor shall provide the required number of reading passages and multiple-choice items as summarized in the table below. Passages and items shall conform to item development specifications.

Reading Comprehension, Multiple-Choice

ILR Level Max. Length of a Passage (in words)* Range of Items per Passage

06 Up to 40 1 10 Up to 60 1– 2 16 Up to 90 1– 2 20 Up to 250 2– 4 26 Up to 250 2– 4 30 Up to 400 2– 4 36 Up to 400 2–5 40 Up to 500 2–5

*Note: The number of words refers to the number of words in the English rendering of the passage (this is so as not to have large differences between agglutinating and isolating languages). Refer to C.5.4.5. for more details regarding the rendering.

Listening Comprehension, Multiple-Choice

ILR

Level

Max. length of a Passage (seconds):

(monologues/dialogs*)

Range of Items per Passage

06 20 30 1 10 30 45 1–2 16 45 60 1–2 20 60 80 1–2 26 80 100 1–2 30 100 120 1–2 36 120 140 1–3 40 140 160 1–3 *Note: Dialogs refer to passages that contain at least two clearly identifiable voices, both of which contribute substantively to the core content of the passage.

C.5.3.2. Constructed Response

The Contractor shall provide the required number of reading passages and multiple-choice items as summarized in the table below. Passages and items shall conform to item development specifications.

Reading Comprehension, Constructed Response

ILR Level Max. Length of a Passage (in words)* Range of Items per Passage

06 Up to 40 1 10 Up to 60 2 16 Up to 90 2 20 Up to 200 2 26 Up to 250 2 30 Up to 300 2 36 Up to 400 2-3 40 Up to 400 2-3

*Note: The number of words refers to the number of words in the English rendering of the passage (this is so as not to have large differences between agglutinating and isolating languages). Refer to C.5.4.5. for more details regarding the rendering.

Listening Comprehension, Constructed Response

ILR

Level

Max. length of a Passage (seconds):

(monologues/dialogs*)

Range of Items per Passage

06 20 30 1 10 30 45 2 16 45 60 2 20 60 80 2 26 80 100 2 30 100 120 2 36 120 140 2-3 40 140 160 2-3 *Note: Dialogs refer to passages that contain at least two clearly identifiable voices, both of which contribute substantively to the core content of the passage.

C.5.4. Test Material Requirements.

C.5.4.1. The Contractor is required to provide passages and items that conform to the specifications and criteria defined by the Government in the technical exhibit documents and during the orientation session.

C.5.4.2. Items submitted by the contractor that do not conform to the specifications and criteria defined by the Government will be rejected.

C.5.4.3. The Contractor is solely responsible for submitting the required number of passages and/or items in accordance with the delivery schedule by 13:00 o’clock, Pacific Standard Time.

C.5.4.4. Copyright permission must be obtained from the content owner. Proof of secured copyright permission for each passage, or in lieu of permission, evidence of attempts to obtain permission from the rights holder, shall be included in a separate document provided to the COR.

C.5.4.5. The Contractor shall provide an English rendering for each target language passage. The rendering must be a coherent communication in English of the target language. The English text must follow, as closely as possible, the lexical and grammatical structure of the target language, yet also adhere to rules of English grammar. Explanations in English shall be provided for target language meanings, words, and/or grammatical structures rendered that are unfamiliar to a native speaker of English. Cognates and borrowings from English shall be marked as [REC]; idioms shall be translated literally and their meaning shall follow in brackets. (See Technical Exhibits 13 and 14 for detailed guidance.)

C.5.4.6. The Contractor shall provide an orientation statement in English for each listening and reading passage. (See Technical Exhibits 15 and 16 for Rules for Writing Items.) For listening items, the contractor is not required to provide spoken orientation statements and shall not add spoken orientation statements as part of the item sound file.

C. 5.4.7. The Contractor shall provide complete and accurate written transcriptions of the original audio texts.

C.5.5. Audio Files.

C.5.5.1. Sound clarity, background noise, and interference in audio files shall follow and conform to the specifications listed in the ILR descriptors. (See Technical Exhibit 6.)

C.5.5.2. Audio files shall be extracted from the Internet, radio, television, or recordings of live discourse intended for communicative purposes.

C.5.5.3. For Listening Comprehension passages at the Lower and Upper Range levels, a maximum of 25%, per language, of listening passages may be produced in a recording studio using unscripted scenarios developed by the item development team. The 25% maximum limit does not apply for Level 06, Level 10, and Level 16 passages"

C.5.5.3.1. For Reading Comprehension passages at the Lower and Upper Range levels, a maximum of 25%, per language, of reading passages may be purpose-written texts created by the item development team. The 25% maximum limit does not apply for Level 06, Level 10, and Level 16 passages."

C.5.5.4. All audio shall be free of any static or gaps in the audio. Authentic content may include background music, or other noise, which is factored into the assessment of the level. No video files are permitted, however, the audio portion of a video clip may be used if it is a good quality recording and the understanding or meaning of the content does not rely on the video. All audio passages shall play within a specific volume range. All audio files will be two‐channel, stereo audio and the two tracks will be in‐phase. The peak audio level will be no lower than ‐24 dB (decibels) and no higher than ‐6 dB, there will be no clipped peaks, and any DC offset (common in iPod recorded audio) will be removed. Equalization should be flat with no bass boost added.

All audio materials shall contain an audio check to ensure proper volume.

C.5.6. Test Material Delivery.

C.5.6.1. The Contractor shall deliver test material in electronic format, using a Content Management System, DOMINO, administered by the Government.

C.5.6.2. The government Content Management System, DOMINO will be accessible by individual user login account for adjudicated Contractor parties.

C.5.6.3. Test material shall be posted to the Content Management System, DOMINO by the Contractor as submissions for Government review.

C.5.6.4. For listening comprehension passages, the Contractor shall also submit one audio file per item set of the passage in MP3 format for the initial submission and subsequent resubmissions.

C.5.6.5. For reading comprehension passages that are taken from an authentic source, the Contractor shall submit the source passage.

C.5.6.6. After an item set has been accepted by the Government, the Contractor shall post the final version of the audio files in WAV format to the network information system. The Contractor shall ensure that the contents of the WAV file match the contents of the accepted MP3 file.

C.5.6.7. Items that are rejected by the Government can be revised and replaced by the Contractor within 30 days of receipt of feedback. The resubmited items are not bound to the 60-day feedback commitment.

C.6. DELIVERABLES

C.6.1. Pre-performance Meeting.

A meeting, in person or by telephone, between the Government and the Contractor will take place within ten working days of the award of the contract. At the meeting, the two parties will review contract deliverables, proposed milestones, and implementation issues.

C.6.2. Additional Meetings.

Additional meetings, in person or by telephone, between the Government and the Contractor may take place as needed to review contract deliverables, proposed milestones, and implementation issues.

C.6.3. Procedural Orientation for Base Period.

Upon contract award, the Contractor shall coordinate with the Government to send key item development personnel (a minimum of 3 and a maximum of 20 personnel) to attend an initial orientation session lasting a minimum of three to a maximum of five days. Date and location of orientation session will be discussed, and the Government will make the final decision on the date and location. All attendees must attend 100% of the orientation. The initial orientation session will be completed no later than 45 working days after contract award. The session includes procedural orientation, ILR text typology norming, introduction to DLPT5 item-writing guidelines, and detailed explanation of test specifications and technical exhibits. These Contractor members will then provide the same orientation information to any additional members of item development teams at the Contractor’s site. The Contractor shall take notes throughout the entire orientation session and then provide the Government a copy of those notes within seven business days after the orientation session ends.

One additional session with contract item development personnel may be conducted via telephone, on site or using Web conferencing tools if the Government determines that additional extensive discussion of test development issues is needed.

C.6.3.1. Procedural Orientation for Option Period.

Orientation for the Option Periods is not mandatory. The orientation will only be held if deemed necessary by the Government and the Contractor: Upon start of option periods, the Contractor shall coordinate with the Government, if orientation is necessary, to send key item development personnel (a minimum of 3 and a maximum of 20 personnel) to attend an orientation session a lasting a minimum of three to a maximum of five days. Date and location of orientation session will be discussed, and the Government will make the final decision on the date and location. All attendees must attend 100% of the orientation. The orientation session will be completed no later than 45 working days after start of option period. The session includes procedural orientation, ILR text typology norming, introduction to DLPT5 item-writing guidelines, and detailed explanation of test specifications and technical exhibits. These Contractor members will then provide the same orientation information to any additional members of item development teams at the Contractor’s site. The Contractor shall take notes throughout the entire orientation session and then provide the Government a copy of those notes within seven business days after the orientation session ends.

One additional session with contract item development personnel may be conducted via telephone, on site or using Web conferencing tools if the Government determines that additional extensive discussion of item development issues is needed.

C.6.4. Documentation of processes.

The Contractor shall submit documentation for item development and quality control within 45 days of contract award for Government approval.

C.6.4.1. Item Development Process.

The Contractor shall submit a flowchart or narrative detailing the process it will use to develop passages, renderings, and items. The Contractor shall submit a checklist that reflects these processes.

C.6.4.2. Quality Control Plan.

The contractor shall implement a quality control plan (QCP) at the beginning of the period of performance (POP) and maintain the plan throughout the POP. The initial plan shall be submitted to the Contracting Officer for review and approval no later than fourty-five (45) calendar days after contract award. All revisions shall be subject to written approval by the Contracting Officer, upon receipt of which the contractor shall document and record the plan number, distribute revised plans and communicate changes to affected contractor and Government personnel. The contractor shall furnish all changes to the Contracting Officer and the appropriate Contracting Officer’s Representative (COR) at least three (3) working days prior to the effective date of the change.

The contractor’s QCP shall establish performance indicators to ensure deliverables are within established tolerance limits. Initial quality control requirements will be administered by the Project Manager . QCP shall include:

a. Performance Indicators (e.g., management goals relative to cost, schedule, and quality of technical and administrative service provided)

b. Inspection and test methods (e.g., accepted techniques and procedures)

c. Deficiency identification (e.g., areas exceeding acceptable tolerance limits)

d. Deficiency correction (e.g., establishes and implements corrective actions)

e. Documentation and enforcement (e.g., document/enforce corrective actions)

f. Trend analysis (e.g., evaluates and record trends in performance results)

g. Surveillance methods (e.g., collect real time, on-line performance metrics)

h. Customer complaint program (e.g., respond to valid customer complaints)

The QCP shall be the basis of the contractor’s Quality Control (QC) Program, a basic tenet of which shall be continuous quality improvement. The QCP shall also:

a. Recommend QC staff should be independent of the contractor’s production and supervisory staff and to report directly to management.

b. Contain methods of direct and indirect communication with the Government regarding performance, to include regular and formal meetings with the Government, review and analyses of key process indicators, analyses of process deficiencies, and problem resolution.

c. Contain process control and process performance measurement procedures to include how the contractor plans to effect preventive actions and corrective actions, as opposed to reliance on Government or customer identification of deficiencies prior to resolving the problem.

d. Contain a customer issue tracking ticketing system for identification and correction of validated complaints and to provide feedback.

e. Establish procedures to document and record all inspections or tests conducted by the contractor and any corrective actions taken, and their effectiveness, during the performance period.

The Contractor shall submit a QCP to the Contracting Officer within 30 calendar days of award.

The Contracting Officer shall review and approve/disapprove the QCP within 15 calendar days of submission.

C.6.4.3. Item Development.

The Contractor shall deliver passages, renderings, orientations, and items according to the tables in paragraphs C.5.3. above in accordance with schedules established by the Test Development Division at DLIFLC. (See Technical Exhibit 1: Delivery Schedule.)

C.6.4.4. Quality Control Documentation for Item Development.

For each item delivered, the Contractor shall submit the quality-control documentation for that item, including the quality-control documentation for the passage when the item is delivered.

Quality-control documentation shall include, at a minimum, the review checklists that were approved in the Quality Control Plan. The completed checklists shall indicate whether the item has successfully passed all contractor-required stages of review.

C.6.4.5. Inventories of Test Material.

The Contractor shall submit monthly inventory reports of test material, following Government specifications.

C.6.4.6 Certificates of Destruction or Transfer of Test Materials.

The Contractor shall submit written certification that all test material have been cleared as defined in US DoD 5220. 22-M, Clearing and Sanitization Matrix, and that all electronic data pertaining to DLPT materials were wiped from the Contractor’s servers and backups at the conclusion of the period of performance.

C.6.4.7. Contract Monthly Status Reports.

The Contractor shall submit by the 10th of each following month, a report for the prior month listing all pertinent contract activities/deliverables accomplished, planned activities for the following month, issues encountered, and any other information pertinent to the contract.

C.6.5. Schedule of deliverables.

C.6.5.1. Refer to Technical Exhibit 1 issued with each Task Order Request (TOR) for a detailed schedule. All passages and corresponding items must be at the same ILR level. Any item that is not rated at the same ILR level as the passage will be rejected.

C.6.5.2. Test Items and quality control checklist shall be delivered per the scheduled delivery dates per Technical Exhibit 1.

C.6.5.3. All items scheduled for a given deadline shall be delivered as specified in the Delivery Schedule (See Technical Exhibit 1).

C.6.5.4. Passages and items will be reviewed by the Government per the Review Criteria. (See Technical Exhibits 17 & 18) The Government will provide feedback within 60 working days.

The 60-day period shall begin one day after delivery.

C.6.5.5. Items submitted other than those listed on the delivery schedule shall not be bound to the 60-day feedback commitment, this includes resubmitted items.

C.6.6. Security of Deliverables:

C.6.6.1. The Contractor shall employ personnel and shall implement procedures to safeguard the security and confidentiality of all deliverables. The Contractor shall comply with Army Regulation 611-5 (2015 revision), paragraphs 3-1 and 3-2. See https://armypubs.army.mil/epubs/DR_pubs/DR_a/pdf/web/r611_5.pdf

C.6.6.2. See DFARS 252.227-7020 for license rights requirement related to all deliverables under this contract.

C.6.7 General Security:

C.6.7.1. Adjudicated Access to Government Network Information System (if required).

Designated Contract employees who require adjudicated access to the network information system must be able to favorably pass a federal background investigation.

The level of investigation will be commensurate with the appropriate level of IT privileges.

C.6.7.2. The COR will provide the contractor with security worksheet for the Contract employee will complete and return the security worksheet to the COR. The COR will then submit the completed security worksheet to the Government Security Office.

C.6.7.3. Once the security office receives the worksheet; contact will be established with the contract employee. Proof of US citizenship or legal status will be requested from the contract employee. If the contract employee is unwilling to provide, the process will cease. Personnel without US-issued social security numbers will not be investigated.

https://armypubs.army.mil/epubs/DR_pubs/DR_a/pdf/web/r611_5.pdf

C.6.7.4. Security initiates the investigation request. The contract employee will be provided instructions for completion of the security questionnaire via email.

C.6.7.5. Contract employees will be directed to a fingerprinting location based on the employees’ geographic location. Instructions will be provided via email.

C.6.7.6. The COR will receive regular courtesy email messages reflecting the status of each security questionnaire. Security personnel will receive courtesy copies of the same email messages.

C.7. PERSONNEL REQUIREMENTS

C.7.1. Confidentiality Agreement:

C.7.1.1. Confidentiality Agreements. The Contractor shall submit confidentiality agreements for all personnel having contact with test material prior to working on the contract. The Contractor and its subcontractor personnel shall sign a confidentiality agreement to protect the security of all foreign language testing materials provided to the Contractor by the Government. This agreement shall include agreements signed by the Contractor and each subcontractor that the individual will not, directly nor indirectly, use, make available, sell, disclose, or otherwise communicate to any third party materials or services provided under this contract with the Government. (See Technical Exhibit 5.)

C.7.1.2. In this agreement, the signatory shall acknowledge that irreparable harm would be caused to the Government if the confidential information obtained by Contractor in the performance of tasks included in this Performance Work Statement were to be revealed to third parties.

C.7.1.3. A copy of each individual’s signed confidentiality agreement must be received by the Test Development Division before that individual can begin work.

C.7.1.4. The confidentiality agreement entered into by Contractor or subcontractor personnel in connection with this contract shall be in effect indefinitely.

C.7.2. Security Procedures:

C.7.2.1. Operational Security (OPSEC) and Training. The Contractor or its subcontractor personnel shall not reveal any materials pertaining to this contract to any other person, or discuss its contents or any purpose beyond that which is reasonably necessary to perform normal work requirements according to the contract.

C.7.2.1.1. The Contractor shall practice OPSEC to protect critical information for specific government contracts and subcontracts. The Contractor will ensure that annual OPSEC training is conducted to protect DLIFLC critical information.

C.7.2.1.2. The Contractor or its subcontractor personnel shall keep all contract related materials including electronic copies under lock and key and secure at all times when not actually performing the work. Test materials including electronic copies, shall be kept in locked rooms or containers (e.g., file cabinets, desks, or bookcases) and in password protected files when not in transit or actual use. (Army Regulation 611-5, Personnel and Classification Testing, paragraph 2- 4b, 9 December 2015; AR25-55, Dept. of the Army Freedom of Information Act, paragraph 4- 401, 1 November 1997; and Appendix D of Army Regulation 190-51, Security of Unclassified Army Property (Sensitive and Nonsensitive), 30 September 1993)

C.7.2.2. The Contractor or its subcontractor personnel shall not retain paper or electronic copies of any contract deliverables or contract related materials following the delivery of contract deliverables to Government, or reuse any of these materials for future private, public, or commercial use.

C.7.3. Conflict of Interest:

The Contractor shall certify that no members of the item development team have a conflict of interest or the appearance of a conflict of interest. Potential sources of conflict of interest include: being a reviewer for the DLPT in the language for which they are writing, being in a position in which they instruct people who will take the DLPT in the language for which they are writing, or being in a position in which they themselves will take the DLPT in the language for which they are writing.

C.7.4. Contractor and Subcontractor Employees:

C.7.4.1. Contractor and Subcontractor personnel shall present a neat appearance while working on Government facilities/installations and be easily recognized as Contractor employees and DLIFLC visitors.

C.7.4.2. Security on Government Installations/Facilities:

C.7.4.2.1. Antiterrorism and Physical Security. The Contractor shall comply with PoM Installation Protection Plan (IPP), ANNEX N (Physical Security) requirements, and safeguard all Contractor and U.S. Government equipment, information and property.

C.7.4.2.1. Security Passes/ID. Contractor personnel shall obtain security passes from the Security Office prior to beginning work and must carry this ID at all times while working on this project at a Government facility. Each employee must show a valid driver's license, birth certificate OR Government-issued ID card to be issued a security pass.

C.7.4.2.2. The Contractor will not stray from designated, authorized work areas and travel routes. Unless specifically tasked, the Contractor will ensure assigned personnel do not attempt to access areas of the installation that are not under the purview of the contract .

C.7.4.2.3. When assigned, the Contractor will remain with the RA/DLIFLC unit escort, and comply with installation/facility access denial during increased readiness conditions.

C.7.4.3. Security of Employees:

C.7.4.3.1. All Contractor personnel entering Government facilities/installations shall abide by all security regulations, which may be in effect during the contract period and shall be subject to such checks as, may be deemed necessary to ensure that no violations occur. The Government reserves the right to require removal from the job site any Contractor or Sub-contractor employee who endangers people, property, or whose continued employment is inconsistent with the interest of military security.

C.7.4.3.2. The Contractor agrees:

(a) To submit immediately to the Contracting Officer a complete confidential report of any information which the Contractor may have concerning existing or threatened espionage, sabotage, or subversive activity;

(b) To submit to the Contracting Officer, upon written request, any and all information the Contractor may have concerning any of its employees that are engaged in any work at the site where work under this contract is being performed; and

(c) To exclude from any site or part thereof, where work under this contract is being performed, any person or persons whom the Contracting Officer, in the interest of security, may designate so, in writing.

(d) The Contracting Officer shall consult with the Contractor before final action is taken. It is understood that the decision of the Contracting Officer pursuant to this clause applies only to work under the contract and does not otherwise relate to the employer-employee relationship between the Contractor and its workers. The cost of replacing any Contractor employee under the provisions of this clause shall be at no additional cost to the Government.

C.7.4.3.3. In any case, should the continued employment of any such person furnished by the Contractor for work under this contract be determined by the Contracting Officer to be prejudicial to the security interests of the Government, that person shall be immediately removed from that worksite and/or transferred from that particular work assignment. The decision by the Contracting Officer that such person should not be employed on work being done under this contract will be final.

C.7.4.3.4. Utilizing Electronic Mail (Email): When prime Contractor or subcontractor personnel send email messages as a part of contract performance (or otherwise relating to contract matters), each sender shall include his/her name (both first and last names), email address, and the name of the individual’s employer.

C.7.4.3.5. iWatch and Training Requirements. The contractor shall brief all employees on the local iWATCH program (training standards provided by Garrison/DLIFLC Anti-Terrorism Officer (ATO)). This locally developed training will be used to inform employees of the types of behavior to watch for and instruct employees to report suspicious activity to the COR. This training shall be completed within 30 calendar days of the performance start date and within 30 calendar days of new employees commencing performance with the results reported to the COR no later than (NLT) 15 calendar days after completion of training.

C.7.4.3.6. Operational Security (OPSEC) and Training: Per AR 530-1 Operations Security, the contractor employees must complete Level I OPSEC Awareness training. New employees must be trained within 30 calendar days of their reporting for duty and annually thereafter. OPSEC Awareness for Military Members, DoD Employees and Contractors is available at the following website: https://www.cdse.edu/catalog/elearning/GS130.html. The Contractor shall practice OPSEC to protect critical information for specific government contracts and subcontracts. The Contractor will ensure that annual OPSEC training is conducted to protect DLIFLC critical information.

C.7.4.3.7. Contractors that do not require CAC, but require access to a DoD facility or installation. Contractor and all associated sub-contractors employees shall comply with adjudication standards and procedures using the National Crime Information Center Interstate Identification Index (NCIC-III) and Terrorist Screening Database (TSDB) (Army Directive 2014-05/AR 190-13), applicable installation, facility and area commander installation/facility access and local security policies and procedures (provided by government representative), or, at OCONUS locations, in accordance with status of forces agreements and other theater regulations.

C.7.4.4. Conduct of Employees:

C.7.4.4.1. The Contractor is fully responsible for the performance and conduct of his employees (including subcontractor employees) at all times while on post performing under the contract.

C.7.4.4.2. The Contractor shall not allow any employee to perform work under the contract while under the influence of alcohol, drugs or any other incapacitating agent.

C.7.4.4.3. Military police and other law enforcement personnel on post have the right to deny entry to post or remove from post any Contractor employee for misconduct, which endangers the health or safety of people or property or for reasons of security. In addition, the Post Commander may bar an individual from entering the post under the authority of 18 U.S.C. 1382. Removal from post of a Contractor employee in accordance with above shall not relieve the Contractor from the requirement to meet all of the terms and conditions of the contract.

C.7.4.4.4. Personnel Familiarity with Regulations:

The Contractor, whenever performing work on a military installation, must be familiar with and obey established fire, safety, environmental and security regulations.

C.7.5. Hold Harmless:

C.7.5.1. The Government, its Officers and Agents will be free from liability for any negligence occasioned by the Contractor’s operations, employees or equipment. In addition, the Contractor shall reimburse the Government for any damage and/or loss that occurs as a result of the Contractor’s negligent operations, employees or equipment.

C.7.5.2. The Contractor shall hold the Government harmless against any liability imposed by a Federal, State, or Local regulatory agency, resulting from the negligent acts or willful misconduct of the Contractor to include assessment of a civil or administrative penalty or fine.

C.7.6. CONTRACTOR VEHICLES AND ACCESS TO GOVERNMENT

FACILITIES/INSTALLATIONS

C.7.6.1. Contractor Vehicles:

C.7.6.1.1. The Contractor or its subcontractors shall provide all motor vehicles and any other transportation equipment required in the performance of this contract.

C.7.6.1.2. Temporary Vehicle Pass. The Contractor shall obtain a temporary vehicle pass, if required at a Government facility/installation where performance is to take place. To obtain a temporary vehicle pass, the Contractor must have in his/her possession at the time of application, a current vehicle registration card for each vehicle he/she wishes to register, a current valid driver’s license for each operator, and proof of insurance covering each vehicle to be registered.

C.7.6.1.3. If the Contractor changes vehicle or a new vehicle is used; a new vehicle pass shall be needed. CONTRACTOR'S SHALL NOT EXCHANGE VEHICLE PASSES

C.7.6.1.4. A violation of the Base Security Regulations or Motor Vehicle Regulations could result in the Contractor being barred from the base, and the contract terminated for default.

C.7.6.1.5. The Contractor or its subcontractors shall provide easily identifiable information (make, model, license plate) for contractor or its subcontractor vehicles.

C.7.6.2. Limited Access The Contractor shall assure that its personnel use designated parking areas only. Vehicles shall not be parked on grassy or landscaped areas.

C.7.7. If the Contractor fails or refuses to comply with paragraph C.7. above, the Contracting Officer may issue a Stop-Work Order. No part of the time lost due to any such order shall be made the subject of a Contractor claim for extension of time or for excess costs or damage.

C.7.8. Assurance of compliance with the provisions of this article by subcontractors is the Contractor’s responsibility.

C.7.9. Public Release of Information:

Contractor and subcontractor personnel shall not publicly release information, photographs, or other documents concerning any aspect of the materials or services relating to this contract or task orders without the prior written approval of the Contracting Officer.

C.7.10. The Contractor or its subcontractor personnel shall not reveal any materials pertaining to this contract to any other person, nor discuss its contents for any purpose beyond that which is reasonably necessary to perform normal work requirements according to the contract. The Contractor and its subcontractor personnel shall keep all contract related materials under lock and key at all times when not actually performing the work.

C.7.11. The Contractor or its subcontractor personnel shall not retain paper or electronic copies of any contract deliverables or contract-related materials following the delivery of contract deliverables to Government, nor reuse any of these materials for future private, public, or commercial purposes.

C.8. GOVERNMENT-FURNISHED PROPERTY (GFP) AND GOVERNMENT-

FURNISHED SERVICES OR MATERIALS (GFS OR GFM)

C.8.1. For the workshops, the Government will provide a training space on-site (Government facilities) equipped with personal computers and interactive whiteboard or projector. The Contractor and Government will discuss any other materials/equipment necessary for the workshops and decide who will be responsible for providing such materials/equipment.

C.8.2. The Government will provide operational services related to trainees, information announcements, and schedules.

C.8.3. The Government will sponsor trainers to enter the Government-training site.

C.9. CONTRACTOR-FURNISHED PROPERTY (GFP) AND CONTRACTOR-

FURNISHED SERVICES OR MATERIALS (GFS OR GFM)

C.9.1. The Contractor shall furnish all supplies, equipment, facilities and services required to perform work under this contract that are not listed under Section C.8 of this PWS.

C.10. TRAVEL

C.10.1. The Contractor may periodically be required to travel for the purpose of attending government-initiated meetings (including orientation at paragraph C.6.3).

C.10.2. The Contractor shall use only the minimum number of travelers and rental vehicles required to accomplish the requirement. Contractor personnel are responsible to make all arrangements for travel, lodging and local transportation without assistance of Government personnel. The Contractor shall coordinate security-related paperwork (including obtaining access to military installations) and any other requirements pertinent to this Performance Work Statement.

C.10.3. Whenever travel is determined to be necessary by the Government; Contractor personnel shall be available to travel within two weeks’ notice.

C.10.4. All travel requires Government approval/authorization and notification to the COR, prior to making travel arrangements. The Contractor will be authorized travel expenses consistent with the substantive provisions of the Joint Travel Regulation (JTR) and the limitation of funds specified in this contract.

C.10.5. The Contractor shall submit an estimated cost of Contractor attendees for in-person meetings/conferences/orientations. Included in their estimate shall be a breakdown of costs related to the travel costs and shall include as a minimum: (1) transportation costs (airfare/car rental, etc.), (2) lodging, and (3) per diem for each employee. The contractor shall use JTR rates as guidelines for expenses (these can be found at http://www.defensetravel.dod.mil/site/travelreg.cfm as of May 10, 2011).

C.10.6. The Contractor shall submit an expense report to the COR when invoicing for travel costs. This report shall contain the following, at a minimum:

● A brief description of the travel to include traveler(s) name(s), dates of travel, destination and purpose of travel.

● Copies of receipts for all airfare, lodging and any expense in excess of $75.00.

● Claims for payment of per diem shall be accompanied by a corporate worksheet or copy of the employee’s per diem voucher listing the location, dates and per diem…