DRAFT PWS_Standard Setting Study Contract.pdf

Attachment 01

PERFORMANCE WORK STATEMENT (PWS)

DLPT5 Standard-Setting Study Contract

03 March 2026

Language Proficiency Assessment Directorate (LPAD) Defense Language Institute Foreign Language Center (DLIFLC)

1. General: This is a non-personal services contract to provide DLPT5 Standard Setting Studies.

1.1. Description of Services/Introduction: The contractor shall provide all personnel, equipment, supplies, facilities, transportation, tools, materials, supervision, and other items and non-personal services necessary to perform DLPT5 Standard Setting Studies as defined in this PWS except for those items specified as Government furnished property and services. The contractor shall perform to the standards in this contract.

1.2. Background: DLIFLC is developing listening and reading tests (Defense Language Proficiency Test5 (DLPT5)) to assess the foreign language proficiency of the US Government military and civilian personnel. The DLPT5 reports scores according to the Interagency Language Roundtable (ILR) Skill Level Descriptions. DLPT5s are available as very low range, covering ILR levels 0+-1+, lower-range tests, covering ILR levels 0+- 3, or as upper-range tests, covering ILR levels 3-4. Each test, with exceptions noted below, has both a reading comprehension and a listening comprehension component;

these components are considered separate tests for scoring purposes, but each standard-setting panel will consider both reading and listening tests in the same study, where both are available. In order to determine the number of items on each test that examinees need to answer correctly to achieve a given ILR score, DLIFLC has been tasked to use standard-setting studies. Standard-setting studies involve panels of experts judging the linkage between number of items correct and score awarded.

Standard-setting studies are considered to be of great importance in the testing industry, as they provide evidence for the validity of decisions made based on a test.

Standard-setting studies are one aspect of the commitment that DLIFLC has made to build quality assessments.

1.3. Objectives:

• Conduct Standard Setting Studies of DLIFLC DLPT5 listening and reading tests

• Create and deliver reports of results of the standard setting studies.

1.4. Scope: The Contractor shall conduct up to six standard-setting studies in the base period and up to six studies in each of the six option periods. See attached delivery schedule. Each standard-setting study shall focus on one language and range, setting cut scores for the two skills (reading and listening) independently, unless specified otherwise. The Contractor shall deliver reports on the results of the standard-setting studies.

1.4.1. Schedule of Standard Setting Studies. The Contractor shall provide one or up to six standard-setting studies in the base period and up to six studies in each of the six option periods thereafter. Standard-setting studies will be performed for any of the following languages: (1) Bulgarian (MC), (2) Ukrainian (MC), (3) Portuguese (MC- Brazilian/Portugal), (4) Japanese (MC), (5) Hebrew (MC), (6) Serbo-Croatian (MC), (7) Russian (MC-AR), (8) French (MC-LR), (9) Punjabi (MC), (10) Thai (MC), (11) Korean (MC-UR), (12) Russian (MC-UR).

1.4.2. The Government reserves the right to make substitutions for languages; the Government will notify the Contractor of any substitutions at least 60 days before conducting the study.

1.4.3. A meeting, in person or by telephone, between the Government and the Contractor shall take place within five (5) working days of the award of the contract. At the meeting, the two parties shall review contract deliverables, proposed milestones, and implementation issues.

1.4.4. Additional meetings, in person or by telephone, between the Government and the Contractor shall take place as needed to review contract deliverables, proposed milestones, and implementation issues.

1.5. Period of Performance: TBD (March 2027). The period of performance shall be for one Base Year of 12 months and six 12-month Option Years.

1.6. General Information

1.6.1. Quality Control Plan: Quality Control is the responsibility of the contractor. The contractor is responsible for the delivery of quality services/supplies to the Government (see FAR 52.246-4, Inspection of Services – Fixed-Price). The Contractor shall develop, implement and maintain an effective Quality Control System which includes a written Quality Control Plan (QCP). The QCP shall implement standardized procedure/methodology for monitoring and documenting contract performance to ensure all contract requirements are met. The Contractors’ QCP must contain a systematic approach to monitor operations to ensure acceptable services/products are provided to the Government. The QCP, as a minimum, shall address continuous process improvement; procedures for scheduling, conducting and documentation of inspection; discrepancy identification and correction; corrective action procedures to include procedures for addressing Government discovered non-conformances;

procedures for root cause analysis to identify the root cause and root cause corrective action to prevent re-occurrence of discrepancies; procedures for trend analysis;

procedures for collecting and addressing customer feedback/complaints. The contractor shall provide to the Government their quality control documentation. The QCP shall be provided to the Contracting Officer (CO) and COR within 30 days of the period of performance. The Government will accept, or return the QCP for revision within 14 days. Any change to the QCP after initial acceptance requires the review and acceptance of the CO.

1.6.2. Quality Assurance: The Government will evaluate the contractor’s performance under this contract in accordance with (IAW) the Quality Assurance Surveillance Plan (QASP). This plan is a Government only document primarily focused on what the Government must do to assure that the contractor has performed IAW the requirements of the contract.

1.6.3. Federal Government Holidays:

New Year’s Day 1st day of January

Martin Luther King Jr.'s Birthday 3rd Monday of January

Presidents Day 3rd Monday of February

Memorial Day Last Monday of May

Juneteenth 19th day of June

Independence Day 4th day of July

Labor Day 1st Monday of September

Columbus Day 2nd Monday of October

Veterans Day 11th day of November

Thanksgiving Day 4th Thursday of November

Christmas Day 25th day of December

1.6.4. Hours of Operation: The contractor is responsible for conducting business outside of study implementation, between the hours of 7:45am - 4:45pm (PT), Monday thru Friday except Federal holidays or when the Government facility is closed due to local or national emergencies, administrative closings, or similar Government directed facility closings. The Contractor must at all times maintain an adequate workforce for the uninterrupted performance of all tasks defined within this PWS when the Government facility is not closed for the above reasons.

1.6.5. Place of Performance: The work to be performed under this contract will be performed at is as follows: Each study will take place with all participants at the same site over 5 days (for tests in both the reading and listening skills). The Contractor is responsible for obtaining a venue with space for the whole group and two parallel sessions in the Washington, D.C. area (within a 50-mile radius of the United States capital) unless specified otherwise. To this end, the contractor shall reserve a room for the whole group to sit in a ‘U’ shape for the first day of the standard-setting study, and two rooms big enough for half of the group to sit in a “U” shape for the remaining days of the standard-setting study.

1.6.5.1 Technology: The Contractor shall provide the following for the standard-setting studies: One laptop computer, mouse, and noise-cancelling audio headset for each language panel experts and the language resource expert exclusive use for the duration of the study. The computers should be password protected and be able to connect wirelessly to the Internet. The computers should contain at least the following software and specifications:

(a) Wired or Wireless Internet connection (minimum - 3 Mbps broadband or faster bandwidth with low latency -- preferred - 5 Mbps broadband or faster bandwidth with low latency)

(b) Google Chrome (V.49 or greater) or Mozilla Firefox (V.52 or greater)

(c) Windows OS 7 or greater (Windows native fonts)

(e) Minimum 14" screen

1.6.5.2 Each facilitator will need to have a computer, and the computers should be password protected and be able to connect wirelessly to the Internet. The computers should contain at least the following software and specifications:

(a) Wired or Wireless Internet connection (minimum - 3 Mbps broadband or faster bandwidth with low latency -- preferred - 5 Mbps broadband or faster bandwidth with low latency)

(b) Google Chrome (V.49 or greater) or Mozilla Firefox (V.52 or greater)

(c) Windows OS 7 or greater (Windows native fonts)

(d) Microsoft Excel 2019 or greater

(e) Microsoft PowerPoint 2019 or greater

1.6.5.3. The contractor will arrange wireless internet connections for each room at the standard-setting study, with each room capable of handling 20 simultaneous connections without latency issues.

1.6.5.4. Lessons Learned from Studies. The Contractor shall document the lessons learned from each study and recommendations for refining the conduct of future studies.

1.6.6. Type of Contract: The Government will award a single Indefinite Delivery, Indefinite Quantity (IDIQ) contract.

1.6.7. Security Requirements: The Contractor shall employ personnel and implement procedures to safeguard the security and confidentiality of all deliverables. Contractor shall comply with Army Regulation 611-5 (2015 revision), paragraphs 3-1 and 3-2, as well as DLIFLC regulation 611-1 (2001 revision), paragraphs 7 and 8. Government will retain sole ownership of, and exclusive rights to, all deliverables and GFM.

1.6.7.1 Confidentiality Agreement. Contractor and all subcontractors’ personnel working under this contract shall sign a Government supplied confidentiality agreement to protect the security of all foreign language testing initiatives by the United States Government. This agreement shall acknowledge that irreparable harm would be caused to Government if the confidential information obtained by Contractor in the performance of tasks included in this Performance Work Statement were to be revealed to third parties. All contractors and subcontractors must submit a copy of their signed confidentiality agreement to Test Review and Production (TRP) Division before they can begin work. The confidentiality agreement entered into by Contractor or subcontractor personnel in connection with this contract shall survive the termination of this contract.

1.6.7.2 Security Procedures. Contractor or subcontractor personnel shall not show any materials pertaining to this contract to any other person, or discuss its contents, beyond normal work requirements. Contractor or subcontractor personnel shall keep all contract related materials under lock and key at all times when not actually performing the work. Contractor or subcontractor personnel shall not retain paper or electronic copies of any contract deliverables or contract related materials following the delivery of contract deliverables to Government, or re-use any of these materials for future private, public, or commercial use.

1.6.7.3 Operational Security (OPSEC) and Training. The Contractor shall practice OPSEC to protect critical information for specific government contracts and subcontracts. The Contractor will ensure that annual OPSEC training is conducted to protect DLIFLC critical information. OPSEC awareness training is available at the following websites: https://www.cdse.edu/catalog/elearning

1.6.8.1. Language Panel Experts.

It is estimated that a maximum of 24 Contractor-supplied experts per language shall be required to hold a standard-setting study. The Government shall supplement the Contractor-supplied panelists with a maximum of 12 experts of their own. The 50% requirements listed in Section https://www.cdse.edu/catalog/elearning

1.6.8.3 apply to the combined total of Contractor and DoD panelists. The exact number of Government and Contractor-provided experts will be coordinated at the task order level.

1.6.8.2. Qualifications of Language Panel Experts.

Experts shall have the following qualifications:

(a) Proficiency of ILR level 3 or greater in the target language (reading and listening).

(b) Proficiency of ILR level 3 or greater in English (reading, listening, and speaking).

(c) Experience working with the Interagency Language Roundtable (ILR) Skill Level Descriptions for Reading and Listening.

(d) Experience using the target language in the context of the Department of Defense.

1.6.8.3. Native Speaker Distribution Requirement.

50% of the experts shall be native speakers of English with ILR 3 or greater proficiency in English and the target language of the study.

50% of the experts shall be native speakers of the target language with ILR 3 or greater proficiency in that language and in English.

This requirement applies to the combined total of Government and Contractor panelists.

1.6.8.6. Language Resource Expert (LRP).

The Contractor shall provide one Language Resource Expert (LRP) for each standard-setting study. LRPs may be selected from ACTFL-screened candidates who meet qualifications but cannot serve as panelists due to prior work on the DLPT5. LRPs will be screened using the same process as panelists prior to recommendation.

1.6.8.7. Qualifications of the Language Resource Expert.

The LRP shall have the following qualifications:

(a) Proficiency of ILR level 4 in the target language (reading and listening).

(b) Proficiency of ILR level 3 in English (reading, listening, and speaking).

(c) Experience in applied linguistics or teaching the target language.

(d) Recent experience in the target culture.

Note: The LRP is not required to be a native English speaker. ILR 4 proficiency is required only in the target language.

1.6.8.8. Exceptions for LRP Qualifications.

If it is not possible to find an LRP meeting all of these qualifications, DLIFLC will determine acceptability on a case-by-case basis. No LRP shall participate in a study without DLIFLC approval.

1.6.8.10. Study Facilitators.

Each study will require at least two facilitators, as target-language panelists will be divided into two subgroups. No facilitator shall participate without DLIFLC approval.

Each facilitator shall demonstrate relevant knowledge, skills, and abilities through:

(a) Successful facilitation of standard-setting studies (of any design) on at least six occasions within the last four years, with experience facilitating adult groups and conducting all facilitation activities in English.

(b) Successful demonstration of group facilitation and moderation techniques on at least five occasions within the last five years, also conducted with adults and in English.

(c) Successful completion — at an accredited U.S. educational institution — of at least 12 graduate-level units addressing any combination of the following topics:

1. Educational and psychological measurement, including classical and modern (item) response theories.

2. AERA/APA/NCME Standards for Educational and Psychological Testing.

3. Selected- and constructed-response test development and analysis methods.

(d) Professional experience conducting research and analyses related to the ILR skill level descriptions is desirable.

(e) Successful observation of at least one DLIFLC Standard Setting Study and successful co-facilitation of at least one DLIFLC Standard Setting Study. This requirement may be waived by DLIFLC.

Additional English Proficiency Clarification:

If a facilitator’s doctoral education was completed outside an inner-circle English-speaking country, the Contractor shall provide documentation demonstrating English proficiency sufficient to conduct all facilitation duties in English.

1.6.8.11. IT Support Specialist.

The Contractor shall provide at least one (1) onsite IT Support Specialist for each standard-setting study. The IT Support Specialist is essential for the successful setup and operation of all technological components required during the study, including laptop configuration on Day 1 and ensuring the hotel provides and maintains stable Wi-Fi connectivity throughout the duration of the study.

The Contractor may, at their discretion, provide additional IT personnel based on study needs.

The presence of more than one IT Support Specialist is encouraged but not required; however, any additional IT personnel are not required to be present for all five (5) days of the study unless otherwise negotiated. Flexibility for staffing more IT personnel may be included as part of contract negotiations.

1. The Qualifications of the IT Support Specialist shall include:

(a) Experience providing onsite technical support in conference, training, or study environments.

(b) Ability to configure and troubleshoot laptops, projectors, audio-visual equipment, and internet connectivity.

(c) Experience coordinating with the venue IT staff to ensure stable Wi-Fi connections for multi-day events.

(d) Ability to provide rapid technical troubleshooting to minimize downtime during study activities.

1.1.1. Post Award Conference/Periodic Progress Meetings: The Contractor agrees to attend any post award conference convened by the contracting activity IAW Federal Acquisition Regulation Subpart 42.5, Post Award Orientation. The Contracting Officer, COR, and other Government personnel, as appropriate, may meet periodically with the contractor to review the contractor's performance. At these meetings the Government will apprise the contractor of how the Government views the contractor's performance and the contractor will apprise the Government of problems, if any, being experienced.

Appropriate action shall be taken to resolve outstanding issues. These meetings shall be at no additional cost to the Government.

1.1.2. Contracting Officer Representative (COR): The COR will be identified by separate letter. The COR monitors all technical aspects of the contract and assists in contract administration. The COR is authorized to perform the following functions:

assure that the Contractor performs the technical requirements of the contract; perform inspections necessary in connection with contract performance; maintain written and oral communications with the Contractor concerning technical aspects of the contract;

issue written interpretations of technical requirements, including Government drawings, designs, and specifications; monitor Contractor's performance and notify both the KO and Contractor of any deficiencies; coordinate availability of Government furnished property; and provide site entry of Contractor personnel. A letter of designation issued to the COR, a copy of which is sent to the Contractor, states the responsibilities and limitations of the COR, especially with regard to changes in cost or price, estimates or changes in delivery dates. The COR is not authorized to change any of the terms and conditions of the resulting order.

1.1.3. Key Personnel: The follow personnel are considered key personnel by the Government: Program Manager (PM) and Standard Setting Study Facilitators.

Program/Project Manager (PM): The Contractor shall provide a PM who shall be responsible for the performance of the work. The name of this person and an alternate who shall act for the contractor when the PM is absent shall be designated in writing to the contracting officer. The PM or alternate shall have full authority to act for the contractor on all contract matters relating to daily operation of this contract. The PM or alternate shall exercise oversight of study facilitators and ensure that facilitators are normed and consistent in adhering to standard setting study specifications. The PM or alternate shall be available during normal business hours, Monday thru Friday except Federal holidays or when the Government facility is closed for administrative reasons.

The PM must have a minimum of three years PM experience to include, but not limited to, experience in scheduling, cost accounting, problem solving, monitoring project performance, communication with stakeholders and skill with Microsoft Suite software.

Familiarity with the ILR scale is preferred. The Contractor shall submit documentation of the qualifications of the Program Manager(s) in its proposal for Government approval, which may include resumes and/or curriculum vitae.

Study Facilitators: The Contractor shall provide a minimum of two Study Facilitators designated as key personnel at the base contract level and assigned to facilitate studies at the task order level. The Contractor shall submit documentation of the qualifications of the Study Facilitators in its proposal for Government approval, which may include resumes and/or curriculum vitae.

1.1.4. Identification of Contractor Employees:

NOT APPLICABLE

1.1.5. Supervision of Contractor Employees: The Government will not exercise any supervision or control over Contractor or subcontractor employees while performing work under the contract. Such employees shall be accountable solely to the Contractor, not the Government. The Contractor, in turn, shall be accountable to the Government for Contractor or subcontractor employees.

1.6.14.1. Contractor Travel. The Contractor will be authorized travel expenses consistent with the substantive provisions of the Joint Travel Regulation (JTR)/Federal Travel Regulation (FTR)/or State Department Travel Regulation and the limitation of funds specified in this contract. All travel requires Government approval/authorization and notification to the COR, prior to making travel arrangements. The Contractor may periodically be required to travel for the purpose of attending Government initiated meetings.

1.6.14.2. The Contractor shall use only the minimum number of travelers and rental vehicles required to accomplish the requirement. Contractor personnel are responsible to make all arrangements for travel, lodging and local transportation without assistance of Government personnel. The Contractor shall coordinate security-related paperwork (including obtaining access to military installations) and any other requirements pertinent to this Performance Work Statement.

1.6.14.3. Whenever travel is determined to be necessary by the Government, Contractor personnel shall be available to travel within two weeks’ notice.

1.6.14.4. The Contractor shall obtain COR approval for travel requirements.

1.6.14.5. The Contractor shall submit a proposed cost of Contractor attendees for in-person meetings/conferences/orientation. Included in their proposal shall be a breakdown of costs related to the travel costs and shall include as a minimum, (1) transportation costs (airfare/car rental, etc.); (2) lodging and; (3) per diem for each employee. The contractor shall use JTR rates as guidelines for expenses (these can be found at http://www.defensetravel.dod.mil/site/travelreg.cfm).

1.6.14.6. The Contractor shall submit an expense report to the COR when invoicing for travel costs. This report shall contain the following, at a minimum:

http://www.defensetravel.dod.mil/site/travelreg.cfm

• A brief description of the travel to include traveler(s) name(s), dates of travel, destination and purpose of travel.

• Copies of receipts for all airfare, lodging and any expense in excess of $75.00.

• Claims for payment of per diem shall be accompanied by a corporate worksheet or copy of the employee’s per diem voucher listing the location, dates and per diem rate applied to the claim.

• Acceptable submissions include paid receipts from airlines and hotels or copies of corporate credit / purchase card statements providing that the statement lists the date, vendor name and amount of purchase.

• All backup documentation shall clearly indicate the actual date that the contractor incurred the claimed expense.

• Failure to provide the required documentation may result in rejection of the contractor’s invoice as not being a proper invoice as described in FAR 32.905(b)(2).

• Travel invoices shall be submitted separately from labor invoices.

1.6.15.1. Other Direct Costs. Task Order Issuance.

1.6.15.2. Administration: Administration for the awarded contract will be by the U.S.

Army Mission and Installation Contracting Command (MICC), Region 6, Assisted Acquisition Services located in Kansas City, MO. The point of contact is identified in block 6 of the Standard Form 26 or block 7 of the Standard Form 33.

1.6.15.3. Types of Orders: The type of orders that are authorized for use under this Indefinite Delivery - Indefinite Quantity (IDIQ) contract is Firm Fixed Price (FFP) with reimbursable line item for travel (when applicable). Task orders will be awarded on a unilateral basis.

1.6.15.4. Unauthorized Work: The contractor is not authorized to commence task order performance without a signed task order or direction by the Contracting Officer.

Notwithstanding any of the other provisions of this contract, the Contracting Officer shall be the only individual authorized on behalf of the Government to:

(a) Accept nonconforming work;

(b) Waive any requirement of the task order; or,

(c) Modify any term or condition of the task order.

1.6.15.5. Task Order Funding: No unfunded task orders are authorized. Funding must be authorized at the task order level and must be the type deemed appropriate for the services to be acquired.

1.6.15.6. Security Requirements: Contractor personnel shall conform to all security requirements as specified in each original IDIQ type contract.

1.6.15.7. Task Order Issuance Procedures: Individual task orders will be awarded with a “Total Price” for FFP task orders. Task orders shall be issued in accordance with the following procedures:

1.6.15.8. The Contracting Officer will issue a unilateral task order that will include:

(a) Contract and task order numbers;

(b) any government-furnished property, material, or base support to be made available for performance of the order;

(c) the schedule of services and/or supplies and period of performance;

(d) and any other pertinent information deemed necessary to the performance of the order.

1.6.15.9. NOTE: The preferred method for task order issuance is through electronic transmission.

1.6.15.10. Upon receipt of a written authorization/order issued by the Contracting Officer, the contractor shall furnish to the Government the services and/or supplies as set forth in the schedule.

1.6.15.11. Oral orders will be placed on an “as needed” basis in accordance with the FAR clause 52.216-19 Order Limitations and 52.216-22 Indefinite Quantity.

Performance/deliveries shall be made in response to oral orders issued against the contract by the ordering officers. Each individual task order will reflect the actual period of performance.

1.6.15.12. The contractor shall submit monthly invoices of items completed. The contractor shall submit each invoice through the ASSIST Portal at https://portal.fas.gsa.gov/public/login.

1.6.15.13. All quantities of supplies required for each individual task order assigned are fixed. The contractor shall only be paid for actual quantities ordered/work performed.

1.1.6. Organizational Conflict of Interest (OCI): The contracting officer has not identified any OCIs inherent to this requirement. It is the offeror’s responsibility to notify the contracting officer, prior to submission of proposals, if a potential OCI is identified.

1.1.7. Anti-Terrorism (AT) Level I Training.

NOT APPLICABLE

1.1.8. Access and General Protection/Security Policy and Procedures.

NOT APPLICABLE

1.1.9. AT Awareness Training for Contractor Personnel Traveling Overseas.

NOT APPLICABLE

1.1.10. iWATCH Training.

NOT APPLICABLE

1.1.11. Access to Government Information Systems.

NOT APPLICABLE

1.1.12. Operations Security (OPSEC) Standing Operating Procedure (SOP)/Plan.

NOT APPLICABLE

1.1.13. OPSEC Training. Per AR 530-1, Operations Security, all contractor employees shall complete Level I OPSEC training within 30 calendar days of their reporting for duty. All contractor employees shall complete annual OPSEC awareness training at https://www.cdse.edu/catalog/elearning.

1.1.14. Information Assurance (IA)/Information Technology (IT) Certification.

https://www.cdse.edu/catalog/elearning

NOT APPLICABLE

1.1.15. Threat Awareness Reporting Program (TARP).

NOT APPLICABLE

1.6.26 Status of Forces Agreements

NOT APPLICABLE

1.6.27. COVID-19 Guidelines, Restrictions: Social Distancing, Mask Wearing, Travel.

All contractor employees shall follow the Centers for Disease Control (CDC) guidance on the wearing of masks, social distancing and travel. All contractor employees shall follow specific guidance on social distancing and mask wearing that may be in place at standard setting study venues.

2. DEFINITIONS AND ACRONYMS:

2.1. DEFINITIONS:

2.1.1. CONTRACTOR. A supplier or vendor awarded a contract to provide specific supplies or services to the Government. The term used in this contract refers to the prime.

2.1.2. CONTRACTING OFFICER. A person with authority to enter into, administer, and/or terminate contracts, and make related determinations and findings on behalf of the Government. Note: The only individual who can legally bind the Government.

2.1.3. CONTRACTING OFFICER'S REPRESENTATIVE (COR). An employee of the U.S. Government appointed by the contracting officer to administer the contract. Such appointment shall be in writing and shall state the scope of authority and limitations.

This individual has authority to provide technical direction to the Contractor as long as that direction is within the scope of the contract, does not constitute a change, and has no funding implications. This individual does NOT have authority to change the terms and conditions of the contract.

2.1.4. DEFECTIVE SERVICE. A service output that does not meet the standard of performance associated with the PWS.

2.1.5. DELIVERABLE. Anything that can be physically delivered, but may include non-manufactured things such as meeting minutes or reports.

2.1.6. GOVERNMENT-FURNISHED PROPERTY (GFP) OR GOVERNMENT

PROPERTY (GP). Property in the possession of, or directly acquired by, the Government and subsequently made available to the Contractor.

2.1.7. KEY PERSONNEL. Contractor personnel that are evaluated in a source selection process and that may be required to be used in the performance of a contract by the Key Personnel listed in the PWS.

2.1.8. PHYSICAL SECURITY. Actions that prevent the loss or damage of Government property.

2.1.9. QUALITY ASSURANCE. The Government procedures to verify that services being performed by the Contractor are acceptable IAW established standards and requirements of this contract.

2.1.10. QUALITY ASSURANCE SURVEILLANCE PLAN (QASP). An organized written document specifying the surveillance methodology to be used for surveillance of contractor performance.

2.1.11. QUALITY CONTROL. All necessary measures taken by the Contractor to assure that the quality of an end product or service shall meet contract requirements.

2.2. ACRONYMS:

AR Army Regulation

CFR Code of Federal Regulations

CMR Contract Manpower Reporting

CONUS Continental United States (excludes Alaska and Hawaii)

COR Contracting Officer Representative

DA Department of the Army

DD254 Department of Defense Contract Security Requirement List

DFARS Defense Federal Acquisition Regulation Supplement

DMDC Defense Manpower Data Center

DoD Department of Defense

FAR Federal Acquisition Regulation

KO Contracting Officer

OCI Organizational Conflict of Interest

OCONUS Outside Continental United States (includes Alaska and Hawaii)

POC Point of Contact

PRS Performance Requirements Summary

PSD Performance Start Date

PWS Performance Work Statement

QA Quality Assurance

QAP Quality Assurance Program

QASP Quality Assurance Surveillance Plan

QC Quality Control

QCP Quality Control Program

3. GOVERNMENT FURNISHED ITEMS AND SERVICES:

3.1. Services: The Government will provide a person who will function as an observer who will monitor the entire standard setting study throughout its duration.

3.2. Facilities

NOT APPLICABLE

3.3. Utilities

NOT APPLICABLE

3.4. Equipment: The government will provide a web link to a specific application in The Test Item Development Workflow Automation System (TIDWA-DOMINO). This link and the specific event in DOMINO will be for the primary use of the standard setting study observer, but will be made available to the study facilitators and language panel experts for specific uses during each study.

3.5. Materials: The Government will provide a “DLPT5 Familiarization Guide” and “Technical Requirements for Study and Report Specifications” as part of the solicitation, but “DLPT5 Framework documents,” “Borderline Proficiency Level Descriptions” and “Standard-setting study plan” will be provided within 5 days of award of the contract.

These three documents include confidential specifications tailored to DLIFLC Standard Setting practices and are not believed to affect solicitors’ cost estimates.

Documents to be provided as part of the solicitation:

Document Description DLPT5 Familiarization Guide (go to http://www.dliflc.edu/resources/dlpt-guides/)

Guide intended for test users, including Interagency Language Roundtable Skill Level Descriptions

Technical Requirements – Study and Report Specifications

Description of the study and reports specifications to be used in the standard-setting studies http://www.dliflc.edu/resources/dlpt-

Documents to be provided within 5 days of award of the contract

Document Description Borderline Proficiency Level Descriptions

Descriptions of the abilities and functions of the borderline examinee, to be used by panelists

DLPT5 Framework document Lays out basic assumptions underlying DLPT5 testing program Standard-setting study plan Description of the methods to be used in the standard-setting studies

4. CONTRACTOR FURNISHED ITEMS AND RESPONSIBILITIES:

4.1. General: The Contractor shall furnish all supplies, equipment, facilities and services required to perform work under this contract that are not listed under Section 3 of this PWS.

4.2. Materials. See paragraph 4.1, above.

4.3. Equipment. See paragraph 4.1, above. The Contractor shall provide the following for the standard-setting studies.

4.3.1. One laptop computer, mouse, and noise-cancelling audio headset for each language panel expert’s and the language resource expert’s exclusive use for the duration of the study. The computers should be password protected and be able to connect wirelessly to the Internet. The computers should contain at least the following software and specifications:

(a) Wired or Wireless Internet connection (minimum - 3 Mbps broadband or faster bandwidth with low latency -- preferred - 5 Mbps broadband or faster bandwidth with low latency)

(b) Google Chrome (V.49 or greater) or Mozilla Firefox (V.52 or greater)

(e) Minimum 14" screen

4.3.2. Each facilitator will need to have a computer, and the computers should be password protected and be able to connect wirelessly to the Internet. The computers should contain at least the following software and specifications:

(a) Wired or Wireless Internet connection (minimum - 3 Mbps broadband or faster bandwidth with low latency -- preferred - 5 Mbps broadband or faster bandwidth with low latency)

(b) Google Chrome (V.49 or greater)

(d) Microsoft Excel 2019 or greater

(e) Microsoft PowerPoint 2019 or greater

4.3.3. The contractor will arrange wireless internet connections for each room at the standard-setting study, with each room capable of handling 20 simultaneous connections without latency issues.

4.3.4. Lessons Learned from Studies. The Contractor shall document the lessons learned from each study and recommendations for refining the conduct of future studies.

5. SPECIFIC TASKS:

5.1. Task #1, Monthly Report. Submit monthly status report to the COR which includes:

1. Contract/Task Order Number and Title

2. Period covered by the report

3. Date and Name of preparer

4. Milestones/Date Due/Government Due/Comments

5. Task Title(s) and Number(s)

6. Status of deliverables

7. Highlight any Deviation from the PWS

8. Efforts this Reporting Period

9. Efforts Projected for Next Reporting Period

10. Problem Areas

11. Travel completed this reporting period

12. Travel projected next reporting period

13. General Comments

5.1.1. Deliverable: Report shall be submitted electronically to the COR in the GSA ASSIST portal under “Collaboration” tab.

5.1.2. Standard: Monthly Status Report submitted by the 10th of each following month.

5.2. Task #2 Submit list of language panel experts.

5.2.1. Deliverable: The Contractor shall submit a list of potential experts with their resumes and evidence of their language proficiency of the target language to DLIFLC before conducting the study. DLIFLC will review and approve qualified experts to participate in each study.

5.2.2. Standard:

(1) Contractor shall submit list and resumes of all potential non- Government language experts for each standard- setting study panel at least 30 days before the scheduled convening of that panel.

(2) Language experts on the list shall meet the qualifications in paragraph 1.6.8.1., 1.6.8.2., 1.6.8.3.

5.3. Task #3 Submit list of language resource experts.

5.3.1. Deliverable: The Contractor shall submit a list of potential language resource people with their resumes and evidence of their language proficiency of the target language to DLIFLC before conducting the study. DLIFLC will review and approve a qualified language resource person to participate in each study.

5.3.2. Standard:

(1) Contractor shall submit list and resumes of all resource people for each standard-setting study panel at least 30 days before the scheduled convening of that panel.

(2) Language resource people shall meet the qualifications in paragraph 1.6.8.7.

5.4. Task #4 Submit list of facilitators.

5.4.1. Deliverable: The Contractor shall submit a list of facilitators with their resumes and curricula vitae to DLIFLC.

5.4.2. Standard:

(1) Contractor shall submit the list of facilitators at least four weeks in advance of conducting the first study. DLIFLC will approve the qualified facilitators for each study

(2) Facilitators shall meet the qualifications in paragraph 1.6.8.10.

5.5. Task #5 Submit schedule for each study.

5.5.1. Deliverable: The Contractor shall submit a detailed schedule for each standard-setting study panel.

5.5.2. Standard:

(1) Schedules shall be submitted at least 14 days before the scheduled convening of that panel.

(2) Schedules shall conform to the requirements in paragraph 1.6.8. and the standard-setting study plan. Schedules shall allow language experts and key Government personnel to attend.

5.6. Task #6 Provide study Venue

5.6.1. Deliverable: The Contractor shall submit a description of the venue in which the standard setting study will be held. The description shall include a description of the meeting spaces, floor plans, and a map showing the location of the venue and the United States Capitol as well as the scale of the map.

5.6.2. Standard: This description shall be submitted no later than 7 calendar days prior to the start of any study. Contractor shall provide a venue in the Washington, D.C. area (within a 50-mile radius of the United States Capitol) that can accommodate two independent groups of standard-setting panelists as well as plenary sessions of all panelists together. (Paragraph 5.5.)

5.7. Task #7 Conduct Studies

5.7.1. Deliverable: The Contractor shall conduct studies based on submitted study schedules.

5.7.2. Standard:

(1) Contractor shall follow approved schedule submitted.

(2) Study shall be conducted in accordance with procedures in Technical Requirements

– Study and Report Specifications.

5.8. Task #8 Submit Study Reports

5.8.1. Deliverable: The Contractor shall submit a report based on the standard setting study.

5.8.2. Standard:

(1) Reports shall be provided for each study within 30 working days of the completion of the study's panel sessions.

(2) Reports shall include the study's general findings, the recommended cut-scores, impact data, and recommendations for improvements for future studies. Reports shall also detail the conduct of the studies and identify any issues that might adversely affect the validity of the study. The study will include evidence and explanations for all conclusions in accordance with paragraph 1.6.8.9. and Tech Exhibit #2.

5.9. Task #9 Submit Confidentiality Agreements

5.9.1. Deliverable: The Contractor shall submit signed confidentiality agreements for all study participants.

5.9.2. Standard: Contractor shall submit confidentiality agreements ((Technical Exhibit #3) from all study participants prior to the participants' receiving any test materials.

5.10. Task #10 Submit certificates of destruction .

5.10.1. Deliverable: The contractor shall conduct inventories of test materials and destroy or transfer all test material to DLIFLC.

5.10.2. Standard: The Contractor shall submit certification that all test material has been destroyed or transferred to DLIFLC within 30 days following the conclusion of the development of each study or the end of the contract period of performance, whichever comes first.

5.11. Task #11 Complete OPSEC training

5.11.1. Deliverable: The contractor employees must complete Level I OPSEC Awareness training.

5.11.2. Standard: New employees must be trained within 30 calendar days of their reporting for duty and annually thereafter.

5.12. Task #12 Submit Quality Control Plan

5.12.1. Deliverable: The contractor shall submit a quality control plan to the Contracting Officer and COR.

5.12.2. Standard: The initial plan shall be submitted to the Contracting Officer for review and approval no later than thirty (30) calendar days after contract award (1.6.1.).

6. APPLICABLE PUBLICATIONS AND DOCUMENTS (CURRENT EDITIONS) .

LPAD will provide “DLPT5 Familiarization Guide” and “Technical Requirements for Study and Report Specifications” (Technical Exhibit #2) as part of the solicitation.

“DLPT5 Framework documents,” “Borderline Proficiency Level Descriptions” and “Standard-Setting Study Plan” will be provided within 5 days of award of the contract.

These three documents include confidential specifications tailored to DLIFLC Standard Setting practices and are not believed to affect solicitors’ cost estimates.

Technical Exhibit # Document Name Description Technical Exhibit #1 Proposed Listing of Standard Setting Studies in the Base Year Languages for the Base Year

Technical Exhibit #2 Technical Requirements – Study and Report Specifications

Description of the study and reports specifications to be used in the standard- setting studies.

Technical Exhibit #3 DLIFLC ATFL-ESD-TD Test Security Agreement Form

Test security agreement form for all participants in standard setting studies process.

Technical Exhibit #4 Borderline Proficiency Level Descriptions (BPLD) (To be provided within 5 days after award of contract)

Descriptions of the abilities and functions of the borderline examinee, to be used by panelists.

Technical Exhibit #5 DLPT5 Framework document (To be provided within 5 days after award of contract)

Lays out basic assumptions underlying DLPT5 testing program.

Technical Exhibit #6 Standard-Setting Study Plan (To be provided within 5 days after award of contract)

Description of the methods to be used in the standard-setting studies.

Technical Exhibit #7 DLPT5 Familiarization Guide (go to https://www.dliflc.edu/resources/dlpt-guides/)

Guide intended for test users, including Interagency Language Roundtable Skill Level Descriptions.

Army Regulation 611-5 (2015 revision), paragraphs 3-1 and 3-2.

DLIFLC regulation 611-1 (2001 revision), paragraphs 7 and 8.

(End of Performance Work Statement) http://www.dliflc.edu/dlptguides.html)