Tech14_Consolidated Item Review Criteria.pdf

Review Criteria – Multiple-Choice

Orientation Meet Criteria

1 The orientation statement reflects the text type of the passage. Yes No

2 The orientation statement does NOT point to the Key. Yes No

Justification(s) for No:

TL passage Meet Criteria

1 TL passage meets the ILR and text mode specifications and aligns with the general passage characteristics provided in the Test Specifications document. (See ILR Descriptions, Text Modes and Test Specifications)

Yes

No

2 The communicative intent of the passage is clear to the reader or listener and can be aligned with Child’s Modes and the corresponding ILR skill level.

Yes No

3 Grammar, vocabulary, register, text organization, spelling reflect generally accepted current usage.

Yes No

4 Topic, genre, cultural schemata, and scenarios reflect FLOs’ topic domains and current socio-cultural contexts of the passage.

Yes No

5 TL passage is delivered in the requested language variant. Yes No

6 TL passage does not compromise examinee performance by evoking a strong negative emotional reaction.

Yes No

7 TL passage is self-standing. Yes No

8 Recognizable [REC] words do not give away the core of the passage or the testable point(s). Yes No

9 TL passage is free from misspellings and typographical errors. Yes No

Transcripts Meet Criteria

1 Transcript of a LC passage is a complete and accurate written record of the audio. Yes No

Justification(s) for No:

Rendering (See Rendering Guidelines) Meet Criteria

1 Rendering accurately reflects TL passage content. Yes No

2 Recognizable words are marked. Yes No

3 Abbreviations, acronyms are explained. Yes No

4 Endophoric references are clear. Yes No

5 Meanings of TL idiomatic expressions and cultural aspects are explained. Yes No

6 RC rendering word count adheres to test specifications. (See Test Specifications) Yes No

7 Word and/or Expression in ‘Vocabulary in Context’ RC item is clearly indicated. Yes No

Justification(s) for No:

Audio Meet Criteria

1 LC audio length adheres to test specifications. (See Test Specifications) Yes No

2 Utterances are distinguishable. Yes No

Task Meet Criteria

1 Answering correctly requires comprehension of the passage. Yes No

2 The proficiency skill measured in the task is level-appropriate according to the ILR descriptors and/or test specifications.

Yes

No

3 Options are conceptually and structurally balanced. Yes No

4 Item set is free from typographical errors and grammatical mistakes. Yes No

5 Stems and options are independent of each other in the same item set. Yes No

Stem Meet Criteria

1 The wording of the Stem elicits the Key proposed in the task. Yes No

2 The question posed in the Stem does NOT point to the Key of another item in the same item set. Yes No

3 The question posed in the Stem elicits explicit and/or implicit information contained in the passage. Yes No

4 The question posed in the Stem does not contain negation or double negation (unless the passage instructs the reader/listener not to do something).

Yes No

Key Meet Criteria

1 The Key is the complete and accurate answer to the question posed in the Stem. Yes No

2 The Key does NOT stand out structurally or conceptually. Yes No

3 The Key does NOT point to the Key of another item in the same item set. Yes No

Distractors Meet Criteria

1 The distractors are incorrect answers to the question posed in the Stem. Yes No

2 The distractors are grammatically and conceptually correct answers to the Stem. Yes No

3 The distractors are NOT the opposite of the Key and/or another distractor in content Yes No

4 The distractors are anchored in or are conceptually related to the passage. Yes No

Technical Exhibit 17 12/9/2021

*Conditions for selecting Accept, Reject, or Fixable:

- Accept: when all of the yes are circled.

- Reject: when no is circled for any of the following: TL Passage, Audio/Word Count, Task, Stem, Key, or Distractors. Justifications will be provided.

- Fixable: when a no is circled under Orientation, Stem, Key, or Distractors and only minor adjustments are needed. Justifications will be provided.