Attachment E.2.xlsx
XLSX spreadsheet 28 KB Posted
- Attached to
- Survey Data Quality Control Services
- Solicitation number
- 951700-25-Q-0009
- Issued by
-
US Agency for Global Media
About this file
This file is a quality control testing script and validation matrix for a survey project, appearing to be an Excel spreadsheet attachment. The document outlines detailed test scenarios and validation requirements for a survey questionnaire that covers media consumption habits, focusing on various news sources including BBC, VOA, CGTN, and others. The matrix includes specific test cases for different response pathways, filtering logic, randomization requirements, and skip patterns across multiple question categories including demographics, media usage, brand awareness, and content preferences.
The file contains technical specifications for script testing, with requirements that each QC deliverable must undergo up to 3 rounds of quality control, with at least 6 script tests per round. Several issues are identified regarding randomization, filtering, and labeling problems that need correction, such as incorrect BA4 header filtering, missing question BA3I, and improper randomization in sections NUB, CTB3, and GM7A. This appears to be part of a larger survey data quality control services contract for the US Agency for Global Media (USAGM) mentioned in the related contract opportunity.
View the file
Other files
| File | Type | Posted |
|---|---|---|
| RFQ - 951700-25-Q-0009 - Amendment 00001.pdf | ||
| Attachment D - Amendment 00001.pdf | ||
| Attachment A - SOW - Amendment 00001.pdf | ||
| Attachment D - QA.xlsx | XLSX spreadsheet | |
| Attachment E.4.xlsx | XLSX spreadsheet | |
| Attachment A - SOW.pdf | ||
| RFQ - 951700-25-Q-0009.pdf | ||
| Attachment E.5.xlsx | XLSX spreadsheet | |
| Attachment C - Price Schedule.xlsx | XLSX spreadsheet | |
| Attachment B - TC.pdf | ||
| Attachment E.6.xlsx | XLSX spreadsheet | |
| Attachment E.1.xlsx | XLSX spreadsheet | |
| Attachment E.3.xlsx | XLSX spreadsheet |
Show all 13
On GovTribe
Work with this file
- Download the original file
- Contacts named in this file
- Similar government files
- Ask GovTribe AI about this file
Text version
2a - Script Review
| Variable Name / Q# | Category of Issue | Issue | Feedback | |
| BA4 | labelling | Please put the BA4 header into a filter so only shows if any of BA3 items = "Yes"? | ||
| BA4I | Missing question | I can see "CRI or China Radio International" as BA4I, but there is no BA3I. | NOTE - for each of our QC deliverables, there are up to 3 of QC, depending on the quality of the script. For each round, at least 6 sccript test should be conducted. | |
| NUB1B | Randomization | Items not currently randomized. | ||
| Section NUB | Randomization | The implemented randomization does not match the randomization outlined in the QQ. | ||
| NUB12 | Randomization | Items not currently randomized. | ||
| RLB2 | Randomization | Items not currently randomized. | ||
| RLO11B | Filtering | Incorrect filtering. | ||
| RLO11C | Filtering | Any categories mentioned at RLO11A or RLO11B should not appear in RLO11C. | ||
| CTB3 | Randomization | Items not currently randomized. | ||
| CTB3F | Randomization | Items not currently randomized. | ||
| DB1 | Filtering | Error message appears on script is "Yes" if selected at all items (including DB1Z). | ||
| GM7A | Randomization | Randomization incorrect. Only randomize "Apple" and "Samsung" and retain "Other Android" as the 3rd category and retain "Some other brand" as the 4th category. | ||
| CEN2B | Incorrect | In the QQ, CEN2BA=XX, but this is missing in the script. "YY" is in the script but is not in the QQ. | ||
| Section GO | Ordering | This currently comes after the "Demographic" section but should be before. | ||
| DM3 | Incorrect | There are more categories in the survey script than in the QQ. | ||
| DM4 | Incorrect | The script does not have all languages outlined in the QQ. | ||
| DM9A | Filtering | The skip pattern preceeding DM9C (the skip on DM9A) is incorrect. |
Tests-1 to 6
| Q# | Test-1 (Yes-route) | Test-2 (No-route) | Test-3 (AC1A=Yes) [TV] | Test-4 (AC1B=Yes) [Radio] | Test-5 (AC1C=Yes) [Computer or laptop or tablet] | Test-6 (AC1D=Yes) [Mobile Phone] |
| AC1 | Select="Yes" for all items | Select="No" for all items | Select="Yes" for "Television"; select "No" for all other items | Select="Yes" for "Radio"; select "No" for all other items | Select="Yes" for "Computer or laptop or tablet"; select "No" for all other items | Select="Yes" for "Mobile Phone"; select "No" for all other items |
| AC2 | Select="Yes" for all items | Select="No" for all items | Select="No" for all items | Select="Don't Know" for all items | Select="Refused" for all items | Select="Refused" for all items |
| AC2ZO | Add any text to text box | Should not appear | Should not appear | Should not appear | Should not appear | Should not appear |
| BA3 | Select="Yes" for all items | Select="No" for all items | Select="Yes" for "BBC", "DW", "Golos Ameriki in Russian"; select "No" for all other items | Select="Yes" for "KTK", "CGTN", "CT", "VOA English"; select "Don't Know" for all other items | Select="Yes" for "Pervyi Kanal Rossiya", "Meduza", "Data QCutnik", "Radio Azattyq"; select "No" for all other items | Select="Don't Know" for all items |
| BA4 | Select="Yes" for all items | Should not appear | "BBC", "DW", "Golos Ameriki in Russian" only should appear; Select="Yes" for each of "BBC ", "DW", "Golos Ameriki in Russian" | "KTK", "CGTN", "CT" and "VOA English" only should appear; Select="Yes" for "VOA English", "CT" and "No" for "KTK" and "CGTN" | "Pervyi Kanal Rossiya", "Meduza", "Data QCutnik" and Radio Azattyq" only should appear; Select="Yes" for "Radio Azattyq", "Meduza", "Data QCutnik" and "No" for "Pervyi Kanal Rossiya" | Should not appear |
| PS1 | Select="Yes" for all items | Select="No" for all items | Select="Yes" for PS1A and "No" for all other items | Select="Yes" for PS1B" and "Don't Know" for all other items | Select="Yes" for PS1C" and "Don't Know" for all other items | Select="Yes" for PS1D" and "Don't Know" for all other items |
| PS2 | Select="Yes" for all items | Should not appear | Select="No" for all items | Should not appear | Should not appear | Should not appear |
| PS3 | Select="Yes" for all items | Should not appear | Should not appear | Select="Don't Know" for all items | Should not appear | Should not appear |
| PS4 | Select="Yes" for all items | Should not appear | Should not appear | Should not appear | Select="Don't Know" for all items | Should not appear |
| PS5 | Select="Yes" for all items | Should not appear | Should not appear | Should not appear | Should not appear | Select="Don't Know" for all items |
| NUB1B | Select="Yes" for all items | Should not appear | Select="No" for all items | Should not appear | Should not appear | Should not appear |
| NUB1C | Select "Very trustworthy" | Should not appear | Select="Don't Know" | Should not appear | Should not appear | Should not appear |
| NUB2C | Select "Very trustworthy" | Should not appear | Should not appear | Select="Don't Know" | Should not appear | Should not appear |
| NUB3C | Select "Very trustworthy" | Should not appear | Should not appear | Should not appear | Select="Don't Know" | Should not appear |
| NUB4C | Select "Very trustworthy" | Should not appear | Should not appear | Should not appear | Select="Don't Know" | Should not appear |
| NUB5C | Select="Yes" for all items | Should not appear | Should not appear | Should not appear | Select="Don't Know" | Should not appear |
| NUB6C | Select "Very trustworthy" | Should not appear | Should not appear | Should not appear | Should not appear | Should not appear |
| NUB7C | Select "Very trustworthy" | Should not appear | Should not appear | Should not appear | Should not appear | Should not appear |
| NUB8C | Select "Very trustworthy" | Should not appear | Should not appear | Select="Don't Know" | Should not appear | Should not appear |
| NUB9C | Select "Very trustworthy" | Should not appear | Should not appear | Should not appear | Should not appear | Should not appear |
| NUB10 | Select="Yes" for all items | Should not appear | Should not appear | Select="Don't Know" for all items | Should not appear | Should not appear |
| NUB11 | Select="Yes" for all items | Should not appear | Should not appear | Select="Don't Know" for all items | Should not appear | Should not appear |
| NUB12 | Select="Yes" for all items | Should not appear | Should not appear | Should not appear | Should not appear | Should not appear |
| RLB1 | Select="Yes" for all items | Should not appear | Should not appear | Should not appear | Select="No" for all items | Should not appear |
| RLB2 | Select="Yes" for all items | Should not appear | Should not appear | Should not appear | Select="No" for all items | Should not appear |
| RLB3 | Select="Yes" for all items | Should not appear | Should not appear | Should not appear | Select="No" for all items | Should not appear |
| RLB4 | Select="Yes" for all items | Should not appear | Should not appear | Should not appear | Select="No" for all items | Should not appear |
| RLB4ZO | Add text to all boxes | Should not appear | Should not appear | Should not appear | Should not appear | Should not appear |
| RLO1 | Select "Several days a week or more" | Should not appear | Should not appear | Should not appear | Select="Don't Know" | Should not appear |
| RLO2 | Select "Very trustworthy" | Should not appear | Should not appear | Should not appear | Select="Don't Know" | Should not appear |
| RLO3 | Select "Several days a week or more" | Should not appear | Should not appear | Should not appear | Select="Don't Know" | Should not appear |
| RLO4 | Select="Yes" for all items | Should not appear | Should not appear | Should not appear | Select="Don't Know" for all items | Should not appear |
| RLO5 | Select="Yes" for all items | Should not appear | Should not appear | Should not appear | Select="Don't Know" | Should not appear |
| RLO6 | Select="Increased" | Should not appear | Should not appear | Should not appear | Select="Decreased" | Should not appear |
| RLO7 | Should not appear | Should not appear | Should not appear | Should not appear | Select="Don't Know" | Should not appear |
| RLO8 | Select="Very interesting" | Should not appear | Should not appear | Should not appear | Select="Don't Know" | Should not appear |
| RLO9 | Select="Yes" for all items | Should not appear | Should not appear | Should not appear | Select="Don't Know" for all items | Should not appear |
| RLO10 | Select="Yes" | Should not appear | Should not appear | Should not appear | Select="Yes" | Should not appear |
| RLO11A | Select="Include a wider variety of topics" | Should not appear | Should not appear | Should not appear | Select="Include a wider variety of topics" | Should not appear |
| RLO11B | Select="Improve fairness/Eliminate bias", note that "Include a wider variety of topics" should not appear | Should not appear | Should not appear | Should not appear | Select="Don't Know", note that "Include a wider variety of topics" should not appear | Should not appear |
| RLO11C | Select="Include more viewpoints and perData QCectives", note that "Improve fairness/Eliminate bias" and "Include a wider variety of topics" should not appear | Should not appear | Should not appear | Should not appear | Should not appear | Should not appear |
| VOAB1 | Select="Yes" for all items | Should not appear | Select="No" for all items | Should not appear | Should not appear | Should not appear |
| VOAB3 | Select="Yes" for all items | Should not appear | Select="No" for all items | Should not appear | Should not appear | Should not appear |
| VOAB4 | Select="Yes" for all items | Should not appear | Select="No" for all items | Should not appear | Should not appear | Should not appear |
| VOAB4ZO | Add text to all boxes | Should not appear | Should not appear | Should not appear | Should not appear | Should not appear |
| VOAB5 | Select="Yes" for all items | Should not appear | Select="No" for all items | Should not appear | Should not appear | Should not appear |
| VOAO1 | Select "Several days a week or more" | Should not appear | Select="Don't Know" | Should not appear | Should not appear | Should not appear |
| VOAO2 | Select "Very trustworthy" | Should not appear | Select="Don't Know" | Should not appear | Should not appear | Should not appear |
| VOAO3 | Select "Several days a week or more" | Should not appear | Select="Don't Know" | Should not appear | Should not appear | Should not appear |
| VOAO4 | Select="Yes" for all items | Should not appear | Select="Disagree" for all items | Should not appear | Should not appear | Should not appear |
| VOAO5 | Select="Yes" for all items | Should not appear | Select="No" | Should not appear | Should not appear | Should not appear |
| CTB1 | Select="Yes" for all items | Should not appear | Should not appear | Select="No" for all items | Should not appear | Should not appear |
| CTB3 | Select="Yes" for all items | Should not appear | Should not appear | Select="No" for all items | Should not appear | Should not appear |
| CTB3F | Select="Yes" for all items | Should not appear | Should not appear | Should not appear | Should not appear | |
| CTB4 | Select="Yes" for all items | Should not appear | Should not appear | Select="No" for all items | Should not appear | Should not appear |
| CTB4ZO | Add text to all boxes | Should not appear | Should not appear | Should not appear | Should not appear | Should not appear |
| CTB5 | Select="Yes" for all items | Should not appear | Should not appear | Should not appear | Should not appear | Should not appear |
| CTB5ZO | Add text to all boxes | Should not appear | Should not appear | Should not appear | Should not appear | |
| CTO1 | Select "Several days a week or more" | Should not appear | Should not appear | Select="Don't Know" | Should not appear | Should not appear |
| CTO2 | Select "Very trustworthy" | Should not appear | Should not appear | Select="Don't Know" | Should not appear | Should not appear |
| CTO3 | Select "Several days a week or more" | Should not appear | Should not appear | Select="Refused" | Should not appear | Should not appear |
| CTO4 | Select="Yes" for all items | Should not appear | Should not appear | Select="Don't Know" for all items | Should not appear | Should not appear |
| CTO5 | Select="Yes" for all items | Should not appear | Should not appear | Select="Don't Know" | Should not appear | Should not appear |
| CTO6 | Select="Yes" for all items | Should not appear | Should not appear | Select="Don't Know" for all items | Should not appear | |
| DB1 | Select="Yes" to DB1A to DB1E, select "No" to "DB1Z" | Should not appear | Should not appear | Should not appear | Select="No" to DB1A to DB1E, select "Yes" to "DB1Z" | Select="Yes" to DB1A to DB1E, select "No" to "DB1Z" |
| DB2 | Select="Yes" for all items | Should not appear | Should not appear | Should not appear | Should not appear | Select="No" for all items |
| DB2ZO | Add any text to text box | Should not appear | Should not appear | Should not appear | Should not appear | Should not appear |
| DB3 | Select="Yes" for all items | Should not appear | Should not appear | Should not appear | Should not appear | Select="No" for all items |
| DB3ZO | Add any text to text box | Should not appear | Should not appear | Should not appear | Should not appear | Should not appear |
| GM15 | Select="Yes" | Should not appear | Should not appear | Should not appear | Select="No" | Select="No" |
| GM5 | Select="Yes" for all items | Should not appear | Should not appear | Select="Don't Know" for all items | Should not appear | Should not appear |
| GM6 | Select="Yes" for all items | Should not appear | Should not appear | Should not appear | Select="No" for all items | Select="No" for all items |
| GM7A | Select="Yes" for all items | Should not appear | Should not appear | Should not appear | Should not appear | Select="Yes" for "Apple", select="No" for all other items |
| GM7B | Select="Yes" for all items | Should not appear | Should not appear | Should not appear | Should not appear | Select="Don't Know" for all items |
| GM11 | Select="Yes" | Should not appear | Should not appear | Should not appear | Should not appear | Select="No" |
| GM12 | Select="Yes" for all items | Should not appear | Should not appear | Should not appear | Should not appear | Should not appear |
| GM15A | Select="Yes" | Should not appear | Should not appear | Should not appear | Select="No" | Select="No" |
| GM16A | Select="Yes" for all items | Should not appear | Should not appear | Should not appear | Should not appear | Should not appear |
| GM17 | Select="Yes" for all items | Should not appear | Select="Yes" for GM17B and "No" for all other items | Should not appear | Should not appear | Should not appear |
| GM18 | Select="Yes" for all items | Should not appear | Select="No" for all items | Should not appear | Should not appear | Should not appear |
| GM18ZO | Add any text to text box | Should not appear | Should not appear | Should not appear | Should not appear | Should not appear |
| GM19 | Select="Yes" | Select="No" | Select="Don't Know" | Select="Refused" | Select="Yes" | Select="No" |
| CEN1A | Select="Yes" | Should not appear | Should not appear | Should not appear | Select="No" | Select="Yes" |
| CEN2A | Select="Yes" | Should not appear | Should not appear | Should not appear | Select="Yes" | Select="No" |
| CEN3B | Select="Yes" | Should not appear | Should not appear | Should not appear | Select="No" | Select="Yes" |
| CEN3C | Select="Anytime I use the internet" | Should not appear | Should not appear | Should not appear | Should not appear | Select="Don't Know" |
| CEN3D | Select="Yes" for all items | Should not appear | Should not appear | Should not appear | Should not appear | Select="Don't Know" for all items |
| CEN2B | Select="Yes" for all items | Should not appear | Should not appear | Should not appear | Select="No" for all items | Should not appear |
| CEN3E | Select="Yes" for all items | Should not appear | Should not appear | Should not appear | Should not appear | Select="Don't Know" for all items |
| GO1 | Select="Very interested" for all items | Select="Don't Know" for all items | Select="Refused" for all items | Select="Don't Know" for all items | Select="Not interested" for all items | Select="Don't Know" for all items |
| GO2 | Select="Very favorable" for all items | Select="Don't Know" for all items | Select="Refused" for all items | Select="Don't Know" for all items | Select="Somewhat favorable" for all items | Select="Don't Know" for all items |
| GO3 | Select="Several days a week or more" | Select="Don't Know" | Select="Refused" | Select="Never" | Select="Once a week" for all items | Select=":Less often" |
| GO5A | Select="Terrorism" | Select="Don't Know" | Select="Ethnic conflict or tension" | Select="Don't Know" | Select="Poverty" | Select="Don't Know" |
| GO5B | Select="Health problems", note that "Terrorism" should not appear | Should not appear | Select="Refused", note that "Ethnic conflict or tension" should not appear | Should not appear | Select="None / No more reData QConses", note that "Poverty" should not appear | Should not appear |
| GO5C | Select="Housing problems", note that "Terrorism" and "Health problems" should not appear | Should not appear | Should not appear | Should not appear | Should not appear | Should not appear |
| GO8 | Select="Very satisfied" | Select="Don't Know" | Select="Refused" | Select="Don't Know" | Select="Don't Know" | Select="Don't Know" |
| GO11 | Select="Very important" for all items | Select="Don't Know" for all items | Select="Refused" for all items | Select="Don't Know" for all items | Select="Don't Know" for all items | Select="Don't Know" for all items |
| GO17 | Select="Very interested" for all items | Select="Don't Know" for all items | Select="Refused" for all items | Select="Somewhat interested" for all items | Select="Somewhat interested" for all items | Select="Don't Know" for all items |
| GO19 | Select="I actively seek…" | Select="Don't Know" | Select="Refused" | Select="Don't Know" | Select="I mostly bump ..." | Select="Don't Know" |
| DM1 | Select="Male" | Select="Female" | Select="Female" | Select="Female" | Select="Female" | Select="Female" |
| DM2 | Select="35" | Select="Don't Know" | Select="45" | Select="Refused" | Select="9999"; then select lowest age in valid range | Select="Don't Know" |
| DM2A | Shoud not appear | Select="35-39" | Shoud not appear | Select="Refused" | Select="Refused" | Select="35-39" |
| DM3 | Answer any | Select="Don't Know" | Select="Refused" | Select="Other" | Select="Other" | Select="Don't Know" |
| DM4 | Select="Kazakh" | Select="Don't Know" | Select="Russian" | Select="Uzbek" | Select="Kyrgyz" | Select="Don't Know" |
| DM5A | Select="All of it" for all items appearing; "Kazakh" as chosen at DM4 should not show in DM5A | Select="Don't Know" for all items appearing; all items should appear | Select="Refused" for all items appearing; "Russian" as chosen at DM4 should not show in DM5A | Select="Most of it" for all items appearing; "Uzbek" as chosen at DM4 should not show in DM5A | Select="None of it" for all items appearing; "Kyrgyz" as chosen at DM4 should not show in DM5A | Select="Don't Know" for all items appearing; all items should appear |
| DM6 | Answer any | Select="Don't Know" | Answer any | Answer any | Answer any | Select="Don't Know" |
| DM7 | Answer any | Select="Don't Know" | Answer any | Answer any | Answer any | Select="Don't Know" |
| DM8 | Answer any | Select="Don't Know" | Answer any | Answer any | Answer any | Select="Don't Know" |
| DM9A | Select="Yes" | Select="No" | Select="Don't Know" | Select="Refused" | Select="Yes" | Select="No" |
| DM9B | Shoud not appear | Select="Yes" | Select="Refused" | Select="No" | Should not appear | Select="Yes" |
| DM9C | Answer any | Select="Don't Know" | Select="Refused" | Select="Student" | Select="Homemaker" | Select="Don't Know" |
| DM10A | Answer any | Should not appear | Should not appear | Should not appear | Select="Don't Know" | Should not appear |
| DM10B | Answer any | Should not appear | Should not appear | Should not appear | Select="Don't Know" | Should not appear |
| II1 | Answer any | Answer any | Answer any | Answer any | Answer any | Answer any |
| II2 | Answer any | Answer any | Answer any | Answer any | Answer any | Answer any |
| II3 | Select="Kazakh" | Select="Russian" | Select="Kazakh" | Select="Russian" | Select="Kazakh" | Select="Russian" |
| II4 | Select="Yes" for all items | Select="Don't Know" for all items | Select="Refused" for all items | Select="No" for all items | Select="No" for all items | Select="Don't Know" for all items |
| II4ZO | Add text to text box | Should not appear | Should not appear | Should not appear | Should not appear | Should not appear |
| SUB1 | Answer any | Answer any | Answer any | Answer any | Answer any | Answer any |
| SUB3 | Add text to text box | Add text to text box | Add text to text box | Add text to text box | Add text to text box | Add text to text box |
| SUB5 | Answer any | Answer any | Answer any | Answer any | Answer any | Answer any |
| SUB6 | Answer any | Answer any | Answer any | Answer any | Answer any | Answer any |
File details come from the government source that posted it. Updated .