RFP I822-24-IQ-00002_QA_final.pdf

Question & Answer Question

Contractor Question Government Response

1 The RFP states that on projects there will be “1-4 languages, depending on the country”.

• What are some or all the languages that will be used on projects?

Please refer to the list of languages included in the revised SOW incorporated as part of Amendment 0002.

• What are some or all the languages that will be used on projects?

Yes, but rarely, and typically in Sub- Saharan Africa. We work with our field partners to determine what languages will cover most of the population, and then field in those.

2 What is the average number of languages on each project?

Between 1 and 4 languages.

3 Can tell us the name of the company that will be conducting the data collection on these studies?

USAGM typically works with 8 different companies to collect data. At this time, the names of the companies will not be shared.

4 Will we work and communicate directly with that company when performing tasks under this contract

Yes, although infrequently. USAGM and teams at the networks will serve as the primary point of contact, but there may be times when receiving scripted survey links.

5 What is the name of the data collection software that will be used by the company conducting the data collection?

This varies depending on the company that collects that data. In the past, our data has been collected using SurveyToGo, SurveyCTO, RCS, and others.

6 What is the length in field per project (in days or weeks)?

We ask that our fieldwork be conducted within 6 to 8 weeks. In some markets, it takes a bit longer.

7 How similar are the questionnaires used on the 15 to 25 projects.

USAGM has a core questionnaire that is the basis for all surveys, and as such, questionnaires are similar across countries. However, there are key differences. USAGM has 5 networks that operate globally, and each of those networks has different questions that they include the survey. As such, the “brand” (or network) sections in each survey are different by country.

8 What is the preferred format of the Data Codebook? Do you have an example you can share with us?

Excel format. Please refer to the sample, Attachment B, incorporated as part Amendment 0002.

9 Do you have an example of a questionnaire that you can share with us?

Please refer to the attached sample questions (Attachment A). This is just to provide a sample of what the questions might be, however it does not cover all aspects of the questionnaire (60-75 pages long on average).

10 Under the section, Review Derived Variable Plan, there is mention of a survey data dictionary. Is this different from the Data Codebook and if so, can you share an example?

This is different, as the data codebook comprises the fielded variables only and the data dictionary is a more comprehensive list of the agency’s derived and fielded variables. The Government will provide this information after award.

11 On projects, will the vendor be provided with statistical norms for media usage patterns in the countries?

This information will be provided, after award, upon request.

12 What is the preferred format for the final data set?

SPSS format.

13 What is the preferred format for topline tables?

CSV or Excel file. Please refer to the revised SOW incorporated as part of Amendment 0002.

14 How many records and variables are in your current database?

201,306 records and 20,900 variables.

15 What software do you use for syntax?

SPSS?

SPSS.

16 The RFP states “Travel funds will be provided for no more than four in-person work sessions for one staff member, lasting no more than business days.”

• Can you clarify the number of business days and length of the work sessions

Two full, business workdays per trip.

Please refer to the revised SOW incorporated as part of Amendment 0002.

17 What is the typical sample size for your media surveys? If it varies widely please provide ranges.

Sample sizes are typically 1,000 observations (for omnibus data) or 2,000 observations for our full media surveys.

In large countries such as Russia or India, sample sizes will be much larger (ex.

9,000 in our last Russia survey).

18 It appears from the task list that there are no tasks for collecting interviews.

Therefore we assume that USAGM will manage that portion of the

Yes.

projects themselves, or through other contractors for each specific country.

Is that correct?

19 We have our own software for programming surveys and collecting survey data. If we provide a link for data collection, can your fielding agencies work with that?

No.

20 Are there any key personnel or anticipated key personnel within the restraints of this project? If so, could you kindly provide their roles?

No. The offeror shall staff this requirement with the appropriate personnel based on their technical approach.

21 Will USAGM confirm whether any travel outside the Washington DC metro area will be required under this contract?

USAGM does not anticipate travel besides to the USAGM headquarters, in Washington DC, to be required.

22 Is international travel required within the duration of this contract?

USAGM does not anticipate that, unless an offeror is based outside of the United States.

23 Can you clarify the expectation of the contractor creating a "Data Codebook"?

Using the survey questionnaire and question tags, create a data codebook that outlines how field vendors should structure the datasets they deliver to

USAGM.

24 Can you clarify the Derived Variable Plan or provide an example of your Delivered Variable Plan? “DV Plan”?

Does the USAGM already have this internally?

USAGM has Derived Variable Plans for previous projects, and those can be shared. The DV Plans for our survey projects are similar and follow a universal template, however for every survey project will have DV Plan that has a subset of variables that must been crafted because they reflect the unique news offering in a particular country.

25 What volume of survey responses would be anticipated for this project?

Please refer to the revised SOW incorporated in Amendment 0002 as well as the response to question 13. Collection of interviews/responses will be handled by other field vendors.

26 How many USAGM staff would need training? How many USAGM staff will be creating/ingesting/Analysing/etc Survey data.

Up to 20 team members employed by USAGM and its networks would need to be trained. These analysts and research directors will be working with the survey data, DV plans, codebooks, data dictionary, and data tables.

27 The agency currently maintains a survey database containing key

SQL tables hosted in the agency’s database management system.

performance indicators for all countries, networks, major brands, and languages, as well as meta-data for each media survey dataset. What platform is the database built on and how is it hosted?

28 For each completed media survey, the contractor shall ingest the dataset into the database, including appropriate metadata: population statistics, weighted percentages, and unweighted Ns. Are there any tools or infrastructure available in-house for developing ETL pipelines?

Yes. USAGM has a coding team responsible for ETL.

29 For each completed media survey, the contractor shall ingest the dataset into the database, including appropriate metadata: population statistics, weighted percentages, and unweighted Ns. How does OPR currently receive and ingest survey data? What tools and platforms are used to collect and store completed surveys?

OPR currently receives survey data as SPSS .sav files, and derived variables are drawn into SQL tables. Data collection is done by other field vendors using a variety of survey platforms (see Q&A and SOW for fuller description), and completed surveys are stored in agency’s shared directories.

30 For each completed media survey, the contractor shall ingest the dataset into the database, including appropriate metadata: population statistics, weighted percentages, and unweighted Ns. Approximately what volume of data does OPR receive? From how many sources?

Please refer to the revised SOW incorporated in Amendment 0002 as well as the response to question 13. Annually, OPR receives datasets from 15-25 CAPI surveys with an average duration of 25 minutes and up to 30-40 omnibus surveys with a duration of 4 minutes. Each full media survey has 475 field variables.

Each omnibus survey contains approximately 150 field variables.

31 For each completed media survey, the contractor shall ingest the dataset into the database, including appropriate metadata: population statistics, weighted percentages, and unweighted Ns. Are there any relevant security and privacy restrictions regarding access to survey data, and developing direct connections between survey collection sources and the survey database?

Survey data is collected by other field vendors, and stripped of PII before being delivered to USAGM. USAGM will share the datasets with contractor for this project via a file transfer program.

Currently, there is no direct connection between survey collection programs and the survey database.

32 The contractor, while working with the agency’s questionnaires and survey dataset, will advise OPR on better practices and tools for managing survey data, with the aim of automating as many parts of the process as possible. Is the data collected structured, semi-structured, unstructured, or a combination thereof?

The data is structured. Open ended survey questions would not be included in the database.

33 The contractor, while working with the agency’s questionnaires and survey dataset, will advise OPR on better practices and tools for managing survey data, with the aim of automating as many parts of the process as possible. What tools, processes, and procedures are used to collect survey data?

Please refer to the responses to questions 2 and 4. Essentially, eight other vendors collect CAPI and CATI survey data using a variety of survey platforms, mostly very well-known programs such as SurveyToGo, Survey CTO, nField, and other proprietary such as RCS. USAGM CAPI and CATI surveys are all representative, obtained through random selection.

34 The deliverable for task 3.0 is listed as "Routinely updated CSV files" in the table and as a "1-5 page written report" in the body. Can USAGM please confirm the deliverables listen in the body are correct?

The deliverables until 3.0 are correct. The reference to “1-5 page written report” is under section 4.0, and is therefore a different activity.

35 Review Derived Variable Plan: In cooperation with the agency, review the accuracy of derived variable plan (DV plan) for each survey, ensuring it aligns with the agency’s survey data dictionary. Will USAGM please confirm that development of the Derived Variable Plan is not within the tasks for this effort, and that task

1.3 is limited to review only?

That is correct. USAGM is responsible for the development of the Derived Variable Plan.

36 Work with agency analysts to develop SPSS syntax and software programming code that applies the agency’s unique, custom variable definitions (aka derived variables) to field datasets (field datasets delivered by field research contractors). This action produces final. Will USAGM please confirm the number of SPSS licenses that will be provided? Will

USAGM will not provide SPSS licenses.

USAGM will not furnish any equipment;

all work shall be performed on the contractor’s computers.

USAGM also confirm whether work will be performed on government furnished computer equipment vs.

company computers?

37 Will USAGM accept CPARS in lieu of Past Performance Questionnaires (PPQs)?

Yes; CPARS may be submitted in lieu of PPQs. Please refer to the revised Volume III, Factor 2, Past Performance, incorporated as part of Amendment 0002.

38 Is it permissible for a company to replace past performance with verifiable relevant project performance?

CPARS and/or PPQs are acceptable forms for the past performance submittal requirement. Please refer to the revised Volume III, Factor 2, Past Performance, incorporated as part of Amendment 0002.

39 Will USAGM confirm that the contractor shall submit one example for each of the listed artifacts (data dictionaries, codebooks, scripting, data quality control deliverables)?

Will USAGM confirm that these artifacts are not counted as part of the Technical Approach - Volume II page counts?

Yes, offerors may submit one example of each. They do not have count toward the Technical Approach Volume II page counts.

40 Is experience with agency's research network and CATI/CAPI a mandatory requirement to bid?

No, prior experience with our research nor CATI/CAPI is a requirement to bid on this project.