Decennial Language Support RFI_Final.docx

Request for Information (RFI)

Multilingual Research Services

(MLR)

1.0 Description

The U.S Census Bureau (Census Bureau) is seeking to obtain the services of a Contractor to conduct pre-testing of the Internet, Telephone, In-Field Enumeration, and paper instruments in multiple non-English languages. This will include, but is not limited to, data collection instruments, interviewer materials and materials for respondents (letters, guides, webpages, etc.). Some of the key testing elements will include expert review, usability and cognitive testing of the instruments with recruited respondents, evaluation of translation appropriateness, and testing of additional materials associated with each instrument.

Given the criticality of the work performed under this contract to the success of the decennial census language program, the Decennial Census Management Division (DCMD) is interested in forming a partnership that builds upon the innovations of the past decade, applies the lessons learned from the 2020 Census language program, enhances the quality of the non-English language translations fielded in data collection questionnaires and materials, reduces overall cost, and meets required timelines. The DCMD seeks a contractor who demonstrates an understanding of and dedication to the decennial census language program mission and/or major field data collection operation across the United States and U.S. Territories and has a history of excellence and leadership in questionnaire design and survey testing for large scale government programs. In short, the DCMD seeks a partner capable of working hand in hand with its government counterparts and stakeholders on laying the foundations for the 2030 decennial census language program.

THIS IS A REQUEST FOR INFORMATION NOTICE ONLY. This RFI is issued solely to gather information for planning purposes (i.e., market research). It does not constitute a Request for Proposal (RFP) or a promise to issue an RFP in the future. This request does not commit the Government to contract for any supply or service whatsoever. Further, the Census Bureau is neither seeking nor accepting proposals. Respondents are advised that the Census Bureau will not pay for any costs incurred in response to this RFI; all costs associated with responding to this RFI will be solely at the respondent’s expense. Not responding to this RFI does not preclude participation in any future RFP, if issued. If a solicitation is released, it will be synopsized on the SAM.gov Contract Opportunities website or if the market research results in a GSA schedule buy it will be announced on GSA’s E-Buy website. It is the responsibility of the potential offerors to monitor these sites for additional information pertaining to this requirement.

2.0 Background

Census Bureau The U.S. Census Bureau (USCB) is the Nation’s primary source of statistics about the U.S. population, housing, and economy. These measures assist the Congress, the Executive branch of the Federal Government, state and local governments, the public, and the private sector in the development and evaluation of social and economic activities. The Census Bureau’s major programs include periodic censuses, current surveys, and a wide range of reimbursable work performed on behalf of other agencies.

The reliable collection, preparation, tabulation, and dissemination of demographic and economic statistics are vital to the Census Bureau’s mission. To fulfill this critical mission and to address the changing data needs of its users, the Census Bureau has become increasingly reliant upon information technology (IT) to improve the timeliness and quality of its statistical products and to develop, process, and maintain enormous collections of basic data about the people and economy of the Nation.

The Decennial Census is a large scale, highly complex, dynamic program of national importance with strict statutory timelines. As such, the program is deliberately phased to reflect the timing of the major activities that will drive later critical design decisions for the 2030 decennial census.

Decennial Census Management Division For the 2020 Census, the U.S. Census Bureau built a language program that became the most robust language support program ever built for the decennial census. In 2020, the Census Bureau provided an opportunity for people to respond online or over the phone in English and 12 non-English languages and offered video and print guides in English and 59 non-English languages. Census materials in English and the 59 non-English languages supported more than 99 percent of all U.S. households, providing them with critical information about the census. The creation of these complex, interrelated products required thorough planning and the engagement of multiple teams of language experts and professionals.

An important part of 2030 Census planning is the development and testing of questionnaires and data collection materials in multiple modes and multiple languages. Qualitative research is needed on the questionnaire design, content, and materials, to ensure the messages are culturally appropriate and effective in explaining and encouraging participation of non-English speakers. As part of mid-decade testing, qualitative research is needed on the questionnaire design and content, materials, and messages to be used in the various tests for the 2030 Census. The research conducted through this contract will be used to inform decisions and finalize instruments and materials leading into the 2030 Census.

Decennial Census Language Program

The language program began robust pretesting in non-English languages early to develop accurate translations for the 2020 Census. Pretesting began during preparation for the 2015 National Content Test, and testing of non-English language support strategies and materials remained an important component of census research and testing throughout the decade.

We identified the pretesting requirements, and determined whether translations were pretested through expert review, cognitive interviews, usability testing, or other methods. These three techniques are described below:

· Expert review. Translations were reviewed by experts in both survey methodology and the relevant language.

· Cognitive testing. Participants responded using a translated questionnaire in their language. The researcher asked them to think aloud while responding and asked probing questions to help identify places where the individual did not fully understand the translation as intended.

· Usability testing. Participants used a translated questionnaire as if responding to the census. They navigated the questionnaire using available instructions, buttons, etc. Researchers observed the participant to identify places where the person did not understand the translation or needed additional information or guidance. In joint cognitive and usability testing, participants were also asked to think aloud as they navigated through each task.

This early and robust process ensured sufficient time to address all critical findings from pretesting before the final questionnaires were fielded, even in instruments where updates required significant lead time. The multilingual research contract in 2020 supported these pretesting services. The multilingual research contract team consisted of contractors with expertise in non-English pretesting and survey methodology. To ensure high-quality translations are fielded in the 2030 Census, the language program is pursuing a similar early and thorough pretesting approach in preparation for the 2030 Census.

3.0 Scope

The Scope of this contract is to provide application-specific architectural support, data migration assistance and developer support for the services outlined below. For each project listed below, the Contractor shall develop a Protocol, recruitment screener questionnaire, and debriefing questionnaire in collaboration with the Census Bureau.

For projects requiring pretesting, the pretesting may include expert review, usability and/or cognitive testing. The determination of the pretesting methods used shall be recommended by the Contractor through the development of a Protocol for each project part. The Government shall review the protocol before testing begins, and additional review shall be completed by additional government agencies as needed.

As part of each project part, the Census Bureau may ask the Contractor to conduct the following activities:

· Conduct expert review of questionnaires and associated materials prior to pretesting to ensure consistency with English source text.

· Recommend changes in the existing translation of questionnaires and associated materials.

· Make approved updates to translations in instrument specs, and pretesting materials.

· Conduct unit testing according to the specs prior to cognitive testing.

· Obtain feedback from respondents on translated wording.

· Record each interview.

· Provide results on a flow basis after testing start date, with a final consolidated report of results and recommendations completed 8 weeks after testing start date.

When the project requires testing with recruited respondents, the Contractor shall recruit respondents in line with Census Bureau requirements described herein. Each respondent shall be used only once per Project. The recruitment screener questionnaire may include some questions asked of all pretesting respondents, such as questions about English language proficiency and questions about whether the respondent chooses to do surveys in the target language or English. The recruitment screener questionnaire may also include questions intended to support the following requirements.

For testing in non-English languages, the Contractor shall recruit respondents who speak various dialects or spoken versions of that language, such as speakers of diverse national origin and/or diverse geographic location within the United States. Respondents should speak English less than very well, with varying levels of English proficiency, and varying levels of literacy in the spoken non-English language. Recruitment requirements may entail conducting interviews in various regions of the country. When reporting results, the Contractor shall make English proficiency and any differences in interpretation that might be related to that factor clear.

If the tested instrument is intended for a specific population, such as people living in certain types of group living arrangements, (examples: group homes, residential treatment centers, college or university student housing, military quarters, nursing or skilled-nursing facilities), or people with limited Internet proficiency, the Contractor shall also recruit respondents that are part of that population.

The Contractor shall also make every effort to recruit respondents with diverse education levels and household compositions, as appropriate to each mode, as well as differing by diverse demographic characteristics, including race, age, sex and gender.

3.1 Project A: 2026 Census Test Pre-testing

· Part A1: Joint usability and cognitive testing of the Housing Unit Internet Self-Response instrument (an online tool that allows respondents living in housing units to complete and submit their questionnaire electronically).

· Part A1 shall test the full scope of the Internet self-response instrument for housing units. The testing must be completed in Spanish and Chinese. The Contractor shall design and conduct joint usability and cognitive testing of the instrument in order to identify usability and cognitive issues and evaluate translation appropriateness and consistency with English source text. The scope of the test may also include testing of corresponding materials, including but not limited to: mail pieces, messages, and brochures.

· The Contractor shall:

· Design and conduct joint usability and cognitive testing of the instrument;

· Obtain feedback from respondents on translated wording in the instrument;

· Conduct cognitive/usability testing of the additional materials that are associated with the Internet instrument;

· Record each interview; and

· Provide results on a flow basis after testing start date, with a final consolidated report of results and recommendations completed 8 weeks after testing start date.

· Part A2: Joint usability and cognitive testing of the Group Quarters Internet Self-Response instrument (an online tool that allows respondents living in certain non-institutional Group Quarters to complete and submit their questionnaire electronically).

· Part A2 shall test the full scope of the Group Quarters Internet Self-Response instrument for individuals in certain types of group living arrangements. The testing must be completed in Spanish. The Contractor shall design and conduct joint usability and cognitive testing of the instrument in order to identify usability and cognitive issues, and evaluate translation appropriateness and consistency with English source text. The scope of the test may also include testing of corresponding materials, including but not limited to: mail pieces, messages, and brochures.

· The Contractor shall:

· Conduct joint usability and cognitive testing of the instrument;

· Obtain feedback from respondents on translated wording in the instrument;

· Conduct cognitive/usability testing of the additional materials that are associated with the Internet instrument;

· Record each interview; and

· Provide results on a flow basis after testing start date, with a final consolidated report of results and recommendations results completed 8 weeks after testing start date.

· Part A3: Joint usability and cognitive testing of the Telephone Self-Response instrument (an online tool that allows respondents to complete the questionnaire over the telephone with an interviewer).

· Part A3 shall test the full scope of the telephone self-response instrument for housing units. The testing must be completed in Spanish and Chinese. The Contractor shall design and conduct joint usability and cognitive testing of the instrument in order to identify usability and cognitive issues, and evaluate translation appropriateness and consistency with English source text. For the Chinese telephone instrument, the Contractor may also be asked to evaluate the effectiveness of providing a written Chinese script in both Mandarin and Cantonese. Part A3 shall be divided into sub-parts A3a and A3b to test both the interviewer’s and respondent’s perspective.

· Part A3a shall test the telephone instrument from an interviewer’s perspective, wherein respondents shall act as interviewers and administer the telephone interview. The scope of the test may also include testing of corresponding materials, including but not limited to: guidance, scripts, and job aids.

· Part A3b shall be designed to test the telephone instrument, from the respondent’s perspective, wherein the Contractor shall act as the interviewer and administer the survey instrument verbally to the respondents. The scope of the test may also include testing of corresponding materials, including but not limited to: mail pieces, messages, and brochures.

· The Contractor shall:

· Conduct joint usability and cognitive testing of the instrument;

· Obtain feedback from respondents on translated wording in the instrument;

· Obtain feedback from respondents administering telephone interviews using the instrument;

· Conduct cognitive/usability testing of the additional materials that are associated with the telephone instrument;

· Record each interview; and

· Provide results on a flow basis after testing start date, with final consolidated report of results and recommendations completed 8 weeks after testing start date.

3.2 Project B: Preparing for 2028 Census Test Pre-testing

· Part B1: Joint usability and cognitive testing of the field operation instruments (online tools used by census bureau interviews to complete the questionnaire with the respondent in person).

· Part B1 shall be designed to test the full scope of the field operation instruments in Spanish in preparation for the 2028 Census Test. These instruments may include, but are not limited to, In-Field Enumeration and Group Quarters Enumeration. The Contractor shall design and conduct joint usability and cognitive testing of the instrument in order to identify usability and cognitive issues, and evaluate translation appropriateness and consistency with English source text. Part B1 shall be divided into sub-parts B1a and B1b to test both the interviewer’s and respondent’s perspective.

· Part B1a shall test the field operation instruments from an interviewer’s perspective, wherein respondents shall act as interviewers and administer the interview. The scope of the test may also include testing of corresponding materials, including but not limited to: training materials, field materials, messages, and brochures.

· Part B1b shall be designed to test the field operation instrument, from the respondent’s perspective, wherein the Contractor shall act as the interviewer and administer the survey instrument verbally to the respondents. The scope of the test may also include testing of corresponding materials, including but not limited to: training materials, field materials, messages, and brochures.

· The Contractor shall:

· Conduct joint usability and cognitive testing of the field operation instruments;

· Obtain feedback from respondents on translated wording in the instruments;

· Obtain feedback from respondents administering the interviews using the field operation instruments;

· Conduct cognitive/usability testing of the additional materials that are associated with the field operation instruments;

· Record each interview; and

· Provide results on a flow basis after testing start date, with final consolidated report of results and recommendations completed 8 weeks after testing start date.

· Part B2: Joint Usability and Cognitive testing of the paper self-response instruments (paper questionnaires that allow respondents to complete and submit their questionnaire through mail). Part B2 shall be designed to test the full scope of the paper self-response instrument in Spanish in preparation for the 2028 Census Test. The Contractor shall design and conduct joint usability and cognitive testing of the instrument in order to identify usability and cognitive issues, and evaluate translation appropriateness and consistency with English source text. The scope of the test may also include testing of corresponding materials, including but not limited to: mail pieces, messages, and brochures.

· The Contractor shall:

· Conduct joint usability and cognitive testing of the paper instruments;

· Obtain feedback from respondents on translated wording in the instruments;

· Conduct cognitive/usability testing of the additional materials that are associated with the paper instruments;

· Record each interview; and

· Provide results on a flow basis after testing start date, with final consolidated report of results and recommendations completed 8 weeks after testing start date.

3.3 Project C: Continuation of 2028 Census Test Pre-testing

· Project C shall be a continuation of Project B Part B1. Project shall be designed to test additional instruments in multiple non-English languages in preparation for the 2028 Census Test. These instruments include, but are not limited to: Internet Self-Response, Telephone, In-Field Enumeration, Mobile Questionnaire Assistance, Transitory Locations, and Service Based Enumeration. The Contractor shall design and conduct joint usability and cognitive testing of the instruments in order to identify usability and cognitive issues, and evaluate translation appropriateness and consistency with English source text. The scope of the test may also include testing of corresponding materials.

· The Contractor shall:

· Conduct joint usability and cognitive testing of the electronic instruments;

· Obtain feedback from respondents on translated wording in the instruments;

· Conduct cognitive/usability testing of the additional materials that are associated with the electronic instruments;

· Record each interview; and

· Provide results on a flow basis after testing start date, with final consolidated report of results and recommendations completed 8 weeks after testing start date.

3.4 Project D: 2030 Census Readiness

· Project D shall test the full scope of the 2030 Census instruments in multiple non-English languages. These instruments include but are not limited to: Internet Self-Response, Telephone, and In-Field Enumeration. Instruments and materials will be developed in multiple non-English languages. These languages will be determined at a later date, but may be similar to or expand upon the languages supported in the 2020 Census[footnoteRef:2]. The Contractor shall design and conduct joint usability and cognitive testing of the instruments in order to identify usability and cognitive issues, and evaluate translation appropriateness and consistency with English source text. The scope of the test may also include testing of corresponding materials. Materials to be tested can include, but may not be limited to: mail pieces, field materials, messages, language guides, knowledge articles, glossaries, etc. These materials may also include written documents, online tools, videos, audio, and other formats. Project D shall be divided into parts, as necessary. [2: See https://www2.census.gov/programs-surveys/decennial/2020/program-management/memo-series/2020-memo-2018_06.pdf for more information.]

· The Contractor shall:

· Conduct cognitive/usability testing of the instruments;

· Obtain feedback from respondents on translated wording in the instruments;

· Conduct cognitive/usability testing of the additional materials that are associated with the electronic instruments;

· Record each interview; and

· Provide results on a flow basis after testing start date, with all results completed 8 weeks after testing start date.

3.5 Project E: Continuation of 2030 Census Readiness

· Project E shall be designed to be a continuation of Project D. Further testing of additional materials shall be performed, in preparation for the 2030 Census. These materials will be developed in multiple non-English languages. These languages will be determined at a later date, but may be similar to or expand upon the languages supported in the 2020 Census[footnoteRef:3]. The Contractor shall design and conduct joint usability and cognitive testing of the instrument in order to identify usability and cognitive issues, and evaluate translation appropriateness. Materials to be tested can include, but may not be limited to: mail pieces, field materials, messages, language guides, knowledge articles, glossaries, etc. These materials may also include written documents, online tools, videos, audio, and other formats. Project E shall be divided into parts, as necessary. [3: See https://www2.census.gov/programs-surveys/decennial/2020/program-management/memo-series/2020-memo-2018_06.pdf for more information.]

· The Contractor shall:

· Conduct cognitive/usability testing of the additional materials;

· Obtain feedback from respondents on materials and translated wording;

· Record each interview; and

· Provide results on a flow basis after testing start date, with final consolidated report of results and recommendations completed 8 weeks after testing start date.

4.0 Delivery Period

It is anticipated that the Period of Performance will consist of One (1) Base Period, plus Four (4) One-Year Option Periods.

5.0 Requested Information

The purpose of this requirement is to acquire services from a contractor who can provide pre-testing of the Internet, Telephone, In-Field Enumeration, and paper instruments in multiple non-English languages.

5.1 Company Overview (Do not exceed 1 page, 12-point font for this section.)

Interested contractors should provide the following information:

a. A brief description of your company

b. Socio-economic status, business size, and size standard/applicable

c. North American Industry Classification System (NAICS) codes

d. Unique Entity ID

e. SINS

f. Available GSA Schedules or Government Wide Acquisition Contracts

g. Government or commercial clients. Please include the scale of these contracts by dollar value, full time equivalent employees (FTEs), or number of annual contacts.

h. Period of Performance of contract vehicles

i. Issuing Agency

j. Cage Code

k. Telephone Number, fax number, and email address

l. Web site address

m. Point of Contact for questions and/or clarification

5.2 Key Questions to Be Answered by Vendors: (Do not exceed 10 pages, 12-point font for this section.):

1. The 2030 Language Program will require pretesting of questionnaires (paper and electronic data collection instruments) and associated materials. Pretesting may include expert review of materials, usability and cognitive testing of data collection instruments with recruited respondents, evaluation of translation appropriateness, and testing of additional materials. Please describe your capabilities and any known challenges associated with pretesting of questionnaires and associated materials.

2. Pretesting activities may also include recommending changes in the existing translations and providing testing results on a flow basis. Alternative translations will need to be provided in a table format for each language and should outline the proposed alternative translation and the reason for the change. Accepted translation changes may also need to be made in electronic instrument specs (technical specification documents that contain non-English content embedded in HTML mode) and pretesting materials. Please describe your capabilities and any known challenges associated with these pretesting activities.

3. For the 2020 Census, 59 non-English languages were supported. Please list the languages you have the resources to support conducting non-English interviews (both written and orally and level of fluency) and describe your capabilities and any known challenges associated with language support.

4. Please describe your capabilities and any known challenges in the following areas:

a. Pretesting of questionnaires (paper and electronic instruments) and nonquestionnaire materials (such as dashboards, letters, FAQs, interviewer materials, etc.) in non-English languages

b. Expert review of translations and providing recommendations

c. Reviewing and modifying non-English instrument content specifications (technical instrument specification documents that contain non-English content embedded in HTML mode) and testing non-English data collection instruments

5. This decade, a focus of the multilingual research contract will be pretesting of spoken translations for interviewer-administered data collection instruments (telephone and in-person interviews) in multiple non-English languages. Please describe your capabilities and any known challenges associated with this pretesting activity.

6.0 Responses

Interested contractors are requested to provide responses to this Request for Information. Responses shall be in Microsoft Word for Office compatible format and are due no later than 12:00PM EST, March 25, 2024. Responses shall be limited to 20 pages and submitted via e-mail only to Matthew Gore (Contracting Officer) at matthew.s.gore@census.gov and Kaihli Charles (Contract Specialist) at kaihli.m.charles@census.gov . Proprietary information, if any, should be minimized and MUST BE CLEARLY MARKED. To aid the Government, please segregate proprietary information. Please be advised that all submissions become Government property and will not be returned.

7.0 Industry Discussions

DCMD representatives may or may not choose to meet with potential offerors. Such discussions would only be intended to obtain further clarification of potential capability to meet the requirements.

8.0 Questions

Questions regarding this announcement should be submitted in writing by e-mail to the Contracting Officer and Contract Specialist’s email addresses. Verbal questions will NOT be accepted. Questions will be answered by posting answers to the Synopsis on the SAM.gov website; accordingly, questions shall NOT contain proprietary or classified information. The Government does not guarantee that questions received after 4:00PM EST, March 19, 2024. will be answered prior to the response due date.

9.0 Summary

THIS IS A Request for Information to provide information that can provide knowledge to the Multilingual Research Contract. The information provided in the RFI is subject to change and is not binding on the Government. The United States Census Bureau has not made a commitment to procure any of the services discussed, and release of this RFI should not be construed as such a commitment or as authorization to incur cost for which reimbursement would be required or sought. All submissions become Government property and will not be returned.

image1.png image2.png