Amendment_91990018R00120001_-_ECLS-K_2023.pdf

NSN 7540-01-152-8070 STANDARD FORM 30. (Rev. 10-83) Previous Edition unusable Prescribed by GSA FAR (48 CFR) 53.243

Page of Pages AMENDMENT OF SOLICITATION/MODIFICATION OF CONTRACT 1. Contract ID Code

2. AMENDMENT MODIFICATION NO. 3. EFFECTIVE DATE 4. REQUISITION/PURCHASE REQ. NO. 5. PROJECT NO. (if applicable)

6. ISSUED BY CODE 7. ADMINISTERED BY (If other than item 6) CODE

(x) 9A. AMENDMENT OF SOLICITATION NO.

9B. DATED (SEE ITEM 11)

10A. MODIFICATION OF CONTRACT/ORDER NO.

8. NAME AND ADDRESS OF CONTRACTOR (NO., Street, Country, State and ZIP Code)

CODE FACILITY CODE

10B. DATED (SEE ITEM 13)

11. THIS ITEM ONLY APPLIES TO AMENDMENTS OF SOLICITATIONS

The above numbered solicitation is amended as set forth in item 14. The hour and date specified for receipt of offers is extended, is not extended.

Offers must acknowledge receipt of this amendment prior to the hour and date specified in the solicitation or as amended, by one of the following methods:

(a) By completing items 8 and 15, and returning ______ copies of amendment; (b) By acknowledging receipt of this amendment on each copy of the offer submitted;

or (c) By separate letter or telegram which includes a reference to the solicitation and amendment numbers. FAILURE OF YOUR ACKNOWLEDGMENT TO BE RECEIVED AT THE PLACE DESIGNATED FOR THE RECEIPT OR OFFERS PRIOR TO THE HOUR AND DATE SPECIFIED MAY RESULT IN REJECTION OF YOUR OFFER. If by virtue of this amendment your desire to change an offer already submitted, such change may be made by telegram or letter, provided each telegram or letter makes reference to the solicitation and this amendment, and is received prior to the opening hour and date specified.

12. ACCOUNTING AND APPROPRIATION DATA (If required)

13. THIS ITEM ONLY APPLIES TO MODIFICATION OF CONTRACTS/ORDERS. IT MODIFIES THE CONTRACT/ORDER NO. AS DESCRIBED IN ITEM 14.

Check One

A. THIS CHANGE ORDER IS ISSUED PURSUANT TO: (Specify authority) THE CHANGES SET FORTH IN ITEM 14 ARE MADE IN THE

CONTRACT ORDER NO. IN ITEM 10A.

B. THE ABOVE NUMBERED CONTRACT/ORDER IS MODIFIED TO REFLECT THE ADMINISTRATIVE CHANGES (such as changes in paying office, appropriation date, etc) SET FORTH IN ITEM 14, PURSUANT TO THE AUTHORITY OF FAR 43.103(b).

C. THIS SUPPLEMENTAL AGREEMENT IS ENTERED INTO PURSUANT TO AUTHORITY OF:

D. OTHER (Specify type of modification and authority)

E. IMPORTANT: Contractor is not, is required to sign this document and return _______ copies to the issuing office.

14. DESCRIPTION OF AMENDMENT/MODIFICATION (Organized by UCF section headings, including solicitation/contract subject matter where feasible)

Except as provided herein, all terms and conditions of the document referenced in item 9A or 10A, as heretofore changed, remains unchanged and in full force and effect.

15A. NAME AND TITLE OF SIGNER (Type or print)

16A. NAME AND TITLE OF CONTRACTING OFFICER (Type or print)

15B. CONTRACTOR/OFFEROR 16B. UNITED STATES OF AMERICA

(Signature of person authorized to sign)

15C. DATE SIGNED

(Signature of Contracting Officer)

16C. DATE SIGNED

Attachment Page

PAGE 2 OF 114 91990018R00120001

Question # Reference Question Category Question Department Response

1 N/A Contract Please let us know if there are any incumbents on this contract

The four ECLS-K:2011 contracts were all awarded to Westat. There were two ECLS-K:2023 sample design contracts (note, the study was the ECLS-K:2022 at the time); these were awarded to Westat and

RTI. There have been no national ECLS-K:2023 to date.

2 N/A Contract What is the dollar value of the contract? The dollar value will be determined at the time of award.

3 N/A Contract We would like to meet with the program officer. Could that be arranged?

Before the award is made, all communiciations will go through the Contracting Officer and Contract

Specialist. A meeting with the program officer can not be arranged before the award is made.

4 N/A Contract Can you tell me who was awarded the design competition for 2017

There were two sample design contract awards. One was awarded to Westat; the other to RTI. Note that the design contract was let only to explore possibilities for sampling that would allow for a collection the year prior to kindergarten. No other aspects of components of data collection were included in the design contract.

RFP, Instructions to

Offerors, page 281 Proposal Instructions

May the following be excluded from the page count: cover/transmittal letter, table of contents and schedule of deliverables? Yes.

Task 5 Sample Recruiting and Locating

PWS Page 49 of 300 Technical

PWS page 49 of 300 says, "Locating/tracing shall also be completed by the contractor for these rounds, including the collection of all data necessary for these activities."

Please confirm that distribution and collection of the household screener instrument should be included under Task 5 Recruiting and Locating, and not under the field test and national data collection tasks (T9/T12).

Yes. This work should be included under Task 5.

Subtask 7.1 Assessment

Specifications

PWS 55 Page of 300 Technical

Can you please provide information on the distribution and type of assessment items by domain in the ECLS-K:2011?

Information on the ECLS-K:2011 assessment content is available in the study's user manuals (available on the ECLS website, nces.ed.gov/ecls) and psychometric reports. The psychometric reports are not yet released but are being made available to offerors. For further information, please contact Pavan

Mehrotra.

Subtask 7.2 Assessment

Item Pools

PWS Page 57 of 300 Technical

PWS page 57 of 300 says, "Particular attention shall be given to sustaining the longitudinal nature of the ECLS-K:2023 assessment battery (i.e., proposing item pools that can be used to establish a vertical scale in each academic domain that can be used to measure children's growth longitudinally within the ECLS-K:2023)."

Can the government provide access to the psychometric methodology reports from the ECLS-

K:2011 so we may determine how the vertical scale of the child assessments for the ECLS-

K:2011 has been maintained? The psychometric reports are not yet released but are being made available to offerors; please contact

Pavan Mehrotra for details.

Subtask 7.2 Assessment

Item Pools

PWS Page 57 of 300 Technical

PWS page 57 of 300 says, "Particular attention shall be given to sustaining the longitudinal nature of the ECLS-K:2023 assessment battery (i.e., proposing item pools that can be used to establish a vertical scale in each academic domain that can be used to measure children's growth longitudinally within the ECLS-K:2023)."

Please confirm that the 3PL model with pattern scoring was used in the 2011 study and that the vertical scale rests upon that IRT model.

The 3PL model was used in the ECLS-K:2011. To clarify, though, it is not a requirement of the current

PWS to use 3PL. Details on the ECLS-K:2011 assessment scoring is available in the study's user manuals

(available on the ECLS website, nces.ed.gov/ecls) and psychometric reports. The psychometric reports are not yet released but are being made available to offerors; please contact Pavan Mehrotra for details.

Subtask 7.2 Assessment

Item Pools

PWS Page 57 of 300 Technical

PWS page 57 of 300 says, "Particular attention shall be given to sustaining the longitudinal nature of the ECLS-K:2023 assessment battery (i.e., proposing item pools that can be used to establish a vertical scale in each academic domain that can be used to measure children's growth longitudinally within the ECLS-K:2023)."

For the sake of comparison of the 2011 and 2023 K cohorts, the existing vertical scale will be used as well as for the demonstration of growth to spring K, grade 1, grade 3, and grade 5. Can

NCES re-confirm the integrity of the scale for measuring growth, given it’s been a decade since the beginning of the last cycle?

The ECLS-K:2011 vertical scale does measure growth. However, it is expected that the psychometric properties of the ECLS-K:2023 assessment will be determined during the development of the scale.

Tests of the integrity of the ECLS-K:2023 and its ability to measure growth are part of this current contract soliciation. It is expected that bidders will present proposals for a scale that they will demonstrate is capable of measuring growth.

Subtask 7.2 Assessment

Item Pools

PWS Page 57 of 300 Technical

PWS page 57 of 300 says, "To the extent possible and appropriate, items from the ECLS-K:2011 shall be used in the ECLS-K:2023 assessments."

For budgeting purposes, can NCES provide an estimate of the proportion of the ECLS-K:2023 item pool that should be newly developed versus ECLS-K:2011 items?

NCES does not have an estimate of this. The bidders should consider what proportion of items must be maintained from the prior cohort to allow for the development of cross-cohort scores and provide a proposal for the percentage of new versus exisiting items.

PAGE 3 OF 114 91990018R00120001

Subtask 7.2 Assessment

Item Pools

PWS Page 57 of 300 Technical

PWS page 57 of 300 says, "To the extent possible and appropriate, items from the ECLS-K:2011 shall be used in the ECLS-K:2023 assessments."

Does NCES require or prefer that the ECLS-K:2011 items be included in the field test? If so, what has been the proportion of legacy to new items field tested together in past studies?

NCES does not have a requirement for the proposortion and asks the bidders to consider this issue and present their proposals for this work. Field test information for the ECLS-K:2011 is available in the psychometric reports. The psychometric reports are not yet released but are being made available to offerors; please contact Pavan Mehrotra for details.

Subtask 7.2 Assessment

Item Pools

PWS Page 57 of 300 Technical

Could NCES share more details regarding any dimensionality study (or the nature of the strands) done as part of the last round of test development, and reports regarding calibration/linking?

Information on dimensionality is available in the psychometric reports. The psychometric reports are not yet released but are being made available to offerors; please contact Pavan Mehrotra for details.

General Proposal

Instructions

PWS Page 281 of 300 Technical

The page limit has been set at 150 pages, including exhibits. We estimate the project management chart to be 30 pages. Can we include the management chart as an appendix?

The project management chart should be included in the 150 page limit.

Appendix E Staff

Qualifications

PWS Page 138 of 300

General Proposal

Instructions

PWS Page 284 of 300 Technical

PWS p. 138 of 300 says, "The project director … shall have full-time commitment to the project…"

PWS p. 284 of 300 says, "The assumption is that this project director will be committed to the project for 33% of his or her time."

Would the government please clarify expectations for the project director's level of commitment? We apologize for the error. The latter is correct - the assumption is that this project director will be committed to the project for 33% of his or her time. A revised PWS is attached to reflect this change.

16 N/A Technical

How many ECLS-K:2011 reading and mathematics assessment items from the kindergarten rounds were copyright protected?

The attached table summarizes the number of copyrighted items in the ECLS-K:2011 kindergarten rounds’ math and reading assessments.

17 N/A Technical

Will the ECLS-K:2011 psychometric reports be released before the ECLS-K:2023 proposals are due?

No, NCES does not expect these to be released in advance of the proposal due date. However,the psychometric reports are being made available to offerors; please contact Pavan Mehrotra for details.

18 N/A Technical

What are the expectations for the linking of the ECLS-K:2011 and ECLS-K:2023 assessment scores?

Please see the PWS for details on the expected linking of the ECLS-K:2011 and ECLS-K:2023 assessment scores. Note that the direct child cognitive assessment scores for the ECLS-K:2011 that are directly comparable to the scores from the ECLS-K are not currently available. Child assessment scores designed specifically for comparisons between the ECLS-K and ECLS-K:2011 cohorts are currently in development. The anticipated release date for these scores is to be determined; they will not be released in advance of the proposal due date.

PAGE 4 OF 114 91990018R00120001

Attachment A – Performance Work Statement

U.S. DEPARTMENT OF EDUCATION

Design and Conduct of the Early Childhood

Longitudinal Study, Kindergarten Class of

2022-23 (ECLS-K:2023)

Contract

Performance Work Statement

Attachment A

National Center for Education Statistics

5/4/18

PAGE 5 OF 114 91990018R00120001

The performance work statement (PWS) is written in four sections. The first section provides an overview and general goals of the work to be done under this contract. The second section describes the core tasks associated with this work and delineates the specifications of the tasks and associated deliverables. The third section describes a set of options and study supplements to enhance the design of the Early Childhood Kindergarten Class of 2022-23 (ECLS-K:2023). The fourth section delineates deliverable specifications. Appendix A discusses some of the specific issues in education policy that the ECLS-K:2023 will address. Appendix B provides information on data confidentiality and data security requirements as well as the security procedures that all contractors must pledge to follow upon award of contract. Appendix C outlines the current NCES review process for publications. Appendix D discusses issues related to policies and standards. Appendix E outlines required staff qualifications.

I. Introduction and Overview

I.A.1 Purpose of Study

The National Center for Education Statistics (NCES) within the United States Department of Education’s (ED) Institute of Education Sciences (IES) requires a cost reimbursement contract to design and conduct the assessments and data collections for the preschool, kindergarten, first-grade, and third-grade years, as well as the design of the fifth-grade year,1 of the Early Childhood Longitudinal Study, Kindergarten Class of 2022-23 (ECLS-K:2023). The ECLS- K:2023 will be the fourth cohort in the series of early childhood longitudinal studies that began with the Early Childhood Longitudinal Study, Kindergarten Class of 1998-99 (ECLS-K) and continued with the Early Childhood Longitudinal Study, Birth Cohort (ECLS-B) and the Early Childhood Longitudinal Study, Kindergarten Class of 2010-11 (ECLS-K:2011).

The purpose of the ECLS-K:2023 will be to provide important information on children’s early learning and development, preschool2/early care and education experiences, transition into kindergarten, and progress through the elementary grades, building upon knowledge acquired from the previous Early Childhood Longitudinal Studies. Data from the ECLS-K:2023 cohort will yield policy-relevant information by (1) providing current data on the cohort of students to be selected in the early 2020’s and their progress through the elementary grades, (2) providing data relevant to emerging policy-related domains not measured fully in the prior ECLS studies, and (3) allowing cross-cohort comparisons of the educational experiences of children attending school before and after the advent of new federal laws and policies. Appendix A discusses some of the specific issues in education policy that the ECLS-K:2023 will address.

The ECLS-K:2023 will collect data about the child and the child’s early care and education environment, school, classroom, teacher(s), before- and after-school care providers, and family.

Information must be collected directly from the child (including through the use of direct

1 Study convention is to refer to the waves of data collection by the grade level of the majority of the study’s students at the time of data collection (e.g., the first-grade wave is the spring 2024 collection). However, the study will follow all children who participated in the kindergarten year regardless of their grade level in later rounds of data collection. Therefore, the study will include students who have been retained at some point prior to the wave of interest, students who are on grade level, and students who have been advanced to a higher grade.

2 It is important to note that when the term “preschool” is used in this document, it refers to all early care and education experiences that children have during the academic year prior to kindergarten.

PAGE 6 OF 114 91990018R00120001

cognitive assessments with the children in reading and math, and in the later rounds, child questionnaires), the child’s parents/guardians, teachers, and school administrators. While all of these components will be included in the study, the ECLS-K:2023 will be designed such that the child is the unit of analysis; the one exception is that the study will also be representative at the school level at the kindergarten year. The methods of data collection will include computer assisted two-stage adaptive testing of children to allow comparability with ECLS-K and ECLS- K:2011, paper and pencil questionnaires, and computer assisted telephone and in-person interviews (CAI). If deemed comparable to prior ECLS studies and feasible for the ECLS- K:2023, child assessments may be administered electronically, and web-based instruments may be considered for adult respondents.

The ECLS-K:2023 will be a kindergarten cohort study (as such, “ base year” for the study is considered the students’ kindergarten year); however, NCES plans to include a data collection in the school year before the study children begin kindergarten (also referred to as the preschool supplement round of data collection) if the preschool field test included within the scope of this contract is successful. The ECLS-K:2023 data collections will be modeled largely after those of its sister studies, the ECLS-K and the ECLS-K:2011. While conceptualized as most similar to the ECLS-K and the ECLS-K:2011, the ECLS-K:2023 is unique among the NCES kindergarten cohort studies in that it includes a data collection during the academic year prior to kindergarten.

As such, the ECLS-B will also be used as a model, given its inclusion of a data collection at this point (i.e., the “preschool round”). The sample design for the ECLS-K:2023 preschool and kindergarten years was developed under a previous contract and when executed must result in a nationally representative sample of kindergartners that can be compared to kindergartners from the ECLS-K and ECLS-K:2011.

The ECLS-K:2023 will begin following the cohort of 2022-23 kindergartners (and kindergarten-aged children in ungraded schools or classrooms) in the spring of the 2021-22 school year; that is, the year prior to kindergarten entry. In this spring preschool collection, data will be collected from the study children’s parents. Data will next be collected in both the fall and spring of the children’s kindergarten year. The children and the children’s parents, teachers, and schools/school administrators will participate in the study in the kindergarten year. Follow-up collections for the full sample will be conducted in the spring of the first-grade (spring 2024), third-grade (spring 2026), and fifth-grade (spring 2028)3 years, including collection from the children, their parents, their teachers, and their schools/school administrators.

Because of the complexity of the ECLS-K:2023, the Department is executing the study through a series of overlapping contracts.

1. Two contracts that focused on the study’s sample design were awarded in August 2017.

2. The current PWS outlines the requirements for the study’s second contract, which will focus on the data collections for the preschool, kindergarten, first-grade, and third-grade years (study design, data collection, and the production of study data files and documentation) and includes field test activities for these data collections as well as the study’s fifth-grade year (i.e., field test of assumptions for the preschool round, field

3 The fifth-grade data collection will be conducted under a different contract.

PAGE 7 OF 114 91990018R00120001

tests for the development of direct child assessments, and field tests for other study instruments). Work to track children between the rounds of data collection is also included in this contract.

3. It is anticipated that the final ECLS-K:2023 contract will focus on fifth-grade data collection, data release, and report writing.

The following summarizes the primary activities covered by his PWS: 1) recruit children, families, and schools in order to follow the progress of the cohort as it moves from preschool through the third grade; 2) develop the parent interviews for all rounds of the ECLS-K:2023; 3) develop the teacher questionnaires and school administrator questionnaires for the kindergarten, first-grade, third-grade, and fifth-grade years; 4) field test the assumptions for the preschool collection such as sample movement into kindergarten schools; 5) field test the direct cognitive assessments in the domains of reading and math (or some other domain as agreed up by NCES) to be conducted in all rounds except for preschool; 6) field test the non-assessment instruments for all ECLS-K:2023 rounds; 7) develop and field test the third- and fifth-grade child questionnaires; 8) plan and conduct the preschool (spring 2022), kindergarten (fall 2022 and spring 2023), first-grade (spring 2024), and third-grade (spring 2026) collections; 9) create restricted-use and public-use data files containing all data collected from rounds through the third grade, along with associated documentation; and 10) update child locating information (e.g., home address and telephone number, last school attended) at least annually to allow children to be traced over time.

The contractor shall use procedures, instruments, and questionnaire items similar to those used in the ECLS-K, the ECLS-B, and the ECLS-K:2011, with updates and improvements made as necessary and any mode changes as approved by NCES. Information about these studies can be found on the NCES web site at https://nces.ed.gov/ecls. All activities for the base period under this contract shall be completed and delivered within 120 months (i.e., 10 years) of the award date.

The work will be monitored by NCES within the Institute of Education Sciences of the U.S.

Department of Education.

I.A.2. Legislation

The Longitudinal Studies program at NCES is authorized by law under Title 20, USC, Section 9543a, 2006:

The Statistics Center shall collect, report, analyze, and disseminate statistical data related to education in the United States and in other nations, including --

(7) conducting longitudinal and special data collections necessary to report on the condition and progress of education;

PAGE 8 OF 114 91990018R00120001

I.A.3. Program Overview

The ECLS-K:2023 is the fourth cohort longitudinal study of young children supported by NCES.

Information about the three prior studies (ECLS-K, ECLS-B, and ECLS-K:2011) can be found at https://nces.ed.gov/ecls. Materials on the site provide examples of the work needed for this contract except the direct assessments. Due to copyright restrictions of items included in the assessments, examples of the direct assessments and associated materials will only be made available for review by interested offerors at NCES offices in Washington, DC upon request.

Additionally, offerors may want to reference the description of the ECLS-K:2011 assessments available online at https://nces.ed.gov/ecls/assessments2011.asp.

I.A.4. ECLS-K:2023 Core Survey Components

The ECLS-K:2023 will collect data about the child and the child’s early care and education, school, classroom, teacher(s), and family. At all rounds except for the preschool round, data will be collected from the child, the child’s parents/guardians, teachers, and school administrators.

During the preschool supplement round, data will be collected only from children’s parents.

Children: At each round of data collection with the exception of the preschool supplement round, children will participate in individually administered cognitive assessments. One-on-one assessments shall be administered using hard-copy easels; if electronic administration (such as use of electronic/tablet-based easels) is instead proposed, the offeror must demonstrate the comparability of the assessments with prior ECLS administrations. Measures of children’s cognitive knowledge and skills (i.e., reading and math, although offerors may suggest an alternative domain for math at some or all rounds) shall be collected through an approximately 30-45 minute two-stage adaptive computer assisted assessment. While a reading assessment shall be included at every round, the second domain may change by round (e.g., math could be assessed at fall kindergarten, science at spring kindergarten, executive function at spring first grade). An English language screener is anticipated to be used in the kindergarten and first-grade rounds, and Spanish translations will be developed and administered for the math (or alternative domain) assessment in these rounds. The reading assessments will be designed such that a reading score will be obtained for all study children regardless of English language proficiency.

Beginning in the third-grade round, a child questionnaire will also be administered.

Parents/guardians: At the preschool round, following being screened into the study via a mail questionnaire, parents shall be interviewed using a computer-assisted telephone interview (CATI); for parents/guardians without a telephone or for whom a face-to-face interview is preferred, an in-person computer assisted interview (CAPI) shall be conducted. At every other round of data collection, again the child’s parent/guardian shall be interviewed using CATI or CAPI. Other modes, such as web-based, may be considered for the parent interviews. Regardless of mode of data collection, the parent interview shall be limited to 30 minutes in the preschool and fall kindergarten rounds and 45 minutes in later rounds, on average. The parent/guardian to be interviewed shall be the individual who is most knowledgeable about the sampled child’s care and education, with preference in the later rounds given to the parental figure interviewed in previous waves of the study. At the preschool round, the parent interview shall be developed from the National Household Education Survey (NHES) Early Child Program Participation

PAGE 9 OF 114 91990018R00120001

(ECCP; see https://nces.ed.gov/nhes/questionnaires.asp) questionnaire, the ECLS-B and ECLS- K:2011 parent interviews, and other relevant item sources. Later rounds’ interviews shall primarily include items adapted from prior ECLS collections (please see interviews and questionnaires from the ECLS-K and ECLS-K:2011 at the following websites for examples -https://nces.ed.gov/ecls/kinderinstruments.asp and https://nces.ed.gov/ecls/instruments2011.asp).

Teachers: Beginning in the fall of 2022 (fall kindergarten) round, teachers shall be asked to complete a self-administered questionnaire about their own professional background, curriculum and instructional practices, and their views on teaching and the school environment, as well as an evaluation of each sampled child on a number of critical cognitive and non-cognitive domains including (but not limited to) the child’s academic and social skills and development, physical activity, program placements, and attendance. While only two cognitive domains will have a direct child assessment at any given round (e.g., reading and math), the indirect assessments may include more than two domains. As in past ECLS collections, it is anticipated that questionnaires will be hard copy, but alternative modes such as web-based may be considered. Total burden time for questions at the teacher and classroom levels shall be approximately 20 minutes, and total burden time for the evaluation of the study children shall be no more than 10 minutes per child.

School administrators (directors, principals, and headmasters): In each spring round of data collection beginning with the spring 2023 (spring kindergarten) round, school administrators shall be asked to complete an approximately 30-minute self-administered questionnaire about the school’s physical and organizational characteristics, school policies, and other school-level characteristics that are associated with children’s educational experiences and learning. The questionnaire will also include questions about the administrator’s background. As in past ECLS collections, it is anticipated that questionnaires will be hard copy, but alternative modes such as web-based may be considered.

I.A.5 Optional Studies and Supplements

The ECLS-K:2023 may be expanded in scope or enhanced with optional studies and supplements. Some of these optional studies and supplements may be supported by NCES depending on the availability of funds and approval from the U.S. Office of Management and Budget, while other offices in the U.S. Department of Education and other Federal agencies may sponsor others.

The optional studies and supplements that NCES is considering for the ECLS-K:2023 during the collections covered by this contract are described in section III of this PWS. The final decision on whether or not to incorporate one or all of these optional components and their final design specifications will be at the discretion of the government and is contingent on funds available to

NCES.

I.B. Quality Control

NCES is firmly committed to assuring that each project meets the project goals and that the data collected are of high quality. Project quality control shall be integrated into every phase of the

PAGE 10 OF 114 91990018R00120001

project. For instance, potential problems for data collection shall be identified early so that possible solutions are tested as part of field testing. Item reliability and validity tests for questionnaires, interviews, and child assessments shall be built into the data collection efforts, and results from these tests shall inform data collection and processing. Nonresponse analyses shall be conducted as part of the weighting process, and information about the survey methodology and sample design effects shall be made available to data users. As part of quality control, the offeror shall institute procedures relevant to confidentiality and protection of data (including the secure transmittal of confidential data and using server applications that are written to be hosted in the IES Data Center environment) (see appendix B).

In addition, deliverables shall be submitted on time and be of sufficient quality (in terms of accuracy, coherence, clarity, and comprehensiveness) to meet NCES statistical standards, professional standards, and NCES and IES style guidelines. NCES expects that only minor changes to drafts will be needed for products to become final deliverables. All deliverables except data sets and computer assisted interview (CAI) programs shall be delivered in electronic format to the contracting officer’s representative (COR) in WORD or WORD compatible format, unless prior approval for a different format is received from the COR. Certain deliverables shall be submitted in hard-copy format as specified under the specific tasks outlined in Part II of this

PWS.

I.C. NCES Statistical Standards

NCES has developed and implemented a set of statistical standards that set guidelines to ensure the quality of NCES' work (see https://nces.ed.gov/statprog/2012/). These standards (as amended) are to be followed by NCES staff and their contractors in performing the day-to-day work of NCES. The contractor shall adhere to these standards. A copy of the 2012 currently approved standards are available at the website noted above. In the event that NCES updates these statistical standards during the period of performance of this contract, the contractor shall adhere to the revised standards. In addition, contractors shall follow content and format guidelines described in the IES style guide, found at:

https://nces.ed.gov/statprog/styleguide/pdf/styleguide.pdf

I.D. Background Documents and Materials

A number of documents and materials (user’s manuals, data file documentation, and methodology reports) from prior NCES early childhood longitudinal surveys are available on the NCES website as noted above. ECLS-K and ECLS-K:2011 materials are the most readily accessible as the ECLS-B materials are primarily restricted-use materials that are accessible only through licensing agreements with NCES. Information about the ECLS-K:2011 can be found at https://nces.ed.gov/ecls/kindergarten2010.asp. Materials for the ECLS-K can be found at https://nces.ed.gov/ecls/kindergarten.asp. Copies of assessment easels used in the ECLS-K and rounds of the ECLS-K:2011 that have been conducted to date may be viewed at NCES offices on 550 12th St SW, Washington, DC upon request.

PAGE 11 OF 114 91990018R00120001

I.E. Confidentiality

Appendix B provides a guide to issues of confidentiality.

I.G. Contract Type

The contract type is Cost Reimbursement.

I.H. Period of performance

The base period of performance for this contract is 120 months. The estimated years covering the period of performance for the tasks in the Performance Work Statement are displayed in Table 1.

Table 1: Period of performance for the major tasks in the ECLS-K:2023 contract by year.

Years Activity 1 2 3 4 5 6 7 8 9 10 Fiscal Year FY

FY

FY

FY

FY

FY

FY

FY

FY

FY

Task 1: Management X X X X X X X X X X

Task 2: Technical and Content Review Panels X X X

Task 3: Sample Design Plan and Specifications X X X

Task 4: Sample Locating System X X X X X X X X X X

Task 5: Sample Recruiting and Locating X X X X X X X X

Task 6: RIMS/OMB Forms Clearance Packages X X X X

Task 7: Assessment Battery and Administration Procedures X X X X X X

Task 8: Non-assessment Instruments and Procedures X X X X X X

Task 9: Field Tests X X X X X X X

Task 10: Production/Acquisition of Instruments and Materials X X X X X X X

Task 11: Hire and Train National Data Collection Field Staff X X X X

Task 12: National Data Collections X X X X

Task 13: Data Files and Documentation X X X X X X

Task 14: Methodology and Psychometric Reports X X X X X X

Optional Task 15: Nationally Representative Sample of Kindergarten Teachers X X X X

Optional Task 16: Charter Schools Oversample X X X X

Optional Task 17: Testing of Base Year (Kindergarten) Recruitment Materials X X

Optional Task 18: Increased Subsampling Rate X X X X

Optional Task 19: Special Education Teacher/Service Provider Questionnaires X X X X X X

Optional Task 20: Development and Administration of a Set of Policy-Relevant Items X X X X X

Optional Task 21: Screening for Auditory Impairments X X X X X

Optional Task 22: Production of Analytic Base Weights, Replicate Weights, and Taylor Series Adjustment

X X

PAGE 12 OF 114 91990018R00120001

Strata and Primary Sampling Unit (PSU) Variables

Optional Task 23: Sample Freshening X X X X X X

Optional Task 24: Kindergarten Before- and After-School Care Provider Data Collection X X X X

Optional Task 25: District Reports X X X X

Optional Task 26: Incentive Experiments X X X

Optional Task 27: Height and Weight Data Collection X X X X X X

PAGE 13 OF 114 91990018R00120001

II. Work Statement

Independently and not as an agent of the United States Government, the Contractor shall provide all personnel, materials, services, and facilities necessary for the project and perform the tasks as described below.

The period of performance for this contract is one hundred twenty (120) months. The base period of this contract includes: 1) recruit children, families, and schools in order to follow the progress of the cohort as it moves from preschool through the third grade; 2) develop the parent interviews for all rounds of the ECLS-K:2023; 3) develop the teacher questionnaires and school administrator questionnaires for the kindergarten, first-grade, third-grade, and fifth-grade years;

4) field test the assumptions for the preschool collection such as sample movement into kindergarten schools; 5) field test the direct cognitive assessments in the domains of reading and math (or some other domain as agreed up by NCES) to be conducted in all rounds except for preschool; 6) field test the non-assessment instruments for all ECLS-K:2023 rounds; 7) develop and field test the third- and fifth-grade child questionnaires; 8) plan and conduct the preschool (spring 2022), kindergarten (fall 2022 and spring 2023), first-grade (spring 2024), and third-grade (spring 2026) collections; 9) create restricted-use and public-use data files containing all data collected from rounds through the third grade, along with associated documentation; and 10) update child locating information (e.g., home address and telephone number, last school attended) at least annually to allow children to be traced over time.

The activities included in the optional tasks are described in section III of this PWS.

Data Collection Schedule

The ECLS-K:2023 will begin data collection in the spring of the 2021-22 school year; that is, the year prior to kindergarten entry. In this spring preschool collection, data will be collected from the children’s parents. Data will then be collected in both the fall and spring of the children’s kindergarten year (i.e., fall 2022, spring 2023). The children as well as the children’s parents, teachers, and schools/school administrators will participate in the study in the kindergarten year.

Follow-up collections for the full sample containing the same respondents as in kindergarten will be conducted in the spring of the first-grade (spring 2024) and the spring of third-grade (spring 2026). It is currently anticipated that the final ECLS-K:2023 data collection round will be conducted in the spring of the fifth-grade (spring 2028) year.

Data in the fall and spring of the children’s kindergarten year (the 2022-23 school year) serve as the baseline data for the study. Spring preschool (the preschool supplement round), fall kindergarten, spring kindergarten, spring first-grade, and spring third-grade data collections will be conducted during the base period of this procurement, along with the field test activities involved in the full-scale administrations. Design and field testing for the fifth-grade collection is also included in this contract. Children who are off track of the standard grade progression schedule shall be included in every collection beginning with the spring 2024 collection (e.g., children in the cohort who are still in kindergarten or have advanced to second grade in the spring of 2024). Cognitive assessments in the domains of reading and math (or another domain as proposed by the offeror) as well the parent interviews and school staff questionnaires to be

PAGE 14 OF 114 91990018R00120001

used in each national data collection shall be completed sufficiently far in advance of the data collection to allow for adequate review and testing and sufficient time to seek and receive clearance from the U.S. Office of Management and Budget (OMB). The project schedule must allow sufficient time for hard-copy materials (e.g., assessment easels and hard-copy study instruments) to be printed by the Government Printing Office (GPO). Additionally, the project schedule must allow sufficient time for in-person field staff training (including hotel or meeting/conference space arrangements) to be approved by the Department. The contractor shall expect the training review and approval process to take approximately 60 days; no contracts may be signed by the contractor with hotels or meeting/conference centers until approval from the government is received.

Tasks

Core tasks listed below describe the tasks necessary for developing the ECLS-K:2023 preschool, kindergarten, first-grade, and third-grade rounds including: field test activities for these rounds of data collection; conduct of the national data collections for these rounds; release of the national collection data for these rounds; and panel maintenance.

The specifications for all deliverables to be generated by the tasks are described below. Unless otherwise specified, deliverables shall not be physically delivered to the NCES COR. Instead, the CO, CS, and NCES COR shall be notified of the deliverable's placement within an Integrated Management System (IMS) or, if requested, delivered electronically to the COR through e-mail.

An important function of the IMS from the NCES COR's viewpoint is the capability to retrieve deliverables from the IMS. All documents shall be delivered as WORD or WORD compatible files unless otherwise specified. In situations where materials are not readily available in WORD or WORD compatible format, the contractor shall verify with the COR that NCES has appropriate software to read or access the materials well before delivery (e.g., PDF formats of graphically complex materials, access to CAI programs needed to test CAI instruments, database formats for data files, etc.).

The products that the contractor shall prepare and submit to NCES/the Department are indicated in the descriptions of the core tasks and the optional study tasks. While there may be other possible schedules for completing the tasks associated with the ECLS-K:2023, several activities must take place at the specific times indicated during the conduct of the project. RIMS/OMB clearance package dates must be set to allow for sufficient review and approval time, allowing of the field tests and the national data collections to start on time. All study instruments and materials necessary for data collection shall be delivered to NCES with sufficient time for revision and approval before submission of the study clearance request to RIMS/OMB.

In addition to the importance of the overall quality of the data collected, deliverables such as documents and manuscripts shall be submitted on time and as complete products that meet or exceed standards in the NCES statistical standards, professional standards, and NCES and IES style guidelines. NCES expects that only minor changes to drafts will be needed for the drafts to become final deliverables. The times to complete and submit in this work statement are shown in business days from the preceding event whereby business days exclude Saturdays, Sundays, and Federal holidays. There are references to calendar days in some situations where that reference

PAGE 15 OF 114 91990018R00120001

period is more suitable for the task. Unless so noted, days means business days in the schedule.

Unless otherwise stated, the contractor shall assume 10 business days for each round of NCES review of all submitted deliverables.

Several deliverables associated with staff Affidavits of Nondisclosure and E-QIP related security forms are not specified in the schedule below but are detailed in appendix B.

The estimated years covering each task is listed next to the task name.

Task 1. Management (Years 1-10)

The contractor shall manage the collection of ECLS-K:2023 data in an efficient manner that fosters communications with contractor staff, subcontractors, the NCES Contract Officer’s Representative (COR), the Department’s Contract Officer (CO), the Department’s Contract Specialist (CS), and NCES ECLS-K:2023 project staff.

Subtask 1.1 Post Award Conference

Within 2 weeks of the contract award, as approved by the COR, the contractor’s project director and four other key staff members who would be able to answer questions about sampling issues, data collection processes, costs, etc., from the contractor project team shall hold a virtual meeting or, if contractor staff are local to the Washington, D.C. area, in Washington, D.C. at facilities made available by the Department. The meeting will include the COR, key NCES project staff, the CO, and the CS. The contractor shall focus the meeting to review the overall contract tasks, identify information needed from NCES, identify potential problems and possible solutions in the project and contract, and discuss areas of concern related to the proposed project staffing plan and other management requirements. The primary purpose of this meeting is to refine the management, staffing, and scheduling plans. These refinements shall provide management information for use by both the contractor and the government in monitoring the work to be performed.

Deliverables: 1.1.1 Post award meeting agenda and revised draft contract schedule

1.1.2 Post award meeting minutes and revised final contract schedule

Deliverable Submission Timing and Specifics: The contractor shall submit an agenda and proposed schedule 5 business days before the meeting and the minutes from the meeting and revised contract schedule 5 business days after the meeting.

Subtask 1.2 Monthly Reports and Schedules

The contractor shall report monthly on the progress made in accomplishing the project tasks including delivery dates for contract deliverables, the hours worked by project staff by task, the consumption of funds by task, cost of work conducted by subcontractors, problems encountered and any NCES-approved solutions, issues related to confidentiality, and plans for the next month. The financial status of the project, including detailed monthly charges by named staff, costs incurred by subcontractors (or projected costs if subcontractors’ billing lags such that

PAGE 16 OF 114 91990018R00120001

current month spending is not billed until later months) shall be described in an attachment submitted with the monthly report. The financial report shall also indicate the amount spent on IT in the month being reported. IT costs shall be defined as labor and computing costs associated with the development of CAI systems developed under task 8 and the production of Electronic Codebook (ECB) software developed under task 11.

The contractor’s monthly report must include a list of who is being billed that month along with their eQip status. This list must contain all contractor and subcontractor employees. The staff titles used in the list must either match the titles NCES provides (which are used on security position designation forms) or a crosswalk of NCES titles and the contractor’s corporate titles.

The contractor shall immediately notify the COR of problems encountered and proposed solutions. The reports shall be delivered with the monthly invoices, which must have costs submitted in IT costs and non-IT costs categories. Incurred costs and costs to completion must be included. If there are delays in invoicing, monthly reports shall still be delivered unless otherwise agreed to in advance with the NCES COR.

Due to the uncertainties of large data collection projects, the contractor shall develop and maintain a schedule for all activities of the project that is more detailed than the contract schedule of deliverables. The detailed schedule shall be updated monthly and submitted with the monthly report. For all activities within the project, the schedule shall detail the key staff assigned, and the projected start and end dates. For each monthly schedule, actual completion dates shall be entered for products completed that month. Any changes to the contract schedule of deliverables must be approved by the Contracting Officer.

Deliverables: 1.2 Monthly reports with schedules and invoices

Deliverable Submission Timing and Specifics: The contractor shall submit the monthly progress report and schedule no later than the 10th business day of each month.

Subtask 1.3 Integrated Monitoring System

The contractor shall implement and maintain an Integrated Monitoring System (IMS) to foster communications with staff and the CO, CS, and COR. The IMS is an archive of all the documents and data files generated during the life of the contract. The archive shall include drafts (with date), E-mail communications, meeting notes, final products, etc. The archive shall identify file name, date saved, author(s), format, and key words corresponding to each document.

The contractor shall design the IMS to routinely produce information about the project and enable the CO, CS, and COR access to this information remotely in a secure environment. At the end of the contract, the contractor shall submit electronic files of all archived products in a portable media format (e.g., DVDs, portable hard drive) that meets the Department’s security guidelines for data storage and transmittal, and agreed to by the NCES COR.

Deliverables: 1.3 (IMS) Document Archive

PAGE 17 OF 114 91990018R00120001

Deliverable Submission Timing and Specifics: The archive shall be updated as needed throughout the life of the contract. The contractor shall deliver the complete archive to NCES/the Department at the end of the contract.

Subtask 1.4 Security and Security Plan

Security is a major concern of NCES: integrity of data; confidentiality of information; privacy and security of personally identifiable information (PII); security of assessment items; and security of data collected from respondents. The threats can be from accidental or intentional disclosure of information to unauthorized persons, and from unauthorized modification or destruction of data. The contractor shall assure the security of the systems used to collect, process, and store data and other information for the study and follow procedures that conform to federal privacy laws and NCES privacy standards.

Please refer to Appendix B for detailed information on Compliance with ED IT Security Policy, Internet Protocol version 6 (IPv6) and Reporting of Data Security Breaches for more information on security requirements.

The contractor shall develop and maintain a system security plan (SSP) that details the security and confidentiality measures that shall guide the operation of this contract. The plan should include the components addressed in appendix B including materials necessary for the Department’s Certification and Accreditation (C&A) or Security Authorization (SA) process.

Once accepted by NCES, the contractor shall execute the provisions of the plan. Data collection systems shall not be used until the C&A/SA process is completed.

In addition to the SSP, the contractor…