BPM007707 Requirements Document - AASA Grades 3 - 8.pdf

NOTICE OF REQUEST FOR PROPOSAL

Solicitation Number: BPM007707

Solicitation Due Date / Time: August 18, 2026 Time (Local Time): 3:00 p.m. Arizona time

Submittal Location: https://appstate.az.gov

Description of Procurement: Arizona Academic Standards Assessment (AASA)

– Arizona Science Test (AzSCI), Grades 3 – 8

Pre-Offer Conference Date, None

In accordance with A.R.S. § 41-2534, the Arizona Department of Education is soliciting competitive sealed proposals pursuant to this Request for Proposal (RFP) for the materials or services specified herein.

Respondents will submit their Offers to the State Procurement Office online through the State’s e-Procurement system. Arizona Procurement Portal (A.P.P.) at https://app.az.gov, at the date and time posted in A.P.P.

Proposals received by the correct time and date will be opened and the name of each Offeror will be publicly available. Proposals shall be in the actual possession of the State prior to the time and date and at the location indicated in the Notice. Late proposals will not be considered.

The Offer shall be submitted in an acceptable format, as described herein, using the State’s online e- Procurement application Arizona Procurement Portal at https://appstate.az.gov. Submission of offers by means other than the Arizona Procurement Portal system will not be accepted. Prospective Offerors with questions in this regard shall contact the Procurement Officer prior to the Solicitation’s due date and time

To submit an Offer, Offerors shall register in A.P.P. Offerors requiring assistance in the registration process or in navigating A.P.P. may call the Help Desk at 602-542-7600.

OFFERORS ARE STRONGLY ENCOURAGED TO CAREFULLY READ THE ENTIRE SOLICITATION.

Please enter a nominal amount in the items/bid tab for award consideration.

Procurement Officer Date

Braulio Garcia 7/15/2026

Chief Procurement Officer Date https://procure.az.gov/ https://app.az.gov/

Table of Contents

Solicitation No. BPM007707 Arizona Academic Standards Assessment (AASA)

– Arizona Science Test (AzSCI)

Arizona Department of Education 1535 W. Jefferson Street

Phoenix, AZ 85007

TABLE OF CONTENTS

SCOPE OF WORK

SPECIAL TERMS AND CONDITIONS

UNIFORM TERMS AND CONDITIONS

Scope of Work

– Arizona Science Test (AzSCI)

Arizona Department of Education

1. MISSION STATEMENT

The Arizona Department of Education is a service organization committed to raising academic outcomes and empowering parents.

2. BACKGROUND

The Arizona Academic Standards Assessment (AASA) tests, previously known as AzMERIT and AzM2, are criterion-referenced achievement tests aligned to and measuring mastery of the Arizona English Language Arts (ELA) and Mathematics Standards. These tests were first administered in Spring 2015 to meet the assessment requirements of the No Child Left Behind Act (NCLB) and then the Every Student Succeeds Act (ESSA). The AASA tests have been administered in Grades 3 – 8 since Spring 2022.

Arizona’s Science Test (AzSCI) is the statewide achievement test for Arizona students in science in Grades 5, 8, and the Grade 11 cohort. It is a criterion-referenced assessment designed to measure student progress toward achievement of the Arizona Science Standards adopted by the State Board of Education in 2018. AzSCI is a grade band assessment in which students in Grade 5 take the assessment based on the standards for Grades 3−5, students in Grade 8 take it based on the standards for Grades 6−8, and students in the Grade 11 cohort take it based on the standards for high school. It is a computer-based assessment, allowing for the use of a variety of innovative item types where students can apply critical thinking skills to demonstrate a deeper understanding of the three dimensions of the Arizona Science Standards. Students do more than answer recall questions about science;

they apply the practices, or behaviors, of scientists and engineers to investigate real-world phenomena and design solutions to problems.

The AASA and AzSCI results provide student academic achievement results to students, parents, teachers, school administrators, and Local Educational Agency (LEA) staff. This information is used by LEAs and stakeholders to inform improvement strategies, gauge student achievement, measure school and district progress relative to student achievement and growth, assess the performance of schools, and inform Arizona’s school accountability measures.

The tests are delivered mainly online with most schools and districts administering computer-based tests. By state statute, A.R.S. §15-741 (H), LEAs may request to administer equivalent paper-based tests at the school or student level.

3. PURPOSE

The Arizona Department of Education (hereinafter referred to as “ADE”) is seeking a contractor(s) for the implementation of the statewide ELA and Math assessment in Grades 3 – 8 and Science in Grades 5 and 8, beginning in spring 2028 and continuing through the term of the contract. The testing Contractor shall work closely with ADE’s Assessment Section to complete all of the tasks described in the Scope of Work.

4. BACKGROUND

4.1 AASA ELA and Mathematics

AASA for English Language Arts (ELA) and Mathematics is administered each spring to students in Grades 3 through 8. Test delivery has historically included both computer-based and paper-based formats. The ELA assessment measures reading, language, and writing standards, and includes a required Move On When Reading (MOWR) component at Grade 3. As established in A.R.S. §§ 15-701 and 15-704, the MOWR score evaluates foundational reading skills using selected-response reading items and Oral Reading Fluency tasks.

AASA uses Arizona-owned test items, including multiple-choice questions, extended-response items, and technology-enhanced items. The assessment is administered within a four-week computer-based testing

– Arizona Science Test (AzSCI)

Arizona Department of Education window each April, with an overlapping paper-based window beginning in early April and lasting approximately ten days. Computer-based writing sessions and the Grade 3 Oral Reading Fluency session are completed during the first two weeks of the testing window. The ELA test consists of three untimed sessions, requiring most students approximately four hours to complete, with an additional timed Oral Reading Fluency session for Grade 3. The Mathematics assessment consists of two untimed sessions, generally requiring about two and a half hours in total. All tests are aligned to Arizona’s grade-level ELA or Mathematics standards, and the administration window is limited to four weeks under A.R.S. § 15-743(F).

4.2 AzSCI Science

AzSCI is administered to students in Grades 5, 8, and the Grade 11 cohort and consists of Arizona-owned assessment items. Item types mirror those used in AASA and include multiple-choice, extended response, and technology-enhanced items. The Grade 5 AzSCI assessment is aligned to the Crosscutting Concepts (CCCs) for Grades 3–5, and the Grade 8 assessment is aligned to the CCCs for Grades 6–8. AzSCI is delivered via three untimed computer-based testing sessions within a four-week testing window in April.

Each session typically requires approximately sixty to ninety minutes to complete. Pursuant to A.R.S. § 15-743(F), the testing administration window may not exceed four weeks.

4.3 Participants

AASA and AzSCI are administered statewide in all state-funded public schools, including school districts and charter schools. Private schools and Bureau of Indian Education (BIE) schools may also participate in AASA and AzSCI. Beginning with the Spring 2028 administration, homeschooled students may participate as well. Homeschooled and private school students must be tested by a trained test administrator in a school setting. The Contractor shall develop and implement a plan to administer testing and bill participating homeschool and private school students. Test results for non-public school students must be delivered to the Arizona Department of Education (ADE) either in a separate data file or within the public school student data file using a clear indicator that identifies non-public school records.

Unless otherwise specified, participation counts referenced in this section include only public school student participation in AASA and AzSCI.

Participation in the statewide assessments is extensive. Each spring, approximately 80,000 students per grade, across approximately 2,000 schools and 650 local education agencies (LEAs), participate in AASA.

Approximately 85,000 students per grade participate in AzSCI. Each LEA designates an LEA Test Coordinator who works directly with ADE and is responsible for coordinating all aspects of test administration and reporting within the LEA. Additional personnel involved in statewide testing may include school-level test coordinators and teachers or other school staff trained to serve as test administrators.

Both AASA and AzSCI are post-equated assessments and report student performance across four achievement levels: Level 1 (Minimally Proficient), Level 2 (Partially Proficient), Level 3 (Proficient), and Level 4 (Highly Proficient). Pursuant to A.R.S. § 15-743(F), Grade 3 AASA English Language Arts (ELA) results must be delivered electronically by May 15, and all remaining grade-level reports must be delivered electronically by May 25. Paper reports for both AASA and AzSCI must be delivered to LEAs by mid-June.

The standard mode of administration for AASA and AzSCI is computer-based testing (CBT), with paper-based testing options provided as required under A.R.S. § 15-741(H). The majority of students complete the assessments via CBT.

The Grade 3 AASA ELA assessment shall include a Move On When Reading (MOWR) score to meet the requirements of A.R.S. §§ 15-701 and 15-704 and applicable State Board rules for measuring student reading proficiency. The Grade 3 ELA assessment must include items aligned to the Grade 3 Reading:

– Arizona Science Test (AzSCI)

Arizona Department of Education

Foundational Skills Standards and assess phonics and fluency through speaking and listening components.

These components must be developed for both computer-based and paper-based administration.

5. CONTRACTOR RESPONSIBILITIES – ELA and Math Grades 3 – 8 and Science Grades 5 and 8

The Contractor for ELA and Math Grades 3 - 8 and Science Grades 5 and 8 shall provide a summative assessment for computer-based and paper-based testing and include the following services:

5.1 Federal and State Requirements and Industry Standards

For all work associated with the Grades 3–8 English Language Arts (ELA) and Mathematics assessments and the Grades 5 and 8 Science assessments, the Contractor shall fully comply with the requirements of the Elementary and Secondary Education Act (ESEA), as amended by the Every Student Succeeds Act (ESSA). The Contractor shall also adhere to recognized industry-standard best practices for large-scale statewide assessment programs, including but not limited to best practices in test design, development, administration, scoring, reporting, research, data handling, and documentation.

Such best practices are reflected in, but not limited to, the following professional standards and guidance documents, as amended or superseded:

• Standards for Educational and Psychological Testing (American Educational Research Association, American Psychological Association, and National Council on Measurement in Education, 2014)

• Operational Best Practices for Statewide Large-Scale Assessment Programs (Council of Chief State School Officers [CCSSO], 2013)

• Testing and Data Integrity in the Administration of Statewide Student Assessment Programs (National Council on Measurement in Education, 2012)

• Comprehensive Statewide Assessment Systems (CCSSO, 2015)

• Code for Fair Practices in Education (Joint Committee on Testing Practices, 2004)

• CCSSO High-Quality Assessment Principles (2015), as well as any comparable or successor guidance issued during the term of the Contract.

The Contractor shall conduct all work under this Contract with the highest standards of professionalism, integrity, and ethical conduct. This requirement applies to all interactions with the Arizona Department of Education, participating schools and LEAs, subcontractors, and any other stakeholders involved in the administration of AASA and AzSCI.

5.2 Test Development

The Contractor shall:

5.2.1 The Contractor may use current Arizona-owned items. The Contractor may perform all services related to importing existing items from previous Contractor item bank into current Contactor’s item bank for the Arizona assessments.

5.2.2 Provide complete item banking services, including all content and statistical information on all items in a format that is accessible, useful, and reviewed by the ADE.

5.2.3 Perform all services related to test design, item development and review, item banking, and test production for the Arizona assessments. The Contractor may use customized products and

– Arizona Science Test (AzSCI)

Arizona Department of Education services derived from existing products developed and published by the Contractor or developed as part of other initiatives.

5.2.4 Develop new items annually throughout the length of the contract.

5.2.5 Design a new assessment for potential implementation beginning in Spring 2028. The

Contractor’s design of the ELA and Math Grades 3 – 8 and Science Grades 5 and 8 assessment shall:

5.2.5.1 Align to the State’s standards and reflect a coherent progression of ELA, Math, and

Science content. The Grade 5 Science test must be aligned to Grade 5 standards only and the grade 8 Science test must be aligned to Grade 8 standards only.

5.2.5.2 Produce a MOWR score based on the reading items in the ELA Grade 3 test.

5.2.5.3 Be a fixed form test that includes innovative item types.

5.2.5.4 Take no longer to administer than the current ELA (≈ 4 hours), Math (≈ 3 hours), and

Science (≈ 2.5 hours) assessments.

5.2.5.5 Include computer-based test (CBT) administration and a comparable paper-based test

(PBT) format as well as comparable Braille and American Sign Language forms.

5.2.5.6 Provide data for pertaining to status of student achievement with respect to standards;

aggregated and disaggregated trends/patterns in student performance, relative performance of cohort, subgroups, grade levels, and subject areas; aggregated and disaggregated relative performance of school, teacher and districts

5.2.6 Involve ADE in all facets of test development. ADE will have the right to approve, reject, or require changes to all final decisions and finished products to any items owned by ADE. ADE shall have the opportunity to review and provide feedback for newly developed items owned by the Contractor.

5.2.7 Apply accepted principles of validity, reliability, and sound measurement practice in all phases of test development and shall incorporate Universal Design principles (UDL) to ensure assessments are clear, accessible, and comprehensible for all students. The Contractor’s test development shall include the application of (UDL).

5.2.8 MOWR Requirement: The Contractor’s ELA Grade 3 assessment shall include items based on the 3rd grade Reading: Foundational Skills Standards, as assessed by speaking and listening to assess phonics and fluency skills, for both CBT and PBT.

5.2.9 New Standards: The Contractor shall plan on an ELA, Mathematics, and Science Standard revision during the life of the contract. The Contractor shall develop new Test Specifications and Test Blueprints and item development for the beginning of the contract and after any standards revisions.

5.2.9.1 Test Item Specifications must be developed for each standard assessed and shall include, at a minimum, performance level descriptors (PLDs), allowable item types, assessment content limits for the standard, standard explanations and content descriptions, possible Depth of Knowledge (DOK) classifications, example or sample items, and any embedded tools specific to the standard or item type. Both an internal

– Arizona Science Test (AzSCI)

Arizona Department of Education version and a public-facing version of the Test Item Specifications must be produced for all test formats, including computer-based testing (CBT), paper-based testing (PBT), Braille, and American Sign Language (ASL).

5.2.9.2 A stand-alone field-test design for operational testing and a separate embedded field-test design for ongoing item development must be developed if new standards are adopted.

5.2.9.3 Standard setting must be conducted following the adoption or revision of Arizona’s English Language Arts, Mathematics, and Science standards. A plan for establishing performance standards based on the Arizona ELA, Math, and Science Standards must be provided.

5.2.9.4 A full-length practice test and accompanying practice test materials must be developed and delivered for each test format based on the approved Test Blueprint. Practice tests must mirror the look and functionality of the operational assessments and accurately reflect the approved Test Specifications and Test Blueprints.

5.2.9.5 Fully aligned formative and interim assessments in English Language Arts, Mathematics, and Science for grades K–8 must be offered.

5.3 Test Development Security Requirements

5.3.1 Provide a secure working environment ensuring that only authorized individuals have access to the test development process and test items at all times, including during the transmission of any test items and during stakeholder committee reviews.

5.3.2 Follow stringent test security procedures during all stages of test development.

5.4 Style Guide

5.4.1 Develop a Style Guide that describes the test design for all ELA, Math, and Science tests for all tested grades. The Style Guide shall include editorial and stylistic considerations for the development of items and online item configuration including screen layouts and navigation elements, font style and size requirements, background and foreground color palettes, and requirements for graphics.

5.4.1.1 Include considerations for the conversion of online items rendered to all paper forms

5.4.2 The Style Guide must be updated and revised annually to reflect changes in style and layout requirements. Revisions must be developed collaboratively with the Arizona Department of Education (ADE), including joint identification of any components requiring modification. ADE will conduct an annual review of the revised Style Guide and, prior to the start of test development, will approve the document, require modifications, or reject the submission.

5.5 Test Specifications and Test Blueprints

5.5.1 Measure conceptual understanding, fluency and procedural skill, and the application of ELA, Mathematics, and Science standards as defined in the Arizona 2016 ELA and Math Standards

– Arizona Science Test (AzSCI)

Arizona Department of Education and the Arizona 2019 Science Standards. The Contractor shall develop Detailed Test Specifications that include the following:

5.5.1.1 An internal and public-facing Test Item Specifications

5.5.1.2 A description of the general content/standards being measured for both internal and external use, including PLDs, content limits of the standard for assessment, standard explanation and content description.

5.5.1.3 A description of the tests reporting categories

5.5.1.4 A description of the Depth of Knowledge (DOK) used to classify each test item

5.5.1.5 A description of the various item types including higher order thinking skills and DOK that can be assessed using each item type with sample task demands

5.5.1.6 A description of the method by which text complexity and grade-level appropriateness is determined for all stimuli/passages and items, and including any content delivered via media, video, or audio

5.5.1.7 Internal Test Blueprints that include: the number of items/points per standard, the number of items/points per reporting category, the distribution of items at specific DOK levels, distribution of items by item response theory (IRT) difficulty value, and distribution of items by item type. The Contractor will work with the ADE and possibly Arizona’s Technical Advisory Committee (TAC) to define and refine this work. The distribution of score points must reflect a balance of ELA and Math concepts and applications, as the state’s standards require

5.5.1.8 External Test Blueprints that include the percentage range of items per reporting category, cluster, or standard depending on the level of reporting available for each content area.

5.6 Item Development Plan

5.6.1 Produce an item development plan and timeline for ADE review. Upon ADE approval, item development activities must be conducted in accordance with the approved plan and must take into account the approved Test Blueprints, including the full range of assessed content, levels of rigor, and item types. The plan must reflect the intent to replace or refresh up to seventy percent (70%) of operational items per test form annually, release up to ten percent (10%) of operational items each year, and maintain a fixed-form test design. The timeline must allow sufficient time for ADE and educator review and for revisions at all stages of item and test development. New items must be developed annually throughout the term of the contract.

5.6.2 Within the item development plan, the Contractor shall include:

5.6.2.1 The Contractor’s item development process, which shall include the development of new items in a quantity, quality, and variety sufficient to initially create assessments for use in Spring 2028. These new items shall align to the Arizona ELA and Math Standards or Arizona Science Standards and produce reliable and valid score interpretations of the measurement of those standards.

– Arizona Science Test (AzSCI)

Arizona Department of Education

5.6.2 Contractor’s conducting of Differential Item Functioning (DIF) analysis for the typical ethnic/racial and gender groups, as well as English language learners and students with disabilities groups to ensure valid score interpretations for all students. Analyses must include students who participate in any format of the assessment but may not include students whose results may not represent their knowledge of the content (e.g., students whose response is always the first answer option).

5.6.2.3 Item and stimuli/passage counts shall be developed by the Contractor annually by item type and standard.

5.6.3 For all items developed for use in Spring 2028 and beyond, the Contractor shall use images and passages/stimulus that are royalty free, in the public domain, or developed in-house. The Contractor shall refrain from using any images in items, presentation or sample/practice items that require licenses or permissions.

5.6.4 Conduct internal reviews to ensure item clarity, content accuracy, adherence to Test Item

Specifications, psychometric properties, difficulty, readability requirements, and potential bias or sensitivity. Contractor shall not submit to the ADE, at any time, proposed test items that contain blatant errors, such as violation of Test Item Specifications, spelling errors, or grammar mistakes. The ADE will not review any submissions with these types of obvious errors even if the impact creates schedule challenges for the Contractor, for which the Contractor will be responsible.

5.6.5 Annually, the Contractor shall update and submit for ADE approval the item and passage development plan taking into account the approved Test Blueprint (including the full range of content, rigor, text complexity, and item types), refresh rate, and release rate. The Contractor shall prepare a detailed summary of the current state of the test item bank inventory, including the item use and relevant item and passage statistics.

5.7 Test Form Construction

5.7.1 Develop a test form construction plan subject to ADE review and approval that ensures compliance with test form requirements. At a minimum, the plan must address the following:

5.7.1.1 Alignment to the Style Guide

5.7.1.2 Alignment to the Test Specification

5.7.1.3 Alignment to the Test Blueprints

5.7.1.4 Alignment to Item Specifications

5.7.1.5 Verification that the percentage of anchor items, new operational items, and field-test items is appropriate

5.7.1.6 Placement of items to facilitate consistency of score interpretation across years

5.7.1.7 Confirmation that the statistics for items selected for forms facilitate the least measurement error at the most critical locations on the scale

5.7.1.8 Confirmation that item selection will be based on matching target test characteristics including item difficulty, test information functions, and standard error curves

– Arizona Science Test (AzSCI)

Arizona Department of Education

5.7.1.9 Review for key-runs, clanging, and cluing

5.7.1.10 Confirmation that computer-based test form and paper-based test form are comparable in target test characteristics

5.7.1.11 At least one in-person content meeting with ADE Content Staff, Contractor Content

Staff, and a Psychometrician each year to develop forms if using Arizona-owned items.

5.7.2 Provide a test map for both computer-based and paper-based test forms with detailed information about the items included in the test form. The Contractor shall retain test construction records, including test maps during the lifetime of the contract.

5.8 ADE Review of Test Items and Test Forms

5.8.1 Provide ADE with the right to review and approve all operational, vertical linking, and field-test items, including their placement within test forms. Submissions provided for final ADE approval must exactly replicate the student testing experience.

5.8.2 Ensure error-free test items and test forms.

5.9 Stakeholder Review Committees

The Contractor shall:

5.9.1 Organize and convene review committees and is responsible for committee member stipends and travel costs. The Contractor shall organize and convene review committees that include appropriate Arizona stakeholders – educators, students, parents, representatives of institutions of higher education and/or business leaders. The Contractor shall collaborate with ADE to establish the final committees from candidates provided by ADE. ADE has the right to make the final determination of the members of the final committees. The Contractor is responsible for the committee meeting invitations.

5.9.2 The Contractor’s development project manager, the development team, and necessary assistants shall participate in and manage the stakeholder review meetings. The Contractor shall prepare, organize, distribute, and secure all meeting materials, and shall perform any data entry or note-taking functions required during the meeting. Meeting materials must be provided to ADE at least ten business days in advance for review.

5.9.3 Organize and convene stakeholder review committees that include, at a minimum:

5.9.3.1 Test Blueprint review committee, to ensure that the Test Blueprint reflects Arizona educator understanding of key English language proficiency content and relative importance.

5.9.3.2 PLD committee to be held any year with standards revision.

5.9.3.3 Content and alignment review committees, to ensure items are aligned to the standards and grade appropriate.

5.9.3.4 Bias and sensitivity review committees, to ensure items are fair and Arizona-specific sensitivities are addressed.

– Arizona Science Test (AzSCI)

Arizona Department of Education

5.9.3.5 Rubric validation committees, to ensure scoring rubrics for open-ended items are accurate.

5.9.3.6 Data review committees, to review statistical data on each field-tested item to identify any issues from a psychometric perspective.

5.9.3.7 Standard setting committee, as needed. This Committee will provide a plan for setting performance standards based on the Arizona ELA and Math Standards. The plan shall provide a process for involving both the ADE and Arizona stakeholders in the development of performance-level descriptors as well as setting new standards.

Standard setting methodology shall use appropriate external evidence and/or benchmarking to assist in stakeholders’ decisions. Additionally, the plan shall outline studies that will be conducted to evaluate the validity of performance standards over time.

5.9.4 Develop a report after each committee meeting describing the committee representation, activities, committee feedback, and recommendations.

5.10 Release of Operational Items

5.10.1 Propose for ADE review and approval, and follow, an item release plan that includes at minimum:

5.10.1.1 The number of items to be released annually, equivalent to at least 10% of operational items in each of the grade and subject tests. This item release is in addition to items used on the practice test.

5.10.1.2 The type of items released, to represent a full range of available item types.

5.10.1.3 Timelines for release

5.10.1.4 The format in which items will be made available to the public.

5.11 Test Administration

The Contractor shall:

5.11.1 Administer the test without error or impediments. The Contractor shall involve ADE in all facets of test administration and shall approve all final decisions and finished products.

5.11.2 By Arizona State Statute §15-741(H), have comparable paper-based tests that must be printed, ordered, packed, and shipped to districts and returned to the vendor for scanning and scoring.

Based on the Spring 2025 administration, the ADE predicts 10 - 15% of students will need paper-based materials printed for a school site to administer the test.

5.11.3 The Contractor may include an optional plan for remote proctoring of CBTs.

5.12 Test Administration Security Requirements

The Contractor shall:

5.12.1 Provide a secure test environment that ensures that students and test administrators access only the appropriate materials, and that the transmission of testing data is secure at all times.

5.12.2 Restrict access to test administration site based on a user role system defined by the ADE.

– Arizona Science Test (AzSCI)

Arizona Department of Education

5.12.3 Provide a test administration site that shall be a secure, encrypted, password-protected system.

All log-ins to the system shall be logged. The ability to make changes to data or processes, including student information in any part of the system, shall be based on user roles and shall be logged.

5.12.4 Provide a system that assures proper identification of each student and the accurate matching of the student to his/her assigned test. The system will ensure that a student can take each assigned test only once unless authorized by the ADE. If an error is found (for example, a student takes a test using the wrong login information), the system shall have the ability to link the test to the correct student profile.

5.12.5 Meet all requirements for student data privacy.

5.12.6 Provide assessments that meet federal and state requirements for student data privacy.

5.12.7 Provide an assurance of student privacy protection, reflecting compliance with all applicable federal and state laws and requirements, such as, but not limited to:

5.12.7.1 Children’s Online Privacy Protection Act (COPPA).

5.12.7.2 Family Educational Rights and Privacy Act (FERPA).

5.12.7.3 Federal Information Security Management Act (FISMA).

5.12.8 Provide a description of how data will be managed securely, including, for example, encrypting all personally identifiable information during test administration, while at rest and in transit.

5.13 Ensuring Test Security

The Contractor shall:

5.13.1 Provide a test administration security plan aligned with current industry standards and practices that includes at a minimum the following:

5.13.1.1 Training for all test administration personnel

5.13.1.2 Secure management of assessments, so that no individual gains access to unauthorized information

5.13.1.3 Auditable test administration information regarding test administrators’ and students’ access to the online system to assist in the detection of testing irregularities

5.13.1.4 Methods used to detect testing irregularities before, during, and after testing, and steps to address them

5.13.1.5 An external validation of the security of the testing platform

5.14 Online Management System

5.14.1 Provide an online management system that shall be the primary resource for all student data management, as well as test administration and reporting tasks.

– Arizona Science Test (AzSCI)

Arizona Department of Education

5.14.2 Ensure that the online management system is operational during the entire test window, providing students and test administrators with full access to the system and to the test without impediment.

5.14.3 Provide an online management system that, at a minimum, shall:

5.14.3.1 Include a secure site that requires usernames and passwords for LEA-level or school-level users.

5.14.3.2 Allow customizable accounts based on user roles (state-level, LEA-level, school-level).

5.14.3.3 Depending on the user role, allow views of and modifications/alterations to other organizations in the system (for example, a state-level user may select and view any LEA or school in the state).

5.14.3.4 Depending on the user role, allow for the addition of schools, enrollment counts, and student pre-identification files that were not included in the original ADE file.

5.14.3.5 Include an online ordering process for additional testing materials, accommodated test versions, and ancillary materials.

5.14.3.6 Support pre-identification and enrollment data transfer using secure file transfer or API.

5.14.3.7 Include the creation of new or updated user accounts, individually or via file upload, based on user role.

5.14.3.8 Provide user access to various non-secure and secure links.

5.14.3.9 Accommodate test delivery.

5.14.3.10 Accurately track student access and participation.

5.14.3.11 Include an online ordering and tracking process for paper tests, accommodated test versions, and ancillary materials.

5.14.3.12 Support secure, unattended file transfer.

5.14.4 Using an ADE provided file or API, the Contractor shall populate the system with all active LEAs and schools and current LEA test coordinators. The Contractor shall population the password-protected online system with this information to create initial LEA-level user accounts.

5.14.5 Submit components of the Contractor’s online systems annually to the ADE for review of content, layout, aesthetic quality, accessibility, and functionality prior to release to the field.

5.14.6 Make any requested changes to such systems. The online systems shall not be used for

Contractor advertisements or other promotional purposes. The “branding” of these systems should be primarily Arizona’s assessment system, but may include Contractor logos and other information as approved by the ADE. If ADE branding guidelines change over the course of the contract, the Contractor will need to update the branding of the system and materials accordingly.

5.14.7 Create a report that includes a checklist of all operable aspects of the system and shall list any malfunctions or unavailability of the system. This report does not take the place of the required

– Arizona Science Test (AzSCI)

Arizona Department of Education incident report and root cause analysis for any malfunctions or unscheduled unavailability. The production frequency of this report, for ADE review, shall be established after the award of the contract.

5.14.8 Design, develop and implement an integrated comprehensive dashboard for user interface with the online management system that allows school and LEA users self-service capabilities with all facets of assessment and instructional instrument administration, processing and reporting.

The dashboard shall also provide Arizona users the ability to monitor all components of the Assessment Program in real- time numeric and graphical presentations of the following:

5.14.8.1 Students registered – pulled from the enrollment files

5.14.8.2 Students active – actively engaged in the assessment at the time of reporting

5.14.8.3 Students not-tested – students who have been pulled out of the registered

5.14.8.4 Students and identified as not testing (e.g., absent, transferred, withdrawn, etc.)

5.14.8.5 Students started today – the number of students who began the activity

5.14.8.6 Students completed today – this indicates final submission (if a student has begun the activity but has paused to complete the activity on another day, they are not listed in this data set)

5.14.8.7 Time lapse visualization – for school, district, or state level once all students have submitted their tests

5.15 Standards for the Handling of Personally Identifiable Information (PII)

5.15.1 Comply with all applicable State of Arizona data security, privacy, and protection requirements, including but not limited to the Standards for the Handling of Personally Identifiable Information set forth in the Special Terms and Conditions of this Contract.

5.15.2 AI and Automation Restrictions

5.15.2.1 The Contractor shall not use generative artificial intelligence tools, including large language models, to process, store, or analyze PII unless explicitly authorized in writing by ADE.

5.15.2.2 The Contractor shall ensure that automated tools such as meeting transcription services, bots, or similar technologies are not used in connection with PII unless approved by ADE and compliant with all applicable data protection and security requirements.

5.16 Information Technology/Homeland Security Policies

5.16.1 Comply with all applicable State of Arizona information technology, security, and homeland security requirements, including but not limited to those set forth in the Special Terms and Conditions of this Contract.

5.16.2 For informational purposes, all technology and security-related questions, including those related to security controls documentation, may be directed to:

– Arizona Science Test (AzSCI)

Arizona Department of Education

Elizabeth Neeley Chief Information Officer beth.neeley@azed.gov

And

Sandeep Desai Information Security Officer sandeep.desai@azed.gov

5.17 Hardware and Software Requirements

The Contractor’s testing platform shall:

5.17.1 Support both wired and wireless connections to the system and all eligible devices described below. The Contractor shall provide continued support for future updates and other assistive technologies that may be needed for students requiring accessibility features and accommodations.

5.17.2 Provide eligible devices with capabilities to “lock down” the device to temporarily disable features, functionalities, and applications that could present a security risk.

5.17.2.1 Features that shall be controlled during test administration include, but are not limited to, unrestricted internet access, cameras (still and video), screen capture (live and recorded), email, instant messaging, Bluetooth connections, application switching, and printing.

5.17.2.2 The Contractor shall demonstrate the capacity to develop and improve capabilities and features for the applicable operating systems and browsers.

5.17.3 Support multiple web browsers which shall at a minimum include Apple Safari, Google Chrome, Mozilla Firefox, and Microsoft Edge or Internet Explorer, with a description of the lowest and highest browser versions supported.

5.17.4 Include a secure browser, which both (a) locks access to all other computer and web programs, applications, and files, and (b) masks and directly accesses the testing host web site.

5.17.5 The testing platform may include a system check that verifies computer software and connectivity readiness for testing which can be run from individual machines.

5.17.6 Perform, at a minimum, on devices that meet the specifications described below:

Device Specifications for Desktop, Laptop, Notebook, and Thin Client/VDI Computers

Operating System Specifications Windows Windows 11 or newer Mac OS Mac OS X 13 or newer Linux Ubuntu 18.04+, Fedora 39 or newer Chrome OS Chrome OS 121 or newer Memory 1 GB RAM or greater Connectivity Computers must be able to connect to the Internet via wired or wireless networks Screen Size 10 inch screen size or larger Screen Resolution 1024 x 768 resolution or higher mailto:beth.neeley@azed.gov mailto:sandeep.desai@azed.gov

– Arizona Science Test (AzSCI)

Arizona Department of Education

Device Specifications for Tablets Operating Systems Specifications Android Android OS 12+ Apple iOS iPadOS 15 or newer Windows Windows 11 or newer Connectivity Tablets must be able to connect to the Internet via wired or wireless networks Screen Size 9.7 inch screen or larger Screen Resolution 1024 x 768 resolution or higher

5.17.7 Prove at a minimum 15-month notification of technology moving to End of Support for the testing Program

5.18 Testing Platform Overview

5.18.1 Provide a testing platform capable of being customized to meet the needs of Arizona students, school and LEA personnel, and the ADE. The Contractor shall ensure that the testing platform can accurately capture student performance and is accessible to all students.

5.18.2 Provide a testing platform that adheres to Universal Design principles (UDL) and is intuitive and easy to use for all participants. This includes item layouts, navigation tools, fonts, and administrative controls such as managing student demographic and participation information, as well as test setup activities. The testing platform shall be compliant with the following design principles:

5.18.2.1 U.S. Rehabilitation Act Section 508, which requires that all web site content be equally accessible to people with disabilities.

5.18.2.2 The Accessible Portable Item Protocol (APIP) Standard and the IMS Access For All Personal Needs & Preferences (AfA PNP) v2.0 Specification

5.18.2.3 Web Accessibility Initiative guidelines including WCAG 2.1 Level AA and WAI-ARIA

1.1. These guidelines provide a wide range of recommendations to support people with disabilities, including blindness and low vision, deafness and hearing loss, learning disabilities, cognitive limitations, limited movement, speech disabilities, photosensitivity, and combinations of these.

5.18.3 Provide a testing platform that does not allow access to secure test content until test administration training requirements have been met.

5.18.4 Provide User Acceptance Testing (UAT) for the ADE to review and approve testing platform look and functionality.

5.18.5 Propose a solution to the ADE if the ADE determines that the testing platform is not performing adequately and is significantly affecting the student testing experience or is unable to meet the requirements listed in this Contract, at no additional cost, which allow for students to participate in the assessment.

5.18.6 Provide a testing platform that meets the following performance requirements in a controlled

Internet access environment:

– Arizona Science Test (AzSCI)

Arizona Department of Education

5.18.6.1 Require a bandwidth connection of no more than five (5) kilobits per second (kbps) per simultaneous test taker using a caching solution or fifty (50) kbps per simultaneous test taker without caching.

5.18.6.2 Deliver less than one second mean screen refresh rate for 90% of all users. Ensure that no users have a refresh rate of greater than five (5) seconds.

5.18.6.3 Support at least 200,000 simultaneous online Arizona testers in addition to any services provided to other states and programs.

5.18.6.4 Continually monitor and report to the ADE the number of simultaneous online users of the system during student testing periods.

5.18.6.5 Develop and provide an infrastructure test, consisting of mock items, that replicates the size of the largest test and is run on the actual testing platform (for example, users log into the testing platform as if they were logging into a live test).

5.18.6.6 Develop a User Guide in collaboration with the ADE to walk users through running the trial on devices that will be used for testing to help LEAs and schools identify technical issues and make adjustments prior to live testing.

5.19 Testing Platform Performance Requirements

5.19.1 Site Readiness

5.19.1.1 Provide available tools, utilities and processes that allow school districts to evaluate the degree to which they have attained technical readiness for CBT, such as device compatibility, network performance and bandwidth.

5.19.1.2 Develop guidelines for Arizona and LEAs to access and use the provided tool(s) utilizing sample data at times during the school day that will closely replicate the operational testing and instructional environments. In addition, the Contractor shall provide a methodology for authentication of completion of the necessary steps for ensuring technological readiness by LEAs prior to operational administration of assessments or instructional instruments.

5.19.1.3 Provide tool(s) for Arizona to use in verifying the capacity of LEAs and their technological infrastructure for conducting online assessments. The Contractor’s tool(s) shall be available through the online solution and, at a minimum, address the following:

(a) Proper configurations of network devices to ensure network connectivity from installed solution components within the LEA and/or campus building to Internet locations required for testing services

(b) Capacity of hardware for use in online testing (minimum workstation specifications, minimum bandwidth requirements, percent of bandwidth utilization at school/LEA levels)

(c) Evaluation of the maximum number of concurrent assessments to be administered at each school site

– Arizona Science Test (AzSCI)

Arizona Department of Education

5.19.1.4 Review and determine the matrix of approved Client-Side Technology within thirty (30) days after the Effective Date of this Contract and each anniversary date during the Term taking into consideration the Client-Side Technology available in Arizona school districts as determined through an annual survey, manufacturer support, or the proven compatibility of the CBT System as provided by the Contractor.

5.20 Screen Layout Requirements

5.20.1 Develop screen layouts for the presentation of test items which shall include at a minimum:

a) Prominently displayed student identifying information (name, student ID, etc., as specified by ADE)

b) Icons to access the item tools/features noted below

c) Icons presented with consistent location and look and feel across all screen layout options

d) Strategies to eliminate or reduce scrolling

e) The ability to display items and text using variable font sizes

5.21 Test Platform Tools and Features

5.21.1 Provide a testing platform that shall, at a minimum, include these testing tools and universal tools available to all students:

Testing Tools

Calculator Enables calculations directly on the computer as appropriate for students as determined by the ADE for each grade and content area. User-acceptance testing will be required to assure that calculations are performed in the same sequence and with the same rounding rules applied as the hand-held calculators. Proposed functionality and features of calculators to be included should be described.

Reference Sheet Displays a pop-up reference sheet as appropriate. This will be capable of being enlarged. The content of such reference sheets shall be determined by the ADE for each grade and content area.

Measurement Tools Allows measurement using tools necessary to demonstrate proficiency of the standards as appropriate.

Universal Testing Tools Available to All Students Area Boundaries Allows student to click anywhere on the selected response text or button for multiple choice options.

Expand/Collapse Passage Expands a passage for easier readability. Expanded passages can also be collapsed.

Help View the on-screen Test Instructions and Help.

– Arizona Science Test (AzSCI)

Arizona Department of Education

Highlighter Highlights text in a passage or item.

Line Reader Allows student to track the line he or she is reading.

Masking The Masking tool temporarily covers a distracting area of the test page.

Mark (Flag) for Review Marks an item for review so that it can be easily found later.

Notes/Comments Allows student to open an on-screen notepad and take notes or make comments. Comments are attached to a specific test item and available throughout the session.

Pause and Restart Allows the session to be paused at any time and restarted and taken over a one-day period. For test security purposes, visibility on past items is not allowed when paused longer than 20 minutes.

Review Test Allows student to review the test before ending it.

Strikethrough Crosses out answer options for multiple-choice and multi-select items.

System Settings Adjusts audio (volume) during the test.

Text-to-Speech for Instructions

Provides an oral reading of test directions and item directions using a natural sounding human voice.

Text-to-Speech for Content Text-to-Speech for content of Math and Writing. The text-to-speech feature must have one consistent voice for text and text graphics and not be operating-system specific. Quality control checks must be in place to ensure all words are pronounced correctly.

Tutorial View a short video about each item type and how to respond using the item type.

Writing Tools Editing tools such as cut, copy, and paste and basic text formatting tools such as bold, underline, and italic for extended response items.

Zoom In/Zoom Out Enlarges the font and images in the test. Undo zoom in and return the font and images in the test to original size.

The system must be able to Zoom, in selected sections or the entire test, in increments from approximately 12 point to approximately 72 point available for the student to zoom or for the administrator to preset. Graphics must be able to be enlarged also. When the entire test is enlarged any buttons, tools, the pointer/cursor, and the scrollbar must also enlarge based on the zoom level selected.

5.22 Accommodations

5.22.1 Provide accommodations for all assessments, including English learners and students with disabilities. Accommodations for English learners shall not include translation of tests or test items.

5.22.2 Provide Computer-Based Tools for Accommodated Students:

– Arizona Science Test (AzSCI)

Arizona Department of Education

5.23 Accommodated Paper Test Versions

5.23.1 For…