OSTEM RFI DRAFT PWS.pdf

NASA Science, Technology, Engineering, and Mathematics (NSTEM)

Performance Work

Statement Attachment XX

DRAFT

1. INTRODUCTIONS

The National Aeronautics and Space Administration’s (NASA or Agency) founding legislation, the National Aeronautics and Space Act of 1958, 51 U.S. Code (U.S.C.) §20101 et. seq. directs the agency to expand human knowledge of Earth and space phenomena and to preserve the role of the United States as a leader in aeronautics, space science, and technology. In carrying out this directive, the NASA Office of STEM Engagement’s (OSTEM) development of a high-quality STEM enterprise and its strategic deployment is essential to lead the Agency’s science, technology, engineering and mathematics (STEM) investments. The vision, mission, and strategic goals for STEM engagement drive a systematic approach to move students across a spectrum of learning to inspire, engage, educate, and eventually, for these students to be employed in STEM fields.

NASA contributes to national efforts for achieving excellence in STEM engagement through a comprehensive education portfolio comprised of a broad and diverse set of programs, projects, activities, and products implemented by the OSTEM, the NASA Mission Directorates, and the NASA Centers and NASA facilities located across the country. The scope of NASA’s STEM enterprise encompasses all endeavors Agency-wide to attract, engage, and educate students and to support educators, educational institutions, and professional and student organizations.

The NASA Strategy for STEM Engagement 2020-2023 serves as OSTEM’s roadmap for the Agency’s work devoted to STEM engagement. This strategy defines OSTEM’s objectives and strategies to drive requirements and alignment of all STEM engagement efforts, including programs, projects, activities, and products. This strategy aligns with the Federal Strategy for STEM Education and Engagement Charting a Course for Success: America’s Strategy for STEM Education and contributes to a STEM education ecosystems that consists of multi-sector partners united by a collective vision of supporting participation in STEM through the creation of accessible and inclusive STEM learning opportunities spanning all education stages and career pathways. A STEM education ecosystem continuously evaluates its activities and adapts as needed, plans for the long-term, and communicates its work to build broad support and advance best-practices.

2. OVERVIEW

To successfully execute NASA’s vision and mission to immerse students in NASA’s work, enhance STEM literacy and inspire the next generation to explore, OSTEM requires a continuum of services.

Services required are the development and/or execution of internships, fellowships, career and workforce training experiences; development and/or execution of STEM challenges and competitions;

academic research and development support; creation and execution of pre-college and college STEM experiences; faculty and educator support; institutional capacity-building; and development of STEM content and products. Services are required to be designed, planned, and implemented across NASA Centers and Facilities and Other Federal Agencies.

NASA makes valuable contributions to the Federal sector’s goals for STEM education by providing mission-driven opportunities that will attract students to STEM and help build a vibrant and diverse next generation STEM workforce. NASA’s goals for contributing to the next generation STEM workforce are to:

1. Create unique opportunities for a diverse set of students to contribute to NASA’s work in exploration and discovery;

2. Build a diverse future STEM workforce by engaging students in authentic learning experiences with NASA’s people, content and facilities; and

3. Attract diverse groups of students to STEM through learning opportunities that spark interest and provide connections to NASA’s mission and work.

To execute OSTEM’s vision, mission, and strategic goals, NASA requires services that need critical knowledge, capabilities, skills and expertise to deliver STEM learning experiences in collaboration with the OSTEM project/functional managers and staff across the Agency. OSTEM works in close collaboration with NASA’s STEM workforce to provide exceptional experiences for students, and with NASA’s public engagement workforce to leverage opportunities for reaching students to promote NASA’s commitment to an equitable, diverse, and inclusive workforce. NASA is committed to finding innovative ways to deliver content and engage students in STEM learning. NASA’s work in STEM engagement is focused on providing opportunities for students, especially those underrepresented and underserved in STEM fields. Providing support and resources to educators and educational institutions is vital to effectively engage students. Ultimately, the beneficiaries of NASA’s investments and work in STEM Engagement are students at all levels. NASA’s unique contributions are vital to attracting and building a vibrant and diverse next generation STEM workforce that will continue the nation’s legacy of exploration and discovery.

3. GOAL

The primary goal of NASA Science, Technology, Engineering and Mathematics (NSTEM) contract (Contract) is to provide quality products and services through support to NASA internships and fellowships; career and workforce training experiences; challenges and competitions; academic research and development opportunities; pre-college and college STEM experiences; faculty and educator support; institutional capacity building; and development of STEM content and materials for the OSTEM, the NASA Mission Directorates, and the NASA Centers and facilities located across the country.

The requirements described in this Performance Work Statement (PWS) apply to NASA HQ, Mission Directorates, Centers, and facilities. Under this Contract, work locations and travel requirements will be defined in task orders. Policy and procedure documents referenced throughout the PWS are listed in Attachment XX, Applicable Documents List.

4. STRUCTURE FOR ORDERING WORK

The paragraphs within this document describe the products and services required on this Contract.

Work will be ordered in accordance with clause XX, Task Ordering Procedure and the following:

a. Contract Number

b. Contract Year

c. Task Order Number

d. Unique Work Item

5. CONTRACT MANAGEMENT AND ADMINISTRATION

5.1 Contract Management and Administration

a. The Contractor shall continually evaluate and implement fiscally responsible, cost effective, innovative, and efficient processes or disciplines for implementing the requirements outlined in this PWS.

b. The Contractor shall provide the management and administrative functions to satisfy the requirements of Data Requirements Deliverable (DRD) XX, Contract Management Plan.

c. The Contractor shall comply with all policies and procedures included in Attachment XX, Applicable Documents.

d. The Contractor shall follow the most current approved version wherever reference is made in this PWS and in task orders to specific policies, procedures, directives, work instructions, and other NASA or Government documents.

e. The Contractor shall provide a diverse, experienced, highly skilled, knowledgeable and flexible workforce with a wide range of skills, technology, and expertise. Contractor shall deliver and sustain day-to-day enterprise functions required for successful implementation of NASA internships and fellowships; career and workforce training experiences; challenges and competitions; academic research and development opportunities; pre-college and college STEM experiences; faculty and educator support; institutional capacity building; and development of STEM content and materials for the OSTEM, the NASA Mission Directorates, and the NASA Centers and facilities located across the country. The Contractor shall deliver enterprise functions virtually, physical location or combination.

f. The Contractor shall maintain the ability to obtain security clearances as appropriate for work on this Contract. Where required, specific employee security clearance requirements will be defined along with the technical content in Task Orders.

i. For employees who no longer require access, the Contractor shall provide verification that these employees have properly cleared all accounts when they no longer need access.

g. The Contractor shall provide all resources (e.g., labor, materials, and property) required to perform this Contract. The exceptions to this are the items (materials and property) listed in:

1. Attachment XX, List of Government-Furnished Property (GFP)

2. Attachment XX, Installation-Provided Facilities and Services

3. Attachment XX, Systems Inventory

h. The Contractor shall provide to the Government all deliverables listed in the Attachment XX, Data Requirements List (DRL) in electronic form as specified in the individual DRD, unless otherwise directed.

i. The Contractor shall, at least once per contract year, conduct a “kick-off” meeting with its Contractor team to communicate the following:

1. OSTEM mission, vision, goals, and objectives as they relate to NSTEM

2. Business ethics and conduct in accordance with FAR 52.203-13, Contractor Code of

Business Ethics and Conduct .

3. Responsibilities of the NASA Ombudsman’s role in resolving Contractor/Civil Servant issues in accordance with NPD 2025.1B.

4. Contract-specific policies on telework and duty station; environmental continencies; and emergency operations.

j. Other topics as defined by the Contracting Officer (CO) and the Contracting Officer’s

Representative (COR).

5.2 Safety and Health

a. The Contractor shall perform work in accordance with DRD XX, Safety and Health Plan.

b. The Contractor shall ensure that all personnel, including sub-contracted personnel, comply with all Federal, State, local and NASA Safety, Health and Environmental laws, regulations, requirements, policies, and guidelines when staffing and performing tasks.

c. The Contractor shall comply with all NASA Safety, Health, and Environmental regulatory reporting and training requirements applicable to this contract.

d. The Contractor shall submit a detailed safety and occupational health plan in accordance with DRD XX, Safety and Health Plan as part of its proposal. The plan shall include a detailed discussion of the policies, procedures, and techniques that will be used to ensure the safety and occupational health of Contractor and sub-Contractor employees and to ensure the safety of all working conditions throughout the performance of the contract.

5.3 Resource Management

a. The Contractor shall provide ongoing business analysis and respond to Government requests for financial information. In performing these functions, the Contractor shall:

1. Maintain detailed records that support Government-performed services (within the

OSTEM enterprise) and allow Government-performed reconciliation.

2. Maintain Enterprise ordering information as directed by the Government.

3. Provide financial information maintained by the Contractor for use by the Government for budgeting purposes and business case analyses.

4. Provide financial planning data to support the Government budget process including:

Planning, Programming, Budgeting, and Execution (PPBE) budget calls, operating plan budget calls, and special requests for budget impacts.

c. The Contractor shall conduct quarterly accounting reconciliations (planned expenditures versus actual expenditures).

5.4 Operations, Project and Function Management

a. The Contractor shall coordinate, operate, and manage designated and new projects, functions, and activities required to provide STEM engagement activities, products and services in accordance with the DRD XX, Contract Management Plan. The Contractor shall be responsible for maintaining communication with the supported organization and alert the COR and CO immediately of any problems that would prevent meeting established objectives. The Contractor shall:

b. Create and maintain project plans (DRD XX, Project Plans).

1. The Contractor shall be knowledgeable about industry standard project management tools.

2. The Contractor’s management team shall demonstrate project management expertise by executing operational and development projects and activities per negotiated schedules and within project, task order, and contractual budgets.

3. Costs associated with projects shall include labor, materials, travel, training and other direct and indirect costs.

4. The Contractor shall report this information monthly to the Government.

c. Maintain and report metric performance.

d. Provide Rough Order of Magnitude (ROM) estimations, in accordance with DRD XX, for work when requested by the Government.

e. Create and maintain Information Technology (IT) Security plans and contribute to the OSTEM

Enterprise Security Plan consistent with NPR 2810.1, Security of Information Technology, in the provisioning of products and services under this contract.

f. Document Lessons Learned and Corrective Action Reports as directed by the CO or COR or as deemed internally appropriate by Contractor management. Reports shall be delivered in accordance with DRD XX, Lessons Learned and Corrective Action Reports.

g. Create and maintain the deliverables required to support the NASA Continuous Monitoring process in accordance with NPR 2810.1.

h. Attend and support key Government-sponsored meetings, conferences, and forums, as defined by the task order.

5.5 Reporting

a. Support data analytics and reporting systems and processes for understanding, assessing, evaluating, sustaining and improving workforce and career learning experiences fiscal, business and programmatic functions in accordance with DRD XX, Contract Management Plan.

b. The Contractor shall provide to the COR at the end of each month a written report summarizing the overall results of the contractor’s performance. This written report submitted monthly will be used by the COR to complete quality assurance monitoring.

c. The Contractor shall prepare for presentation a Quarterly Status Review. The Quarterly Status Review shall include accomplishments, work upcoming, and problems encountered during the reporting period. This quarterly status shall be provided to the COR on, or before, the 10th day of the first month in the following quarter and will cover the previous quarter’s status. The Contractor shall provide special cost analyses and projection reports, as requested by the COR.

d. The Contractor shall follow all Agency safety, health, and environmental reporting regulations and report any mishaps to the COR and CO including pertinent safety statistics in the Quarterly Status Report.

5.6 Management Integration

a. The Contractor shall perform management and technical integration across the activities, products and services required within this PWS. While this Contract is specifically awarded by OSTEM as the Government Requiring Office, the activities, services and products provided will extend to Mission Directorates, NASA centers and facilities.

b. The Contractor shall execute a management integration approach that ensures all elements (i.e., technical, programmatic, business, management information analysis and data analysis) of the Contract, including subcontracts, are well-integrated and focused on overall mission success.

c. The Contractor’s integration approach shall be transparent to the Government, in terms of the integration between the prime Contractor and its subcontractors.

d. Management and technical integration shall be included as part of monthly performance reports and quarterly status reviews in accordance with DRD XX, Contract Management Plan.

5.7 Technology, Innovations and Process Improvements

a. The Contractor shall take the initiative, seek creative solutions, and infuse technology and innovations from other industries consistent with NPR 2810.1, Security of Information Technology.

b. The Contractor shall initiate and participate in benchmarking activities as appropriate and propose process efficiencies, innovative process changes, and potential cost reductions to NASA while maintaining technical capabilities. The Contractor shall participate in reviews of proposed changes; however, the Government will decide on implementation of any changes.

c. The Contractor shall investigate best practices from contracts or facilities similar to NSTEM and OSTEM and shall identify potential improvements to the operations of this contract. The Contractor will consider the PWS in its approach but will not limit the proposed changes only to processes currently used or described in the PWS.

d. The Contractor shall define overall strategies for approaching innovation, its plan for implementing those strategies, and shall incorporate them into DRD XX, Contract Management Plan. Contractor proposed innovation approaches shall result in improved activities, products or services while maintaining or reducing costs to the Government. An increase in costs to the Government or change in scope must have concurrence from the CO or COR before implementation.

e. The Contractor shall report proposed individual innovations accepted by the Government, as well as internal innovations implemented by the Contractor, per DRD XX, Contract Management Plan

5.8 Business Agility

a. Business agility is defined herein as the capability of an entity to rapidly change or adapt in response to changes in the business environment, and enables that entity to successfully react to the emergence of new industry-changing technologies or sudden shifts in business environment conditions (dynamic requirements, schedule demands, financial constraints, and technical considerations).

b. The Contractor shall include strategies and approaches for maintaining business agility as part of the DRD XX, Contract Management Plan for the contract.

c. Strategies for improving business agility shall not result in overall increase of costs to Government (materials or labor), without CO approval, prior to implementation.

5.9 Risk Management

a. The Contractor shall assess, evaluate, document, and manage all identified risks associated with the performance of contract requirements.

b. The Contractor shall create, implement, modify, and maintain, a contract-wide Risk

Management Plan as defined in DRD XX, Contract Management Plan, and in compliance with NPR 2810.1, Security of Information Technology.

c. The Contractor shall develop and utilize a Risk Management Program that is complimentary to NASA Procedural Requirement (NPR 8000.4) process and document its methodology for managing risk in DRD XX, Contract Management Plan.

5.10 Property Management

a. The Contractor shall comply with Government-defined requirements for property management

(DRD XX, Government Property Management Plan, DRD XX, Financial Reporting Contractor-Held Property, and RFP Sections G and H), to include the use of Government specified applications, and perform property custodian functions for GFP (Attachment XX, List of Government Furnished Property, Pursuant to FAR 52.245-2) in accordance with NPR 4200.1, NASA Equipment Management Procedural Requirements, and NPR 4200.2, Equipment Management Manual for Property Custodians.

b. Vacancy permitting, the Contractor shall first consider utilizing facilities furnished by the Government. The Contractor shall be responsible for ensuring all Contractor and Subcontractor staff complies with the operational policies and procedures for all contract specified facilities (reference Attachment XX, Government Furnished Property). Compliance also applies to Contractor-leased facilities for the purpose of performance on this contract.

5.11 Records Management

a. The Contractor shall electronically maintain accurate and complete records (including legacy, electronic, paper, and vital records) and administer the disposition of these records and non-records in accordance with NPR 1441.1, NASA Records Retention Schedules, which has been approved by NASA and the National Archives and Records Administration (NARA).

b. The Contractor shall segregate NASA records from company-owned records and from non-record materials and shall provide NASA or authorized representatives’ access to all Government records in accordance with FAR Subpart 4.7. The Government reserves the right to inspect, audit, and copy record holdings.

1. At the completion or termination of this Contract, the Contractor shall leave all Government-owned data with the appropriate Government entity.

2. The Contractor shall ensure that Government-owned data is in a format that is accessible, readable, and usable by the Government.

3. The Contractor shall deliver Government-owned records to the appropriate Center records manager for dissemination to the Offices of Primary Responsibility (OPRs).

4. The Contractor shall provide the Government (or authorized representatives as designated by the COR) with access to all Government records.

c. The Contractor shall maintain a records management program for all data/records produced as part of this contract and electronically submit a records management plan in accordance as part of DRD XX, Records Management Program Plan. The Contractor shall utilize specific contract and account record management systems when such systems are provided by the Government.

d. The Contractor shall deliver records to the OSTEM Records Manager in accordance with NPR

1441.1 at the completion or termination of this contract or as record retention schedule expires.

When in doubt of the ownership of records, the Contractor shall submit electronically to the CO a request for a determination from the OSTEM Records Manager as to which records are subject to this direction.

5.12 Procurement

a. The Contractor shall execute procurement and accounting processes for both internal and external funding sources for NASA internships and fellowships, research assistance, collaborators, and educator and faculty career enhancement and professional development.

Processes for accounting for funding and procurements made should be in accordance with DRD XX Contract Management Plan.

b. The Contractor shall maintain complete purchasing documentation for all articles purchased under this contract including purchase request, purchase order, contact information, purchasing organization, Internal Task Agreements (ITA), Memorandums of Understanding (MOU), other agreements and invoices.

1. The Contractor shall ensure that all purchases used in support of this contract (or satellite site[s]) are consistent with dynamic Federal, NASA, and OSTEM regulations and policies.

2. All purchase records shall be tracked as part of the Contractor’s Record Management system (in accordance with DRD XX, Contract Management Plan) and deliverable to the Government upon request and expiration/termination of the contract.

5.13 Work Authorization

a. The Government will use task orders to authorize work under this contract. Task orders are approved by Task Order Managers (TOM)s. The Contractor shall utilize a Government-provided system for processing task orders.

b. Standard/Non-Standard Business Hours: The Contractor shall work a five-day work week and define their work schedule within Agency normal work hours (6:30 AM through 5:30 PM) unless an alternate work schedule, such as Quiet Fridays, has been approved by the COR or CO.

The Contractor shall work outside of standard business hours when directed by task order or work authorization as provided by the CO.

5.14 Quality Management and Control

a. The Contractor is responsible for supervising, directing, and controlling the quality of products and services provided to the Government, and assuring products and services procured meet appropriate quality requirements. This responsibility includes development and maintenance of procedures that effectively control nonconforming supplies and services, including activities for the identification, segregation, disposition, and disposal of the supplies. Acceptance or rejection criteria shall be clear and measurable.

1. Metrics: The Contractor shall provide metrics (DRD XX, Contract Management Review) to be made continuously available in an electronic system accessible by the Government. (Metrics shall include a measurement of innovation and business agility.)

2. Training and Certifications: The Contractor shall be responsible for obtaining and maintaining the skills and certifications required on this contract.

5.15 Continuity of Operations Plan (COOP) and Contingency Plan

a. The Contractor shall provide and maintain a COOP (DRD XX, Continuity of Operations Plan).

The COOP shall establish Contractor policy and guidance to ensure the execution of the mission essential functions for this contract. The plan shall cover the situation/event when an emergency in a facility threatens or incapacitates operations. The plan shall address the relocation of selected personnel and functions of any service provided by this contract. The Contractor’s plan shall be designed to respond to emergencies, recover from them, and mitigate against their impacts. In addition, the plan shall address a contract status of threatened, diminished, or incapacitated, as well as an associated timeline.

5.16 IT Security Management for Program Compliance

a. Contractors that purchase, lease, network to, or otherwise utilize Government-funded IT

(Clinger-Cohen Act of 1996 and referenced by Office of Management and Budget (OMB) Circular A-130) shall comply with NPR 2810.1, Security of Information Technology.

b. IT Security Program Management Plan: The Contractor shall submit an IT Security Program Management Plan (per DRD XX, IT Security Plan) for its unclassified IT resources, and in the Plan, identify an Information Systems Security Officer (ISSO) who is responsible for the Contractor’s system(s). An IT Security Program Management Plan outlines the elements to meet the IT Security requirements for interfacing with other contractors and NASA, for training, and to comply with NPR 2810.1. This Plan shall describe the policy, processes, and procedures that will be followed to ensure appropriate security of IT resources that are developed, processed, or used under this contract. The Contractor’s IT Security Program Management Plan shall be compliant with Federal and NASA policies as referenced in OMB Circular A-130 and NPR 2810.1.

c. Employee IT Security Awareness Training: Contractor employees performing work under this contract shall complete annually the NASA-provided IT Security Awareness Training. The Contractor shall provide evidence that IT security awareness training has been met for all employees subject to this contract. The Contractor shall submit periodic reports (as required by the CO) detailing the overall status of the annual training. The annual renewal of IT Security certification is defined by the anniversary date of an employee’s initial successful completion of the training. The IT Security Awareness Training is delivered via desktop workstation and takes approximately 1 hour to complete.

d. Internal IT Security Plan audits: Employee/Participant information is sensitive. The Contractor shall proactively protect sensitive data as defined by IT Security Awareness Training and documented in the IT Security Plan.

5.17 Catalog for Products and Services Provided

a. The Contractor shall provide a comprehensive and current list reflecting products and services provided by the NSTEM contract in accordance with DRD XX, NSTEM Products and Services Catalog.

6. AWARDS AND GRANT SUPPORT

The Contractor shall provide management and administrative support for grants and cooperative agreements lifecycle tasks which include pre-award phase, award phase and post-award phase in accordance with Federal and Agency grant management procedures, regulatory requirements and guidance.

6.1 Awards and Grant Management

a. The Contractor shall be knowledgeable of NASA Shared Service Center (NSSC) and HQ requirements for grant administration, grant manuals, and OMB circulars. Contractor personnel supporting grant or cooperative agreement solicitations shall be familiar with 2 CFR 200, 2 CFR 1800, the NASA Proposers Guide, the NASA Grants and Cooperative Agreement Manual (GCAM) and registered and trained in NSPIRES or other agency-identified grant management system.

6.2 Award and Grant Process

a. The Contractor shall apply NASA programmatic goals, objectives and requirements for

Minority University Research and Education Programs (MUREP), Next Gen STEM, Established Program to Stimulate Competitive Research (EPSCoR) and Space Grant.

b. The Contractor shall conduct pre-award processes including:

1. Announcing programs and soliciting applications or proposals for funding under assistance awards;

2. Overseeing, reviewing, analyzing, and evaluating grants/assistance applications, plans, and estimates;

3. Determining awardee eligibility using formulas and methodology and established eligibility criteria, such as competitive rating factors; and

4. Conducting risk assessments and business reviews.

c. The Contractor shall conduct award processes including negotiating terms and conditions of grants/assistance awards to include costs, schedules, and oversight responsibilities

d. The Contractor shall conduct post-award processes including

1. Preparing, processing, issuing, and tracking grants/assistance awards and compliance with reporting requirements;

2. Conducting program evaluation, including monitoring and assessing awardee performance, and establishing performance measures;

3. Monitoring, assessing, and ensuring awardee complies with all terms and conditions of award;

4. Initiating and/or recommending that an audit be performed;

5. Conducting resolution of audit findings or monitoring audit resolution in partnership with resolution officials;

6. Conducting post-award reviews and analyses to identify management, financial, and administrative issues;

7. Ensuring recipients of Federal funds comply with Government’s environmental and other requirements;

8. Performing final review of completed awards, making appropriate adjustments or disallowances, and processing close-outs; and ensuring compliance with all regulatory and legal requirements; and

9. Performing the necessary data base collections, coordination, entry, verification, validation, maintenance and integration with agency data performance assessment and evaluation collections.

7. NASA STEM ENGAGEMENT RECRUITMENT

The Contractor shall execute strategies for education and scientific institutions, STEM organizations, and other related associations to inform, engage, promote and recruit a qualified pool of applicants who represent the diversity of the nation to participate in NASA Office of STEM Engagement activities, including NASA Internships, NASA Workforce and Career Learning Experiences; NASA K-12 STEM Engagement; NASA Challenges and Collegiate Experiences; NASA Institutional Support and Research and Development Opportunities; NASA K-16 Educator Professional Development (EPD).

7.1 Recruitment, Selection and Placement

a. Provide a strategic marketing approach to develop and implement a researched and documented plan designed to reach the maximum number of diverse candidates that considers all aspects of the ways potential applicants receive their information. Provide resources and solutions for the recruitment, selection and placement of high school, undergraduate, and graduate students, educators and faculty in authentic NASA learning opportunities.

7.2 Engagement Opportunities

a. Organize, coordinate, and support recruitment and public engagement events, national and regional STEM Conferences, related conferences, workshops, and exhibits, in-person and virtual career fairs, competitions and challenges designed to attract students, educators and faculty to NASA unique STEM engagement, and potential career opportunities.

7.3 Promotional Tools

a. Provide resources, communication strategies, tracking metric tools, and products to promote recruiting, leveraging and delivering STEM content, in partnership with NASA OSTEM, Office of Communications, Mission Directorates, cross-cutting organizations, and program offices, to create rich, effective learning experiences and connections for potential applicants with an emphasis on diverse candidates. Provide understandable and engaging content and logistical planning to execute digital media platforms, virtual environments, and educational simulations to engage students, educators in NASA unique learning opportunities.

7.4 Live Coverage

a. Provide enterprise resources for live coverage during STEM engagement events. Adhere to agency guidance on storage of relevant photos and video with signed image release forms for potential future use. Coordinate logistical support of live streaming on social media or post content and updates during a live event as required by NASA project management in coordination with OSTEM Comm lead.

8. PERFORMANCE ASSESSMENT AND EVALUATION SERVICES

The performance assessment and evaluation services contemplated under these requirements include one or a combination of the activities listed below. An individual task order will require services in only one of these activities or a combination of these activities. The Contractor shall execute the performance assessment and evaluation services described below in accordance with all relevant Federal, Agency and OSTEM regulations, policies, directives, strategies and guidance that pertain to performance and evaluation and professional standards of assessment practice and education evaluation (see section J. for more details).

8.1 Performance and Evaluation Management

a. The Contractor shall develop an innovative and comprehensive Performance and Evaluation (P&E) Strategy/Framework and accompanying Learning Agenda (Evidence Plan) for the NASA Office of STEM Engagement (OSTEM) Enterprise.

b. The Contractor shall execute the NASA OSTEM Enterprise P&E Strategy/Framework and Learning Agenda (Evidence Plan) for internal assessment and external (independent) evaluation of the portfolio of STEM Engagement activities. The Contractor shall manage and perform all support tasks in in alignment with P&E Strategy/Framework and Learning Agenda (Evidence Plan) and compliance with Agency annual performance planning, metrics and success criteria development, strategic review, data collection and analysis, and reporting processes.

c. The Contractor shall develop guidance, business processes and technical support for the NASA STEM Gateway (universal registration/application and data management system).

The Contractor shall develop and execute an enterprise approach to data collection, performance monitoring and data visualization dashboards, community of practice, presentation briefings and reporting. Annually, the Contractor shall generate a body of evidence (i.e., milestone accomplishments, performance and participation data, evaluation outcomes, and/or other metrics) to assess performance progress in achieving NASA OSTEM Enterprise and Agency STEM Engagement function performance goals, objectives, success criteria, and outcomes/impacts of its program, projects and engagement activities.

d. The Contractor shall develop and execute an evidence-based decision-making process with the internal and external stakeholders to ensure utilization of performance assessment and evaluation findings and recommendations to inform budgetary, policy, programmatic policy, project formulation, planning, coordination and operational decisions.

e. The Contractor shall convene expert review panels (ERP) made up of external stakeholders at strategic decision points in order to provide recommended solutions to NASA identified questions or challenges and feedback on NASA STEM Engagement performance and evaluation activities in support of executing the evidence-based decision-making process and continuous improvement efforts.

8.2 Project Design Support

a. The Contractor shall provide support as needed for program design functions, including the development of logic models and theory of change documents, and for evidence-based decision-making through benchmarking, literature reviews and syntheses, performance data analysis and lessons learned reviews. These support functions typically require analyses of existing documentation and data and consultation with NASA staff and key stakeholders.

This work will involve fact-finding or information gathering and analysis.

8.3 Evaluation Studies

a. The Contractor shall facilitate a rigorous and iterative process to develop evidence-based and innovative evaluation plans dependent on the purpose of the evaluation, the questions asked by STEM stakeholders, type and design of evaluation, the stage of program development, the proposed uses of findings and recommendations, and the resources available for evaluation in alignment to the NASA OSTEM P&E Strategy/Framework and

Learning Agenda.

b. The Contractor shall deploy enterprise-determined evaluation techniques and to conduct

Needs Assessments, Formative Evaluations, Process/Implementation Evaluations, Outcome Evaluations and/or other special studies.

c. The Contractor shall provide appropriate staffing to execute internal evaluations and procure services for the execution of external (independent) evaluations that utilize innovative design methodologies, data collection and analysis services in alignment to the NASA OSTEM P&E Strategy/Framework and Learning Agenda.

d. Evaluation planning and execution will include development of evaluation questions; data collection and analysis plan to generate statistically sound findings; sampling strategy;

strategy for respondent recruitment; instrument/protocol identification and/or development;

survey testing for reliability and validity of instruments; activity observations; product review; project documentation review; site visits; preparation of transcripts and translation of data collection instruments; qualitative analysis and descriptive and multivariate statistical analysis; and other professionally accepted and appropriate methods.

e. The Contractor shall procure services to perform external (independent) evaluation services, but still maintain responsibility for the successful execution of the entire evaluation study and maintain an arms-length relationship with the project/program under study. In addition, the sub-contractor serving as the external (independent) evaluator shall obtain all applicable clearances prior to commencement of data collection activities.

8.4 Collection of Data

a. The Contractor shall provide support throughout the lifecycle of NASA OSTEM Enterprise projects and engagement activities in the areas of data collection, analysis, and reporting, including assisting NASA OSTEM Enterprise with the development of performance goals, success criteria, data validation and verification, facilitation of focus group discussions and site visits, technical writing and editing, descriptive and statistical analysis of performance data, graphic visualization, dashboards, presentation briefings, communication with internal and external stakeholders, and reporting.

b. The Contractor shall analyze existing documentation and data and provide support for evaluation or research studies led by NASA staff, and/or consultation with NASA staff and key stakeholders. The Contractor shall execute quick turn-around fact-finding or information gathering and analysis.

c. The Contractor shall execute agency approved data collection strategies for Office of Management and Budget (OMB) approved information collections, approved systems of record and data collected via the NASA STEM Gateway (universal registration/application and data management system).

d. The Contractor shall oversee the collection of data and reporting on performance goals and other performance indicators throughout the lifecycle of STEM Engagement programs/projects.

8.5 Regulatory Compliance

a. The Contractor shall provide technical support in compliance with regulations, requirements, policies, documents and processes for information collections involving human subjects pertinent to performance assessment and evaluation activities.

b. The Contractor shall develop and coordinate submission of information about the collection of personally identifiable information (PII), security controls, records management, and other topics related to the Privacy Act and NASA’s Privacy Act policy, the development of Paperwork Reduction Act information collection request (ICR) clearance packages and submission documentation for review by NASA Institutional Review Board (irb.nasa.gov) or an independent IRB, including an IRB provided by the Contractor.

c. The Contractor shall conduct a review of existing documentation, preparation of detailed research procedures, including detailed statistical plans, and consultation with NASA staff and key stakeholders. Note that detailed statistical plans will include the development of statistically sound plans for sampling, power analyses, response rate calculation, and non-response bias analyses.

d. The Contractor shall develop guidance, business processes and training materials to ensure awareness and compliance of the NASA OSTEM Enterprise and stakeholders with regulations, policies and processes for performance assessment and evaluation information collections.

8.6 Grantee/Awardee Evaluation Capacity Building

a. The Contractor shall provide evaluation technical expertise and assistance to NASA STEM

Engagement leadership, Mission Directorates and grantees/awardees.

b. The Contractor shall align activities to evaluation evidence-based practices and develop performance and evaluation business processes and training support tools to ensure awareness of relevant strategies, learning agenda, standards, and evidence-based practices to build evaluation capacity to manage and/or conduct rigorous and appropriate evaluations with an independent evaluator.

c. The Contractor shall develop tools and resources for assessing quality control of third-party (independent) evaluation plans and reports.

9. NASA INTERNSHIPS AND FELLOWSHIPS

The Contractor shall design and administer a high quality, self-sustaining semester and year-round career learning/workforce development internship program to engage national and international students, educators and faculty, with a special emphasis on outreach to those from underrepresented and underserved groups, in authentic NASA learning opportunities. The program should offer real-world experience, professional development, and strengthen the future workforce while contributing to the advancement of NASA’s missions and aligns to NASA’s values and its principles of unity and inclusion. STEM fields should be the predominant areas of opportunity; however, several positions in other fields such as the social sciences, business and communications will be included.

9.1 Internships Model

a. Execute a competitive internship model that integrates knowledge and theory with practical application and skill development in a professional/research setting with a special emphasis on underrepresented and underserved participation. The model will train, educate, and motivate students to pursue degree programs leading to NASA-related careers, with emphasis on STEM but not exclusive of other disciplines.

9.2 Fellowships Model

a. Execute a competitive fellowship model to support student-authored and independently conceived graduate research proposals responding to NASA Research Opportunities (NRO).

While supporting all institution types, the NASA Fellowship Activity will focus on increasing underrepresented and underserved participation in research disciplines needed to help advance NASA’s missions. Fellowships will provide academic institutions the ability to enhance graduate-level learning and development. Fellows will become an integral part of a research team, gain relevant research experience, expand their professional network, learn best practices, develop and strengthen research ethics, and cultivate an understanding of specific research processes.

9.3 Support Services and Technical Assistance

a. Utilize and provide support and technical assistance for the NASA-owned on-line application and registration system for NASA internships, fellowships, academic, research, professional development opportunities, and other learning experiences to identify mentor opportunities, receive and review applications, aid in the selection of participants, and provide metrics and updates to the agency in accordance with DRD XX, Workforce Experience Reporting.

9.4 Developmental Opportunities

a. Design, plan, develop, and implement educational engagement and professional development opportunities for students based on national best-practices for all participants including, but not restricted to, seminars, workshops, colloquiums, career development, shadowing and other relevant activities.

b. Create opportunities to increase participant appreciation, competencies, and interpersonal skills needed for working in a complex NASA organizational and professional setting that represents various ages, races, cultural backgrounds, professional roles, and stages of career development.

9.5 Model Implementation

a. Provide innovative approaches to increase broader participation, enhance management efficiencies, lower overhead costs, and maximize the implementation of the internship programs.

b. Provide performance reports demonstrating progress of innovative approaches and internship programs participant data in alignment with performance assessment and evaluation requirements.

c. Support agency and center functional offices to secure necessary access to NASA facilities, badges and IT assets including managing on and off-boarding of participants, on-site enrollment and issuance of NASA credentials, IT and security training, government equipment, phone, and workspace. Approach will include the special requirements for international students’ pre-arrival activities, visa applications, and security clearance.

9.6 Specialized Training for Mentors

a. Design and execute professional development instruction that meets a variety of specialized training, formal education, or advanced professional knowledge for mentors and stakeholders to increase cultural responsiveness, professional understanding, competence, skill, and effectiveness in mentorship.

9.7 Internship and Fellowship Collaborations and Partnerships

a. Cultivate, sustain and leverage professional relationships with a network of higher education institutions, with an emphasis on Minority Serving Institutions, and faculty principal investigators (PIs) to support the established NASA collaborations and partnerships performed at universities in support of NASA workforce and career learning experiences.

9.8 Agency Stakeholders

a. Form, maintain, and leverage a network of positive relationships with STEM engagement and education stakeholders and partners brokering between NASA’s mission directorates, center-specific programs, employee resource groups and students, universities, museums and other STEM engagement institution, ensuring mission driven, distinctive learning experiences for students and educators.

10. NASA WORKFORCE AND CAREER LEARNING EXPERIENCES

The Contractor shall design and administer authentic learning experiences (non-internship) that provide NASA-related experiences for students, educators and higher education faculty to gain real-world experience, professional development and career enhancement while contributing to the advancement of NASA’s missions.

10.1 Support and Technical Assistance

a. Provide support and technical assistance for the agency’s Enterprise on-line application and registration system for students, educators and faculty applying to NASA academic, research, professional development opportunities and other types of learning experiences.

Provide innovative approaches to increase broader participation, enhance management efficiencies, lower overhead costs, and maximize the implementation of the workforce and career learning experiences.

10.2 Participant Competencies

a. Increase participant appreciation, awareness, competencies and interpersonal skills required for working in a complex NASA organizational and professional environment representing various ages, races, cultural backgrounds, professional roles, and stages of career development.

10.3 Student Volunteer Opportunities

a. The National Aeronautics and Space Administration (NASA), pursuant to 5 U.S.C. § 3111 and 51 U.S.C. § 20113 offers unpaid training opportunities to students in high school and college. These opportunities provide NASA an opportunity to train individuals in a specialized field and obtain volunteer services making the working experience mutually beneficial to both NASA and the volunteer. Occupational experiences are designed to enable the volunteer to apply and test theoretical learning to specific STEM fields, help the volunteer gain perspective on her strengths and weaknesses, and create an awareness of the skills and abilities such experience provides, and provides NASA to mentor the next generation of STEM.

10.4 Specialized Training

a. Design and execute development opportunities meeting a wide variety of specialized training, formal education, or advanced professional learning for administrators, teachers, and other educators to increase professional knowledge, competence, skill, and effectiveness in STEM careers. Learning experiences integrate knowledge and theory with practical application and skill development in a professional setting connecting the participant’s experience and the participant’s academic or professional institution.

10.5 Workforce and Career Collaborations and Partnerships

a. Execute and sustain a network of higher education institutions, including Minority

Serving Institutions, PIs, and established NASA collaborations and partnerships to support STEM disciplines needed to help advance NASA’s missions. Execute and sustain a network of STEM engagement and education stakeholders and partners for brokering between NASA’s Mission Directorates and students,…