Draft_FRA_EDIMS_HighLevelObjectives-wElements_v4Oct24.pdf

FRA Enterprise Data Integration and Management Support (EDIMS) Services Draft High Level Objectives (4 October 2024)

Task Area High Level Objective Elements Data Engineering Support

For Data Engineering, FRA seeks to develop and optimize data analytics pipelines to deliver high quality data that enables data driven decision making through analytics and geospatial analysis.

Build, maintain, and improve FRA data management framework, structure and processes;

Design information architecture for a Delta Data Lake House or comparable system;

Develop and implement Extract Transform and Load (ETL) processes;

Develop and implement scalable data practices;

Maintain change data capture logs;

Following the Medallion model, process (via ETL) data from raw (bronze) to cleaned and validated (silver) to presentation (gold) levels. Note: Movement of data between environments (ELT) will be predominantly managed via a separate contract.

Data Quality For Data Quality (Data QA/QC), FRA seeks cleaning and validation of submitted data to review, detect and correct any inaccurate data.

Review data submissions for accuracy and resolve errors through coordination with submitters;

Develop, implement and maintain automated data quality rules;

Track submission errors for trend analysis;

Monitor data quality and develop process for elevating data quality errors to FRA;

Clean and validate submitted data to create trusted system of record;

Develop and maintain data transaction log.

Data Information Architecture

For Data Information Architecture, FRA seeks to organize and arrange collected data in accordance with appropriate physical and logical data models to ensure the capability to analyze, interpret, and use data.

Design, implement and maintain logical and physical data models for FRA and its stakeholders;

Participate in FRA Data Architecture and Planning Review (DAPR) process;

Develop information architecture strategy;

Document database diagrams and provide supporting documentation to enable proper data governance .

Data Collection Design

For Data Collection Design, FRA seeks to employ user friendly methods for collecting high quality and thorough data that enables effective analysis and decision-making.

Provide design recommendations to FRA and stakeholders for effective data collection, including: data fields, valid codes, and form design

Align design of data collection instruments with security requirements Coordinate design implementation with appropriate FRA staff or support contractor;

Validate and verify operability on recommended designs.

Data Governance For Data Governance, FRA seeks support for development and implementation of policies including data standards and other governance initiatives including in AI/ML to ensure data integrity and compliance with federal regulations and standards.

Review and assess existing FRA/DOT principles, standards, tools, methodology and practices;

Recommend updates to improve data management governance and address deficiencies;

Support coordination of recommendations to FRA/DOT stakeholders;

Support designing, developing, implementing, and overseeing a unified data management and governance process spanning the full data lifecycle;

Create and maintain necessary documentation to support new and updated data governance;

Support the use of FRA data governance platform

Data Strategy Support

For Data Strategy Support, FRA seeks to identify and assess current and future capabilities (including AI/ML) in order to make informed decisions to improve data analytics, mining, integration, and governance capabilities.

Assess current FRA capabilities, previous plans, and documentation to forecast future needs;

Develop and maintain data strategy plan that captures the technology, processes, people, and rules required to manage FRAs information assets;

Outline FRA's long-term vision for collecting, storing, sharing, and usage of its data;

Develop business goals, objectives and Key Performance Indicators (KPIs) to measure effectiveness of implemented capabilities.

Communications Strategy/Plan

For Communications Strategy, FRA seeks to develop and implement a communications plan to educate internal and external stakeholders about available data and how to effectively leverage it.

Review current data management processes and communicate them to internal and external stakeholders;

Develop, document, and maintain a plan for bidirectional information flow;

Support implementation of FRA approved communications plan directed to data consumers;

Develop, maintain, and update outreach and educational resources;

Conduct on-going outreach to internal and external stakeholders.

Coordination Support

For Coordination Support, FRA seeks to ensure seamless communication, interaction, and collaboration between FRA organizations and contractors to align data management across the agency

Develop, document, and maintain a plan for how the contractor will coordinate activities with FRA organizations and FRA contractors;

Provide support to enable synchronization of data related activities to align with data and communication strategies;

Provide technical guidance and updates to the FRA Data, Architecture, Planning, and Review (DAPR) Board.

Data Extraction from BIS

For Data Extraction from BIS, FRA seeks to capture and export curated data sets to enable special studies

Support on-demand dataset extraction requests, as required;

Develop and store (e.g. in DOT GitHub or other repository) necessary code (such as SQL queries) to support data extraction requests;

Document data extraction process including data extraction method, programming, and data sources for each request that documents rationale to support requests in DOT GitHub or other repository to enable reuse;

Advise and support FRA stakeholders on best practices and processes to extract data/information.