Promoting algorithmic equity in in-hospital mortality prediction

Active Project Grant Awarded Last action

Award ID
R01HL171311
Recipient
Awarding agency
Obligated
$2,969,352

Award facts

Assistance listing
93.837 Cardiovascular Diseases Research
Completion date 45% complete
Place of performance
Philadelphia, PA 19104, USA

Award details come from USAspending.gov.

Description

As the agency reported it.

Abstract
In-hospital mortality prediction models (MPMS) are widely used in clinical research and practice; but existing MPMS suffer from algorithmic bias, or systematic differences in performance by group. We and others showed that MPMS for hospitalized patients - the sequential organ failure assessment score (SOFA) and laboratory- based acute physiology score, version 2 (LAPS2) - overestimate mortality for black patients with acute respiratory failure (ARF) or sepsis, and underestimate mortality for white patients. Biased MPMS may thus produce healthcare inequities and flawed inferences about contributions of sociodemographics to clinical outcomes. Therefore, we seek to develop, validate, and demonstrate the impact of a novel MPM that optimizes fairness (i.e., defined by 'groupwise optimality,' optimizing subgroup performance without sacrificing predictive accuracy) across key subgroups defined by race, ethnicity, SEX, age, primary language, insurance status, and social vulnerability without sacrificing accuracy. We will address key causes of bias in model development: differential missing data and calibration biases. We will study hospitalized ARF and sepsis patients because they face high risks of biased predictions due to diagnostic uncertainty and high mortality risk, and these syndromes pose increased mortality risks for racial and ethnic minorities. In aim 1, we will develop a fairness- informed, in-hospital MPM. We will identify predictive features using those in common MPMS and structured data within 24 hours of presentation. We will assess missing data bias by comparing feature proportions by subgroup, excluding biased features, using a 2018-2023 cohort of ~220,000 encounters across 28 hospitals in the university of pennsylvania and kaiser permanente northern california health systems. We will select features using elastic net regression, and develop and internally validate a set of novel MPMS for use at admission, building logistic and elastic net regression, and machine learning models. We will implement model bias audits and mitigation strategies (i.e., multicalibration, optimizing calibration across subgroups without sacrificing predictive accuracy) to develop a set of optimized MPMS. We will evaluate performance overall and by subgroup, and compare performance to SOFA, LAPS2, and the epic deterioration index. In aim 2, we will conduct focus groups among key stakeholders to present blinded results of the novel MPMS, varying subgroup performance tradeoffs and decision thresholds, to select the model and thresholds that best promote equity and accuracy. In aim 3, we will test the external validity of this MPM among patients admitted to medstar health, a health system serving primarily racial and ethnic minority patients, using a different electronic health record. In aim 4, we will quantify the impact of the novel MPM on key use cases, by (1) RE-analyzing our team's pragmatic trials to assess the impact of risk adjustment on effect estimates overall and by subgroup; and (2) performing microsimulation informed by intensive care unit (ICU) demand in our health systems during peak covid surges to compare ICU bed allocation across subgroups, compared to SOFA and LAPS2.

Transactions

Action Obligated Date
Amendment Promoting algorithmic fairness in in-hospital mortality prediction - modified project summary/abstract section in-hospital mortality prediction models (MPMS)… $709,098
Amendment $732,488
Amendment $0
Amendment $0
Amendment $763,883
Original award $763,883

Subawards

Subrecipient Amount Awarded
Medstar Health Research Institute Inc. "The proposed study seeks to develop, validate, and demonstrate the impact of a novel in-hospital mortality prediction model (MPM) that optimizes fairness… $137,939
Kaiser Foundation Hospitals "The proposed study seeks to develop, validate, and demonstrate the impact of a novel in-hospital mortality prediction model (MPM) that optimizes fairness… $119,472
Medstar Health Research Institute Inc. "The proposed study seeks to develop, validate, and demonstrate the impact of a novel in-hospital mortality prediction model (MPM) that optimizes fairness… $38,006
Kaiser Foundation Hospitals "The proposed study seeks to develop, validate, and demonstrate the impact of a novel in-hospital mortality prediction model (MPM) that optimizes fairness… $202,987
Medstar Health Research Institute Inc. The proposed study seeks to develop, validate, and demonstrate the impact of a novel in-hospital mortality prediction model (MPM) that optimizes fairness (i.e.,… $25,380
Kaiser Foundation Hospitals The proposed study seeks to develop, validate, and demonstrate the impact of a novel in-hospital mortality prediction model (MPM) that optimizes fairness (i.e.,… $115,387
Kaiser Foundation Hospitals $38,462

Quick answers

Who received award R01HL171311?

R01HL171311 was awarded to The Trustees Of The University Of Pennsylvania by National Heart Lung and Blood Institute (National Institutes of Health) on September 9, 2024.

How much is award R01HL171311 worth?

$2,969,352 has been obligated on R01HL171311.

On GovTribe

See this award's full record

  • Every transaction and subaward
  • The recipient's other awards and teaming partners
  • Similar grant awards
  • Ask GovTribe AI about this award
Try for free Login