Structure-function-aware large protein language models for enhanced biomedical applications - large protein language models have shown their foundational role in biomedical research

Active Grant Awarded Last action

Award ID
R01LM014510
Recipient
Awarding agency
Obligated
$1,319,394

Award facts

Assistance listing
93.879 Medical Library Assistance
Completion date 61% complete
Place of performance
Lexington, KY 40506, USA

Award details come from USAspending.gov.

Description

However, two challenges are roadblocking their broad applications: (a) the absence of critical knowledge about protein structure and functions in the models, and (B) the lack of efficient approaches to adapt a trained protein language model. To address the two challenges, we propose to develop protein language models with knowledge of protein structures and functions, and adaptation methods that can provide accurate predictions for protein properties. The goal is to develop and validate the structure-function-aware large protein language models (SF-PLM) that could be adapted to operate challenging biomedical research tasks using few-shot learning. We hypothesize that (a) multi-view contrastive learning can fuse 2D/3D structural information into 1D representation, (B) well-developed reinforcement learning can align a large protein language model with the related function annotation, and (C) prompt tuning can realize a few-shot learning process to adapt the trained models to specific biomedical tasks. Inspired by the hypotheses, we develop three specific aims to help achieve the proposal's goal. Aim 1: develop large protein language models aware of 2D and 3D structures using multi-view contrastive learning. We will develop the encoders for the protein 1D, 2D, and 3D structures; optimize the model training procedure and contrastive loss functions, and validate and select the developed models using structure-oriented downstream tasks. Aim 2: develop a reinforcement learning- based method to align knowledge of protein functions with the structure-aware large protein language models. We will start by developing an initial policy model, further develop the reward model and proximal policy optimization to align the trained large protein language models and validate and select the aligned large protein language models. Aim 3: develop prompt technologies and tools to adapt structure-function-aware large protein language models for downstream tasks. We will develop prompt tuning to adapt the trained protein language models for antimicrobial peptide design and predict the targets and phosphorylation strengths for polo-like kinase 1 (PLK1), an overexpressed kinase in cancer cells. We will build utilities to enable the community usage of the prompt tuning. The success of the proposed research will lead to (a) the development of novel large protein language models aware of structures and functions, (B) prompt-based efficient adaptation of trained large protein language models for downstream tasks, (C) several novel antimicrobial peptides, (D) a list of predicted substrates and their phosphorylation strengths of PLK1, and (F) a library of python code that enables the development of the pre-trained protein language models and efficient prompt tuning. These outcomes will provide and validate fundamental deep learning tools for biomedical research. The outcome (C) and (D) will further enhance biomedical research in bacterial resistance and cancer treatment.

Transactions

Action Obligated Date
Amendment $0
Amendment $325,245
Amendment $325,245
Amendment $325,780
Original award $343,124

Subawards

Subrecipient Amount Awarded
University Of South Florida The goal of this proposal is to develop deep learning technologies to incorporate missing knowledge into protein language models (PLMs) to enhance their… $118,000
University Of Missouri System The goal of this proposal is to develop deep learning technologies to incorporate missing knowledge into protein language models (PLMs) to enhance their… $125,000
University Of Missouri System The goal of this proposal is to develop deep learning technologies to adapt missing knowledge into protein language models with the aim of enhancing their… $105,299

Quick answers

Who received award R01LM014510?

R01LM014510 was awarded to The University Of Kentucky Research Foundation by National Institute of Environmental Health Sciences (National Institutes of Health) on June 21, 2024.

How much is award R01LM014510 worth?

$1,319,394 has been obligated on R01LM014510.

On GovTribe

See this award's full record

  • Every transaction and subaward
  • The recipient's other awards and teaming partners
  • Similar grant awards
  • Ask GovTribe AI about this award