BioCOMPASS: Integrating Biomarkers into Transformer-Based Immunotherapy Response Prediction
Sayed Hashim, Frank Soboczenski & Paul Cairns · 2026
Read BioCOMPASS: Integrating Biomarkers into Transformer-Based Immunotherapy Response Prediction by Sayed Hashim, Frank Soboczenski & Paul Cairns (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-00739.txt.
Introduction
Hashim, Soboczenski, and Cairns extend the COMPASS transformer model into BioCOMPASS for predicting how patients respond to immunotherapy. Rather than feeding biomarkers in as inputs, they add loss terms that line those signals up with the model's middle layers. Treatment gating and a pathway consistency loss complete the design. Tested by holding out whole cohorts, cancer types, and treatments in turn, the added parts improved generalization to unseen patient groups.
Catalog record
| CREATOR | Sayed Hashim, Frank Soboczenski & Paul Cairns |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25567 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.00739
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
BioCOMPASS: Integrating Biomarkers into Transformer-Based Immunotherapy Response Prediction Sayed Hashim, Frank Soboczenski & Paul Cairns Abstract Datasets used in immunotherapy response prediction are typically small in size, as well as diverse in cancer type, drug administered, and sequencer used. Models often drop in performance when tested on patient cohorts that are not included in the training process. Recent work has shown that transformer-based models along with self-supervised learning show better generalisation performance than threshold-based biomarkers, but is still suboptimal. We present BioCOMPASS, an extension of a transformer-based model called COMPASS, that integrates biomarkers and treatment information to further improve its generalisability. Instead of feeding biomarker data as input, we built loss components to align them with the model’s intermediate representations. We found that components such as treatment gating and pathway consistency loss improved generalisability when evaluated with Leave-one-cohort-out, Leave-one-cancer-type-out and Leave-one-treatment-out strategies. Results show that building components that exploit biomarker and treatment information can help in generalisability of immunotherapy response prediction. Careful curation of additional components that leverage complementary clinical information and domain knowledge represents a promising direction for future research. 1 Introduction The immune system is responsible for the management of cancer and the identification of neoantigens produced by tumour cells that can trigger cellular immune responses ( 13 ) . However, tumour cells have devised ways to avoid immune surveillance ( 27 ) . To tackle this challenge, cancer immunotherapy emerged with the objective of reinstating the immune system’s capacity to identify and destroy cancer cells ( 21 ) . Although immunotherapy has improved the prognosis for patients, its success is limited to a select, unpredictable fraction of individuals diagnosed with cancer ( 6 ) . Thus, accurate characterisation of the tumour microenvironment (TME) in a patient with the ability to anticipate responses to immunotherapy is critical to enhance the efficiency of immunotherapy treatment strategies ( 21 ) . Existing methods for predicting the efficacy of immunotherapy are predominantly dependent on specific biomarkers, including the level of immune cell infiltration ( 33 ) , the expression levels of programmed death 1 (PD-1) and programmed death-ligand 1 (PD-L1) ( 10 ) , the expression of the cytotoxic T lymphocyte-associated protein 4 (CTLA-4) ( 20 ) , as well as tumour mutational burden (TMB) ( 29 ) . However, current clinical methodologies that rely on threshold-based approaches are often inadequate ( 21 ) . Many machine learning (ML)-based methods have been proposed to estimate biomarkers and treatment outcomes ( 21 ) . These models face challenges when tasked with new data that they were not previously trained on. When evaluated on new datasets, their performance tends to be mediocre or even inadequate, highlighting a gap in their ability to generalise ( 21 ) . A recent work called COMPASS ( 32 ) used self-supervised learning (SSL) with a transformer-based encoder and a biologically grounded concept bottleneck layer to improve performance across cancer types and treatments. COMPASS is pre-trained on gene expression data from 33 types of cancers using a triplet loss based SSL method. Pre-training improves its generalisability, while the concept bottleneck enables interpretability. COMPASS is fine-tuned on clinical cohorts to predict immunotherapy response. In COMPASS, patient embeddings produced from the encoder are passed onto a concept bottleneck layer to generate scores for 44 biological concepts such as genome integrity, cell proliferation and immune checkpoint for each tumour. These are then passed onto a classifier module to generate treatment response probabilities. The authors of COMPASS used Leave-one-cohort-out (LOCO) strategy to evaluate its generalisability. In this setting, all cohorts except one are used for training, and the left-out cohort is used for testing. Although the generalisability of COMPASS in this setting is better than methods that use single biomarkers, such as the expression of PD-1 or PDL-1, it is still suboptimal. For instance, the accuracy of COMPASS is about 65% across small cohorts (sample size less than 20) in LOCO setting as reported in their publication. Moreover, COMPASS does not make use of treatment information or external biomarkers. As treatment response could vary based on the treatment type, it is vital to feed this information into the model. COMPASS also does not have a way to validate its concepts with external biomarkers during training. We present BioCOMPASS, a modified version of COMPASS that integrates external biomarkers and treatment information using components including treatment gating, concept alignment, pathway consistency, and auxiliary multi-task learning into COMPASS. Our contributions are the following. 1. A treatment gating layer to feed information about the target of the treatment (eg. PD-1, CTLA-4, combination) into the model so that it produces treatment-aware concepts. 2. Alignment between known external biomarker scores and concept scores produced by the model to ensure that concept scores are validated against biomarker scores during training. 3. Pathway consistency loss to ensure that embeddings produced by the model contain pathway relevant information and are biologically grounded. In short, BioCOMPASS is an extension of COMPASS that exploits treatment information as well as external biomarker and pathway scores in order to make the model treatment-aware, biologically grounded, and thus more generalisable. This work also shows that rather than feeding clinical and biomarker data as input to the model, aligning the intermediate latent representations using them could be a good avenue to pursue in general medical applications, especially if such data is only available during training and not inference. 2 Methods 2.1 Data The authors of COMPASS finetuned the model on a total of 16 cohorts. However, COMPASS does not provide access to these datasets; rather, they list the original publications of the cohorts, and access to these datasets needs to be requested from the original publications. Due to difficulties in accessing them, we visited the CRI iAtlas portal ( 7 ) , which contains preprocessed gene expression data, biomarkers, and treatment information for 8 out of the 16 immunotherapy cohorts. We downloaded data for 8 of these cohorts from CRI iAtlas. Due to issues in accessing data of all cohorts in COMPASS, we reproduced results for COMPASS using the 8 cohorts we could obtain and used the pretrained model from COMPASS with its default hyperparameters to finetune. Information on the sample size of the cohorts, the drug used in them, and their publication is given in the Appendix A.1.1 . The gene expression data was already normalised to Transcripts Per Million (TPM) units. A binary responder label derived from the labels based on response evaluation criteria in solid tumours (RECIST) was used for classification. BioCOMPASS is finetuned to predict this binary label from gene expression data. 2.2 Model Architecture We added biomarker and clinical components on top of the COMPASS architecture to build BioCOMPASS, as shown in Figure 1 . The formulae for the components are in Appendix A.2 . The implementation is available at https://github.com/hashimsayed0/BioCOMPASS . Figure 1: BioCOMPASS architecture: Gene expression data is first fed into the COMPASS encoder to generate embeddings. Minimising the pathway consistency loss makes sure that the pathway scores predicted from embeddings are aligned with external pathway scores. The embeddings are then fed into the COMPASS concept bottleneck to generate 44 biological concepts. These are aligned with cell-type biomarker scores using the concept alignment objective. They are also used to predict