RH
Back to projects

Medical AI Research

Multimodal Survival Prediction in Multiple Myeloma

First-author doctoral research integrating bone-marrow single-cell morphology with clinical variables to predict overall survival in newly diagnosed multiple myeloma.

Medical AI Research
1.66M cells
Dataset
912
Patients
0.94
Classifier AUROC
0.76
Fused C-index

Evidence mode

Metrics snapshot

1.66M cells
Dataset
912
Patients
0.94
Classifier AUROC
0.76
Fused C-index
PyTorchViTMultiple-Instance LearningSurvival Analysis

Architecture

  1. 01Bone-marrow cell morphology images and clinical variables
  2. 02Self-supervised vision transformer embedding pipeline
  3. 03Plasma-cell / plasmablast classifier and malignancy index
  4. 04Multiple-instance-learning survival model over patient cell bags
  5. 05Late fusion with clinical Cox model for final risk prediction

Case study

Problem

Cancer prognosis depends on both microscopic morphology and patient-level clinical variables. The technical challenge is to convert millions of single-cell images into patient-level survival signals without losing clinically relevant heterogeneity.

Contribution

Designed an end-to-end multimodal pipeline that uses self-supervised cell embeddings, a malignancy index, multiple-instance survival modeling, and late fusion with clinical Cox models.

Engineering

Built Python/PyTorch feature pipelines with HDF5 storage, 384-dimensional image embeddings, patient-level bag construction, survival metrics, and interpretable risk stratification.

Outcome

Improved C-index from 0.73 for clinical-only modeling to 0.76 after image-clinical fusion; time-dependent AUROC reached up to 0.84 and high-vs-low risk stratification showed HR around 4.0 with p < 0.001.