2026

Performance, Generalizability, and Fairness of a Peripheral Artery Disease Detection Model Across Patient Phenotypes and Health Systems

Journal of the American Heart Association · Submitted 2026

Kallis K, Quitevis C, Malas MB, Ross EG

Background: Peripheral artery disease (PAD) is a major cause of cardiovascular events but remains underdiagnosed. Electronic health record (EHR)-based machine learning models show promise for earlier detection, but developing generalizable and fair models across diverse populations remains challenging.

Methods: Using the University of California Health Data Warehouse, containing EHR data from five health systems, we identified patients with and without PAD. We used unsupervised clustering to define PAD phenotypes and trained a LightGBM classifier using 14,023 features spanning demographics, comorbidities, medications, laboratory values, healthcare utilization, and diagnosis, procedure, and medication codes. We evaluated performance overall and across demographic groups and phenotypes, and assessed fairness using selection rates and subgroup differences in true- and false-positive rates.

Results: The study included 33,739 cases and 33,739 matched controls. Clustering identified four phenotypes: patients with limited healthcare documentation (cluster 1), younger patients with severe metabolic disease (cluster 2), patients with a traditional atherosclerotic risk profile (cluster 3), and frail elderly patients with multimorbidity (cluster 4). Overall, the model demonstrated consistent performance across institutions (AUROC 0.76–0.79; AUC-PR 0.76–0.79) with well-calibrated probabilities. Performance was similar across genders, with modest variation by race and age, and was stronger in clusters 2–4. Cluster 2 demonstrated the highest sensitivity (TPR 0.87, 95% CI 0.87–0.88), while cluster 1 showed the lowest performance (TPR 0.40, 95% CI 0.39–0.41).

Conclusions: The EHR-based PAD detection model demonstrated consistent performance across five health systems. Phenotypic clustering revealed clinically meaningful differences in model performance adding an additional consideration in ML fairness and performance evaluations.

Detection and Localization of Unfavorable-histology Prostate Cancer Using MRI and Whole-mount Histopathology

European Urology Oncology · 2026

Rojo Domingo M, Dornisch A, Conlin CC, Bagrodia A, Barrett T, Cooperberg M, Desloges JJ, Do DD, Do S, Hahn ME, Harisinghani M, Hollenberg G, Kallis K, Kane CJ, Kim J, Lee KL, Levine J, Liss MA, Liu J, Nakrour N, Osinski T, Pare C, Rakow-Penner R, Rupareliya R, Salmasi A, Simko J, Song Y, Sushentev N, Weinberg E, Woolen S, Dale AM, Shabaik AS, Seibert TM

Background and objective: We evaluated the utility of PI-RADS and the automated Restriction Spectrum Imaging restriction score (RSIrs) for detecting and localizing unfavorable-histology prostate cancer (uhPC), including high-grade and cribriform or intraductal disease.

Methods: Patient-level detection was evaluated in a multicenter biopsy cohort, while lesion-level localization was assessed against whole-mount histopathology after radical prostatectomy. PI-RADS and RSIrs were compared for uhPC detection and index-tumor localization.

Results: In 1022 patients from five centers, PI-RADS and RSIrs showed comparable patient-level discrimination. In 103 patients with whole-mount histopathology, combined PI-RADS and RSIrs achieved 93% sensitivity for the index tumor and 90% sensitivity for all uhPC tumors.

Conclusions and clinical implications: MRI showed high sensitivity for detecting uhPC. PI-RADS and automated RSIrs may support targeted biopsy and tumor-focused treatment, including focal radiation dose escalation.

UCSD Radiology 🔗 DOI View project

D2T2: Multimodal Automated Planning for Brachytherapy

CVPR 2026 · 2026

Moore LC, Mitra A, Truong R, Kallis K, Kisling K, Meyers SM, Vasconcelos N

Brachytherapy is a complex radiation oncology problem that requires the simultaneous prediction of radiation dose and a set of machine parameters known as dwell times, used for treatment delivery. We propose Direct Dwell Time Transformer (D2T2), the first deep learning architecture that directly predicts dwell times during dose prediction. D2T2 is a two-stage model: the first stage predicts a vector of dwell times and the second implements the physical model of radiation delivery as a linear combination of dose kernels. This constrains the model to make physically plausible dose predictions when trained end-to-end. We also propose a new loss function — the gamma loss — based on prediction of the gamma index, the gold standard for dose comparisons. D2T2 is trained on a large dataset of ~5,000 clinical brachytherapy plans spanning gynecological, breast, and other treatment sites. Results demonstrate that D2T2 outperforms existing methods in both accuracy and speed, producing deliverable plans and physically valid dose distributions in a single forward pass — hours faster than manual planning and minutes faster than recent automated methods.

Rapid Artificial Intelligence Autoplanning Rivals Manual Expert Planning for Cervical Brachytherapy

Practical Radiation Oncology  ·  2026

Mitra A, Moore LC, Kallis K, Rash DL, Einck JP, Nwachukwu C, Yashar CM, Mayadev JS, Ayala-Peacock DN, Balogun OD, Chino JP, Contreras JA, Zoberi I, Kisling K, Zou J, Vasconcelos N, Meyers SM

Purpose: The study aims to evaluate the quality and clinical acceptability of artificial intelligence automated plans compared with manual clinical plans through blinded physician review, for cervical brachytherapy applicators.

Methods and Materials: Automated plans were generated using dose predictions from a U-Net with anatomic masks, dwell position location masks, and applicator-specific 3-dimensional dose inputs. Model data included 2005 brachytherapy plans from 7 implant types (train/validation/test split 62%/19%/19%). Test set dose predictions were fed into an optimizer to produce automated plans. Randomized automated and clinical plan pairs were presented to 10 expert gynecologic brachytherapy physicians, who indicated plan preference, scored plans from 1 to 5, and guessed which plan was automated. Autoplan scores were compared between physician groups and with clinical plans using Wilcoxon signed-rank tests (P < .05 considered significant).

Results: Autoplans were deemed better or equivalent in approximately 50% of cases for both physician groups, with the highest preference rates for hybrid implants (>58% on average). Automated and clinical plans scored 4 (acceptable plan with clinically unimportant stylistic differences) on average (P > .05 for all comparisons). Slightly reduced preference rates and scores for external physicians were attributed to stylistic planning differences not captured in model training data. Physicians correctly identified about 50% of autoplans, consistent with random chance, indicating indistinguishability from clinical plans.

Conclusions: Our brachytherapy AI automated planning technology produced automated plans comparable in quality and indistinguishable from manual, clinical plans in a median of 1.4 minutes.

Systematic Effects of Patient Factors and Scanner/Protocol Factors on a Restriction Spectrum Imaging Quantitative MRI Biomarker for Prostate Cancer

Cancer Imaging  ·  2026

Do DD, Rojo Domingo M, Conlin CC, Matthews I, Kallis K, Baxter M, Ollison C, Song Y, Xu G, Zhong AY, Bagrodia A, Barrett T, Cooperberg M, Feng F, Hahn ME, Harisinghani M, Hollenberg GM, Javier-Desloges J, Kamran SC, Kane CJ, Kessler D, Kuperman J, Lee KL, Levine J, Liss MA, Margolis DJA, Murphy PM, Nakrour N, Ohliger MA, Osinski T, Pamatmat AJ, Pompa IR, Rakow-Penner R, Roberts JL, Santhosh K, Shabaik AS, Song D, Tempany CM, Trecarten S, Wehrli N, Weinberg EP, Woolen S, Dale AM, Seibert TM

While multiparametric MRI has revolutionized clinically significant prostate cancer (csPCa) detection, conventional apparent diffusion coefficient (ADC) maps suffer from a monoexponential model that conflates the various forms of diffusion in the tissue, leading to poor microstructural specificity and substantial inter-scanner variability. Restriction Spectrum Imaging (RSI) addresses these limitations with a multi-compartment biophysical model that separates the diffusion signal into four compartments, providing a more specific quantitative imaging biomarker, the RSI restriction score (RSIrs). Although RSIrs has demonstrated promising detection performance for csPCa, patient- and acquisition-related factors may influence its measured values and performance. Our retrospective analysis included 1,890 men (median age 70) from seven centers between 2018 and 2024. We assessed how age, race, ethnicity, prostate volume, medication use, and MRI acquisition parameters influenced prostate maximum RSIrs values using linear modeling. Results revealed modest effects from age (1.8/year increase), prostate volume (−0.83/mL decrease), and acquisition methods (varying between −63.14 to +56.23). While these variations partially overlapped with change in RSIrs due to Grade Group 2 csPCa, they were secondary to the primary signal variation due to csPCa. Adjusting for them did not improve csPCa detection performance (p > 0.05). AUC of RSIrs for patient-level csPCa detection was 0.77 [95% CI: 0.75–0.79]. RSIrs demonstrates robust csPCa detection performance regardless of modest signal variations from patient and acquisition factors, supporting its potential as a generalizable quantitative imaging biomarker for csPCa.

UCSD Radiology 🔗 DOI View project
2025

Peripheral Artery Disease in US Primary Care Practices: A Retrospective EHR-Based Analysis from 2018 to 2022

Journal of General Internal Medicine · 2025

Nriagu VC, Hao S, Kamdar NS, Fukaya E, Wang X, Kallis K, Rehkopf DH, Ross EG

Background: Peripheral artery disease (PAD) affects >10 million adults over age 40, causing high morbidity, mortality, and healthcare costs in the USA. Primary care settings are critical for early detection of PAD, and understanding the landscape of PAD diagnosis patterns can help identify high-risk populations and inform screening strategies to address disparities.

Objective: To characterize the epidemiological patterns of PAD diagnosis and examine the clinical and socioeconomic characteristics of patients diagnosed with PAD in US primary care settings.

Design: Retrospective cohort study utilizing EHR data from the American Family Cohort (AFC) from 2018 to 2022, comprising data from over 2,000 primary care practices across all 50 states.

Results: A total of 18,405 patients had a new diagnosis of PAD among 2,313,650 eligible patients. PAD patients were more likely to be male (49% vs. 43%), older (64% aged 60–79), current smokers (17% vs. 11%), from racial/ethnic minority groups, and residing in areas with higher social deprivation. Non-Hispanic Black and Hispanic individuals had higher odds of PAD diagnosis compared to non-Hispanic Whites across all comorbidity groups. Unlike CAD and hyperlipidemia with decreased incidence, PAD incidence increased notably in 2021.

Conclusions: PAD diagnosis patterns across racial, ethnic, and neighborhood socioeconomic groups reveal significant differences in burden of disease. Optimized screening in the primary care setting targeting these high-risk groups is important to improve early detection and reduce PAD-related disparities.

UCSD Surgery 🔗 DOI

Integration of Single-Click, AI-Based Brachytherapy Auto-Planning for Cervical Cancer Within a Treatment Planning System

Brachytherapy  ·  2025

Truong R, Moore LC, Mitra A, Kallis K, Kisling K, Vasconcelos N, Meyers SM

Purpose: Previous work developed an automated cervical brachytherapy treatment planning pipeline consisting of a U-Net dose prediction model and dwell time optimizer. While this method can produce clinically acceptable plans, it relies on time-consuming, manual export and import of DICOM data. This study proposes to increase efficiency by combining scripts into an all-in-one tool that can be used directly within the BrachyVision treatment planning system, producing automated plans in a single click.

Materials and Methods: We developed an AI-based planning tool through four main tasks: data retrieval, model inference, dwell time optimization, and auto-plan import. A C# plug-in interacts with the currently open patient in BrachyVision, and a Python executable performs model inference and optimization before copying optimized dwell times back into the open plan. The script was tested on 28 brachytherapy plans spanning 7 applicator types, and auto-plans were compared to clinical plans using mean absolute error (MAE) in voxel-based 3D dose and dwell times.

Results: The average MAE in 3D dose and dwell times were 3.8 ± 0.7% (normalized to prescribed dose) and 10.3 ± 7.4 s (2.1 ± 0.9% of total plan dwell time), respectively. The average runtime was 3.5 ± 1.2 minutes.

Conclusions: We developed a script that enables efficient, streamlined auto-planning directly within BrachyVision. After contouring and digitization, the script produces high-quality, customized plans with a single button-click in a few minutes.

Restriction Spectrum Imaging as a Quantitative Biomarker for Prostate Cancer With Reliable Positive Predictive Value

The Journal of Urology  ·  2025

Rojo Domingo M, Do DD, Conlin CC, Bagrodia A, Barrett T, Baxter MT, Cooperberg M, Feng F, Hahn ME, Harisinghani M, Hollenberg G, Javier-Desloges J, Kallis K, Kamran S, Kane CJ, Kessler D, Kuperman J, Lee KL, Levine J, Liss MA, Margolis DJA, Matthews I, Murphy PM, Nakrour N, Ohliger M, Ollison C, Osinski T, Pamatmat AJ, Pompa IR, Rakow-Penner R, Roberts JL, Shabaik AS, Song Y, Song D, Tempany CM, Trecarten S, Wehrli N, Weinberg EP, Woolen S, Xu G, Zhong AY, Dale AM, Seibert TM

Purpose: Positive predictive value of PI-RADS for clinically significant prostate cancer (csPCa, grade group ≥2) varies widely between radiologists. The RSI restriction score (RSIrs) is a biophysics-based metric derived from diffusion MRI that could be an objectively interpretable biomarker for csPCa. We aimed to evaluate performance of RSIrs for patient-level detection of csPCa in a large and heterogeneous dataset, and to combine RSIrs with clinical and imaging parameters for csPCa detection.

Materials and Methods: At 7 centers, participants underwent prostate MRI between January 2016 and March 2024. We calculated patient-level csPCa probability based on maximum RSIrs in the prostate and compared patient-level csPCa detection to ADC and PI-RADS using AUC. We also evaluated csPCa discrimination by grade group and combined RSIrs with clinical risk factors through multivariable regression.

Results and Conclusions: Among 1,892 patients, probability of csPCa increased with higher RSIrs. In biopsy-naïve patients (n=877), AUCs for GG≥2 vs non-csPCa were: RSIrs 0.73 (0.69–0.76), ADC 0.54 (0.50–0.57), and PI-RADS 0.75 (0.71–0.78). RSIrs significantly outperformed ADC (P < .01) and was comparable with PI-RADS (P = .31). RSIrs and PI-RADS combined outperformed either alone. RSIrs is an accurate and reliable quantitative biomarker that performs better than conventional ADC and comparably with expert-defined PI-RADS for patient-level detection of csPCa, providing objective estimates that do not require radiology expertise.

UCSD Radiology 🔗 DOI View project
2024

Utility of Quantitative T2 Measurement Using Restriction Spectrum Imaging for Detection of Clinically Significant Prostate Cancer

Scientific Reports  ·  2024

Rojo Domingo M, Conlin CC, Karunamuni R, Ollison C, Baxter MT, Kallis K, Do DD, Song Y, Kuperman J, Shabaik AS, Hahn ME, Murphy PM, Rakow-Penner R, Dale AM, Seibert TM

The RSI restriction score (RSIrs) has been shown to improve accuracy for diagnosis of clinically significant prostate cancer (csPCa) compared to standard DWI. Both diffusion and T2 properties of prostate tissue contribute to the DWI signal, and each may be valuable for distinguishing csPCa from benign tissue. This retrospective study evaluated whether csPCa detection with RSIrs is improved by acquiring scans at different echo times to measure compartmental T2 (cT2). Data includes two cohorts scanned for csPCa with 3T multi-b-value diffusion-weighted sequences at multiple TEs. In both cohorts, T2 differed significantly (p < 0.05) across the four RSI compartments. At the voxel level, T2 differed in csPCa for C1, C2, C3 (p < 0.001). At the patient level, RSIrs and a logistic regression model incorporating cT2 both outperformed diffusion alone (p < 0.001), but the difference between RSIrs and the combined model was not significant (p = 0.54). Significant differences in cT2 were observed between normal and cancerous prostatic tissue; however, incorporating cT2 alongside diffusion did not significantly improve csPCa detection performance.

UCSD Radiology 🔗 DOI View project

Clinical Impact of Contouring Variability for Prostate Cancer Tumor Boost

International Journal of Radiation Oncology, Biology, Physics  ·  2024

Zhong AY, Lui AJ, Kuznetsova S, Kallis K, Conlin CC, Do DD, Rojo Domingo M, Manger R, Hua P, Karunamuni R, Kuperman J, Dale AM, Rakow-Penner R, Hahn ME, van der Heide UA, Ray X, Seibert TM

Purpose: The focal RT boost technique was shown in a phase III RCT to improve prostate cancer outcomes without increasing toxicity. This technique relies on accurate delineation of prostate tumors on MRI. A recent prospective study demonstrated high variability in tumor contours among radiation oncologists. We sought to evaluate the impact of contour variability and inaccuracy on predicted clinical outcomes.

Methods and Materials: 45 radiation oncologists and 2 expert radiologists contoured prostate tumors on 30 patient cases. A knowledge-based planning model generated focal RT boost plans for each contour per the RCT protocol. The probability of biochemical failure (BF) was determined using a model from the RCT. The primary metric was delta BF (DBF = Participant BF − Expert BF); an absolute increase in BF ≥5% was considered clinically meaningful.

Results: Eight patient cases and 394 target volumes were included. Participant plans were associated with worse predicted clinical outcomes compared to expert plans, with an average absolute increase in BF of 4.3%. Of participant plans, 37% had an absolute increase in BF of 5% or more.

Conclusions: Radiation oncologists' attempts to contour tumor targets for focal RT boost are frequently inaccurate enough to yield meaningfully inferior clinical outcomes for patients.

UCSD Radiology RMAS 🔗 DOI View project
★ First author

Quantitative MRI Biomarker for Classification of Clinically Significant Prostate Cancer: Calibration for Reproducibility Across Echo Times

Journal of Applied Clinical Medical Physics  ·  2024

Kallis K, Conlin CC, Ollison C, Hahn ME, Rakow-Penner R, Dale AM, Seibert TM

Purpose: To develop a calibration method to account for differences in echo times (TE) and facilitate the use of the RSI restriction score (RSIrs) as a quantitative biomarker for detection of clinically significant prostate cancer (csPCa).

Methods: 197 consecutive patients underwent MRI and biopsy; 97 were diagnosed with csPCa (grade group ≥2). RSI data were acquired three times during the same session at two echo times (~75 ms and 90 ms). A linear regression model was fit to match C-maps of TE90 to reference C-maps of TEmin. RSIrs comparisons were made at the 98th percentile within each patient's prostate.

Results: Scaling factors for C1, C2, C3, and C4 were 1.68, 1.33, 1.02, and 1.13. In non-csPCa cases, calibration reduced the absolute error between TE90 and TEmin by 72%. In csPCa cases, calibration reduced the mean difference by 55%. At the Youden index for patient-level classification (8.94 SI), RSIrs achieved a sensitivity of 66% and specificity of 72%.

Conclusions: The proposed linear calibration method produces similar quantitative biomarker values for acquisitions with different TE, reducing TE-induced error by 72% and 55% for non-csPCa and csPCa respectively, enabling more reproducible multi-site deployment of RSIrs.

UCSD Radiology 🔗 DOI View project
★ First author

Comparison of Synthesized and Acquired High b-Value Diffusion-Weighted MRI for Detection of Prostate Cancer

Cancer Imaging  ·  2024

Kallis K, Conlin CC, Zhong AY, Hussain TS, Chatterjee A, Karczmar GS, Rakow-Penner R, Dale AM, Seibert TM

Background: High b-value diffusion-weighted images (DWI) are used for detection of clinically significant prostate cancer (csPCa). This study qualitatively and quantitatively compares synthesized DWI (sDWI) to acquired DWI (aDWI) for csPCa detection.

Methods: 151 consecutive patients who underwent prostate MRI and biopsy were included. DWI with b = 0, 500, 1000, and 2000 s/mm² was acquired on a 3T scanner. sDWI for b = 2000 s/mm² was synthesized via monoexponential extrapolation from b = 0 and 500 s/mm² (sDWI500) and from b = 0, 500, and 1000 s/mm² (sDWI1000). Signal differences and csPCa classification accuracy were compared across methods, including RSIrs as reference.

Results: Within the prostate, mean percent differences between sDWI and aDWI were −46 ± 35% for sDWI500 and −67 ± 24% for sDWI1000. AUCs for aDWI, sDWI500, sDWI1000, and RSIrs within the prostate were 0.62, 0.63, 0.65, and 0.78, respectively.

Conclusions: sDWI is qualitatively comparable to aDWI within the prostate, but hyperintense artifacts in surrounding pelvic tissue interfere with quantitative cancer detection and may mask metastases. RSIrs yields superior quantitative csPCa detection compared to both sDWI and aDWI.

UCSD Radiology 🔗 DOI View project

Rapid Auto-Planning for Cervical Brachytherapy: Direct Dwell Time vs. Dose Prediction with Deep Learning Networks

ICCR 2024 — International Conference on the Use of Computers in Radiation Therapy · 2024

Moore LC, Kallis K, Kisling K, Vasconcelos N, Meyers SM

Treatment planning for cervical brachytherapy is often performed manually and can take over an hour. This work assessed a new approach to automated planning: using a neural network to directly predict dwell times (VGG model), compared to a method that predicts 3D dose followed by an optimizer (OPT model). Models were developed using 1,803 prior cervical brachytherapy treatment plans across 7 implant types. The VGG model used a 16-layer 3D VGG regression network; the OPT model used a Cascade U-Net. Both models produced plans very similar to clinical plans: MAE in dose was 3.4% (OPT) and 4.7% (VGG); MAE in dwell times was 7.3 s (OPT) and 8.0 s (VGG). While the OPT model showed slightly superior accuracy, direct dwell time prediction with the VGG model reduced computation time. Both methods demonstrate high clinical value for automated brachytherapy planning.

Neural Network Dose Prediction for Cervical Brachytherapy: Overcoming Data Scarcity for Applicator-Specific Models

Medical Physics  ·  2024

Moore LC, Ahern F, Li L, Kallis K, Kisling K, Cortes KG, Nwachukwu C, Rash D, Yashar CM, Mayadev J, Zou J, Vasconcelos N, Meyers SM

Background: 3D neural network dose predictions are useful for automating brachytherapy treatment planning for cervical cancer. Cervical brachytherapy can be delivered with numerous applicators, necessitating models that generalize across applicator types. The variability and scarcity of data for any given applicator poses challenges for deep learning.

Purpose: To compare three neural network training strategies — a single combined model, fine-tuned applicator-specific models, and individual (IDV) applicator models — for dose prediction across four applicator types.

Methods: Models were produced for tandem-and-ovoid (T&O), T&O with needles (T&ON), tandem-and-ring (T&R), and T&R with needles (T&RN). The combined model was trained on 859 treatment plans from 266 patients. Inputs included anatomical masks, dwell position locations, and 3D applicator dose channels. A 3D Cascade U-Net was used with mean squared error loss.

Results: Fine-tuned and combined models outperformed IDV applicator training. Fine-tuning yielded modest improvements in ~half of metrics. Gamma pass rates (3%/3mm) were 86%/91%/83%/89% for T&O/T&R/T&ON/T&RN.

Conclusions: 3D brachytherapy dose was accurately predicted for all applicator types. Training on all treatment data overcomes data scarcity challenges and achieves superior performance over individual applicator training, enabling automated knowledge-based planning for any cervical brachytherapy treatment.

2023

ReIGNITE Radiation Therapy Boost: A Prospective, International Study of Radiation Oncologists' Accuracy in Delineating Intraprostatic Tumor Using RSI MRI

International Journal of Radiation Oncology, Biology, Physics  ·  2023

Lui AJ, Kallis K, Zhong AY, Hussain TS, Conlin C, Digma LA, Phan N, Mathews IT, Do DD, Rojo Domingo M, Karunamuni R, Kuperman J, Dale AM, Shabaik A, Rakow-Penner R, Hahn ME, Seibert TM

Purpose: In a phase III randomized trial, adding a radiation boost to tumor(s) visible on MRI improved prostate cancer disease-free and metastasis-free survival without additional toxicity. We hypothesized that (1) radiation oncologists would find accurately delineating PCa tumors on conventional MRI challenging, and (2) using RSIrs maps would improve their accuracy.

Methods and Materials: In this multi-institutional, international, prospective study, 44 radiation oncologists and 2 expert radiologists contoured prostate tumors on 39 patient cases using conventional MRI with or without RSIrs maps. Participant volumes were compared to consensus expert volumes using percent overlap, Dice coefficient, conformal number, and maximum distance beyond expert volume.

Results: 1,604 participant volumes were produced. 40 of 44 participants (91%) completely missed ≥1 expert-defined target lesion without RSIrs, compared to 13 of 44 (30%) with RSIrs maps. On conventional MRI alone, 134 of 762 contour attempts (18%) completely missed the target, vs. 18 of 842 (2%) with RSIrs maps. RSIrs maps improved all contour accuracy metrics by approximately 50% or more. System Usability Scores confirmed RSIrs maps significantly improved the contouring experience (72 vs. 58, p < 0.001).

Conclusions: Radiation oncologists struggle with accurately delineating visible PCa tumors on conventional MRI. RSIrs maps improve radiation oncologists' ability to target MRI-visible tumors for prostate tumor boost.

UCSD Radiology RMAS 🔗 DOI View project

Estimating Follow-up CTs from Geometric Deformations of Catheter Implants in Interstitial Breast Brachytherapy

Medical Physics  ·  2023

Dürrbeck C, Schulz M, Pflaum L, Kallis K, Geimer T, Abu-Hossin N, Strnad V, Maier A, Fietkau R, Bert C

Background: Electromagnetic tracking (EMT) systems provide valuable information on the geometry of catheter implants in interstitial breast brachytherapy (iBT). To detect dosimetric shortcomings, the relative positions between catheters and target volume must be known. Since EMT cannot provide anatomical context and cone-beam CT is not routinely available in brachytherapy suites, anatomic changes cannot be detected on a daily or fraction basis.

Purpose: To develop and evaluate a technique capable of estimating follow-up CTs at any time based on the initial treatment planning CT and surrogate information about changes of the implant geometry from an EMT system.

Methods: A deformation vector field is calculated from two EMT-based implant reconstructions acquired in treatment position. Discrete displacement vectors of control and target points are extrapolated using radial basis functions to cover the entire CT volume. The planning CT is warped according to the deformation field to produce an estimated CT (ECT).

Results: ECTs and clinical follow-up CTs of 20 patients were compared quantitatively in terms of absolute Hounsfield unit differences. Median differences were 31.2 and 29.5 HU for the convex hull enclosing the catheters and the planning target volume, respectively.

Conclusion: The proposed ECT approach approximates the "anatomy of the day" and allows a dosimetric appraisal of treatment plan quality before each fraction, contributing to patient-specific quality assurance in iBT of the breast and helping identify the timing for potential treatment adaptation.

★ First author

Automated Treatment Planning Framework for Brachytherapy of Cervical Cancer Using 3D Dose Predictions

Physics in Medicine and Biology  ·  2023

Kallis K, Moore LC, Cortes KG, Brown D, Mayadev J, Moore KL, Meyers SM

Objective: To lay the foundation for automated knowledge-based brachytherapy treatment planning using 3D dose estimations by describing an optimization framework to convert brachytherapy dose distributions directly into dwell times (DTs).

Approach: A dose rate kernel was produced by exporting 3D dose for one dwell position and normalizing by DT. A Python-coded COBYLA optimizer iteratively determines the DTs minimizing mean squared error between calculated and reference dose. As validation, the optimizer replicated clinical plans in 40 patients treated with tandem-and-ovoid or tandem-and-ring applicators. Automated planning was then demonstrated in 10 T&O patients using dose predicted from a CNN developed in prior work.

Main Results: Validation plans agreed well with clinical plans (MAD_dose = 1.1%, MAD_DT = 4 s, DSC = 0.99). For automated plans, MAD_dose = 6.5% and MAD_DT = 10.3 s (2.1%). The overall shape of automated dose distributions was similar to clinical doses (DSC = 0.91).

Significance: Automated planning with 3D dose predictions could provide significant time savings and standardize treatment planning across practitioners regardless of experience.

2022

Knowledge-Based Three-Dimensional Dose Prediction for Tandem-and-Ovoid Brachytherapy

Brachytherapy  ·  2022

Cortes KG, Kallis K, Simon A, Mayadev J, Meyers SM, Moore KL

Purpose: To develop a knowledge-based dose prediction system using a convolution neural network (CNN) for cervical brachytherapy treatments with a tandem-and-ovoid applicator.

Methods: A 3D U-NET CNN was trained on 395 previously treated cases (training/validation/test: 273/61/61) to make voxel-wise dose predictions based on OAR, HRCTV, and possible source location geometry. Model performance was assessed with voxel-wise dose differences and DVH metric accuracy (HRCTV D90%; bladder, rectum, sigmoid D2cc).

Results: Isodose dice similarity coefficients ranged from 0.96/0.91 (training) and 0.94/0.87 (test). DVH metric prediction errors were small: HRCTV D90 -0.09 ± 0.67 Gy, bladder D2cc -0.17 ± 0.67 Gy, rectum D2cc -0.04 ± 0.46 Gy, sigmoid D2cc 0.00 ± 0.44 Gy in the test set.

Conclusions: 3D knowledge-based dose predictions provide voxel-level and DVH metric estimates that could be used for treatment plan quality control and data-driven plan guidance.

2021
★ First author

Evaluation of Dose Differences Between Intracavitary Applicators for Cervical Brachytherapy Using Knowledge-Based Dose Predictions

Brachytherapy  ·  2021

Kallis K, Mayadev J, Covele B, Brown D, Scanderbeg D, Simon A, Frisbie-Firsching H, Yashar CM, Einck JP, Mell LK, Moore KL, Meyers SM

Purpose: To evaluate the accuracy of organ-at-risk (OAR) dose predictions using knowledge-based intracavitary models, and to determine dosimetric differences between tandem-and-ring (T&R) and tandem-and-ovoid (T&O) applicators.

Materials and Methods: Knowledge-based models predicting organ D2cc were trained on 77/75 cases and validated on 32/38 for T&R/T&O applicators. Model-predicted applicator dose differences were determined by applying T&O models to T&R cases and vice versa.

Results: Validation T&O/T&R model precision was 0.65/0.55 Gy, 0.55/0.38 Gy, and 0.43/0.60 Gy for bladder, rectum, and sigmoid. When applying cross-applicator models, bladder, rectum, and sigmoid D2cc EQD2 values were on average 5.69/2.62 Gy, 7.31/6.15 Gy, and 3.65/0.69 Gy lower for T&R. Clinical data showed lower T&R OAR doses, with mean EQD2 D2cc deviations of 0.61 Gy, 7.96 Gy (p < 0.01), and 5.86 Gy (p < 0.01) for bladder, rectum, and sigmoid.

Conclusions: Accurate knowledge-based dose prediction models were developed for two common intracavitary applicators. Both models and clinical data suggest significant OAR sparing with T&R over T&O applicators, particularly for the rectum.

★ First author

Knowledge-Based Dose Prediction Models to Inform Gynecologic Brachytherapy Needle Supplementation for Locally Advanced Cervical Cancers

Brachytherapy  ·  2021

Kallis K, Mayadev J, Kisling K, Brown D, Scanderbeg D, Ray X, Cortes K, Simon A, Yashar CM, Einck JP, Mell LK, Moore KL, Meyers SM

Purpose: To determine whether dose prediction models can guide needle supplementation decision-making for cervical cancer brachytherapy.

Materials and Methods: Intracavitary knowledge-based models for OAR dose estimation were trained and validated for T&R/T&O implants. Models were applied to hybrid cases with 1–3 needles to predict OAR dose without needles. 70/67 hybrid T&R/T&O cases were replanned without needles; cases where dose exceeded objectives were classified as requiring needles. ROC curves assessed classification accuracy.

Results: Needle supplementation reduced OAR dose, but 67%/39% of T&R/T&O replans met all dose constraints without needles. ROC AUC was 0.89/0.86 for T&R/T&O. The optimal classification threshold (99%/101% of dose limit) yielded sensitivity/specificity of 78%/86% and 85%/78%.

Conclusions: Needle supplementation was not always required to meet standard dose objectives. Our knowledge-based model accurately identified cases that could have met constraints without needles, suggesting utility for data-driven applicator selection and reducing operator dependence.

ORBIT-RT: A Real-Time, Open Platform for Knowledge-Based Quality Control of Radiotherapy Treatment Plans

JCO Clinical Cancer Informatics  ·  2021

Covele BM, Puri KS, Kallis K, Murphy JD, Moore KL

Purpose: To provide clinicians worldwide with uninhibited access to knowledge-based radiotherapy plan quality control, independent of treatment planning system (TPS).

Methods: ORBIT-RT was designed to satisfy four criteria: web-based access, TPS independence, HIPAA compliance, and autonomous operation. The platform uses a cloud-based server to anonymize DICOM-RT files and autonomously generate knowledge-based DVH estimations. Performance was evaluated on 45 VMAT prostate plans using DVH estimation accuracy and processing time.

Results: ORBIT-RT organ DVH predictions showed <1% bias and 3% error uncertainty at doses >80% of prescription. Processing required 3.0 seconds per organ; total workflow from DICOM upload to DVH display took 2.5–3 minutes.

Conclusion: ORBIT-RT provides fast, fully autonomous knowledge-based feedback on a web-based platform, using only anonymized DICOM-RT as input, enabling real-time objective quality control feedback for clinics of any size worldwide.

2020

A Knowledge-Based Organ Dose Prediction Tool for Brachytherapy Treatment Planning of Patients with Cervical Cancer

Brachytherapy  ·  2020

Yusufaly TI, Kallis K, Simon A, Mayadev J, Yashar CM, Einck JP, Mell LK, Brown D, Scanderbeg D, Hild SJ, Covele B, Moore KL, Meyers SM

Purpose: To explore knowledge-based organ-at-risk dose estimation for intracavitary brachytherapy planning for cervical cancer using established external-beam DVH estimation methods.

Methods: 136 patients treated with 456 CT-based tandem-and-ovoid brachytherapy fractions (356:100 training:validation) were analyzed. DVH estimations were obtained by subdividing OARs into HRCTV boundary distance subvolumes and computing cohort-averaged differential DVHs.

Results: Training set deviations: bladder ΔD2cc = −0.04 ± 0.61 Gy, rectum = 0.02 ± 0.57 Gy, sigmoid = −0.05 ± 0.52 Gy. Validation predictions did not statistically differ: bladder ΔD2cc = −0.02 ± 0.46 Gy (p = 0.80), rectum = −0.007 ± 0.47 Gy (p = 0.53), sigmoid = −0.07 ± 0.47 Gy (p = 0.70).

Conclusion: A simple boundary distance-driven knowledge-based DVH estimation showed promising results for predicting critical brachytherapy dose metrics, providing a foundation for quality control and automated brachytherapy planning.

Adaptive Radiotherapy and the Dosimetric Impact of Inter- and Intrafractional Motion on the Planning Target Volume for Prostate Cancer Patients

Strahlentherapie und Onkologie  ·  2020

Böckelmann F, Putz F, Kallis K, Lettmaier S, Fietkau R, Bert C

This study investigated the dosimetric influence of daily interfractional setup errors and intrafractional target motion on the planning target volume (PTV) and the feasibility of offline adaptive radiotherapy (ART) for prostate cancer. Using daily CBCT imaging of 31 consecutive patients, systematic and random components of inter- and intrafractional errors were quantified. Results showed that interfractional systematic uncertainties exceeded intrafractional ones (1.12, 2.28, 1.48 mm vs. 0.44, 0.69, 0.80 mm in LR/SI/AP). Calculated margins were 4–5 mm (LR), 8–9 mm (SI), 6–7 mm (AP). Adapted plans showed smaller residual variations. Offline ART is feasible and becomes necessary with further PTV margin reductions.

UKER 🔗 DOI
2019
★ First author

Is Adaptive Treatment Planning in Multi-Catheter Interstitial Breast Brachytherapy Necessary?

Radiotherapy and Oncology  ·  2019

Kallis K, Ziegler M, Lotter M, Kreppner S, Strnad V, Fietkau R, Bert C

Purpose: To assess the need for adaptive treatment planning in 55 patients treated with interstitial multi-catheter breast brachytherapy.

Methods: A treatment planning CT and a follow-up CT were acquired per patient. Keeping dwell times and positions constant, the plan at implantation was compared to the situation 48 h later. Catheter deviations (DDP, discrete Fréchet distance) and dosimetric changes (ΔCI, ΔCOIN, ΔDNR) were assessed for both rigid and deformably registered PTVs.

Results: Mean DDP = 2.41 ± 1.73 mm, ΔCI = 3.10 ± 3.17%, ΔCOIN = 0.009 ± 0.007, ΔDNR = 0.036 ± 0.040 for rigidly aligned CTs. With deformed PTV, ΔCI = 5.05 ± 4.14%. In 4% of cases, re-planning would have been beneficial.

Conclusion: Adaptive re-planning is not routinely necessary but is warranted for cases with large PTV changes or large dwell position deviations.

★ First author

Estimation of Inter-Fractional Variations in Interstitial Multi-Catheter Breast Brachytherapy Using a Hybrid Treatment Delivery System

Radiotherapy and Oncology  ·  2019

Kallis K, Abu-Hossin N, Kreppner S, Lotter M, Strnad V, Fietkau R, Bert C

Purpose: To assess inter-fractional variations in interstitial multi-catheter breast brachytherapy using an electromagnetic tracking (EMT) system integrated into an afterloader prototype.

Methods: 41 patients were included with 355 EMT measurements. Catheter traces were measured automatically after implantation, after CT imaging, and after each fraction. Dwell positions (DPs) were reconstructed and compared to the treatment plan reference. Euclidean distances between reconstructed and planned DPs were assessed, along with the influence of patient and implant factors on deviations.

Results: Median Euclidean distance across all measurements was 2.19 mm. Minimal deviation occurred at post-CT measurement (1.67 mm median). Fraction-to-fraction median deviation was 2.31 mm, improvable to 2.05 mm with follow-up CT adaptation. No correlation was found between skin distance, rib proximity, mammilla position, breast volume, or catheter length and large deviations. Largest deviations occurred in the upper inner breast quadrant.

Conclusion: The EMT afterloader prototype was successfully integrated into clinical routine, enabling real-time inter-fractional quality assurance with a median DP deviation below the 2.5 mm step size.

Error Detection Using an Electromagnetic Tracking System in Multi-Catheter Breast Interstitial Brachytherapy

Physics in Medicine and Biology  ·  2019

Masitho S, Kallis K, Strnad V, Fietkau R, Bert C

Purpose: To test the feasibility of the hybrid treatment delivery system (HTDS) — an afterloader with integrated electromagnetic tracking (EMT) — for detecting treatment planning and delivery errors in multi-catheter breast brachytherapy.

Methods: Planning errors (incorrect offset, indexer length, tip/connector end swaps, partial swaps) and delivery errors (catheter shifts, connection swaps) were manually simulated using phantoms. A MATLAB algorithm assessed geometrical deviations between CT-defined and EMT-measured dwell positions. Detection ability under implant motion was also evaluated. Patient data from the ongoing study at Erlangen were analyzed.

Results: All simulated planning errors were detected. Catheter connection swaps were detected 100% of the time. Shift detection rate was >97% for shifts larger than 1.1 mm. The algorithm reliably identified errors in patient data.

Conclusion: The HTDS with EMT enables robust, automated error detection for both planning and delivery errors in clinical brachytherapy QA workflows.

★ First author

Impact of Inter- and Intra-Observer Variabilities of Catheter Reconstruction on Multi-Catheter Interstitial Brachytherapy of Breast Cancer Patients

Radiotherapy and Oncology  ·  2019

Kallis K, Kaltsas T, Kreppner S, Lotter M, Strnad V, Fietkau R, Bert C

Purpose: To evaluate inter- and intra-observer variabilities of catheter reconstruction and their dosimetric impact in multi-catheter interstitial breast brachytherapy.

Methods: Three medical physicists reconstructed catheter traces of 13 patients for IOV assessment; repeated reconstructions of two physicists were compared for IAV. 426 catheters were analyzed. Geometrical deviations between dwell positions and changes in quality indices (CI, DNR, COIN) and OAR doses were evaluated.

Results: Mean IOV dwell position deviation: 0.60 ± 0.35 mm (observer 1: 0.54 ± 0.32 mm; observer 2: 0.58 ± 0.37 mm). Mean catheter trace length varied by 0.51 ± 0.45 mm. Relative deviations in CI, DNR, COIN, heart dose, and lung dose were small (<0.3%). Maximum skin dose change was 8.52%. Mean IAV deviation was 0.49 ± 0.30 mm. IOV and IAV were significantly different (Wilcoxon p < 0.01).

Conclusions: Repeated catheter reconstruction does not lead to large geometrical deviations or significant dosimetric changes. Reliable quality indices can be obtained with all tested reconstruction techniques, though ground truth validation remains challenging.

2018
★ First author

Introduction of a Hybrid Treatment Delivery System Used for Quality Assurance in Multi-Catheter Interstitial Brachytherapy

Physics in Medicine and Biology  ·  2018

Kallis K, Kreppner S, Lotter M, Fietkau R, Strnad V, Bert C

Purpose: To demonstrate the possibilities of an electromagnetic tracking (EMT) system integrated into an afterloader for quality assurance in HDR multi-catheter interstitial breast brachytherapy.

Methods: A hybrid afterloader equipped with an EMT sensor was used for phantom and patient measurements. After coherent point drift registration of EMT traces to CT-reconstructed catheters, dwell positions (DPs) were defined. Fitting and interpolation methods for DP reconstruction were compared. All estimated DPs were compared to treatment planning DPs. Implant geometry was acquired for 20 patients.

Results: Both fitting and interpolation detected manually introduced shifts and swaps. Interpolation showed superior accuracy (RMSE = 1.27 mm); fitting was more stable under distortion and motion. The EMT system was successfully integrated into clinical workflow for 20 patients.

Conclusion: The EMT-integrated hybrid afterloader is beneficial for brachytherapy QA and clinical feasibility was demonstrated, laying the groundwork for real-time treatment monitoring.

2017

On the Use of Particle Filters for Electromagnetic Tracking in High Dose Rate Brachytherapy

Physics in Medicine and Biology  ·  2017

Götz TI, Lahmer G, Brandt T, Kallis K, Strnad V, Bert C, Hensel B, Tomé AM, Lang EW

Purpose: To develop a hybrid system combining multi-dimensional scaling with particle filters for precise sensor dwell position determination in HDR breast brachytherapy.

Methods: Solenoid sensors measured with an EMT system were used to localize source positions relative to implanted catheters. Empirical mode decomposition removed superimposed breathing artifacts. The hybrid system relates EMT sensor positions to catheter positions initially determined from CT.

Results: The hybrid model robustly and reliably determined spatial positions of all catheters and precisely detected deviations of actual dwell positions from the treatment plan across subsequent treatment sessions. Only EMT sensor data were required — no additional imaging.

Conclusion: The particle filter–based hybrid system enables real-time, image-free quality assurance of dwell position delivery in HDR brachytherapy.

2016

Dosimetric Accuracy of the Cone-Beam CT-Based Treatment Planning of the Vero System: A Phantom Study

Journal of Applied Clinical Medical Physics  ·  2016

Yohannes I, Prasetio H, Kallis K, Bert C

The accuracy of dose calculation based on CBCT images from the non-bowtie filter kV imaging system of the Vero linac was investigated. Different materials and tube voltages were used to generate Hounsfield unit lookup tables (HLUTs) for both CBCT and fan-beam CT systems. A cube phantom with water-equivalent slabs and inhomogeneity inserts was evaluated using point-dose and 2D dose distribution measurements. Higher tube voltage improved dose calculation accuracy and gamma passing rates. Tissue-equivalent insert materials yielded negligible differences between CBCT- and FBCT-based treatment planning. CBCT-based planning with the Vero system is feasible if calibrated using tissue-equivalent materials at 120 kV.

UKER 🔗 DOI