Computational Patient Models
headed by Dr. Kristina Giske
We are physicists, medical informaticians, computer scientists, mathematicians, and radiooncologists working together for the benefit of the patient.
You also want to join our team within your →thesis project? Get in touch
focussing to
Our research is dedicated to in-silico radiotherapy simulation of cancer patients undergoing curative irradiation treatment. The challenge for technically precise radiation therapy lies in adapting dose delivery to deformations in the patient’s anatomy induced by motion and physiological changes. Our vision is to create a virtual patient model or a digital twin, serving as a proxy for treatment simulation by accumulating the physical dose and predicting the therapeutic effect of the planned treatment. This empowers treating physicians to tailor the treatment to the specific needs of the patient before irradiation. Algorithm development, advancements in computer technology, and our passion for unusual solutions are our tools in the fight against cancer.
working on
- Utilzing CBCTs for dose computation (phantom measurements, CBCT reconstruction, dose re-optimization, image registration, CNN style transfer, cycleGANs)
- Clinical Target Volume definition (image segmentation, inter-observer variability, expert guidelines, expert conformance, ANNs, nn-Unet, neuro-symbolic AI)
- MR-guided treatment and MR-only treatment planning (MR-DECT imaging studies, CNN style transfer, segmentation & regression, deformable image regsitration)
- Biomechanical motion modelling (Multi-body phsics, Finite Element models)
- CT generation and extrapolation of anatomy (Statistical models, Data generators, Diffusion models)
- GPGPU parallelisation for image processing algorithms (CUDA kernels, multi-GPU scheduling)
- Voxelized, tessellated, and analytical patient representation (Dosimetric impact for small structures)
People
- Dr. Kristina Giske (group leader)
- Dr. Pasit Jarutatsanangkoon (postdoc)
- Pedro Rodrigues (staff scientist)
- Ama Katseena Yawson (doctoral student)
- Alexandra Walter (HIDSS4Health doctoral student)
- Goran Stanic (doctoral student)
- Richard Häcker (master's student)
- Jakob Kreft (master's student)
- Marc Buckmakowski (master's student)
- Sina Thürwächter (bachelor's student)
- Florian Ebert (HiWi)
Current Projects
BionicDIR - Towards Biofidelic Deformable Image Registration of the Skeleton by Kinematically Articulated Multi-Body Physics
Accurate motion estimation between medical scans of different modalities (e.g. CT, MRI) is crucial for adaptive radiation therapy. The widely used intesity-based deformable image registration is limited by the absence of physical constraints during deformation. The KinematicDIR project studies the use of a biomechanical model for biofidelic image registration. For the head and neck area, it focusses on a kinematically articulated skeleton model as the driving motion model.
In this BMBF*-funded doctoral project Cornelius Bauer investigates the best approach to incorporate the body model into the registration task and assesses the accuracy and robustness - but also limitations - of the model-based approach. follow me for more details...
*ARTEMIS Project (#13GW0436B) in collaboration with UKHD & HIT (Jürgen Debus, Oliver Jäkel)
based on PuppetMaster preceding projects by Hendrik Teske and Kathrin Bartelheimer
associated project by Sina Thürwächter
DeepSPYN - Deep Learning based PseudoCT Generation for MR-only Treatment Planning
Stopping power ratio (SPR) maps are essential for dose deposition calculations in ion beam cancer treatments and are usually estimated from single energy CT (SECT) in clinical practice. Dual-energy CT (DECT), which involves the acquisition of two energy spectra, captures both material-specific information and tissue characterization, showing promise in enhancing patient-tailored SPR map conversion.
In this BMBF*-funded doctoral project Ama Katseena Yawson scrutinises the capability of deep learning models to convert MRI scans into pseudo-CTs or pseudo-SPR maps. follow me for more details...
*ARTEMIS Project (#13GW0436B) in collaboration with UKHD & HIT (Jürgen Debus, Oliver Jäkel)
associated project by Nora Wolf
TVoracle - Towards Expert-Guideline Conformance for Machine-Learning-based Segmentations of Clinical Target Volumes
Patient-tailored contours of target volumes are crucial for radiation treatment planning, significantly influencing the outcome of cancer treatment. Clinical target volume delineation on planning CT scans poses challenges for human experts, proving to be extremely time-consuming and displaying substantial variation between observers. State-of-the-art machine learning algorithms achieve high accuracy on the automatically segmenting anatomical structures, but this success doesn't seamlessly extend to target volumes without additional constraints. The translation of expert guidelines into the machine learning realm has the potential to advance automated target volume delineation, facilitating guideline conformance and clinical use.
In this HIDSS4Health-funded doctoral project Alexandra Walter tackles the implications of supervised learning on data prone to inter-observer variabilities and patient-individual differences utilizing mathematical rules provided by human experts. follow me for more details...
collaboration with Martin Frank (KIT)
associated project by Jakob Kreft and by Marc Buckmakowski
CBCTart - Data-Driven CBCT Image Quality Improvements for Online Adaptive Radiotherapy
CBCT imaging has become an integral component of photon radiotherapy devices. However, its image quality is restricted in its ability to faacilitate precise patient positioning. The primary objective of the project is to bridge the gap toward achieving image quality comparable to planning CTs, thereby enabling on-couch treatment plan adaptation based solely on CBCTs.
In this Varian-funded doctoral project Goran Stanic investigates the impact of typical image quality shortcomings of CBCT on the degradation of plan quality. Additionally, generative deep learning models are employed to generate synthetic CTs from the lower-quality CBCT images. follow me for more details..
collaboration with Niklas Wahl (E0404) (PI: Oliver Jäkel), Fabian Weykamp (KKE UKHD-DKFZ)
collaboration with Bálint Kovács (MIC DKFZ)
with support by Florian Eber
ALIEN - Generating non-existent Radiotherapy Patient Cousins for FAIR Research
Reseach progress in medicine relies on patient-sensitive data, particularly in radiation therapy, which involves the most diverse and frequent imaging requirements for each patient within its precise image-guided adaptive treatment options. Sharing such rich connected data in compliance with ethical and legal requirements necessitates thorough preparations in long-term projects. Technological short-term projects cannot share in-house data, preventing a direct comparison of competing algorithm designs. Creating a data cohort of non-existent but patient-representative radiotherapy-relevant scans could be made openly accessible for radiotherapy research.
In this AI Health Innovation Cluster-funded infrastructural project Pedro Rodrigues scrutinises cutting-edge AI image generator technologies for their capability to mimic medical scans with consistently realistic patient anatomies. follow me for more details...
collaboration with Jens Fleckenstein (UMM)
PRELUDE - Towards Learning 3D Thorax Anatomy and its Motion Extrapolation from 2D Cross-section Time Series
Precise irradiation of lung tumors can be highly challenging due to cyclic respiratory motion and deformations of neighbouring soft tissues in the mediastinum. Continuous online measurement of this complex motion can currently only be acquired via 2D time series, such as cine-MRI sequences. However, 2D anatomy and out-of-plane local deformations complicate fast mitigation techniques and limit dose monitoring along the intrafractional irradaition.
In this scholarship*-funded postdoctoral project Pasit Jarutatsanangkoon scrutinizes machine learning strategies to detect suddenlyemerging organs at risk in the scan and extrapolate 4D anatomy based on time-resolved 2D snapshots. follow me for more details..
*HRH Princess Chulabhorn's 60th Birthday Anniversary Scholarship
associated project by Richard Häcker
CLARITY - CineMR-guided ML-driven breaAthing models for adaptive RadIoTherapY
Dose escalation in breathing anatomies of ultra-central lung cancer lesions is based on cutting-edge LINAC-integrated imaging technology using 2D cineMR time series combined with high-end adaptation strategies. Yet, the 4D motion trajectories still cannot be visualized and processed online with available technologies.
In this Helmholtz Imaging-funded project Richard Häcker investigates biomechanical and ML-based 4D motion modelling approaches for their ability and reliability to predict critical deformation events of organ at risks from 2D cineMR. follow me for more details..
collaboration with Daniel Lang (HMGU) and Julia Schnabel (HMGU & TUM) supported by Juliane Hörner-Rieber, Sebastian Regenry and Sebastian Klüter (UKHD)
Selected publications
Walter A, Hoegen P, Stanic G, Rodrigues JP, Adeberg S, Jäkel O, Frank M, Giske K. 2024 Segmentation of seventy-one anatomical structures necessary for the evaluation of guideline-conform clinical target volumes in head and neck cancers. Cancers 2024, 16(2), 415. https://doi.org/10.3390/cancers16020415 Preprints 2023, 2023121562. https://doi.org/10.20944/preprints202312.1562.v1
Yawson AK, Walter A, Wolf N, Klüter S, Hoegen P, ADebus J, Frank M, Jaekel O, Giske K. 2024 Essential parameters needed for a U-Net-based segmentation of individual bones on planning CT images in the head & neck region using limited datasets for radiotherapy application. Phys Med Biol. in press https://doi.org/10.1088/1361-6560/ad1996/
Bauer CJ, Teske H, Walter A, Hoegen P, Adeberg S, Debus J, Jaekel O, Giske K. 2023 Biofidelic image registration for head and neck region utilizing an in-silico articulated skeleton as a transformation model. Phys Med Biol. 68(9):095006
Niebuhr NI, Johnen W, Echner G, Runz A, Bach M, Stoll M, Giske K, Greilich S, Pfaffenberger A. 2019 The ADAM-pelvis phantom - an anthropomorphic, deformable, and multimodal phantom for MRgRT. Phys Med Biol. 64(4):04NT05
Stoiber EM, Bougatf N, Teske H, Bierstedt C, Oetzel D, Debus J, Bendl R, Giske K. 2017 Analyzing human decisions in IGRT of head-and-neck cancer patients to teach image registration algorithms what experts know. Radiat Oncol. 12:104
Teske H, Bartelheimer K, Meis J, Bendl R, Stoiber EM, Giske K. 2017 Construction of a biomechanical head and neck motion model as a guide to evaluation of deformable image registration. Phys Med Biol. 62(12):N271-N284
Teske H, Bartelheimer K, Bendl R, Stoiber EM, Giske K. 2017 Handling images of patient postures in arms up and arms down position using a biomechanical skeleton model. Current Directions in Biomedical Engineering 3(2):469-472
Bartelheimer K, Teske H, Bendl R, Giske K. 2017 Tissue-specific transformation model for CT-images. Current Directions in Biomedical Engineering 3(2):525-528
Stoll M, Stoiber EM, Grimm S, Debus J, Bendl R, Giske K. 2016 Comparison of Safety Margin Generation Concepts in Image Guided Radiotherapy to Account for Daily Head and Neck Pose Variations. PLoS One 11(12):e0168916