James Balter Laboratory

About Us:

Our lab group investigates ways to explore the optimal use of images and the signals from which they are conventionally reconstructed to optimally support precision radiation therapy. Our projects include investigations related to:

  • Advancing precise Image-Guided Radiotherapy (IGRT)
  • Developing and improving dynamic human models
  • Studying the complexity of therapeutic decisions and the sparsity of information sufficient to justify decisions throughout the radiotherapy process
  • MRI-guided radiotherapy
  • Projection-to-volume modeling of pose, configuration, and movement

Projects

MRI-Only Treatment Planning and Image Guidance

Our lab investigates the development of patient models that support both the planning of radiation therapy as well as image-guided patient positioning. Patient models are derived from a combination of the intensity patterns of different tissues across different MRI contrasts, as well as through the integration of prior knowledge of anatomic shapes (e.g. pelvic bones) within a population of patients. Synthetic CT models of the head have been developed and clinical implementation is expanding from initial support of whole-brain radiotherapy to more focal treatments of glioblastomas and stereotactic treatments of multiple metastases.

Synthetic CT of the head
Example of synthetic CT of the head
CT and MRCT of head
Comparison of treatment plans optimized using CT and synthetic CT (MRCT) image volumes for glioblastoma multiforme (GBM)
Alignment of MRCT
Alignment of MRCT to Cone Beam CT for positioning of a patient undergoing treatment for brain metastases

In the pelvis, statistical shape models have been used to improve the accuracy and reduce the scanning complexity of synthetic CT modeling. Principal Component Analysis of a statistical bone shape model extracted from deformable modeling of pelvic volumes across a population of previous patients yields a simple description of a bone mask that separates bone from air in the pelvis. This methodology has been demonstrated to provide sufficient accuracy for IMRT planning in the female pelvis, and is currently being translated to a robust software tool for clinical implementation.

Pelvic image 2
Pelvic imaging: MRCT vs. CT
Brain unit architecture
U-net architecture for synthetic CT generation. Each block represents a convolution operation, followed by batch normalization and Leaky ReLU. Last convolution operation converts 64 dimensional channel to 3 channel synthetic CT.
Liver unit architecture
Schematic flow chart of the algorithm for MRI-based synthetic CT (sCT) generation. The training stage, which is consisted of four generators and two discriminators, is shown on the left. Each generator includes several dense blocks. The synthesizing stage is shown on the right, in which a new MR image is fed into the well-trained model to produce the sCT.

Biological Sparsity

MR imaging is typically slow and subject to artifacts from several factors that limit its utility for supporting a number of radiation therapy tasks, including target definition and understanding and reacting to motion.  Fortunately, sufficient sparsity exists to potentially support these tasks with more efficient sampling and/or intelligent reconstruction techniques. Our lab is currently investigating sparsity of biological mapping of diffusion, morphological mapping of anatomic structure, and mapping hierarchical motion states of patients.

B value
Clusters of different tissue types classified to establish prior characteristic diffusion attenuation curves.

Morphological Sparsity

MR imaging is typically slow and subject to artifacts from several factors that limit its utility for supporting a number of radiation therapy tasks, including target definition and understanding and reacting to motion.  Fortunately, sufficient sparsity exists to potentially support these tasks with more efficient sampling and/or intelligent reconstruction techniques. Our lab is currently investigating sparsity of biological mapping of diffusion, morphological mapping of anatomic structure, and mapping hierarchical motion states of patients.

Brain with priors
Comparison of conventional image reconstruction (top row) with Compressed Sensing reconstruction based on analysis of Principal Components from a population of prior patients.

Hierarchical Motion of the Abdomen from Dynamic MR Signals

MR imaging is typically slow and subject to artifacts from several factors that limit its utility for supporting a number of radiation therapy tasks, including target definition and understanding and reacting to motion.  Fortunately, sufficient sparsity exists to potentially support these tasks with more efficient sampling and/or intelligent reconstruction techniques. Our lab is currently investigating sparsity of biological mapping of diffusion, morphological mapping of anatomic structure, and mapping hierarchical motion states of patients.

Breathing motion: Breathing states extracted from dynamic radial sampling of a free-breathing patient during a 6-minute dynamic contrast enhanced scan (R-click on image and select LOOP for continuous playback).
Antral contractions of the gastrointestinal tract (R-click on image and select LOOP for continuous playback).

Join Us:

If you are interested in joining us, please email James Balter, PhD.

Laboratory Lead

Lab Members

Yue Cao, PhD

Yue Cao, PhD

Professor, Radiation Oncology
Professor, Radiology
Daekeun You

Daekeun You, PhD

Software Developer
Jeffrey Fessler

Jeffrey Fessler, PhD

William L. Root Collegiate Professor, Electrical Engineering and Computer Science
Professor, Radiology
Professor, Biomedical Engineering
734-763-1434

Zeyi Ren

Student, Computer Science

Yuhang Zhang

Student, Biomedical Engineering