4DRGS: 4D Radiative Gaussian Splatting
for Efficient 3D Vessel Reconstruction from
Sparse-View Dynamic DSA Images

1School of Biomedical Engineering & State Key Laboratory of Advanced Medical Materials and Devices, ShanghaiTech University, Shanghai, China
2Australian National University, Canberra, Australia
3School of Computer Science, Wuhan University, Wuhan, China


Abstract


Overview of DSA imaging and vessel reconstruction. (a) DSA images are generated by subtracting fill-run X-ray images from their mask-run counterparts. (b) We model vessels as a set of 4D radiative Gaussians. (c) The final 3D vessel volume is reconstructed via attenuation voxelization.

Reconstructing 3D vessel structures from sparse-view dynamic digital subtraction angiography (DSA) images enables accurate medical assessment while reducing radiation exposure. Existing methods often produce suboptimal results or require excessive computation time. In this work, we propose 4D radiative Gaussian splatting (4DRGS) to achieve high-quality reconstruction efficiently. In detail, we represent the vessels with 4D radiative Gaussian kernels. Each kernel has time-invariant geometry parameters, including position, rotation, and scale, to model static vessel structures. The time-dependent central attenuation of each kernel is predicted from a compact neural network to capture the temporal varying response of contrast agent flow. We splat these Gaussian kernels to synthesize DSA images via X-ray rasterization and optimize the model with real captured ones. The final 3D vessel volume is voxelized from the well-trained kernels. Moreover, we introduce accumulated attenuation pruning and bounded scaling activation to improve reconstruction quality. Extensive experiments on real-world patient data demonstrate that 4DRGS achieves impressive results in 5 minutes training, which is 32x faster than the state-of-the-art method. This underscores the potential of 4DRGS for real-world clinics.

DSA Imaging


DSA imaging with mask run (left), fill run (middle), and DSA sequence (right).

Digital subtraction angiography (DSA) is a widely recognized gold standard for diagnosing vascular diseases. DSA imaging involves two rotational cone-beam X-ray scans: the mask run, performed before the contrast agent injection, and the fill run, performed after the injection. Subtracting X-ray images in the fill run from those in the mask run yields 2D DSA images, which highlight blood flow marked by the contrast agent while removing background tissues. However, significant vessel overlap in DSA images hinders accurate anatomical assessment. Therefore, reconstructing 3D vessel structures from DSA images is essential for clear visualization to support medical diagnosis. Existing DSA systems typically capture hundreds of images (133 in our study) for precise reconstruction based on the Feldkamp-Davis-Kress (FDK) algorithm, exposing patients and radiographers to significant radiation. In this work, we aim to achieve high-quality reconstruction efficiently with dozens of images to reduce radiation exposure.

Methodology


The overall pipeline of 4DRGS. (a) We model vessels as a set of 4D radiative Gaussian kernels and (b) optimize them with image losses. (c) 3D vessel volume is reconstructed via attenuation voxelization.

In this paper, we introduce 4D radiative Gaussian splatting (4DRGS), the first Gaussian splatting-based framework for efficient 3D vessel reconstruction from sparse-view dynamic DSA images. A key observation is that vessels maintain static structures during DSA scanning process, while their attenuation varies over time due to the contrast agent flow. Therefore, we represent vessels as a set of 4D radiative Gaussian kernels, where each kernel acts as a local Gaussian-shaped time-varying attenuation distribution. The static vessel structures are modeled with time-invariant geometry parameters, including position, rotation, and scale. To mimic the temporal attenuation changes, we introduce a compact neural network dubbed dynamic neural attenuation field (DNAF). It takes kernel position and timestamp as input, and predicts the central attenuation. We splat these Gaussian kernels to synthesize DSA images via X-ray rasterization and optimize them by minimizing the disparities with real captured images. After training, 3D vessel volume is reconstructed via attenuation voxelization. Two innovations are further introduced to enhance reconstruction quality: (1) accumulated attenuation pruning to remove non-vessel kernels and (2) bounded scaling activation to reduce needle artifacts. Experiments on real-world data demonstrate our method's effectiveness for both 3D vessel reconstruction and 2D DSA image synthesis. Notably, 4DRGS achieves impressive results in 5 minutes and converges in 13 minutes, offering a speedup of 32x and 12x compared to the state-of-the-art (SOTA) method VPAL.

Training Progress


Training progress visualization on Gaussian kernel positions. The model is trained for 30k iterations. Adaptive control runs from 600 to 15k iterations, adjusting every 200 iterations. Iteration=0 represents FDK initialization.

3D Vessel Reconstruction


3D Vessel Reconstruction on case #1 with 30 training views. Visualization with 3D Slicer.

3D Vessel Reconstruction on case #2 with 40 training views. Visualization with 3D Slicer.

2D DSA Image Synthesis


2D DSA image synthesis on case #1 with 30 training views.

2D DSA image synthesis on case #2 with 40 training views.

Quantitative Results


Quantitative results on 3D vessel reconstruction and 2D DSA image synthesis. The best performance is shown in bold, while the second best is underlined.

Citation


@article{4DRGS,
          title={4DRGS: 4D Radiative Gaussian Splatting for Efficient 3D Vessel Reconstruction from Sparse-View Dynamic DSA Images},
          author={Liu, Zhentao and Zha, Ruyi and Zhao, Huangxuan and Li, Hongdong and Cui, Zhiming},
          journal={arXiv preprint arXiv:2412.12919},
          year={2024}
        }