Holographic Visualisation and Interaction of Fused CT, PET and MRI Volumetric Medical Imaging Data Using Dedicated Remote GPGPU Ray Casting
M. Fröhlich, C. Bolinhas, A. Depeursinge, A. Widmer, N. Chevrey, P. Hagmann, C. Simon, V.B.C. Kokje, S. Gobron
Proceedings of Simulation, Image Processing, and Ultrasound Systems for Assisted Diagnosis and Navigation: International Workshops, POCUS 2018, BIVPCS 2018, CuRIOUS 2018, and CPM 2018, Held in Conjunction with MICCAI 2018, Granada, Kingdom of Spain, September 16-20, 2018, [Lecture Notes in Computer Science, vol. 11042, Springer, 2018], pp. 102-110.
Medical experts commonly use imaging including Computed Tomography (CT), Positron-Emission Tomography (PET) and Magnetic Resonance Imaging (MRI) for diagnosis or to plan a surgery. These scans give a highly detailed representation of the patient anatomy, but the usual Three-Dimensional (3D) separate visualisations on screens does not provide an convenient and performant understanding of the real anatomical complexity. This paper presents a computer architecture allowing medical staff to visualise and interact in real-time holographic fused CT, PET, MRI of patients. A dedicated workstation with a wireless connection enables real-time General-Purpose Processing on Graphics Processing Units (GPGPU) ray casting computation through the mixed reality (MR) headset. The hologram can be manipulated with hand gestures and voice commands through the following interaction features: instantaneous visualisation and manipulation of 3D scans with a frame rate of 30 fps and a delay lower than 120 ms. These performances give a seamless interactive experience for the user [1].
References
-
K. Raaen, I. Kjellmo, "Measuring Latency in Virtual Reality Systems," Proceedings of the International Conference on Entertainment Computing (ICEC'15), Paris, French Republic, August 27-28, 2015, [Lecture Notes in Computer Science, vol. 9353, Springer, 2015], pp. 457-462.
@INPROCEEDINGS(http://bigwww.epfl.ch/publications/froehlich1801.html,
AUTHOR="Fr{\"{o}}hlich, M. and Bolinhas, C. and Depeursinge, A. and
Widmer, A. and Chevrey, N. and Hagmann, P. and Simon, C. and Kokje,
V.B.C. and Gobron, S.",
TITLE="Holographic Visualisation and Interaction of Fused {CT}, {PET}
and {MRI} Volumetric Medical Imaging Data Using Dedicated Remote
{GPGPU} Ray Casting",
BOOKTITLE="Proceedings of Simulation, Image Processing, and Ultrasound
Systems for Assisted Diagnosis and Navigation: International
Workshops, {POCUS} 2018, {BIVPCS} 2018, {CuRIOUS} 2018, and {CPM}
2018, Held in Conjunction with {MICCAI} 2018",
YEAR="2018",
editor="",
volume="11042",
series="Lecture Notes in Computer Science",
pages="102--110",
address="Granada, Kingdom of Spain",
month="September 16-20,",
organization="",
publisher="Springer",
note="")