Virtual-Reality-Heathcare.jpg

HMD-Based Navigation for Ventriculostomy

 

Background

A ventriculostomy is a device that drains excess cerebrospinal fluid from the head. It is also used to measure the pressure in the head (referred to as ICP, intracranial pressure). The system is made up of a small tube, drainage bag, and monitor. Here is a brief surgical procedure for ventriculostomy refer to Figure 1 below: 1. Incision 2. Hole burred into bone to create opening for catheter 3. Insert catheter and drain excess fluid from ventricle

ventriculostomy.png

Technical Approach

Our navigation system work flow diagram is shown as the following figure, and the following steps describe the workflow in detail.

  1. A ZED mini camera mounted to HoloLens to track skull(AR marker) and catheter

  2. Register CT to patient by touching anatomic points (glabella)

  3. Create ventricle model by segmenting CT on PC and import model to Unity

  4. Unity generate AR overlay of ventricle and overlay via HoloLens

  5. Target accuracy within 3 mm

  6. Unity generates entry point by touching and overlay via HoloLens

  7. Display Catheter guide line on HoloLens, which a virtual line from centroid of ventricle to entry point with possibility for entry point adjustment

  8. Catheter tracking result including catheter insertion depth, angle that processed on PC and send to Unity through UDP

  9. Unity receives catheter tracking result from PC and overlay the information via HoloLens

Overview.png

CAD Design

CAD.png

Ventricle Segmentation

CT.jpg
3dslicer_bottom.png

Ventricle and Skull segmentation in 3D slicer

  1. Thresholding

  2. Select target object

  3. Close holes

  4. Smooth and mesh

Manually select anatomic point and entry point to get relative position

Software Design

The software of our system mainly consists of two parts, one is on PC, for AR markers tracking and depth sensing, another is running on HoloLens, for registration, AR overlay and UI.

software design.png

Calibration

Pivot Calibration [1] for the pointer and Display Calibration [2] for OST-HMD overlay.

[1] Yaniv, Ziv. "Which pivot calibration?" Medical Imaging 2015: Image-Guided Procedures, Robotic Interventions, and Modeling. Vol. 9415. International Society for Optics and Photonics, 2015.

[2] Qian, L., Azimi, E., Kazanzides, P., Navab, N.: Comprehensive tracker based dis- play calibration for holographic optical see-through head-mounted display. arXiv preprint arXiv:1703.05834 (2017)

Registration

Based on existing clinical workflow, we designed this Three-Point Registration process to register virtual skull models to its real counterpart. We added another Manual Registration process.

Registration.png

Catheter Tracking

  1. Generate mask Hand color tracking and depth info

  2. Probabilistic Hough transformation to find catheter endpoint

  3. Thresholding based on geometric constraint

  4. Calculate endpoint position and angle of catheter

Catheter.png

Experiment

User.png
Skull Phantom Cross section.png
test_1.PNG
test_2.PNG

Result

AR.png
result.png

User wear HoloLens to perform catheter insertion on skull phantom 5 times, record the number of time that hit ventricle to evaluate success rate. The score is evaluated by the following criteria:

  • Ventricle Center: 20

  • Ventricle: 10

  • Miss: 0