Augmented reality in computer-assisted interventions based on patient-specific 3D printed referenceeference

Thumbnail Image
Publication date
Defense date
Journal Title
Journal ISSN
Volume Title
John Wiley & Sons, Inc. on behalf of The Institution of Engineering and Technology
Google Scholar
Research Projects
Organizational Units
Journal Issue
Augmented reality (AR) can be an interesting technology for clinical scenarios as an alternative to conventional surgical navigation. However, the registration between augmented data and real-world spaces is a limiting factor. In this study, the authors propose a method based on desktop three-dimensional (3D) printing to create patient-specific tools containing a visual pattern that enables automatic registration. This specific tool fits on the patient only in the location it was designed for, avoiding placement errors. This solution has been developed as a software application running on Microsoft HoloLens. The workflow was validated on a 3D printed phantom replicating the anatomy of a patient presenting an extraosseous Ewing's sarcoma, and then tested during the actual surgical intervention. The application allowed physicians to visualise the skin, bone and tumour location overlaid on the phantom and patient. This workflow could be extended to many clinical applications in the surgical field and also for training and simulation, in cases where hard body structures are involved. Although the authors have tested their workflow on AR head mounted display, they believe that a similar approach can be applied to other devices such as tablets or smartphones.
Proceeding of: 12th workshop on Augmented Environments for Computer-Assisted Interventions AE-CAI 2018, held in conjunction with MICCAI 2018, in Granada, Spain on September 16th.
Cancer, Augmented reality, Tumours, Computerised tomography, Medical image processing, Surgery, Bone, Image registration, Paediatrics, Augmented reality, Computer-assisted interventions, Patient-specific 3D printed reference, Real-world spaces, Patient-specific tools, Visual pattern, Automatic registration, Placement errors, Software application, Actual surgical intervention, Tumour location, Surgical field, Extraosseous Ewing sarcom
Bibliographic citation
Healthcare technology letters, 5(5) (Special Issue: Papers from the 12th workshop on Augmented Environments for Computer-Assisted Interventions, Granada, Spain, September 16th), Oct. 2018, Pp. 162-166