Alice Chambers |
Microsoft Taiwan and the National Taiwan University (NTU) Hospital have used HoloLens 2 to create a database of holographic images of injuries to help doctors make medical diagnoses, support the hospital’s teaching department and enhance remote consultations.
The research team used HoloLens 2, 3D Slicer and other technologies to reconstruct 2D computer tomograms and MRI images and convert them into holographic models that can be accessed in the metaverse for medical training. This helps physicians to identify fractures, internal bleeding and more with 3D images so they can compare them to patient wounds.
“The HoloLens 2 headset has been introduced to view stereoscopic images of trauma patient’s organs in an extended reality and more intuitive way, with the aim of improving imaging diagnosis capabilities, optimising the process of medical teaching, and setting a new milestone for the clinical utility of medical imaging technology and remote consultation,” said Shi Licheng, global assistant legal officer and general manager of the public and legal affairs department at Microsoft Taiwan.
The new database includes holographic imagery of various injuries, including rib fractures, lung contusions, and spleen and liver injuries.
Physicians can use HoloLens 2 during remote consultations on Microsoft Teams to talk through a patient’s injury by making the 3D images available to them during calls.
“Telemedicine and teleconsultation can effectively alleviate the shortage of medical resources in rural areas, and HoloLens 2 combined with Microsoft Teams is an intuitive and effective new prescription for telemedicine and teleconsultation,” said Ma Huiming, director of the Yunlin Branch at NTU Hospital. “Through this technology, the Yunlin Branch can instantly conduct video consultation with Taipei Hospital or other branches, and see 3D images and virtual and real comparisons simultaneously, which improves the quality and efficiency of consultation.”