Limitations of Low-Resolution 3D Tracking on the Use of AR Glasses in Surgical Procedures

2020-01-21

When tech companies release new AR glasses, most people focus on key details such as the size and resolution of the augmented reality display within the user's field of view. The bigger and more detailed the "window" in front of their eyes, the better. However, medical researchers in Switzerland are now highlighting 3D tracking as an underappreciated technical indicator, with a focus on using augmented reality technology in more critical areas such as surgery. A group of researchers from foreign hospitals claim that AR technologies like Microsoft's HoloLens can be used to improve spinal fusion surgery - allowing surgeons to place digitally generated 3D anatomical maps onto the patient's surgical site, instead of using invasive radiation to identify the location. Unfortunately, the first generation of holographic lenses was not designed for high-fidelity 3D tracking, so even if the wearer tries to minimize head movements, it is still affected by hologram drift and unstable applications. For years, seamlessly blending the real world and the digital world has been the ultimate goal for augmented reality hardware developers. However, achieving this goal has proven to be challenging, as most systems simply overlay digital objects onto real objects, rather than using real objects in the foreground to "occlude" digital objects. It is difficult to place a virtual pillow on a real sofa, but accurately positioning to the millimeter where a doctor can insert spinal fusion screws is a whole different level of difficulty - it's truly "hell mode". The researchers collected three-dimensional mapping point clouds of the surface area of the spine from a real but "virtual" spinal model, instead of using human subjects to test the system. It is worth noting that these mappings were securely fixed on a table to prevent them from moving during testing. To simulate using holographic lenses, the researchers needed to activate two front-facing environment tracking cameras, each with a resolution of only 640x480, and then use a custom pointing device to mark the surgical location on the vertebrae - digitally "registering" the position for the surgery. Finally, the surgeon used the marked positions and virtual images to correctly bend and insert the spinal fusion rod. During the experiment, the researchers found that the time and accuracy of the AR system were comparable to state-of-the-art non-AR alternatives. They stated that future efforts will focus on improving software and hardware to completely eliminate hologram drift and provide a more stable application environment.

RECENT AI NEWS

RECENT AI TOOLS