with annotations and trainee's hands mimicing the surgeon (both images by Andrei State, UNC)
Today, the pace of surgical innovations has increased dramatically, as have the societal demands for safe and effective practices. The mechanisms for training and retraining suffer from inflexible timing, extended time commitments, and limited content. Traditional videotaped instruction has also long been available to help surgeons learn new procedures, but these videos are universally seen as marginally effective at best for a number of reasons: the fixed point of view that is integral to the narration, lack of depth perception and interactivity, and missing information. In short, the experience of watching a video is not sufficiently close to being there and seeing the procedure.
We are exploring a new paradigm for teaching surgical procedures immersive electronic books that in effect blend a "time machine" with 3D hypermedia. Our goal is to allow surgeons to witness and explore (in time and space) a past surgical procedure as if they were there, with the added benefit of instruction from the original surgeon or another instructor, as well as integrated 3D illustrations, annotations, and relevant medical metadata. The trainees should be able to freely and naturally walk around a life-sized, high-fidelity, 3D graphical reconstruction of the original time-varying events, pausing or stepping forward and backward in time to satisfy curiosity or allay confusion. Existing tools for time-varying 3D scene capture are crude at best, and the authoring tools, interaction metaphors, and "cinematic" techniques for this fundamentally new medium are unknown. We are bringing together experts in the respective disciplines and leverage our prior work in tele-immersion, to achieve our goals.
University of North Carolina, Chapel Hill, Office of the Future, Prof. Henry Fuchs and Prof. Greg Welch
Back to tele-immersion home