Augmented Reality and Patient Specific Imaging Data
Brown Bag Lecture by R. Scott Riddle and Dr. Daniel Wasser | 10/10/2017 11:00AM – 12PM | 7th Floor Conference Room, Bldg 38A
Augmented reality (AR) is gaining traction in health care by providing clinicians, researchers and patients with another dimension to our physical world, and allowing us to see and interact with a digital layer of images to enhance what we experience in the real world. A promising avenue of this research is the integration of patient-specific data sets into AR in order to allow for visualization of actual 3D structures – whether at the molecular, cellular or anatomic level – for a wide range of purposes from protein visualization to medical education and surgical planning. Our independent research team built the first reported prototype that allows for realtime interaction with high-resolution cellular modules using AR modalities, such as Microsoft HoloLens. The prototype was developed using zStack data sets which allow for realtime interaction of low polygon and direct surface models exported from primary source imaging.
This talk will start with a brief overview of AR and virtual reality then discuss its general applications in education and healthcare before diving into our published research in integrating actual z-stack data sets into AR. Particular attention will be provided to discussing the development pipeline which incorporated a wide array of technologies including IMARIS, ImageJ, MAYA, 3DCOAT, UNITY, ZBrush, OcculusRift, LeapMotion, and output for multiplatform AR function as its viewing modality. The talk will conclude with a demo of our AR output as well as with a discussion of future directions of this research and other potential avenues of research where AR integration may be beneficial. We are confident that the integration of actual z-stack data sets, whether from CT, MRI, or elsewhere, has tremendous potential to enrich the visualization experience and unlock significant potential educational as well as clinical benefits.
Scott Riddle, MFA Medical Illustration, is a medical illustrator and co-founder of Photon Biomedical, an innovative medical animation, 3D-modeling and augmented reality (AR)/virtual reality (VR) content creation agency for the healthcare industry. He has previously worked in biotech, defense and pharmaceutical industries developing medical visualization. His interests include bringing the latest in 3D animation and augmented reality into medical education and clinical medicine.
Daniel Wasser, MD, received his medical degree from Tel Aviv University and is the other co-founder of Photon Biomedical. Dr. Wasser has extensive experience in clinical medicine, scientific communications, and health technology. Additional interests include advancing medical education and bridging the gap between technology and clinical medicine to enhance patient outcomes.