Imaging Science in Dentistry

Korean Academy of Oral and Maxillofacial Radiology (대한영상치의학회)
권호 표지
DOI QR코드

DOI QR Code

Use of a gesture user interface as a touchless image navigation system in dental surgery: Case series report

  • Rosa, Guillermo M. (CORE Dental Clinic) ;
  • Elizondo, Maria L. (CORE Dental Clinic)
  • Received : 2013.11.07
  • Accepted : 2014.01.06
  • Published : 2014.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

Purpose: The purposes of this study were to develop a workstation computer that allowed intraoperative touchless control of diagnostic and surgical images by a surgeon, and to report the preliminary experience with the use of the system in a series of cases in which dental surgery was performed. Materials and Methods: A custom workstation with a new motion sensing input device (Leap Motion) was set up in order to use a natural user interface (NUI) to manipulate the imaging software by hand gestures. The system allowed intraoperative touchless control of the surgical images. Results: For the first time in the literature, an NUI system was used for a pilot study during 11 dental surgery procedures including tooth extractions, dental implant placements, and guided bone regeneration. No complications were reported. The system performed very well and was very useful. Conclusion: The proposed system fulfilled the objective of providing touchless access and control of the system of images and a three-dimensional surgical plan, thus allowing the maintenance of sterile conditions. The interaction between surgical staff, under sterile conditions, and computer equipment has been a key issue. The solution with an NUI with touchless control of the images seems to be closer to an ideal. The cost of the sensor system is quite low; this could facilitate its incorporation into the practice of routine dental surgery. This technology has enormous potential in dental surgery and other healthcare specialties.

Keywords

References

  1. Josh B. What is the natural user interface? 2010 Mar 1 [cited 2013 Oct 4]. In: Deconstructing the NUI [Internet]. Woodbridge: InfoStrat Advanced Technology Group. Available from: http://nui.joshland.org/2010/03/what-is-natural-user-interface-book.html.
  2. Strazdins G, Komandur S, Styve A. Kinect-based systems for maritime operation simulators? In: Rekdalsbakken W, Bye RT, Zhang H. Proceedings of 27th European Conference on Modelling and Simulation, ECMS 2013; 2013 May 27-30; Ålesund, Norway: Digitaldruck Pirrot GmbH; 2013. p. 205-11.
  3. Weichert F, Bachmann D, Rudak B, Fisseler D. Analysis of the accuracy and robustness of the leap motion controller. Sensors (Basel) 2013; 13: 6380-93. https://doi.org/10.3390/s130506380
  4. Rosa G. First use of Leap Motion during dental implant surgery [Internet]. YouTube.com [cited 2013 Oct 4]. Available from: https://www.youtube.com/watch?v=1dc8G5lTVtI.
  5. Strickland M, Tremaine J, Brigley G, Law C. Using a depthsensing infrared camera system to access and manipulate medical imaging from within the sterile operating field. Can J Surg 2013; 56: E1-6. https://doi.org/10.1503/cjs.035311
  6. Ruppert GC, Reis LO, Amorim PH, de Moraes TF, da Silva JV. Touchless gesture user interface for interactive image visualization in urological surgery. World J Urol 2012; 30: 687-91. https://doi.org/10.1007/s00345-012-0879-0
  7. Boulos MN, Blanchard BJ, Walker C, Montero J, Tripathy A, Gutierrez-Osuna R. Web GIS in practice X: a Microsoft Kinect natural user interface for Google Earth navigation. Int J Health Geogr 2011; 10: 45. https://doi.org/10.1186/1476-072X-10-45

Cited by

  1. Effects of Mouse, Trackpad and 3d Motion and Gesture Control on Performance, Posture, and Comfort vol.59, pp.1, 2015, https://doi.org/10.1177/1541931215591068
  2. Leap Motion Gesture Control With Carestream Software in the Operating Room to Control Imaging : Installation Guide and Discussion vol.22, pp.6, 2014, https://doi.org/10.1177/1553350615587992
  3. Robust Hand Motion Tracking through Data Fusion of 5DT Data Glove and Nimble VR Kinect Camera Measurements vol.15, pp.12, 2014, https://doi.org/10.3390/s151229868
  4. Device- and system-independent personal touchless user interface for operating rooms : One personal UI to control all displays in an operating room vol.11, pp.6, 2014, https://doi.org/10.1007/s11548-016-1375-6
  5. Evidence from the surgeons: gesture control of image data displayed during surgery vol.35, pp.12, 2014, https://doi.org/10.1080/0144929x.2016.1203025
  6. The LEAPTM Gesture Interface Device and Take-Home Laparoscopic Simulators : A Study of Construct and Concurrent Validity vol.23, pp.1, 2014, https://doi.org/10.1177/1553350615594734
  7. Natural User Interfaces : Is It a Solution to Accomplish Ubiquitous Training in Minimally Invasive Surgery? vol.23, pp.4, 2014, https://doi.org/10.1177/1553350616639145
  8. Touchless interaction with software in interventional radiology and surgery: a systematic literature review vol.12, pp.2, 2014, https://doi.org/10.1007/s11548-016-1480-6
  9. Review of Three-Dimensional Human-Computer Interaction with Focus on the Leap Motion Controller vol.18, pp.7, 2014, https://doi.org/10.3390/s18072194
  10. Use of Commercial Off-The-Shelf Devices for the Detection of Manual Gestures in Surgery: Systematic Literature Review vol.21, pp.5, 2019, https://doi.org/10.2196/11925
  11. Experimental Assessment of a Novel Touchless Interface for Intraprocedural Imaging Review vol.42, pp.8, 2019, https://doi.org/10.1007/s00270-019-02207-8
  12. Touchless computer interfaces in hospitals: A review vol.25, pp.4, 2014, https://doi.org/10.1177/1460458217748342
  13. Evaluating interactive data systems : Survey and case studies vol.29, pp.1, 2014, https://doi.org/10.1007/s00778-019-00589-2
  14. Early clinical experience with a touchless image navigation interface for the endovascular suite vol.29, pp.3, 2020, https://doi.org/10.1080/13645706.2019.1612440
  15. Touchless Control of Picture Archiving and Communication System in Operating Room Environment: A Comparative Study of Input Methods vol.13, pp.3, 2014, https://doi.org/10.4055/cios20004
  16. Comparison of Kinect and Leap Motion for Intraoperative Image Interaction vol.28, pp.1, 2014, https://doi.org/10.1177/1553350620947206
  17. Using Virtual Reality-Based Rehabilitation in Sarcopenic Older Adults in Rural Health Care Facilities-A Quasi-Experimental Study vol.29, pp.5, 2021, https://doi.org/10.1123/japa.2020-0222
  18. Using Virtual Reality-Based Rehabilitation in Sarcopenic Older Adults in Rural Health Care Facilities-A Quasi-Experimental Study vol.29, pp.5, 2021, https://doi.org/10.1123/japa.2020-0222
  19. Sensors and Artificial Intelligence Methods and Algorithms for Human-Computer Intelligent Interaction: A Systematic Mapping Study vol.22, pp.1, 2014, https://doi.org/10.3390/s22010020