Skip to main navigation menu Skip to main content Skip to site footer

Vol. 17 No. 2 (2017)
July-December

ARTICULOS

Audio effects on haptics perception during drilling simulation

https://doi.org/10.19053/1900771X.v17.n2.2017.7179

Published 2017-07-04

  • Yair Valbuena
    • ,
  • Álvaro Uribe-Quevedo
    • ,
  • Alexandra Velasco-Vivas

Yair Valbuena
Universidad Militar Nueva Granada

Álvaro Uribe-Quevedo
Universidad Militar Nueva Granada

Alexandra Velasco-Vivas
Universidad Militar Nueva Granada

Abstract

Virtual reality has provided immersion and interactions through computer generated environments attempting to reproduce real life experiences through sensorial stimuli. Realism can be achieved through multimodal interactions which can enhance the user’s presence within the computer generated world. The most notorious advances in virtual reality can be seen in computer graphics visuals, where photorealism is the norm thriving to overcome the uncanny valley. Other advances have followed related to sound, haptics, and in a lesser manner smell and taste feedback. Currently, virtual reality systems (multimodal immersion and interactions through visual-haptic-sound) are being massively used in entertainment (e.g., cinema, video games, art), and in non-entertainment scenarios (e.g., social inclusion, educational, training, therapy, and tourism). Moreover, the cost reduction of virtual reality technologies has resulted in the availability at a consumer-level of various haptic, headsets, and motion tracking devices. Current consumer-level devices offer low-fidelity experiences due to the properties of the sensors, displays, and other electro-mechanical devices, that may not be suitable for high-precision or realistic experiences requiring dexterity. However, research has been conducted on how toovercome or compensate the lack of high fidelity to provide an engaging user experience using storytelling, multimodal interactions and gaming elements. Our work focuses on analyzing the possible effects of auditory perception on haptic feedback within a drilling scenario. Drilling involves multimodal interactions and it is a task with multiple applications in medicine, crafting, and construction. We compare two drilling scenarios were two groups of participants had to drill through wood while listening to contextual and non-contextual audios. We gathered their perception using a survey after the task completion. From the results, we believe that sound does influence the haptic perception, but further experiments are required to better comprehend the implications and possible medical applications.

Keywords

Fidelity, haptics, simulation

PDF

References

  1. R. Riener, M. Frey, T. Proll, F. Regenfelder and R. Burgkart, “Phantom-based multimodal interactions for medical education and training: the Munich knee joint simulator,” in IEEE Transactions on Information Technology in Biomedicine, vol. 8, no. 2, pp. 208-216, June 2004. doi: https://doi.org/10.1109/TITB.2004.828885. DOI: https://doi.org/10.1109/TITB.2004.828885
  2. Aïm, Florence et al., “Effectiveness of Virtual Reality Training in Orthopaedic Surgery”, in Arthroscopy: The Journal of Arthroscopic & Related Surgery 32.1: 224-232, January 2016. doi: https://doi.org/10.1016/j.arthro.2015.07.023. DOI: https://doi.org/10.1016/j.arthro.2015.07.023
  3. Otaduy, Miguel A, Allison Okamura, and Sriram Subramanian, “Haptic technologies for direct touch in virtual reality”, in ACM SIGGRAPH 2016 Courses 24: 13, July 2016. doi: https://doi. org/10.1145/2897826.2927307. DOI: https://doi.org/10.1145/2897826.2927307
  4. Azmandian, Mahdi et al., “Haptic Retargeting Video Showcase: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experience”, in Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems: 3-3, May, 2016. doi: https://doi. org/10.1145/2858036.2858226. DOI: https://doi.org/10.1145/2851581.2889441
  5. J. M. Loomis, “Presence in Virtual Reality and Everyday Life: Immersion within a World of Representation,” in Presence, vol. 25, no. 2, pp. 169174, Nov. 1 2016. doi: https://doi.org/10.1162/ PRES_a_00255. DOI: https://doi.org/10.1162/PRES_a_00255
  6. Heilig, M., “Beginnings: sensorama and the telesphere mask”, in Digital illusion. ACM Press/Addison-Wesley Publishing Co. pp. 343-351, January, 1998. [7] Page, Ray L., “Brief History of Flight Simulation”, inProceedings of SimTecT 2000 Conference, Sydney, 2000.: 11-17.
  7. Rosen, Kathleen R., “The history of medical simulation”, in Journal of critical care 23.2: 157166, June 2008. doi: https://doi.org/10.1016/j. jcrc.2007.12.004. DOI: https://doi.org/10.1016/j.jcrc.2007.12.004
  8. Sutherland, I. E. (1965). The ultimate display. Multimedia: From Wagner to virtual reality.
  9. Algazi, V. R., Duda, R. O., & Thompson, D. M. (2004). Motion-tracked binaural sound. Journal of the Audio Engineering Society, 52(11), 1142-1156.
  10. Lyu, SR., Lin, YK., Huang, ST. et al. BioMed Eng OnLine, 2013 12: 63. doi: https://doi.org/10.1186/1475-925X-12-63 DOI: https://doi.org/10.1186/1475-925X-12-63
  11. Abdulmotaleb El Saddik, et al. Haptics: General Principles, in Haptics Technologies, Part of the series Springer Series on Touch and Haptic Systems pp 1-20, August 2011. DOI: https://doi.org/10.1007/978-3-642-22658-8_1
  12. T. R. Coles, D. Meglan and N. W. John, “The Role of Haptics in Medical Training Simulators: A Survey of the State of the Art,” in IEEE Transactions on Haptics, vol. 4, no. 1, pp. 51-66, January-March 2011. doi: https://doi.org/10.1109/TOH.2010.19. DOI: https://doi.org/10.1109/TOH.2010.19
  13. Federico Avanzini, Davide Rocchesso. “Controlling material properties in physical models of sounding objects”, in Proc. Int. Computer Music Conf., La Habana: 91-94, 2001.
  14. M. Strese; C. Schuwerk; A. Iepure; E. Steinbach, “Multimodal Feature-based Surface Material Classification,” in IEEE Transactions on Haptics, vol. PP, no.99, pp.1-1. doi: https://doi.org/10.1109/ TOH.2016.2625787
  15. Ming-Dar Tsai, Ming-Shium Hsieh, Chiung-Hsin Tsai, “Bone drilling haptic interaction for orthopedic surgical simulator”, Computers in Biology and Medicine, Volume 37, Issue 12, December 2007, Pages 1709-1718. doi: https://doi.org/10.1016/i. compbiomed.2007.04.006 DOI: https://doi.org/10.1016/j.compbiomed.2007.04.006
  16. Andreas Petersik, Bernhard Pflesser, Ulf Tiede, Karl-Heinz Höhne, and Rudolf Leuwer, “Realistic haptic interaction in volume sculpting for surgery simulation”, in Proceedings of the 2003 international conference on Surgery simulation and soft tissue modeling (IS4TM’03), Nicholas Ayache and Hervé Delingette (Eds.). Springer-Verlag, Berlin, Heidelberg, 194-202, 2003. DOI: https://doi.org/10.1007/3-540-45015-7_19
  17. Panait L, Akkary E, Bell RL, Roberts KE, Dudrick SJ, Duffy AJ., “The role of haptic feedback in laparoscopic simulation training.”, in Journal of Surgical Research 156.2: 312-316, 2009. doi: https://doi. org/10.1016/i.iss.2009.04.018 DOI: https://doi.org/10.1016/j.jss.2009.04.018
  18. John, Nigel W, and Robert J Stone, “Mastoidectomy simulation with combined visual and haptic feed
  19. Yair Valbuena Álvaro Uribe-Quevedo Alexandra Velasco-Vivas
  20. Audio effects on haptics perception during drilling simulation
  21. Rev. I2+D. Vol.17 (2). Julio-Diciembre. 2017, pp. 6-15. ISSN 1900-771X e-ISSN 2422-4324 DOI: https://doi.org/10.19053/1900771X.v17.n2.2017.7179
  23. back” in Medicine Meets Virtual Reality 02/10: Digital Upgrades, Applying Moore’s Law to Health 85: 17, 2002.
  24. The Columbia Electronic Encyclopedia. [Online] Available at: http://encyclopedia2.thefreedictionar y.com/Perception [2016, December 19].
  25. Lerner, Michelle A et al., “Does training on a virtual reality robotic simulator improve performance on the da Vinci® surgical system?”, in Journal of Endourology 24.3: 467-472, 2010. DOI: https://doi.org/10.1089/end.2009.0190
  26. Benjamin Zendejas, Amy T. Wang, Ryan Brydges, Stanley J. Hamstra, David A. Cook, Cost: The missing outcome in simulation-based medical education research: A systematic review, Surgery, Volume 153, Issue 2, February 2013, Pages 160-176. doi: https://doi.org/10.1016/j.surg.2012.06.025 DOI: https://doi.org/10.1016/j.surg.2012.06.025
  27. Thomas, Geb et al., “The design and testing of a force feedback dental simulator”, in Computer methods and programs in biomedicine 64.1: 5364, 2001. DOI: https://doi.org/10.1016/S0169-2607(00)00089-4
  28. doi: https://doi.org/10.1016/S01692607(00)00089-4
  29. Tse, Brian et al. “Design and development of a haptic dental training system-haptel”, in International Conference on Human Haptic Sensing and Touch Enabled Computer Applications: 101-108, July 2010. doi: https://doi.org/10.1007/978-3-64214075-4_15 DOI: https://doi.org/10.1007/978-3-642-14075-4_15
  30. P. A. Heng et al., “A virtual-reality training system for knee arthroscopic surgery,” in IEEE Transactions on Information Technology in Biomedicine, vol. 8, no. 2, pp. 217-227, June 2004. doi: 10.1109/ TITB.2004.826720 DOI: https://doi.org/10.1109/TITB.2004.826720
  31. A. M. Okamura, C. Simone and M. D. O’Leary, “Force modeling for needle insertion into soft tissue,” in IEEE Transactions on Biomedical Engineering, vol. 51, no. 10, pp. 1707-1716, Oct. 2004. Doi: https://doi.org/10.1109/TBME.2004.831542 DOI: https://doi.org/10.1109/TBME.2004.831542
  32. Maran, NJ, and RJ Glavin, “Low-to high-fidelity simulation–a continuum of medical education?” in Medical education 37.s1: 22-28, 2003. doi: https:// doi.org/10.1046/i.1365-2923.37.s1.9.x DOI: https://doi.org/10.1046/j.1365-2923.37.s1.9.x
  33. Norman, Geoff, Kelly Dore, and Lawrence Grierson, “The minimal relationship between simula
  34. tion fidelity and transfer of learning”, in Medical education 46.7: 636-647, 2012. doi: https://doi. org/10.1111/j.1365-2923.2012.04243.x DOI: https://doi.org/10.1111/j.1365-2923.2012.04243.x
  35. Wiriyacosol, S, and EJ Armarego, “Thrust and torque prediction in drilling from a cutting mechanics approach”, in CIRP Annales: 87-91, 1979.
  36. Todd, Robert H, Dell K Allen, and Leo Alting, “Manufacturing processes reference guide”, Industrial Press Inc, 1994.
  37. Ravikiran B. Singapogu and Timothy C. Burg, “Haptic virtual manipulatives for enhancing K-12 special education”, in Proceedings of the 47th Annual Southeast Regional Conference (ACMSE 47), ACM, New York, 2009. DOI: https://doi. org/10.1145/1566445.1566547 DOI: https://doi.org/10.1145/1566445.1566547
  38. Shah, A. V., Teuscher, S., McClain, E. W., & Abbott, J. J., “How to build an inexpensive 5-dof haptic device using two novint falcons”, In International Conference on Human Haptic Sensing and Touch Enabled Computer Applications, Springer Berlin Heidelberg, pp. 136-143, July 2010. doi:https:// doi.org/10.1007/978-3-642-14064-8_21 DOI: https://doi.org/10.1007/978-3-642-14064-8_21
  39. Martin, S, & Hillier, N, “Characterisation of the Novint Falcon haptic device for application as a robot manipulator”, In Australasian Conference on Robotics and Automation (ACRA), pp. 291-292, December 2009.
  40. A. Uribe-Quevedo, D. Rojas and B. Kapralos, “Customization of a low-end haptic device to add rotational DOF for virtual cardiac auscultation training,” 2016 7th International Conference on Information, Intelligence, Systems & Applications (IISA), Chalkidiki, 2016, pp. 1-6. DOI: https://doi.org/10.1109/IISA.2016.7785431 DOI: https://doi.org/10.1109/IISA.2016.7785431
  41. Conti, F., Morris, D., Barbagli, F., & Sewell, C., “CHAI 3D” in http://www. chai3d. org, 2006.
  42. Urbaniak, G.C., &; Plous, S. (2013). Research Randomizer (Version 4.0) [Computer Software]. Retrieved on June 22, 2013, from http://www.randomizer.org/
  43. Melaisi, M., Nguyen, M., Uribe-Quevedo, A., Kapralos, B., “The Effect of Sound on Haptic Fidelity Perception”, in EDUCON 2017. To appear. DOI: https://doi.org/10.1109/EDUCON.2017.7942926

Downloads

Download data is not yet available.