Simulating a virtual drilling task using audio, visual, and mouse movement cues during the COVID-19 pandemic

Abstract

This work examined whether a real-world drilling task can be successfully simulated using combinations of appropriate audio, visual cues, and basic haptic stimuli obtained with mouse movements instead of a haptic device. Two experiments were conducted where participants were asked to accomplish a virtual drilling task (drilling a block of virtual wood) under different visual, auditory, and “haptic” conditions using some commonly available computer devices such as a mouse, headphones, and monitor. The results of these experiments indicate that audio, visual, and basic haptic cues can be used to simulate a drilling process without a haptic device. Although greater work remains, this work has shown that skills requiring haptic feedback (e.g., drilling) can be simulated without haptic devices. This is particularly important when considering remote learning where trainees may be able to practice various psychomotor-based skills at home with commonly available computer hardware and devices.