Multiple markers tracking technique as tracked handheld controller for smartphone virtual reality welding application

Abstract

Smartphone Virtual Reality (VR) is the cheapest VR technology that can be used to simulate a similar or completely different real-world experience. The smartphone VR utilize simple interaction techniques such as gestures, voice, magnetic buttons, and gaze techniques due to its low-cost development. However, the input controller for smartphones VR is currently limited to up to 3 Degrees of Freedom (DOF) and limits the user's freedom and experience to interact with the virtual environment. Currently, welding VR simulations only use the expensive VR device because of its 6 DOF input controller advantages. Hence, this research recommends a novel input method using a multiple marker tracking method as a 6 DOF input controller for smartphone VR. The idea is to integrate the welding VR simulation into the cheapest VR technology. This approach involves three objectives. In the first phase, a literature review will locate the current input method and research paper involving smartphone VR. This research also conducted few welding expert’s interviews to get input about the current welding vocational training problems. The second phase focuses on the design of the smartphone VR integration with multiplemarker tracking methods. The VR welding application is designed based on welding experts’ opinions and was named as VR Welding Kit. The last objective oversaw the quantitative and qualitative analysis using a welding torch with markers as the 6 DOF input controller and welding position markers are virtual welding plate objects. The quantitative analysis has three-phase experiments such as accuracy comparison, usability study, and simulation sickness tests. The test compares welding travel speed, work angle and travel angle are the benchmarks for three types of welding position using the Root Mean Square Error (RMSE) method. The multiple markers as smartphone VR input controller have better results for all welding tasks than current popular standalone VR devices, Oculus Quest. The proposed method gets a score of 72.5 on the usability test, when using the System Usability Scales (SUS) method. Participants' susceptibility towards smartphone VR are also lower when using Simulator Sickness Questionnaire (SSQ) method. Finally, for qualitative analysis, an expert’s review is conducted. The question asks their opinion towards the VR Welding Kit application in terms of usefulness, teaching aid, mobility, ease of use and handle. The experts have given a good satisfaction result towards the questions. The experts also suggest improving the VR Welding Kit application for future works. This research shows that the use of multiple markers as input controllers allows the welding VR vocational training to be mobile and ubiquitous.