Usability testing of industrial training system (ITS-UTM) phase i for modules used by the students

Abstract

Usability testing is the core of usability engineering practice to identify areas where users struggle with the site and make recommendations for improvement. Industrial Training Systems (ITS-UTM) is a web based application system which is developed to manage the industrial training process in Universiti Teknologi Malaysia (UTM). Since ITS-UTM is new system, no usability assessment has been done on it before. Therefore, a usability evaluation is needed to evaluate if ITS-UTM is easy to use for average students. However, the literature on usability testing offers surprisingly little help in how to measure usability, in particular how to select measures of usability. Therefore, it is needed to identify the suitable usability aspects and evaluation methods for usability testing on ITS-UTM. In this study, a usability evaluation model has been developed to evaluate the usability of ITMS in aspects of effectiveness, efficiency and satisfaction. The usability evaluation methods applied in this study is performance measurement, observation, and questionnaire. From the results, the overall effectiveness for Student Pre-registration and ITS-UTM are above the success criterion (70%). However, the efficiency and satisfaction of Student Preregistration rated by subjects from questionnaires are low. For usability testing of ITS-UTM, the overall satisfaction rated by subjects after completing each task is high. Besides, the main usability problems met by the students have been identified in this study. Furthermore, this research found that correlations among effectiveness, efficiency, and satisfaction were medium correlated.