An evaluation of the Online Social Learning Environment Instrument (OSLEI) using Rasch Model Analysis

Abstract

One of the questionnaires that will be used to evaluate social learning environments such as Facebook is the Online Social Learning Environment Instrument (OSLEI). The aim of this study was to evaluate the OSLEI using alternative method of analysis via Rasch model toward 49 undergraduate students in Malaysia. To date, no study has evaluated the OSLEI through the lens of Rasch model analysis among Malaysian samples. Firstly, the OSLEI underwent content validation by three experts. The results of the overall percent agreement on eight constructs (perceived usefulness, usage of learning groups, learning outcomes, affective outcomes, self-efficacy, trust, privacy, and teaching member presence) of the OSLEI was 86% for 48 items. Next, 10 measurement properties of Rasch model analysis were employed with the OSLEI. The results revealed that 23 respondents needed to be dropped. Subsequently, the data from the remaining 26 respondents proceeded to Rasch Model analysis of the 43 items in the OSLEI. The results of the item analysis revealed that 13 items and the construct of privacy needed to be dropped. The findings demonstrated that 35 items were robust, valid, and reliable, and could be used to measure online social learning environments.