Observation system for assessment of learning engagement in various pedagogies

Abstract

This study is focused on the development of an instrument for the measurement of learning engagement. It evaluates engagement as a function of students' attitudes displayed in form of concentration on or distraction from learning based on the pedagogy being employed by the teacher. The instrument, Code for Students' Performance Measures (COSPERM) is designed to provide a measure of student engagements within different pedagogies and especially in learning settings that employ technology-based modes. The COSPERM validation process involves different pedagogies as well as live and recorded observations. COSPERM is content-validated and inter-observer agreement and intra-observer reliability measures established through Cohen's kappa are consistently high for item-by-item as well as whole observer matches showing very good agreement and a minimum of 0.418 (moderate reliability). This shows the COSPERM is a reliable instrument employable in either live or recorded observations. It can also be reliably employed by single or multiple observers.