The development of an instrument to assess the usability of courseware
Hollins, Louvenia D.
MetadataShow full item record
This study describes the development and initial validation of a survey designed to measure students' perceptions of the usability of instructional design of educational courseware. There is a lack of measuring instruments to conduct this kind of research. The present study attempts to take steps to provide educators and researchers with a useful tool to facilitate their studies of this aspect or courseware creation and use. A three-phase approach is taken in this study to develop the Instructional Design Usability Survey (IDUS) instrument. Expert evaluators from the field of educational technology, research and assessment were involved in Phase I to establish content and face validity. During Phase II, student focus groups were formed from the population of courseware users to establish content validity and clarity of the instrument. In Phase III, students examined the usability of the instrument, and reliability and validity tests were conducted. Reliability and validity of scores from the IDUS were assessed through statistical procedures performed on the data collected from 206 student participants. Internal consistency reliability was assessed for each construct using Cronbach's alpha. The internal consistency for the six constructs ranged from .73 to .92. Confirmatory factor analysis (CFA) was conducted to establish construct validity by examining the overall fit of the models as well as the magnitude of the factor loadings for each proposed construct. Results of the study show the IDUS is reliable but does not yet show strong enough evidence of validity.