Flexible automated assessment in 3D learning environments: Technical improvements and expert feedback

Abstract

Immersive 3D learning environments have a great potential to improve learning. This holds especially true for the usage of computer simulations in science education. Nevertheless, the importance of formative assessment, guidance and feedback requires the implementation of automated and flexible assessment solutions within these environments. Our workgroup has recently introduced a flexible assessment framework with focus on behavioral assessment and immediate feedback provision. The aim of this paper is to report about the latest technical challenges and improvements of our Open Wonderland prototypes, as well as a first expert evaluation that yields promising results. From the technical perspective, issues with synchronization and the amount of data being transferred have been identified and a first solution has been implemented. The expert evaluation confirms the assessment concept and reveals interest among (emerging) practitioners; however, several ideas to improve the feedback provision and usage of simulations have been stated as well.