Quantifying use of a health virtual community of practice for general practitioners’ continuing professional development: A novel methodology and pilot evaluation

Abstract

Background: Health care practitioners (HPs), in particular general practitioners (GPs), are increasingly adopting Web-based social media platforms for continuing professional development (CPD). As GPs are restricted by time, distance, and demanding workloads, a health virtual community of practice (HVCoP) is an ideal solution to replace face-to-face CPD with Web-based CPD. However, barriers such as time and work schedules may limit participation in an HVCoP. Furthermore, it is difficult to gauge whether GPs engage actively or passively in HVCoP knowledge-acquisition for Web-based CPD, as GPs’ competencies are usually measured with pre- and posttests. Objective: This study investigated a method for measuring the engagement features needed for an HVCoP (the Community Fracture Capture [CFC] Learning Hub) for learning and knowledge sharing among GPs for their CPD activity. Methods: A prototype CFC Learning Hub was developed using an Igloo Web-based social media software platform and involved a convenience sample of GPs interested in bone health topics. This Hub, a secure Web-based community site, included 2 key components: an online discussion forum and a knowledge repository (the Knowledge Hub). The discussion forum contained anonymized case studies (contributed by GP participants) and topical discussions (topics that were not case studies). Using 2 complementary tools (Google Analytics and Igloo Statistical Tool), we characterized individual participating GPs’ engagement with the Hub. We measured the GP participants’ behavior by quantifying the number of online sessions of the participants, activities undertaken within these online sessions, written posts made per learning topic, and their time spent per topic. We calculated time spent in both active and passive engagement for each topic. Results: Seven GPs participated in the CFC Learning Hub HVCoP from September to November 2017. The complementary tools successfully captured the GP participants’ engagement in the Hub. GPs were more active in topics in the discussion forum that had direct clinical application as opposed to didactic, evidence-based discussion topics (ie, topical discussions). From our knowledge hub, About Osteoporosis and Prevention were the most engaging topics, whereas shared decision making was the least active topic. Conclusions: We showcased a novel complementary analysis method that allowed us to quantify the CFC Learning Hub’s usage data into (1) sessions, (2) activities, (3) active or passive time spent, and (4) posts made to evaluate the potential engagement features needed for an HVCoP focused on GP participants’ CPD process. Our design and evaluation methods for ongoing use and engagement in this Hub may be useful to evaluate future learning and knowledge-sharing projects for GPs and may allow for extension to other HPs’ environments. However, owing to the limited number of GP participants in this study, we suggest that further research with a larger cohort should be performed to validate and extend these findings.