Reliable data collection in participatory trials to assess digital healthcare apps

Abstract

AbstractThe number of digital healthcare mobile apps on the market is increasing exponentially owing to the development of the mobile network and widespread usage of smartphones. However, only a few of these apps have undergone adequate validation. As with many mobile apps, healthcare apps are generally considered safe to use, making them easy for developers and end-users to exchange them in the marketplace. The existing platforms are not suitable to collect reliable data for evaluating the effectiveness of the apps. Moreover, these platforms only reflect the perspectives of developers and experts, not of end-users. For instance, data collection methods typical of clinical trials are not appropriate for participant-driven assessment of healthcare apps because of their complexity and high cost. Thus, we identified a need for a participant-driven data collection platform for end-users that is interpretable, systematic, and sustainable —as a first step to validate the effectiveness of the apps. To collect reliable data in the participatory trial format, we defined distinct stages for data preparation, storage, and sharing. Interpretable data preparation consists of a protocol database system and semantic feature retrieval method to create a protocol without professional knowledge. Collected data reliability weight calculation belongs to the systematic data storage stage. For sustainable data collection, we integrated the weight method and the future reward distribution function. We validated the methods through statistical tests conducted on 718 human participants. The validation results demonstrate that the methods have significant differences in the comparative experiment and prove that the choice of the right method is essential for reliable data collection. Furthermore, we created a web-based system for our pilot platform to collect reliable data in an integrated pipeline. We validate the platform features with existing clinical and pragmatic trial data collection platforms. In conclusion, we show that the method and platform support reliable data collection, forging a path to effectiveness validation of digital healthcare apps.