Umeå University's logo

Background: The increased use of wearable sensor technology has highlighted the potential for remote telehealth services such as rehabilitation. Telehealth services incorporating wearable sensors are most likely to appeal to the older adult population in remote and rural areas, who may struggle with long commutes to clinics. However, the usability of such systems often discourages patients from adopting these services.

Objective: This study aimed to understand the usability factors that most influence whether an older adult will decide to continue using a wearable device.

Methods: Older adults across 4 different regions (Northern Ireland, Ireland, Sweden, and Finland) wore an activity tracker for 7 days under a free-living environment protocol. In total, 4 surveys were administered, and biometrics were measured by the researchers before the trial began. At the end of the trial period, the researchers administered 2 further surveys to gain insights into the perceived usability of the wearable device. These were the standardized System Usability Scale (SUS) and a custom usability questionnaire designed by the research team. Statistical analyses were performed to identify the key factors that affect participants’ intention to continue using the wearable device in the future. Machine learning classifiers were used to provide an early prediction of the intention to continue using the wearable device.

Results: The study was conducted with older adult volunteers (N=65; mean age 70.52, SD 5.65 years) wearing a Xiaomi Mi Band 3 activity tracker for 7 days in a free-living environment. The results from the SUS survey showed no notable difference in perceived system usability regardless of region, sex, or age, eliminating the notion that usability perception differs based on geographical location, sex, or deviation in participants’ age. There was also no statistically significant difference in SUS score between participants who had previously owned a wearable device and those who wore 1 or 2 devices during the trial. The bespoke usability questionnaire determined that the 2 most important factors that influenced an intention to continue device use in an older adult cohort were device comfort (τ=0.34) and whether the device was fit for purpose (τ=0.34). A computational model providing an early identifier of intention to continue device use was developed using these 2 features. Random forest classifiers were shown to provide the highest predictive performance (80% accuracy). After including the top 8 ranked questions from the bespoke questionnaire as features of our model, the accuracy increased to 88%.

Conclusions: This study concludes that comfort and accuracy are the 2 main influencing factors in sustaining wearable device use. This study suggests that the reported factors influencing usability are transferable to other wearable sensor systems. Future work will aim to test this hypothesis using the same methodology on a cohort using other wearable technologies.