Progress in Rehabilitation Medicine
Online ISSN : 2432-1354
ISSN-L : 2432-1354
Development and Feasibility Testing of a Remote Support Application for Adherence to Home Exercise Programs: A Randomized Pilot Study
Rufus A. AdedoyinJohn O. MakindeAdekola B. AdemoyegunFrancis FatoyeChidozie E. Mbada
Author information
JOURNAL OPEN ACCESS FULL-TEXT HTML

2023 Volume 8 Article ID: 20230045

Details
ABSTRACT

Objectives: Poor adherence to home exercise programs (HEPs) is a significant barrier to continuity of care and eventual outcomes, thus requiring innovative mitigating approaches. This study aimed to develop and test the feasibility of a remote support application (RSA) designed to encourage adherence to HEPs.

Methods: Using standard computer programing, an RSA with administrator and user interfaces was developed for mobile phone or tablet. Consenting patients receiving physiotherapy for musculoskeletal conditions (n=19) were randomly assigned into the experimental group (n=10) or the control group (n=9). The experimental group received their customized HEP reminders via the RSA, whereas the control group used conventional paper handouts for HEPs. Adherence to HEPs was assessed over 4 weeks. The feasibility of the RSA was assessed using the Mobile Application Rating Scale and System Usability Scale (SUS) questionnaires. Data were summarized using descriptive and inferential statistics.

Results: The adherence rate of patients in experimental group was significantly higher than that of patients in the control group after 2 weeks [median diff.=−6.0, 95% confidence interval (CI): −8.0 to −5.0; U=5.00; Z=−3.304; P=0.001; r=0.75] and 4 weeks (median diff.=−7.0, 95% CI: −8.0 to −5.0; U=0; Z=−3.695; P<0.001; r=0.84) of intervention. The RSA had a mean SUS score of 82.53±9.04 (out of 100) and a mean app quality rating score of 75.95±4.98 (out of 95).

Conclusions: The use of an RSA to improve adherence to HEPs is feasible for patients with musculoskeletal conditions.

INTRODUCTION

Interventions in rehabilitation practice are traditionally structured to be delivered in-person to the patient.1) However, the benefits of interventions are largely dependent on sustained patient participation, which has seen the emergence of home exercise programs (HEPs).2) Like face-to-face rehabilitation interventions, HEPs are typically long-term interventions.3) Therefore, adherence to HEPs is important if they are to achieve effective rehabilitation outcomes.4) Meichenbaum and Turk5) defined adherence as “an active voluntary collaborative involvement of the patient in a mutually acceptable behavior to produce a desired preventive and therapeutic result.” Adherence to HEPs is a major predictor of improved rehabilitation outcomes for patients with musculoskeletal problems.6,7,8,9) Unfortunately, despite the proven benefits of HEPs, the rates of non-adherence to HEPs are high. Literature reports have indicated rates of non-adherence to HEPs as high as 70%, together with high costs of care, detrimental impacts on treatment outcomes, reduced overall effectiveness in the health system, and promotion of negative relationships between patients and clinical staff.9,10,11) Researchers have simplified the factors associated with HEP adherence to include self-efficacy, outcome expectations, and environmental and personal factors.4,9,12,13,14,15,16,17)

Recognizing the detrimental effects and drawbacks of these multifaceted problems of HEP adherence, several attempts are being made globally to abate the issue. Earlier approaches have involved health education and orientation of patients about the benefits of HEPs18) and exercise prescription notes,19) among several others. However, the use of technology in aiding adherence to HEPs has been suggested in the literature.20) Recent use of software tools and aids has shown significant improvement in HEP adherence.19,21) Remote monitoring is a recent innovation that is considered to have the potential to improve adherence while also providing feedback.19,20) In recent times, applications with a remote monitoring function were utilized to enhance adherence among patients with hemophilia20) and musculoskeletal dysfunction.19) However, there remains limited information on the feasibility and effectiveness of these remote applications in improving adherence to HEPs. According to Lambert et al.19) more studies are needed to establish the clinical importance and benefits of HEP applications with remote support among people with musculoskeletal conditions by using freely available online software or other comparable technology towards improving adherence to HEPs. This study aimed to develop and test the feasibility of a remote support application (RSA) for improving HEP adherence.

MATERIALS AND METHODS

Participants

Participants for this experimental study were patients receiving physiotherapy for musculoskeletal conditions at the Physiotherapy Department of Obafemi Awolowo University Teaching Hospital Complex (OAUTHC), Ile-Ife, Nigeria. The following inclusion criteria were used: a musculoskeletal dysfunction (MSD), aged 18 years or older, and use of a physiotherapist-prescribed HEP. Patients with cognitive impairment were excluded. By using the stepped rules of thumb for a pilot study, with a standardized difference d≥0.7 and expected 80% power for the main trial, ten samples were needed for each group.22) In total, 19 patients met the inclusion criteria and were recruited into either the experimental group (n=10) or the control group (n=9) based on simple consecutive assignment. As the patients became available and consented to participate in the study, they were enrolled in the study register. Patients with odd serial numbers on the register were assigned to the experimental group, whereas those with even serial numbers were assigned to the control group. The decision to assign odd (heads) or even (tails) numbers to the experimental or control group was based on a coin flip carried out by one of the research team. The assessors and therapists were not blinded to the patients who enrolled in this study. The study was carried out between 21 June and 10 September 2021. The CONSORT flow diagram of participant selection is shown in Fig. 1.

Fig. 1.

CONSORT flow diagram showing the flow of patients through the study.

Device

Each patient assigned to the experimental group used a mobile phone or tablet device (Android® operating system) loaded with the RSA developed for this study. The Android® operating system was selected because it was the most commonly used operating system in the study setting. Patients in the control group used a diary to record their adherence to the HEP.

The RSA was assessed using the System Usability Scale (SUS) and the Mobile App Rating Scale (MARS). The SUS questionnaire assessed each user’s experience in terms of engagement, satisfaction, level of motivation, and perceived complexity of the RSA. The interpretation of user experience was based on ISO 9241–210 (Ergonomics of human–system interaction), which defines a user’s experience as “a person’s perceptions and responses that result from the use or anticipated use of a product, system, or service.” The SUS questionnaire presents ten statements about the perceived usability of the mobile application. Participants rate on a scale of 0–4 to indicate the extent to which they agree with the statement.23) The MARS questionnaire was used to assess application quality, esthetics, engagement, functionality, and the user’s experience. This questionnaire is recognized as a reliable multidimensional scale for classifying and rating the information quality of mobile applications.24)

Procedure

Before commencing this study, approval was obtained from the Ethics and Research Committee (ERC) of the Obafemi Awolowo University Teaching Hospital Complex, Ile-Ife, Nigeria (Protocol number: ERC/2021/06/27). This study was conducted in accordance with the CONSORT statement25) and was retrospectively registered on the Pan African Clinical Trial Registry (PACTR202310710523197). Written informed consent was obtained from all participants. Using standard computer programing, an RSA for a HEP was developed for mobile phone or tablet. The application allowed for individualized exercises/activities to be created for the patient and included reminders to carry out the exercises/activities, in addition to tracking the patient’s adherence. The RSA had dual interfaces for administration and user interaction. The administrator interface allowed users to be added to the database and allowed the administrator (researcher) to register, monitor progress, and interact with users by sending them data in form of exercises, descriptive clips, texts, and notifications (Fig. 2). The user interface allowed the user to access individualized data sent by the administrator. It also allowed the user to set automatic reminders for exercise sessions (with consideration of the patient’s daily routine) and to view progress (Fig. 3).

Fig. 2.

Examples of screenshots from the administrator area of the RSA.

Fig. 3.

Examples of screenshots from the user area of the RSA.

The mobile interface was set based on the patient’s characteristics, preferences, and clinical profile. Interfaces were based on a simple design to ensure that inexperienced or less skilled users of technology would find the application easy to use with only basic educational experience or qualifications.

The development of the RSA occurred in two stages. The first stage considered the design of the user experience/user interface (UX/UI) for the administrator and the user. The interface designs were developed by a product designer. These interfaces were then constructed on the Android® operating system by a product developer. Full disclosure of the purpose and procedure of the research was given to all consenting participants prior to the study. The RSA developed and used in this study is for research purposes only and does not have any financial or commercial interest. It is available from the authors on request.

All participants were assigned to either the experimental (RSA) group (n=10) or the control group (n=9). The experimental group received customized HEP reminders via the RSA, whereas the control group used conventional paper handouts for HEPs provided to them by the supervising physiotherapist. The participants in the control group were advised to keep a daily record of their adherence to the recommended HEPs in a dairy. They did not receive any encouragement nor were asked to provide feedback until their 2-week follow-up assessment when diaries were assessed.

All participants in the experimental group used mobile phones that ran the Android® operating system (version 8.0 or above). After individualized HEPs were configured on the RSA installed on the mobile devices, participants were instructed on how to navigate through the application. Participants were instructed to use the application for 4 weeks, and those who required further clarification on use of the application were allowed to call for assistance. Participants were advised to complete their HEPs as recommended by the supervising physiotherapist. Each time the RSA was opened or used by the patients, the researcher received notifications and could log patient activities. However, participants were assured of their privacy and safety and that none of their personal information would be remotely accessed. Adherence to HEPs through RSA use was assessed after the second and fourth weeks of the study. All participants using the RSA completed the SUS and MARS questionnaires. Because self-administration was used in this study, the participants required a basic standard of literacy.

Data Analysis

Data were summarized using the descriptive statistics of mean, standard deviation, median, interquartile range (IQR), frequency, range, and percentage. The chi-square test and Mann–Whitney U test were used to investigate differences in gender and age between the groups. The inferential statistics of the Mann–Whitney U test were used to compare effects between groups. The alpha level was set at P<0.05. Data analysis was carried out using SPSS version 28 (IBM, Armonk, NY, USA).

RESULTS

In this study, 52.6% of the participants were male and 47.4% were female. Most participants (73.7%) were aged 43–65 years with the remainder (26.3%) aged 18–42 years. The mean age of the participants was 48.4±13.5 years. Each group included five men. The mean age of the participants was 47.5±13.5 years in the experimental group and 49.5±13.6 years in the control group. There was no significant difference between the groups in terms of age or gender (P>0.05). Clinical characteristics of the patients are presented in Table 1. The most commonly affected sites among the participants were the lower limbs (42.1%), whereas the neck regions (5.3%) showed the lowest involvement. The most common type of injury was post-immobilization stiffness secondary to fracture (31.6%). The prescribed home programs were varied and used 13 different exercises amongst the 19 patients. The more commonly used exercises included grip strengthening exercises (15.8%), supine heel slides (15.8%), prone press-ups on elbows (10.5%), and supine triceps extension (10.5%).

Table 1. Clinical characteristics of participants

CharacteristicControl group (n=9)Experimental group (n=10)Total (n=19)
Affected area
 Neck0 (0)1 (10.0)1 (5.3)
 Upper limb4 (44.4)3 (30.0)7 (36.8)
 Lower limb2 (22.2)6 (60.0)8 (42.1)
 Lower back3 (33.3)0 (0)3 (15.8)
Injury/condition type
 Bilateral knee OA0 (0)1 (10.0)1 (5.3)
 Frozen shoulder1 (11.1)0 (0)1 (5.3)
 Low-back pain3 (33.3)0 (0)3 (15.8)
 Neck pain0 (0)1 (10.0)1 (5.3)
 PIMSF3 (33.3)3 (30.0)6 (31.6)
 Piriformis syndrome0 (0)1 (10.0)1 (5.3)
 Round shoulder1 (11.1)0 (0)1 (5.3)
 Unilateral knee OA2 (22.2)3 (30.0)5 (26.3)
Exercise
 Ankle pump exercise1 (11.1)0 (0)1 (5.3)
 Bridging exercise1 (11.1)0 (0)1 (5.3)
 Doorway pectoralis stretch1 (11.1)0 (0)1 (5.3)
 Grip strengthening exercise2 (22.2)1 (10.0)3 (15.8)
 Lateral neck flexion stretch0 (0)1 (10.0)1 (5.3)
 Piriformis stretch0 (0)1 (10.0)1 (5.3)
 Prone press-ups on elbows2 (22.2)0 (0)2 (10.5)
 Seated knee flexion and extension0 (0)1 (10.0)1 (5.3)
 Shoulder wall-climb stretch1 (11.1)0 (0)1 (5.3)
 Squatting with support0 (0)1 (10.0)1 (5.3)
 Supine hamstring stretch1 (11.1)0 (0)1 (5.3)
 Supine heel slides0 (0)3 (30.0)3 (15.8)
 Supine triceps extension0 (0)2 (20.0)2 (10.5)

Data presented as number (percentage).

OA, osteoarthritis; PIMSF, post-immobilization stiffness secondary to fracture.

The mean scores from the SUS and MARS questionnaires are presented in Table 2. The mean total usability rating score (from SUS) was 82.5±9.04 (out of 100). The mean score for the total app quality rating (from MARS) was 76.0±4.98 (out of 95). The mean score for the subjective app quality rating (from MARS) was 16.6±2.43. The scores for engagement (19.6±1.07), functionality (16.1±1.56), and information (28.1±3.12) were relatively high. The mean scores for the perceived impacts of the RSA on the knowledge, attitudes, intentions, and behavior change in relation to the importance of adherence to HEPs are presented in Table 3. The total mean score was 24.5±2.41 (out of 30). The results showed that use of the RSA primarily led to increased levels of awareness and increases in other parameters. After 2 weeks, the median (IQR) adherence to HEPs was 10.0 (4.5) sets (out of 28 sets) for the control group (paper handouts) and 15.5 (3.0) sets for the experimental group (RSA). After 4 weeks, the median (IQR) adherence to HEPs was 14.0 (3.5) sets for the control group and 20.5 (1.5) sets for the experimental group. The adherence rate after 2 weeks was significantly higher for the experimental group [median diff.=−6.0, 95% confidence interval (CI): −8.0 to −5.0; U=5.00; Z=−3.304; P= 0.001; r=0.75]. After 4 weeks, the participants in the experimental group showed a significant increase in adherence to HEPs when compared with the control group (median diff.=−7.0, 95% CI: −8.0 to −5.0; U=0; Z=−3.695; P<0.001; r=0.84).

Table 2. App quality rating and system usability scores for the RSA (n=10)

RatingParticipant scoreRange
MinimumMaximum
App quality scrs
 Engagement19.6±1.071823
 Functionality16.1±1.561419
 Esthetics12.2±1.65714
 Information28.1±3.122234
App quality mean score76.0±4.986987
Subjective quality rating
 App subjective quality score16.6±2.431220
App usability score of RSA
 Total app usability score82.5±9.046692

Participant scores given as mean±standard deviation. App quality scores and subjective quality score from MARS questionnaire; total app usability score from SUS questionnaire.

Table 3. Mean scores for perceived impact of the RSA on user knowledge, attitude, intentions, and behavior change in relation to the importance of adherence to HEPs (n=10)

App effectScoreMinimumMaximum
Awareness4.32±0.5835
Knowledge3.84±0.8935
Attitude4.00±0.7535
Intention to change4.21±0.7135
Help seeking4.16±0.9035
Behavior change3.95±0.9125
Total mean score24.5±2.412129

Scores given as mean±standard deviation.

DISCUSSION

Despite the rapid uptake of digital applications within the health community, there has been little attempt at providing and validating an RSA to promote adherence to HEPs in the field of physiotherapy. The aim of this study was to develop and test the feasibility of an RSA for HEP adherence, as well as to assess the usability of the application among users. The results showed that adherence to recommended HEPs for patients using the RSA was higher than the adherence shown by patients using the conventional approach. There are limited studies on the use of RSAs to improve adherence to HEPs among patients with MSDs; however, their benefits have been reported in other studies.19,20) The results of the current study confirm the earlier reports. Beyond the method employed by Lambert et al.,19) where self-reported adherence was used to determine the effect of online software for HEP adherence, the RSA used in the current study calculated the patient’s adherence, which could be monitored through the administrator dashboard of the application. This new approach helps to minimize the chances of poor completion rates, inaccurate recall, and self-presentation bias, which are factors already noted by other investigators.26) Furthermore, the RSA utilized in this study was designed to allow for individualized HEPs that could be monitored remotely by triggering an alert when the patient starts and completes a HEP session. These features help the monitoring of HEPs and are valuable for providing feedback to patients.

The findings of this study showed that the RSA for adherence to HEPs had high scores for usability, quality, and ability to change health behavior. In addition, there was a significant increment in adherence to HEPs through use of the RSA. It can be inferred that the RSA is a credible and reliable tool to improve patient adherence to HEPs. In the present study, the participants gave a high rating for the quality of the RSA, especially in the areas of engagement, functionality, and information. These features have been reported to be important in the uptake and continued use of health-related apps.27) A report released by a software company claimed that only 8% of users continued to use medical and fitness apps 7 days after installation because of a lack of or poor engagement and functionality features (see https://www.braze.com/blog/app-customer-retention-spring-2016-report). Another study reported that most patients only use medical apps a few times after initial exposure.28) In the present study, no participant in the experimental group was lost to follow-up and none discontinued the intervention during the 4 weeks of the study. Furthermore, the adherence rate among this group increased from the 2-week assessment to the 4-week assessment, suggesting that the application was easy to use with good functionality. Other factors that have been mentioned in the literature as being responsible for poor continued use of medical apps include a lack of interactive, feedback, and self-monitoring features.29) The RSA in the present study had these features and may be responsible for the high ratings of patients.

This study has some limitations. First, the generalizability of the findings of this study is limited to patients with MSDs and those with basic literacy. Second, the lack of blinding to the participants in this study may be a source of performance and detection bias. This may have affected the internal validity of the findings through possible underestimation or overestimation of the intervention effect. Nonetheless, considering the pilot nature of this study, the findings will serve as preliminary data for a full-size randomized clinical trial. In this study, the RSA attributes of satisfaction, usability, acceptance, and quality were assessed using MARS and SUS questionnaires, in addition to adherence, which is an associated clinical outcome. The findings showed that use of the RSA enhanced the adherence to HEPs when compared with conventional methods using paper handouts. However, further studies should be carried out to ascertain the long-term effectiveness of RSAs.

CONCLUSION

This study examined the feasibility of using an RSA to encourage adherence to HEPs by comparison with the conventional method of using paper handouts. The use of RSAs is feasible for the improvement of patient engagement and to improve adherence to HEPs among patients with musculoskeletal dysfunctions.

ACKNOWLEDGMENTS

The authors thank the study participants for their assistance.

CONFLICTS OF INTEREST

The authors declare no conflict of interest.

REFERENCES
 
© 2023 The Japanese Association of Rehabilitation Medicine

This is an open-access article distributed under the terms of the Creative Commons Attribution Non-Commercial No Derivatives (CC BY-NC-ND) 4.0 License.
https://creativecommons.org/licenses/by-nc-nd/4.0/deed.ja
feedback
Top