Technologies to Support Assessment of Movement During Video Consultations: Exploratory Study

Understanding and assessing patients' body movements is essential for physical rehabilitation but is challenging in video consultations, as clinicians are frequently unable to see the whole patient or observe the patient as they perform specific movements.

The objective of this exploratory study was to assess the use of readily available technologies that would enable remote assessment of patient movement as part of a video consultation.

We reviewed the literature and available technologies and chose four technologies (Kubi and Pivo desktop robots, Facebook Portal TV, wide-angle webcam), in addition to help from a friend or a simple mobile phone holder, to assist video consultations. We used 5 standard assessments (sit-to-stand, timed "Up & Go," Berg Balance Test, ankle range of motion, shoulder range of motion) as the "challenge" for the technology. We developed an evaluation framework of 6 items: efficacy, cost, delivery, patient setup, clinician training and guidance, and safety. The coauthors, including 10 physiotherapists, then took the roles of clinician and patient to explore 7 combinations of 5 technologies. Subsequently, we applied our findings to hypothetical patients based on the researchers' family members and clinical experience.

Kubi, which allowed the clinician to remotely control the patient's device, was useful for repositioning the tablet camera to gain a better view of the patient's body parts but not for tracking movement. Facebook Portal TV was useful, but only for upper body movement, as it functions based on face tracking. Both Pivo, with automated full body tracking using a mobile phone, and the wide-angle webcam for a laptop or desktop computer show promise. Simple solutions such as having a friend operate a mobile phone and use of a mobile phone holder also have potential. The setup of these technologies will require better instructions than are currently available from suppliers, and successful use will depend on the technology readiness of patients and, to some degree, of clinicians.

Technologies that may enable clinicians to assess movement remotely as part of video consultations depend on the interplay of technology readiness, the patient's clinical conditions, and social support. The most promising off-the-shelf approaches seem to be use of wide-angle webcams, Pivo, help from a friend, or a simple mobile phone holder. Collaborative work between patients and clinicians is needed to develop and trial technological solutions to support video consultations assessing movement.