Optimized Assessment of Physical Rehabilitation Exercises using Spatiotemporal, Sequential Graph-Convolutional Networks
Ikram Kourbane
Panagiotis Papadakis
Mihai Andries
IMT Atlantique, Lab-STICC UMR 6285, team RAMBO, Brest, France
[Paper]
[Filtered KIMORE]

Abstract

Rehabilitation is the process of helping people regain or improve lost or impaired function due to injury, illness, or disease. To assist in tracking the progress of patients undergoing rehabilitation, this paper proposes a lightweight graph-based deep-learning model for the automatic assessment of physical rehabilitation exercises. The model takes as input the 3D skeleton sequence of a patient performing a movement and outputs a continuous quality score, as a means for patient supervision that could complement or even substitute the need for ordinary clinical exams. Two graph convolutional networks (GCNs) are sequentially employed to learn spatial and temporal features, the first learning key joint relationships per exercise category and the second exploiting frame correlation to focus on relevant parts of the input sequence. Furthermore, in order to enhance the significance of the scores derived from testing, we propose implementing a classification phase. This phase enables the regression model to produce scores exclusively for sequences specifically tailored to each exercise, which further ensures that an input sequence is assessed only if it corresponds to a complete movement demonstration. The evaluation of the proposed approach on the publicly available KIMORE and UI-PRMD datasets shows that our approach outperforms the state-of-the-art in terms of quality score prediction as well as in terms of efficiency.


Demo



Acknowledgements

This research was funded by the Région Bretagne and the Departement Council of Finistère - Conseil départemental du Finistère - through the ECFvisuL project, as well as the - Institut Carnot Télécom et Société numérique - through the FCEval project.
This research was guided by Dr. Brice Loddé, an occupational health doctor at CHRU Brest, who provided expertise on our data augmentation techniques..
This template was originally made by Phillip Isola and Richard Zhang for a colorful ECCV project; the code can be found here.