Abstract
Background Studies aiming to objectively quantify upper limb movement disorders during functional tasks using wearable sensors have recently increased, but there is a wide variety in described measurement and analyzing methods, hampering standardization of methods in research and clinics. Therefore, the primary objective of this review was to provide an overview of sensor set-up and type, included tasks, sensor features and methods used to quantify movement disorders during upper limb tasks in multiple pathological populations. The secondary objective was to select the most sensitive sensor features for symptom detection and quantification and discuss application of the proposed methods in clinical practice.
Methods A literature search using Scopus, Web of Science, and PubMed was performed. Articles needed to meet following criteria: (1) participants were adults/children with a neurological disease, (2) (at least) one sensor was placed on the upper limb for evaluation of movement disorders during functional tasks, (3) comparisons between: groups with/without movement disorders, sensor features before/after intervention, or sensor features with a clinical scale for assessment of the movement disorder. (4) Outcome measures included sensor features from acceleration/angular velocity signals.
Results A total of 101 articles were included, of which 56 researched Parkinson’s Disease. Wrist(s), hand and index finger were the most popular sensor locations. The most frequent tasks for assessment were: finger tapping, wrist pro/supination, keeping the arms extended in front of the body and finger-to-nose. The most frequently calculated sensor features were mean, standard deviation, root-mean-square, ranges, skewness, kurtosis and entropy of acceleration and/or angular velocity, in combination with dominant frequencies and power of acceleration signals. Examples of clinical applications were automatization of a clinical scale or discrimination between a patient/control group or different patient groups.
Conclusion Current overview can support clinicians and researchers to select the most sensitive pathology-dependent sensor features and measurement methodologies for detection and quantification of upper limb movement disorders and for the objective evaluations of treatment effects. The insights from Parkinson’s Disease studies can accelerate the development of wearable sensors protocols in the remaining pathologies, provided that there is sufficient attention for the standardisation of protocols, tasks, feasibility and data analysis methods.
1 Introduction
The execution of functional tasks requires fine-tuned coordination of multiple upper limb joints, which is often disturbed in individuals with movement disorders [1-3]. Movement disorders can be defined as “a neurological syndrome in which there is either an excess of movement or a paucity of voluntary and automatic movements” and are the consequence of lesions in the basal ganglia, cerebellum or thalamus brain regions. They are present in a variety of neurological diseases and can occur in every phase of the life cycle [4]. Prevalence of movement disorders increases with age, up to 28% in a general population over 50 years old and 50% for individuals over 80 years old [5]. In several neurologic diseases, movement disorders belong to the main symptom of the disease. In childhood, neurologic movement disorders are most often associated with a diagnosis of dyskinetic cerebral palsy (CP) or with primary dystonias (i.e., inherited or idiopathic dystonias) with a prevalence of 25-50/100 000 and 15-30/100 000, respectively [6-8]. In individuals over the age of 50 years, the prevalence of primary dystonia increases to 732/100 000 [9]. In the elderly, the most prevalent condition causing movement disorders is Parkinson’s disease (PD), reporting a prevalence of 1-2 per 1000 adults [10].
Movement disorders lead to slower movement execution, increased movement variability and a decrease in functionality [11-15]. Both in early-onset and late-onset movement disorders, accurate evaluation is indispensable for the follow-up of the disease course – especially in progressive movement disorders – and to evaluate and optimize the effect of treatment strategies. Currently, the effect of an intervention program on upper limb function or the presence and/or severity of movement disorders is mostly evaluated using clinical assessment scales such as functional scales and movement disorder severity scales [16-18]. The Unified Parkinson’s Disease Rating Scale (UPDRS), the Movement Disorders Society revised version of this scale (MDS-UPDRS) and the Hoehn and Yahr scales are currently the most often used assessment scales in PD, whereas the Essential Tremor Rating Assessment Scale is used to rate the severity of essential tremor during nine functional tasks [19-22]. To evaluate the severity of ataxia, the Scale for the Assessment and Rating of Ataxia (SARA) is most often applied [23]. In stroke, the Wolf Motor Function Test (WMFT) and Fugl-Meyer Assessment (FMA) are mainly used to evaluate motor function post-stroke [19, 21, 24-26]. The Action Research Arm Test (ARAT), Box & Block test, Nine Hole Peg Test and Jebsen-Taylor Test evaluate hand function in multiple pathologies, amongst other multiple sclerosis (MS) and stroke, whereas the Monkey Box test was recently developed to evaluate bilateral motor function in Huntington’s Disease (HD) [27-29]. For children with CP, the Melbourne Assessment is a validated measure for upper limb activity [30, 31]. Apart from upper limb activity evaluation scales, the severity of movement disorders such as dystonia can be evaluated with the Burke–Fahn–Marsden Dystonia Rating Scale (BFMDRS) or the Dyskinesia Impairment Scale (DIS) in children and adolescents with dyskinetic CP [32, 33].
A common drawback of all abovementioned activity and movement disorder severity assessment scales is that they have to be evaluated by clinicians through the use of standardized guidelines or definitions with respect to task execution or presence/severity of the movement disorder. This clinical judgement induces subjectivity, as not all clinicians may interpret a definition or guideline in exactly the same manner. Moreover, the attribution of scores by a clinician based on video recordings is time-consuming, especially if frequent monitoring is required to evaluate disease progression or the effect of an intervention.
In an effort to reduce the subjective aspect in the evaluation of movement disorders, motion analysis has been widely introduced as an alternative to objectify movement disorders, as well as to evaluate the effect of treatment interventions in PD [34, 35], CP [36-38] and stroke [39-41]. While three-dimensional motion analysis is the gold standard in movement analysis, it requires a specially equipped expensive laboratory whereby patients need to visit the hospital or study center for study participation or assessment of rehabilitation.
With both the time-consuming aspect of clinical scoring and the location-restricted aspect of three-dimensional motion analysis as main drivers, multiple studies have recently attempted to automate clinical scales with the use of wearable sensors or inertial measurement units (IMUs). These devices are attractive because of their ease-of-use and portability, omitting the necessity for a standardized laboratory which is in particular relevant for long-time follow-up or home-based measures for less mobile patients. IMUs measure linear acceleration and angular velocity of the segment they are placed on, whereas accelerometers measure only acceleration and gyroscopes measure only angular velocity. Specific features derived from acceleration and angular velocity measures can be used to characterize (pathological) movement patterns during multiple tasks or daily life activities. The use of wearable sensors for objective assessment has been previously discussed in PD [42], but this overview focused on all symptoms of PD, consequently providing very little information on specific upper limb tasks. Similarly, Tortelli and colleagues discussed the use of portable digital sensors in HD, whereby the focus was mostly on the assessment of activity and gait [43]. In dyskinetic CP, a recent review discussed instrumented measures for the assessment of dyskinetic CP symptoms, but this scope was not limited to IMUs and therefore less detailed on the topic [44]. While these previous reviews provide much needed insights in the domain of each pathology, an overarching view of sensor protocols and features for the assessment of movement disorders during upper limb tasks could enhance standardisation of data collection. Such standardisation facilitates multi-centre studies and international collaborations and comparison between characteristics of movement disorders between diseases. Therefore, the primary objective of this review was to provide an overview of sensor set-up and type, included tasks, sensor features and methods that are used to evaluate movement disorders during upper limb tasks in multiple pathological populations. The secondary objective was to select the most sensitive sensor features for symptom detection and quantification and describe the application of the proposed methods in clinical practice.
2 Methods
Search strategy
The full literature search was conducted following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines [45]. A literature search using three different databases was performed: Scopus, Web of Science, and PubMed until July 2022. Following terms were used in “all fields”:
#1: sensor OR inertial measurement unit; #2: arm OR upper limb; #3: movement disorder
Subsequently, all three databases were searched for #1 AND #2 AND #3.
Article screening
Articles (n = 990) retrieved from the literature search were extracted. An overview of the articles retained at each stage of the screening process can be found in the PRISMA flow diagram presented in Figure 1 [45]. Any duplicated articles, retrieved by more than one database, were removed by de-duplication based on congruity in authors, title, and year of publication.
Unique articles (n = 903) were screened by I.V. for inclusion according to the criteria below in two consecutive stages: (1) title-abstract; and (2) full-text screening.
Articles were screened for inclusion along a set of pre-defined eligibility criteria for (1) the title-abstract and (2) the full-text screening stages. These criteria were designed in line with the PICO/PECO framework [46], which clarifies the review objectives and inclusion criteria across four domains: (P) it was required that the participants were adults or children with a neurological disease subsequently leading to a movement disorder in (but not limited to) the upper limb. (I/E) a minimum of one wearable sensor was placed on the upper limb for the evaluation of movement disorders during the execution of an upper limb task. (C) multiple comparisons were possible: i) a group with movement disorders compared with a healthy group, ii) comparison of sensor features before and after an intervention or iii) comparison of sensor features with scores of a clinical scale. (O) Outcome measures needed to include sensor features derived from acceleration or angular velocity signals. Studies from the same authors who mentioned the exact same features in the same population as a study that was already included were excluded. Additionally, to meet the inclusion criteria, articles were required to be original research containing empirical data. Finally, only articles published after the year 2000 were included.
Data extraction
Relevant information from each included article was extracted in a custom-made Excel based (Microsoft Office, Microsoft, Redmond, WA, USA) data extraction form. Information regarding goal population, sensor type, number of sensors, location of sensor(s), included tasks, sensor features and statistical method was obtained to address objective 1. To address objective 2, the sensitivity and/or responsiveness of the sensor features were extracted for the articles that provided the contribution of individual sensor features. Finally, the clinical application of the proposed method was extracted.
3 Results
General information
From the 166 full-text articles screened for eligibility, 62 were finally included. Additionally, 39 articles were included from citations of screened articles. The full-text articles that were screened but excluded and the reasons for exclusion can be found in Supplementary Material S1.
Of the included studies, 56 included adults with PD [11, 47-101], of which 46 assessed one or multiple symptoms of PD and 10 studies specifically focused on Parkinsonian tremor [91-100]. Twelve studies included patients with essential tremor [102-113] and 11 included adults post-stroke [15, 28, 114-122], whereas six included adults with MS [123-128]. One study included adults with HD and eight studies included children or adults with ataxia [29, 129-136]. Five studies included children with CP while two studies included children with dystonia and spasticity, respectively [12, 13, 137-141] (Figure 2).
Type, number and location of sensors
Table 1 provides an overview of type and number of sensors used, and their respective location for all included studies. From the 101 identified studies, 24 studies used an accelerometer [29, 47-49, 51, 53, 54, 56, 63, 89, 91, 94, 96, 104, 111, 115, 116, 119, 120, 127, 134, 138, 140, 142], 13 studies measured motion with a gyroscope or angular sensor [50, 52, 58-61, 64, 73, 79, 105, 108, 110], four studies collected motion data using an orientation sensor, motion sensor or magnetic motion tracker [13, 55, 80, 114], 58 studies used IMUs including an accelerometer and gyroscope [11, 12, 15, 28, 57, 62, 65, 67-72, 74-78, 81-88, 90, 93, 98-101, 106, 107, 109, 112, 113, 117, 118, 121-123, 125, 126, 128, 129, 131-137, 139, 141, 143, 144] and three studies included IMUs but only used the acceleration signal for further analysis [102, 103, 107], while one study used IMUs but only processed angular velocity signals [97].
The number of sensors ranged from one to 17. Thirty-seven studies used only one sensor, either on the finger, hand, wrist or forearm [15, 50-52, 59, 61, 63, 68, 69, 72, 75, 79, 84, 89, 91, 94, 96, 97, 99, 100, 104, 106, 108, 109, 112-114, 117, 118, 122-124, 126, 127, 131, 134, 140], while seven studies used two sensors bilaterally placed on the hand or wrist [60, 66, 78, 81, 82, 133, 137]. Nine studies used two sensors of which the majority placed one on the thumb and one the index finger [54, 58, 64, 70, 71, 73, 85, 88, 101], while Martinez-Manzara et al. used one sensor on the hand and one on the finger [67], Samotus et al. and Rahimi et al. put one on the wrist and one on the index finger [95, 111] and Shawen et al. put one on the hand and one on the wrist [86]. In the studies where three sensors were used, the most frequent locations for PD and tremor were hand, forearm and upper arm [74, 92, 102, 116], index finger, hand, forearm [105, 110] or index finger, forearm and upper arm [132, 135]. In children with CP, Newman et al. attached one sensor on the sternum and two on both upper arms [12] and in HD, Bennasar et al. placed one sensor on the sternum and two on the wrists [29]. In stroke, Van Meulen et al. fixed one sensor on the wrist, sternum and sacrum [121]. When four sensor were used, sensor placements were: three fingers and the wrist in PD [83], thumb, index finger, wrist and upper arm in stroke [119], hand, forearm, upper arm and shoulder in spasticity [141], hands and forearms [90, 103] and wrists, trunk and head in PD [76]. Four more studies also included lower limb sensors, where three placed sensors on both wrists and ankles and Zwartjes et al. included wrist, foot, thigh and sternum [57, 77, 87, 139]. Four studies used five sensors on the upper limbs, with sensor placement on hand, wrist, upper arm, shoulder and sternum in MS [125, 128], thumb, index finger, hand, forearm, upper arm and sternum for Di Biase et al. and hand forearm, upper arm, head and back for Sanger et al. (note that both studies are based on magnetic or orientation sensors) [13, 80]. Seven studies used six sensors, where the sensor placement was thumb, index finger, hand, forearm, upper arm and sternum [115, 120]. Two studies placed the sensors on hands, forearms and upper arms [98, 107], while Krishna et al. used one sensor but subsequently fixed it on both hands, wrists and ankles, thus including six sensor signals in the analysis [129]. Cheralu et al. placed sensors on the hand, scapula, thorax, sacrum, head and shank, while Tsipouras et al. attached sensors bilaterally on ankles and wrists and one the waist and chest [55, 62]. Repnik et al. used seven sensors on the hands, wrists, upper arms and sternum and Hof et al. and Keijsers et al. placed the sensors on the wrists, upper arms, trunk and upper legs [28, 47, 48]. Five studies used eight sensors. Delrobaei et al. placed the sensors on the hands, wrists, upper arms, and shoulders and Bonato et al. on the forearms, upper arms, thighs, right shin and sternum [49, 65]. Patel et al. and Cole and colleagues attached the sensors on the forearms, upper arms, shins and upper legs [53, 56], whereas in ataxia, Kashyap and colleagues placed sensors on the index finger, hand, wrist, foot, sternum, back and ankles [136]. Finally, Van den Noort et al. used 11 sensors, all located on the hand and fingers [11] and Delrobaei and colleagues used 17 sensors placed on the hands, wrists, upper arms, clavicle’s, sternum, head, pelvis, upper and lower legs and feet [93]. In one study, the number of sensors was not specified [138].
Upper limb tasks
The upper limb tasks occurring in more than one study are presented in Figure 3. Wrist pro/supination was included in 25 studies [11, 50, 52, 53, 58, 60, 65, 69, 72-74, 76, 78-83, 86, 88, 101, 106, 129, 132, 144] whereas finger tapping was included in 24 studies [11, 49, 51, 54, 58, 59, 61, 64, 67, 69, 71-73, 79, 80, 83, 85, 88, 101, 131, 136, 144-146]. Keeping arms in front of the body was included in 23 studies [52, 66, 91, 93, 95, 97-100, 103-105, 107-113, 125-128], as well as finger-to-nose [13, 53, 76, 86, 91, 97-99, 104, 108, 112, 113, 124-129, 132, 133, 135, 136, 144]. Drinking from a can/cup was included in 13 studies [47, 48, 52, 57, 62, 76, 86, 87, 107, 113, 117, 120, 141], and opening/closing of the hand in seven studies [11, 58, 69, 71, 83, 88, 101] as well as writing/drawing [52, 76, 77, 86, 102, 106, 113]. Eating was included in six studies [48, 52, 68, 77, 84, 87] as well as pouring water [76, 86, 108, 113, 126, 127] whereas reaching/grasping objects was included in five studies [117, 121, 126, 127, 137]. Teeth brushing was included in four studies [52, 68, 77, 84] as well as putting clothes on/off [47, 48, 77, 87]. In stroke, the Wolf Motor Function test or parts of this clinical scale were included four times [115, 118-120] and four studies measured activities in an unrestricted home environment [63, 89, 134, 139]. Combing hair was included in three studies [52, 77, 87] as well as typing and folding laundry [76, 77, 86] and forwards and sideways reaching [12, 114, 116]. Tasks from the ARAT were included in two studies [28, 123]. Finally, following tasks were included once: the monkey box test [29], the box and block test [90], holding a weight with the wrist [96], wrist extension [75], wrist ab/adduction, flexion/extension, elbow flexion/extension and pro/supination [92], and following a bent wire shape with a wand loop [104]. One study included wrist supination/flexion, hand behind back and wrist flexion/pronation [15]. In CP, one study included outwards reaching [13], one included the drinking test, the bean bag test and the nine hole peg test [141] while Strohrmann et al. included turn around cards, pick up small objects, stack dominos, open & close & bottle, use a key, and the nine-hole peg test [137]. Kim et al. included the Jebsen Taylor Hand Function Test, the Quality of Upper Extremity Skills Test and the Box and Blocks Test [138].
Sensor features
Table 2 provides an overview of the calculated sensor features in the time-and frequency domain, as well as a formula or feature description when given in the original study. As an easy and straightforward feature, execution time was often calculated for the upper limb tasks for stroke [15, 28, 117], MS [123], PD [11, 49, 54, 71, 75, 80], tremor [102, 144], CP [137] and ataxia [132, 134]. The frequency of movements was popular in multiple studies in PD, mostly in repetitive tasks such as finger tapping and pro/supination [64, 83].
For the studies where both acceleration and angular velocity signals were collected, both mean and standard deviation (STD) were often calculated [62, 78, 86, 87, 90, 118, 129, 139], as well as root-mean-square (RMS) values [11, 86, 89, 129, 139]. Additionally, mean and RMS or STD of acceleration and angular velocity separately were used in studies were one of the signals was available [29, 50, 52, 54, 57, 63, 64, 66, 71, 74, 82, 83, 85, 89, 96, 104, 105, 108, 110, 111, 115, 119, 120, 132-134, 137], as well as median angular velocity in one study [82]. Maximal linear velocity was additionally often used as key feature, mostly by integration of the acceleration signal [51, 54, 115]. The range of angular displacement or range of motion was only used in studies in PD [58-60, 69, 79, 83], mainly to assess hypokinesia. The range of acceleration and angular velocity was included in PD [53, 54, 75, 80, 86, 89, 122], tremor [133] and CP [12, 137], as well as the inter-quartile range for PD [82, 89]. The range of jerk and angular acceleration was used in one study in PD [72].
Peak-to-peak and magnitude of angular velocity were additionally used in PD [73, 77, 80, 87], whereas Repnik and colleagues calculated a rotational jerk index for angular velocity values to evaluate hand rotation in stroke [28]. Finally, a study in PD used the square root of the sum of squares of jerk signals and named this feature ‘segment velocity’ [48].
As basis statistical features, kurtosis and skewness were popular in PD [66, 76, 78, 86, 87, 118], but not in other populations apart from one ataxia study [134]. With respect to signal dynamics, multiple forms of entropy were used, most commonly sample entropy and approximate entropy in PD [53, 55, 62, 66, 70, 76, 86], stroke [120] and ataxia [136] and Shannon entropy and permutation entropy in PD [87], dyskinetic CP [139] and HD [29]. Fuzzy entropy was additionally calculated in two ataxia studies [131, 144]. Apart from entropy, the Gini index and Lyapunov exponent were additionally used as a measure of signal complexity in PD [87], ataxia [131] and HD [29]. The same HD study additionally used recurrence rate, determinism and average diagonal line to evaluate signal dynamics [29].
For signal smoothness, RMS of jerk was often used as a straightforward measure in PD [118] and stroke [115, 116], as well as a jerk metric for which multiple definitions were given, mostly RMS jerk normalized over time/peak velocity or mean jerk [12, 15, 76, 89, 90, 115, 123, 139, 141]. Additionally, smoothness measures were also described as the difference between movement accelerometer readings and smoothed readings, number of movement units or number of speed peaks [114, 122, 141].
Coefficient of variation was often used as a measure of variability or rhythm for different signals such as excursion angle [58, 69, 79, 101], (angular) velocity [58, 64, 79], amplitude [64, 71] and movement frequency [64, 83, 144], while two studies in PD defined ‘rhythm’ via the STD of intervals of a finger tapping movement [51] and any sequence of regularly occurring events [67]. Finally, a stroke study defined variability as the RMS error between a reference trial and a warped trial [117]. Considering the geometrical structure of a non-linear time-series, Newman et al. included Higuchu’s fractional dimension in children with CP [12].
With respect to orientation and rotational information, correlation between the different axes of the accelerometer or gyroscope was often included as a feature in PD [76, 86, 89, 99], HD [29] and stroke [115]. Additionally, the peak of the normalized cross-correlation from pairs of acceleration time series and the lag of first peak in autocorrelation acceleration were included in two PD studies [53, 56]. Concerning trajectories and travelled distances, multiple studies used different definitions for this feature. 3D hand trajectory and length of 3D trajectory [121] and path-length ratio were used in stroke [114], while the index of curvature (deviation from a straight line) was used in dyskinetic CP [13]. Elevation angle was included in a CP study, while in stroke, the similarity of hand trajectories was used [12, 28]. Two studies in patients with ataxia used mean and standard deviation of Euclidian distance from the mean trajectory and curved and straight-line similarity analysis [132, 135]. In PD, Heldman et al. used a bradykinesia index, based on variability in time and amplitude of task execution whereas Tamas et al. and Garza-Rodriguez and colleagues quantified hypokinesia using velocity decrement, which is defined as a decrease in velocity between subsequent data parts [69, 82].
In the frequency-domain, the dominant frequency component of acceleration/angular velocity or both was most often used [47, 53, 84, 87, 91, 94, 97-99, 104, 112, 115, 126, 127, 129], while only three studies included the second dominant frequency or dominant frequency of jerk [87, 115, 136]. Energy in the frequency spectrum was often included in multiple populations, both for the acceleration signal [49, 53, 56, 66, 115, 119, 120], angular velocity signal [100] or both [15, 62, 129]. One PD study additionally included amplitude and dominant frequency of modulations associated with the acceleration signal as well as fractal dimension [49], while one HD study included the average magnitude of the first five Short-Term-Fourier-Transfer components [29]. Apart from the frequency, power in specific frequency bands was a popular feature in multiple populations, including spectral power [68, 77, 84, 87, 102, 113, 118, 140], peak power [59, 60, 73, 87, 94], total power [59, 60, 73, 80, 99, 102, 104, 105, 110, 125, 134], mean power [63] and band power [139]. Considering entropy in the frequency domain, spectral entropy was used in two PD studies [62, 87] and one ataxia study [131], as well as component entropy in HD [29]. Spectral Arc Length was used as a measure of smoothness in two PD studies and one CP study [12, 73, 80]. For tremor studies, tremor frequency and tremor amplitude [109] were included as well as multiple specific tremor indices: Carpinella et al. defined the tremor index as the ratio of tremor (defined by peaks in the frequency spectrum) and the norm of angular velocity [124]. Western et al. defined average tremor amplitude as the product of frequency bins, sampling period and the signal’s power spectral density [128], whereas Benito-Leon et al. and McGurrin et al. used the mean logarithmic tremor power and tremor rotational amplitude/amplitude respectively, based on identified peaks in the power spectrum [103, 106].
Statistical method used
Figure 4 gives a representation of the statistical methods used in the included studies. Forty-five studies included between-or within-group comparisons using statistical tests [12, 13, 28, 47, 51, 55, 58-60, 62-65, 69, 70, 73, 75, 79, 80, 85, 89, 90, 92-94, 96-98, 102, 104, 105, 109, 111, 114, 117, 123, 124, 131, 134, 137, 140-142, 144], mainly parametric and non-parametric ANOVA and parametric and non-parametric t-tests, whereas 43 studies used machine learning [15, 29, 48, 49, 53, 55-57, 62, 63, 66, 67, 72, 74-78, 81-84, 86-89, 100, 102, 112, 113, 115, 118-120, 122, 126, 129, 132, 133, 135, 136, 139, 144]. Twenty-five studies evaluated correlation of sensor features with clinical scales [12, 28, 51, 52, 54, 59, 60, 65, 70, 71, 80, 93, 103, 106-108, 110, 127-129, 131, 133, 134, 138, 144], whereas nine studies used regression analysis for a similar purpose [13, 54, 101, 102, 109, 116, 121, 133, 137]. Finally, five studies used only descriptive statistics or observation without hypothesis testing [11, 68, 91, 99, 125] and two studies evaluated ROC curves [61, 133]. The sum of these numbers does not add up to 101, because multiple studies used multiple of the abovementioned methods. Eleven studies used both statistical tests for comparison between groups and correlation with a clinical scale [12, 28, 59, 60, 65, 70, 71, 80, 93, 131, 134], whereas five studies used statistical tests and machine learning [55, 62, 63, 75, 89]. Yokoe et al. used both logistic regression and correlation with a clinical scale in PD [54]. In patients with ataxia, Tran et al. used statistical tests, correlation with a clinical scale and machine learning [144] and Oubre et al. used statistical tests, regression, correlation with a clinical scale and machine learning [133]. In participants with essential tremor, Ali et al. used statistical tests, regression analysis and machine learning [102] and Sprdlik et al. used statistical tests, ROC curves and regression analysis [109]. In CP, Sanger et al. used both regression analysis and ANOVA/t-tests [13], and Strohrmann et al. used a t-test, to subsequently continue with a linear regression for the features that were significantly different between groups [137].
Sensitivity and/or responsiveness of most prevalent sensor features
Table 3 provides an overview of the features included by more than five articles, the number of articles reporting sensitivity of the specific feature and the number of articles that identified a significant difference between groups, severity levels or pre/post intervention.
RMS of angular velocity was reported in 18 studies, with sensitivity results for 11 studies. In PD, Van den Noort et al. found significantly higher RMS values for ON vs OFF dopaminergic medication, while Summa et al. did not find a significant difference between medication states [11, 73]. Espay et al. found 25% improvement in RMS values after dopaminergic medication in PD patients [58]. Kwon et al. and Luksys et al. found significant higher RMS angular velocity values for PD patients in comparison with controls, whereas two studies found a correlation of -0.78 between RMS angular velocity and clinical scores of the UPDRS [59, 60, 79, 98]. Additionally, Heldman et al. found a correlation of -0.78 between RMS angular velocity values and the modified bradykinesia rating scale [101] and Salarian et al. found good correlation between RMS angular velocity values and the UPDRS bradykinesia subscore, as well as good correlation between RMS angular velocity of the roll axis and the tremor subscore of the UPDRS [52]. In patients with tremor, spearman correlation between RMS angular velocity and tremor severity scores ranged from 0.19 (finger-to-nose) to 0.73 (keeping arms extended in front of the body) for Lopez-Bianco et al. [108] and between 0.41 and 0.70 for Kwon et al. [110], whereas Heo et al. found lower RMS angular velocity values after electrical stimulation [105].
Seventeen studies reported mean acceleration as a feature, but only two PD studies and one ataxia study discussed its sensitivity. Romano et al. found lower mean acceleration for PD patients in comparison with the control group, while Zwartjes et al. did not find significant differences between ON and OFF stimulation states of deep brain stimulation [57, 90]. In patients with Ataxia, Samotus et al. found lower mean acceleration after botulinum-toxin-A injections [111]. Execution time was included in 17 studies, with reported sensitivity for 11 studies. Execution time significantly differed between different severity levels [28] and between healthy controls and patients with stroke [28, 117] and MS [123, 124] and between the paretic and non-paretic arm in children with unilateral CP [12]. Execution time was significantly longer for PD patients in comparison with healthy controls [75, 80] and for patients with multiple system atrophy of parkinsonian type and progressive supranuclear palsy in comparison with healthy controls [71]. Third, execution time was significantly different between the ON and OFF medication state in PD patients [11]. In CP, execution time was one of the three features to best estimate upper limb performance in a regression analysis [137].
The dominant frequency domain was included in 15 studies, but only Hoff et al. reported individual contributions of this feature, reporting that amplitude in 1-4Hz and 4-8Hz frequency bands correlated with the modified Abnormal Involuntary Movement Scale [47]. Peak power was included in 12 studies, of which six discussed its individual sensitivity. Jun et al. reported a good correlation between peak power and clinical bradykinesia scores and Kim et al. reported decreasing peak powers with increasing UPDRS scales steps [59, 60], while Makabe et al. reported increasing peak powers with increasing severity stages of the Hoehn and Yahr scale [94]. Similarly, Summa et al. reported increases in peak power in ON vs OFF medication state [73]. In essential tremor, Heo et al. reported higher peak power after electrical stimulation [105] and Kwon et al. reported high correlation between peak power and tremor severity scores [110].
Sample entropy was included in 11 studies, but only two PD studies reported its sensitivity. Chelaru et al. found significantly higher entropy for dyskinetic PD patients in comparison with non-dyskinetic PD patients, as well as Liu et al. who found a significant difference between PD patients and healthy controls and good correlation with UPDRS scores [55, 70]. RMS of angular displacement was included in 11 studies, of which ten reported sensitivity. Tamas et al. found significant differences in RMS amplitude before and after subthalamic stimulation and Espay et al. found significant differences between ON and OFF medication state in PD [58, 69]. Kwon et al. found significantly lower RMS amplitudes for PD patients in comparison with controls and Jun et al. found decreasing angular displacement with increasing bradykinesia scores, but this was based on visual observation [60, 79]. Chan et al. found higher values for angular displacement for patients with PD with tremor in comparison with essential tremor [92]. Kim et al. additionally found a significant difference between PD patients and controls [59], whereas Heldman et al. found a correlation of -0.81 between RMS excursion angle and clinical scores [101]. Delrobaei et al. found a higher tremor severity score (which was composed of the RMS values of angular velocity) for tremor-dominant PD patients in comparison with non-tremor dominant PD patients and good correlation between tremor severity score and UPDRS scores [93]. In essential tremor, Kwon et al. and Chan et al. found correlations ranging from 0.29-0.66 and 0.80-0.93 respectively, between RMS angular displacement and tremor severity scores [107, 110]. Energy and STD of acceleration were included in 10 studies, but none reported sensitivity.
RMS of acceleration was included in 10 studies, but only van den Noort et al. discussed its specific contribution in PD patients, reporting increased RMS acceleration in ON vs OFF medication state during a finger tapping and opening/closing of the hand task [11]. Mean angular velocity was also included in 10 studies with six of them reporting sensitivity. In PD, three studies found lower mean angular velocity for PD patients in comparison with healthy controls [64, 71, 90], whereas one study additionally identified significant differences between ON/OFF DBS stimulation [52]. Garza-Rodriguez et al. found lower angular velocity values for PD patients with higher clinical severity [81]. In patients with ataxia, Oubre et al. found significant differences between patients and healthy controls [133].
Jerk metrics were calculated in nine studies with five reporting on its sensitivity. Romano et al. used the dimensionless jerk index as a jerk metric and found a significant difference between PD patients and healthy controls, while Habets et al. did not find a significant difference between ON and OFF medication state in PD patients [89, 90]. Carpinella et al. found a significantly higher jerk measure for patients with MS in comparison with healthy controls and a negative correlation between the jerk measure and ARAT score (r = -0.90) [123]. In children with unilateral CP, Newman and colleagues found a significantly higher normalised jerk index for the paretic arm in comparison with the non-paretic arm, but no correlation with the Melbourne Assessment Scale [12]. In children with spasticity, the normalized jerk score improved significantly after botulinum-toxin A injections [141].
Coefficient of variation (CoV) was included in eight studies, where CoV of time and amplitude was mostly calculated to evaluate bradykinesia. Djuric-Jovicic and colleagues found significant differences between PD patients and healthy controls for both CoV of time and amplitude, whereas Lee et al. found significant differences for CoV of speed, amplitude and frequency between PD patients and controls [64, 71]. Kwon et al. additionally found significant differences between PD patients and controls for the CoV of angles and velocity [79]. Tamas et al. found that the coefficient of variation – also called ‘rhythm’ – improved significantly after bilateral and contralateral subthalamic stimulation, whereas Espay et al. found significant differences between ON and OFF medication state for CoV in PD patients [58, 69].
Spectral power was used in seven studies of which four reported sensitivity. Bravo et al. compared power spectral density (PSD) plots between PD patients and healthy controls and found both higher and lower PSD amplitude for PD patients in comparison with healthy controls, depending on the individual [68]. In patients with dystonia, Legros et al. found a decrease of the area under the spectrum curve after deep brain stimulation surgery [140]. Ali et al. found higher PSD ratios for patients with essential tremor in comparison with healthy controls [102], whereas Heldman et al. found correlations from 0.77-0.83 between the logarithm of peak power and the UPDRS scores [113]. The range of acceleration was additionally calculated in seven articles, but only two articles reported its sensitivity. Rabelo et al. found a significantly higher acceleration range for healthy controls in comparison with PD patients, while Habets et al. did not find a significant difference between ON and OFF medication state in PD patients [75, 89]. Approximate entropy was also included in seven studies, but only two PD studies included its sensitivity, where Liu et al. and Luksys et al. found significant differences between PD patients and a control group [70, 98].
Range of angular displacement was calculated in six studies, but only four discussed its sensitivity. Djuric et al. reported a higher range for healthy controls in comparison with PD patients, whereas van den Noort et al. reported lower displacement in the ON vs OFF medication state and improved amplitude in the ON compared to OFF state [11, 71]. Romano et al. found significant differences between PD patients and healthy controls for wrist flexion and shoulder movements and Salarian et al. found significantly lower angular displacements at the level of the wrist for PD patients compared to healthy controls [52, 90]. Energy of acceleration in the frequency domain and STD of acceleration were included in 11 articles, but all of them included these features as part of a feature set for machine learning, without discussing its individual contribution.
Mean acceleration and angular velocity were included in six studies, but only Romano et al. found significantly lower mean acceleration and angular velocity in PD patients in comparison with healthy controls [90]. Correlation between axes was included in six studies, but only Zhu et al. reported no significant differences in correlations when comparing PD patients in ON and OFF medication state [99]. Kurtosis and skewness were additionally included in six studies, but none of them reported the contribution of the individual features.
Clinical application
Figure 5 presents an overview of the clinical application of the included studies. Fifty-two studies used sensor features for the automatization of a clinical scale [15, 29, 49, 51-54, 56, 57, 59, 60, 63, 65, 67, 72, 76-78, 81-84, 86-88, 93, 100, 101, 103, 106-108, 110, 112, 113, 115, 116, 118-123, 126-129, 131, 133, 137-139]. Sixteen studies used sensor features to evaluate the effect of an intervention [47, 48, 50, 55, 58, 68, 69, 74, 89, 99, 104, 105, 111, 140-142], whereas 35 studies used the obtained features to discriminate between patients and controls or between different patient groups [11-13, 28, 61, 62, 64-66, 70-73, 75, 79, 80, 85, 90-94, 96-98, 102, 109, 117, 124, 125, 132, 134-136, 144]. Four studies subsequently discriminated between different severity levels [28, 65, 72, 114]. Again, there was some overlap in clinical applications: Delrobaei et al., Spasojevic et al. and Repnik et al. compared control and patient groups as well as severity levels within the patient group, while also correlating sensor features with a clinical scale [28, 65, 72]. Kamper et al. compared a patient and control group but also compared severity levels separately [114].
4 Discussion
The primary objective of this systematic review was to provide an overview of sensor set-up and type, included tasks, sensor features and statistical methods that are used to evaluate movement disorders during upper limb tasks in multiple pathological populations. We identified 101 studies in eight pathological conditions using wearable sensors placed on the upper limb during upper limb tasks and including at least one sensor feature based on linear acceleration or angular velocity. Of all included studies, 55% were studies in PD, 12% were studies with essential tremor patients, 11% were studies in stroke patients, 8% were studies in adults or children with ataxia, 6% were studies including participants with MS and 5% included children with CP. Adults with HD and spasticity and dystonia in children represented only 1% of the included studies. When comparing these numbers with the prevalence of the abovementioned conditions, an important imbalance emerges. Worldwide, approximately 101 million people are living post-stroke [147], 25 million people live with essential tremor [148], 17 million people live with CP [149], 10 million people are estimated to live with PD [150-152], approximately 0.2 to 3 million people live with ataxia, depending on the type [153, 154] and 0.2 to 0.5 million people live with HD, depending on the geographical area [155, 156]. While stroke is much more prevalent than PD or essential tremor, this ratio is not reflected in the number of available studies per condition. More surprisingly, where CP is the most prevalent neurological childhood condition included apart from stroke and essential tremor, its high prevalence does not agree with the number of studies investigating the associated movement disorders using wearable sensors. Current findings thus identify a mayor gap between prevalence of a condition and insights in the related movement disorders. Especially for early-onset conditions such as CP, more insights in the disturbed movement patterns from an early age could benefit targeted therapy and long-term treatment management.
The abundance of included PD studies reflects its more advanced state-of-the-art assessment in comparison with other pathological populations. These insights offer opportunities and learning experiences for clinicians and researchers aiming to bridge the gap between technology and clinical measures in the quantitative evaluation of movement disorders. Although wide-spread in research, the clinical implementation of IMU-based analysis of movement disorders is lacking in clinical practice in all populations, mainly due to the lack of validation of algorithms in real-world conditions [157].
With respect to sensor type, IMUs containing both an accelerometer and gyroscope were most often used, where a time-related trend was clearly visible in the included PD studies: between 2000 and 2010, all PD studies included either an accelerometer or a gyroscope, whereas after 2010, IMUs were almost exclusively used. This trend is presumably supported by technological advancements, allowing more sensors in a smaller device with longer battery life combined with more affordable prices for IMUs.
Sensor location, number of included sensors and upper limb tasks were separately discussed to provide a comprehensive overview, but conclusions should be drawn on a combination of these settings as they are closely inter-related. E.g., five out of the ten studies that placed one sensor on the index finger included the finger tapping task [51, 59, 61, 69, 113] and of the nine studies who placed a sensor one the thumb and index finger, all included finger tapping [54, 58, 64, 70, 71, 73, 85, 88, 101]. When more sensors were used both on the distal and proximal upper limb, tasks ranged from distal upper limb tasks (pro/supination) [65, 74] to a myriad of tasks such as the ARAT [28]. Finally, the four studies that measured activities in a home environment all placed sensors on the wrist, mostly likely due to the high comfort and ease of use of wrist-worn sensors [63, 89, 134, 139].
The collection of upper limb tasks included in the selected studies reflects the insight that the choice of upper limb task is heavily dependent on the movement disorder. The high prevalence of finger tapping and wrist pro/supination in the PD studies follows from their presence in the Motor Examination part of the (MDS-)UPDRS [20], whereas the finger-to-nose task and keeping arms extended in front of the body are part of both the (MDS-)UPDRS and the Essential Tremor Rating Assessment Scale [22]. Both tasks are well-suited to quantify decrease and slowness of movements. Since these scales are well implemented in clinical practice, patients are often requested to perform these tasks in the presence of a neurologist. In stroke, the Wolf Motor Function Task was most popular, presumably because this scale is used in daily practice for the evaluation of upper extremity rehabilitation progress. An important notion is that the aetiological differences between PD/tremor on the one hand and CP, stroke and dystonia on the other hand influence the potential of task execution. In CP and stroke, functional ability can be impaired to a level where execution of specific functional tasks is not possible, which requires a very different approach in comparison with PD or tremor, where most tasks can be executed but performance may be impaired. When the level of physical impairment prohibits the execution of specific tasks, one should focus on monitoring of the movement disorders during home-based activities such as powered mobility (e.g. joy-stick steering) or in rest positions in the case of severe CP or stroke [139].
The secondary objective was to identify the most sensitive sensor features for symptom detection and quantification and describe the application of the proposed methods in clinical practice. Similar to the requested tasks, the derived sensor features were dependent of the movement disorder under investigation. Mean amplitude, movement/amplitude decrement and RMS, range and IQR of angular displacement were only used in PD studies and are hypothesized to correlate with the definition of hypokinesia (reduction in movement amplitude) in the (MDS-)UPDRS. Range and RMS of angular displacement can detect differences between PD and TD groups and quantify the severity of hypokinesia, implying that these features can be used in clinical practice as simply interpretable triggers of movement reduction. Velocity decrement and peak-to-peak, magnitude, IQR and mean of angular velocity were additionally only used in PD studies and are hypothesized to relate to the bradykinesia (slowing of movement) aspect in the (MDS-)UPDRS, emphasizing their clinical usefulness for early detection of bradykinesia symptoms [81]. Coefficient of variation of both amplitude and velocity as well as rhythm, were included to reflect the interruptions as described in the (MDS-)UPDRS. CoV values are easy to calculate and interpret and showed to be sufficiently sensitive to discriminate between medication and stimulation states in PD patients from both finger- and wrist-worn sensors. This parameter could thus be implemented to evaluate objective intervention effects in large-scale medication or stimulation studies. In essential tremor and studies focusing on tremor in PD patients, occurrence and amplitude of peaks in specific frequency bands as well as power in these frequency bands were most often included, owing to the rhythmical aspect of tremor. However, the selected frequency bands were not always similar. The 4-12Hz frequency band was most often considered as tremor [102, 113], while Heo et al. and Kwon et al. used 3-12Hz [105, 110], Patel et al. used a 3-8Hz band and Schaefer et al. considered 7-12Hz as the tremor frequency [53, 96]. Makabe et al. used a range of 8-12Hz and 20-25Hz and Sprdlik et al. used the frequency distribution for highest maxima between 1-15Hz [94, 109]. Lopez-Bianco et al. used a high-pass filter with cut-off 4Hz followed by low-pass filter with cut-off 8Hz [108]. These differences suggest that a solid definition of tremor frequency is required in order to standardize instrumented tremor quantification, to allow comparison of methodologies on a large-scale cross-sectional level and to facilitate data merging and sharing.
In pathologies not related to PD or tremor, path length or similarity of hand trajectories were calculated. This was the case in stroke, dyskinetic CP and spasticity, reflecting the importance of the impact of the movement disorder on reaching movements. The frequent use of sensor features such as smoothness and jerk metrics might reflect the effect of the location of the brain lesions on the smooth execution of functional tasks and its impact on daily-life activities in these pathologies.
The clinical application of the included studies varied from discrimination of groups to prediction of severity levels and was closely related to the method used to obtain this specific result. With respect to the discrimination of groups, the sensor features sufficiently sensitive to detect differences between a control group and pathological patients could be used for early detection of e.g. PD or MS symptoms, allowing for early intervention and possibly preventing rapid worsening of symptoms. For the prediction of severity levels, all PD studies correlated the sensor features to the (MDS-)UPDRS (or specific sub-items), the AIMS or the Hoehn & Yahr scale. In CP and stroke, sensor features were correlated with the Melbourne Assessment Scale and ARAT, whereas in another CP study, the Jebsen-Taylor Test, the Quality of Upper Extremity Skills Test (QUEST) and the Box and Blocks Test were included. When the clinical application was the (side)effect of intervention, six out of 16 studies used sensor features to assess dyskinesia in PD patients, as this is a well-known levodopa-induced motor complication [158]. The (MDS-)UPDRS, Hoehn & Yahr and Essential Tremor Rating Assessment Scale are severity scales, while the Melbourne Assessment Scale, the ARAT, the Jebsen-Taylor Test, the Quality of Upper Extremity Skills Test and the Box and Blocks Test evaluate upper extremity function. In stroke and CP however, the severity of the movement disorder is dependent on the location of the brain lesion, which was not studied in detail in the included studies and has not been fully elucidated to date in most movement disorders. To this end, wearable sensors provide opportunities for detailed exploration of the connection between the location of the brain lesion and the aetiology and severity of movement disorders.
IMUs have mostly been used to assess upper limb use and for detection of activity periods in daily life in patients with PD and/or essential tremor [159-161], CP [162-164] or stroke [165], but their application to quantify movement disorders in the upper limb is less extensive. Activity measures mostly focus on the amount of time that acceleration measures exceed a pre-defined threshold (e.g., Activity Index), which yields information about the quantity of movement, but not about the quality. To facilitate follow-up of intervention or long-term rehabilitation programs, a combined assessment of both movement quantity and quality can provide more insights in both the presence and severity of movement disorders. Ideally, long-term monitoring is executed in a home-environment (i.e., low patient-burden while collecting long-term data), while a contact moment to record pathology-related tasks in a standardized setting could be added to the study protocol since this allows more specific data analysis, e.g., through the presence of video recordings of the performed tasks.
The lessons learned from the PD studies in the current review can accelerate the development of wearable sensors protocols in the remaining pathologies, provided that there is sufficient attention for the standardisation of protocols, tasks, feasibility and data analysis methods. These conditions could facilitate reproduction of studies, large-scale multi-centre studies and merging of study results in the near future. The insights provided in current review highlight the potential of wearable sensors for symptom detection and evaluation in CP, stroke, HD, MS and dystonia, but a larger international research focus is urgently required to meet those needs.
Conclusions and future directions
Wearable sensors offer a myriad of opportunities for the quantification of movement disorders in multiple pathologies, but the abundance of available information could threaten its usability. Our findings illustrate that there are a lot of similarities between pathology-related sensor protocols and tasks, but the agreement is yet not sufficient to allow data pooling or international multi-centre studies. For this purpose, higher-level standardisation with respect to task selection and sensor feature extraction per pathology is strongly recommended. Although multiple sensors can provide a lot of information, researchers should think carefully about the balance between information gain and accessibility. One sensor on the index finger for PD or on the wrist for other pathologies could be attached in a non-obstructive way, allowing for better adherence and less missing data due to e.g., battery loss. Current overview can support clinicians and researchers to select the most sensitive pathology-dependent sensor features and measurement methodologies for detection and quantification of upper limb movement disorders and for the objective evaluations of treatment effects.
Data Availability
All data produced in the present study are available upon reasonable request to the authors
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
5 Author Contributions
IV: Conceptualisation, methodology, analysis, data curation, writing-original draft, visualisation. HH: Methodology, writing-reviewing and editing. JDV: Writing-reviewing and editing. EVW: Reviewing and editing. HF: Writing-reviewing and editing. KD: Writing-reviewing and editing. J-MA: Writing-reviewing and editing. EM: Conceptualisation, writing-reviewing and editing, supervision, project administration, funding acquisition.
6 Funding
IV received an FWO fellowship (Fonds Wetenschappelijk Onderzoek Vlaanderen). The funder had no involvement in study design, collection, analysis and interpretation of data, writing of the report, or in the decision to submit the article for publication.
8 Supplementary Material
Supplementary Material should be uploaded separately on submission, if there are Supplementary Figures, please include the caption in the same file as the figure. Supplementary Material templates can be found in the Frontiers Word Templates file.
Please see the Supplementary Material section of the Author guidelines for details on the different file types accepted.
9 Data Availability Statement
The data that support the findings of this study are available from the corresponding author upon reasonable request.
7 Acknowledgments
The author would like to thank M.N. and S.B. for their help throughout the systematic review process.
References
- 1.↵
- 2.
- 3.↵
- 4.↵
- 5.↵
- 6.↵
- 7.
- 8.↵
- 9.↵
- 10.↵
- 11.↵
- 12.↵
- 13.↵
- 14.
- 15.↵
- 16.↵
- 17.
- 18.↵
- 19.↵
- 20.↵
- 21.↵
- 22.↵
- 23.↵
- 24.↵
- 25.
- 26.↵
- 27.↵
- 28.↵
- 29.↵
- 30.↵
- 31.↵
- 32.↵
- 33.↵
- 34.↵
- 35.↵
- 36.↵
- 37.
- 38.↵
- 39.↵
- 40.
- 41.↵
- 42.↵
- 43.↵
- 44.↵
- 45.↵
- 46.↵
- 47.↵
- 48.↵
- 49.↵
- 50.↵
- 51.↵
- 52.↵
- 53.↵
- 54.↵
- 55.↵
- 56.↵
- 57.↵
- 58.↵
- 59.↵
- 60.↵
- 61.↵
- 62.↵
- 63.↵
- 64.↵
- 65.↵
- 66.↵
- 67.↵
- 68.↵
- 69.↵
- 70.↵
- 71.↵
- 72.↵
- 73.↵
- 74.↵
- 75.↵
- 76.↵
- 77.↵
- 78.↵
- 79.↵
- 80.↵
- 81.↵
- 82.↵
- 83.↵
- 84.↵
- 85.↵
- 86.↵
- 87.↵
- 88.↵
- 89.↵
- 90.↵
- 91.↵
- 92.↵
- 93.↵
- 94.↵
- 95.↵
- 96.↵
- 97.↵
- 98.↵
- 99.↵
- 100.↵
- 101.↵
- 102.↵
- 103.↵
- 104.↵
- 105.↵
- 106.↵
- 107.↵
- 108.↵
- 109.↵
- 110.↵
- 111.↵
- 112.↵
- 113.↵
- 114.↵
- 115.↵
- 116.↵
- 117.↵
- 118.↵
- 119.↵
- 120.↵
- 121.↵
- 122.↵
- 123.↵
- 124.↵
- 125.↵
- 126.↵
- 127.↵
- 128.↵
- 129.↵
- 130.
- 131.↵
- 132.↵
- 133.↵
- 134.↵
- 135.↵
- 136.↵
- 137.↵
- 138.↵
- 139.↵
- 140.↵
- 141.↵
- 142.↵
- 143.↵
- 144.↵
- 145.
- 146.↵
- 147.↵
- 148.↵
- 149.↵
- 150.↵
- 151.
- 152.↵
- 153.↵
- 154.↵
- 155.↵
- 156.↵
- 157.↵
- 158.↵
- 159.↵
- 160.
- 161.↵
- 162.↵
- 163.
- 164.↵
- 165.↵