Continuously Identifying Dyskinesia Periods in Parkinson's Disease with Body-Worn Sensors
Parkinson’s disease (PD) is a progressive neurodegenerative disorder that causes both motor and nonmotor deficits, which can be clinically observed and regulated with treatment. Motor symptoms include akinesia, bradykinesia, impaired balance, and tremor. Deficits typically fluctuate in severity on an hourly or daily basis. Time periods characterized by severe deficits are referred to as “off” periods, while periods of relatively normal function are considered “on” periods. Clinicians treat the symptoms of PD through the combined administration of Carbidopa/Levodopa medication, dopamine agonist medication, and voltage-controlled deep brain stimulation (DBS) devices. Overmedication or overstimulation can cause dyskinesia, an involuntary, often rhythmic or choreic, exaggeration of movements. As medication doses are increased with disease progression, dyskinesias become more prevalent. Clinicians aim to reduce both off and dyskinesia periods by prescribing the correct balance of medication and/or DBS treatments. Clinicians investigate the prevalence of dyskinesia, in part, by asking patients to retrospectively self-report the frequency of their dyskinesia periods over the several months prior to their clinical visit, a method subject to recall bias. Our goal in this study was to develop an objective system that identifies dyskinesia periods occurring over a 1-2 hour observational period from body-worn accelerometer data using signal analysis, feature extraction, and machine learning algorithms. We are using the results from this study to design a continuous system that automatically generates a time history of off and dyskinesia periods, which clinicians could use to optimize their prescription of PD treatments.
Eileen Kowler
Faculty: Project PI
What have you learned about Parkinson’s as a result of the monitoring, or what do you think can be learned?
Nathan Darnall
Hi Eileen, thank you for your question. I have learned that motor complications of Parkinson’s, such as dyskinesia, can be quantified and identified from body-worn sensors. Within our sample population, the reliability of the system is similar to that of a clinician. This finding has a great implication for people with Parkinson’s: they can automatically have their symptoms monitored by daily wearing a watch-shaped sensor, without requiring personal monitoring from their clinician.
On a more personal note, I’ve really enjoyed getting to know the Parkinson’s volunteers in my studies! They are a highly motivated group of people, who strive for a better treatment or cure. Most volunteers are active in the community and are eager to give back, despite their impairments. I often find they challenge me to be a better person.
Ayelet Gneezy
Faculty
my question is related to that of Eileen: is there a way for you to “quantify” the value of your research? In other words, can you link your results (current, or those you hope to have by the time you complete this project), with increase in treatment efficiency?
more important, do you think that data from a set of participants (even if a very large one) could be used for treatment of all/most patients, or would one need to take hese measures for each patient (periodically) in order to provide beter care?
Kristopher Irizarry
Faculty: Project Co-PI
What additional data would you like to collect assuming that the accelerometer works the way you hope it does? Can you think of a way in which medication could be automatically delivered in response to data collected from the watch? How might the dose be tailored in response to the additional data you would like to collect?
Nathan Darnall
Kristopher, in our latest study, we are collecting periodic data that indicates off periods, mood, drowsiness, mental capability, and gait. We are interested in our ability to identify off periods, as well as fluctuating non-motor symptoms such as depression/mood and mental clarity, which greatly impact the quality of life in Parkinson’s. Clinicians treat nonmotor symptoms different than motor symptoms, so a mood tracking system would be valuable to them.
Regarding automatic medication dosing, probably the easiest way to do this is not through medication but through deep brain stimulation (DBS) settings such as voltage. DBS can induce dyskinesia when the voltage is too high, but the correct amount of stimulation can reduce tremor and other motor complications. The dyskinesia monitoring system could potentially act as a feedback control to adjust DBS voltage within an acceptable range.
Nathan Darnall
Ayelet, Yes, it is possible to conduct a study that would quantify the efficacy of this system coupled with clinical treatment in reducing dyskinesia. Because the clinician is still an integral part of the treatment and would only use the system to inform them of patients’ symptoms, the study would need a control group that is treated by clinicians without access to information from the dyskinesia monitoring system. Also, because motor symptoms and complications fluctuate in Parkinson’s, the study would need to be conducted over several months or years to draw conclusions with greater certainty.
Regarding your second question, this is a really great question we have discussed at length with neurologists. Because each person displays different forms of dyskinesia, and variations also occur over the progression of the disease, the system would need to be “robust” in the sense of identifying all possible types of dyskinesia and classifying to the type that is being presented at the time of sensor observation. Our sample size of 19 participants is far too small to establish a power factor across the entire Parkinson’s population. Likewise, we have not conducted a study that tracks dyskinesia changes with time within individuals. However, the identification accuracy we reported on the poster is across all participants in the study, and is quite high. Preliminarily, we anticipate the system may be able to generalize across the entire Parkinson’s population if it was trained on a large and diverse enough sample population. One of the reasons we think this is because we are calculating a set of 20 features per sensor signal that are designed to capture the critical aspects of different types of dyskinesia reported in the literature. The machine learning algorithm has the ability to select the most important features in identifying dyskinesia across the sample population used to train the algorithm.
Timothy Waring
Faculty
Interesting! I am interested in how you calibrated the decision tree classifier system. How many parameters does the system use, and did you have to initialize them? If so, what data did you use?
Nathan Darnall
Timothy,
The decision tree classifier classifies 20 features per sensor (total of 100 features per participant wearing 5 sensors) into dyskinesia and nondyskinesia periods using visually observed dyskinesia periods as the target class. The decision tree trains on the data set, then validates using 10-fold cross validation. Each instance of 100 features are derived from 1 minute moving time windows of accelerometer data, so there is one instance per 1 minute window. All instances from all participants were included in the training and validation. For a nominal 1.5 hour observation period per participant, this totals about 102600 instances. The tree build nodes based on which feature reduced the classification entropy the most at the level of the node.
Timothy Waring
Faculty
Excellent response! Thank you.
Mary Gauvain
Faculty: Project Co-PI
Is it possible in the course of your research to assess the utility of this technique in relation to the currently used subjective report measure to understand their relation to each other as well as the validity of the subjective report measure? What do you predict? If the two sets of findings are inconsistent, what are the implications? On the other hand, if they are consistent, how would this impact your research?
Nathan Darnall
Mary, this is an insightful question. It is interesting because we are currently using observed dyskinesia as our “gold standard” to train our algorithms, even though inter- and intra- rater reliabilities are variable and well documented. When we use human-observed dyskinesia in the algorithm training, we would not expect our algorithms to have greater reliability than the human observers. You ask, is it possible to have greater greater reliability with the machine learning system? Yes, I suspect it is because the system is identifying quantifiable features (such a peak frequencies, energies, amplitudes, etc.) that are documented in the literature as describing dyskinesia, some features of which may not be detectable by human observers. To further investigate this possibility, we have plans to conduct cluster analysis, in which the machine learning algorithms groups features into clusters based on similarities in the data. Although the algorithm would not identify the clusters as belonging to dyskinesia or not, if we could correlate known dyskinesia periods to data within a cluster we could identify that cluster with dyskinesia. This method could potentially surpass the reliability of human observers.