How Can Affect Be Detected and Represented in Technological Support for Physical Rehabilitation?

Temitayo A. Olugbade; Aneesha Singh; Nadia Bianchi-Berthouze; Nicolai Marquardt; Min S. H. Aung; Amanda C. de C. Williams

doi:10.1145/3299095

journal article Open Access Jan 30, 2019

How Can Affect Be Detected and Represented in Technological Support for Physical Rehabilitation?

Temitayo A. Olugbade Aneesha Singh

Nadia Bianchi-Berthouze Nicolai Marquardt Min S. H. Aung Amanda C. de C. Williams

ACM Transactions on Computer-Human Interaction Vol. 26 No. 1 pp. 1-29 · Association for Computing Machinery (ACM)

View at Publisher Save 10.1145/3299095

Abstract

Although clinical best practice suggests that affect awareness could enable more effective technological support for physical rehabilitation through personalisation to psychological needs, designers need to consider what affective states matter, and how they should be tracked and addressed. In this article, we set the standard by analysing how the major affective factors in chronic pain (pain, fear/anxiety, and low/depressed mood) interfere with everyday physical functioning. Further, based on discussion of the modality that should be used to track these states to enable technology to address them, we investigated the possibility of using movement behaviour to automatically detect the states. Using two body movement datasets on people with chronic pain, we show that movement behaviour enables very good discrimination between two emotional distress levels (F1=0.86), and three pain levels (F1=0.9). Performance remained high (F1=0.78 for two pain levels) with a reduced set of movement sensors. Finally, in an overall discussion, we suggest how technology-provided encouragement and awareness can be personalised given the capability to automatically monitor the relevant states, towards addressing the barriers that they pose. In addition, we highlight movement behaviour features to be tracked to provide technology with information necessary for such personalisation.

Topics

No keywords indexed for this article. Browse by subject →

References

97

[1]

10.1109/acii.2013.87

[2]

10.1007/s12193-013-0123-2

[3]

10.1109/fg.2013.6553796

[4]

David DeVault , Ron Artstein , Grace Benn , Teresa Dey , Ed Fast , Alesia Gainer , Kallirroi Georgila , Jon Gratch , Arno Hartholt , Margaux Lhommet , Gale Lucas , Stacy Marsella , Fabrizio Morbini , Angela Nazarian , Stefan Scherer , Giota Stratou , Apar Suri , David Traum , Rachel Wood , Yuyu Xu , Albert Rizzo , and Louis-Philippe Morency . 2014 . SimSensei kiosk: A virtual human interviewer for healthcare decision support . In Proceedings of AAMAS. 1061--1068 . David DeVault, Ron Artstein, Grace Benn, Teresa Dey, Ed Fast, Alesia Gainer, Kallirroi Georgila, Jon Gratch, Arno Hartholt, Margaux Lhommet, Gale Lucas, Stacy Marsella, Fabrizio Morbini, Angela Nazarian, Stefan Scherer, Giota Stratou, Apar Suri, David Traum, Rachel Wood, Yuyu Xu, Albert Rizzo, and Louis-Philippe Morency. 2014. SimSensei kiosk: A virtual human interviewer for healthcare decision support. In Proceedings of AAMAS. 1061--1068.

[5]

10.1016/j.cviu.2015.12.004

[6]

10.1007/978-3-319-32703-7_71

[7]

10.1109/taffc.2016.2537327

[8]

10.1016/j.procs.2016.04.072

[9]

10.1109/cvprw.2016.191

[10]

Christian Schönauer , T. Pintaric , H. Kaufmann , S. Jansen-Kosterink , and M. Vollenbroek-Hutten . 2011. Chronic pain rehabilitation with a serious game using multimodal input . In Proceedings of ICVR. 1--8. Christian Schönauer, T. Pintaric, H. Kaufmann, S. Jansen-Kosterink, and M. Vollenbroek-Hutten. 2011. Chronic pain rehabilitation with a serious game using multimodal input. In Proceedings of ICVR. 1--8.

[11]

10.1145/2556288.2557268

[12]

10.1016/j.brat.2016.08.016

[13]

10.1016/s0304-3959(01)00344-x

[14]

Dennis Turk . 2015. Generalization and maintenance of performance . In Fordyce's Behavioural Methods for Chronic Pain and Illness . C. Main, F. Keefe, M. Jensen, J. Vlaeyan, and K. Vowles (Eds.), IASP Press , Washington, DC , 415--427. Dennis Turk. 2015. Generalization and maintenance of performance. In Fordyce's Behavioural Methods for Chronic Pain and Illness. C. Main, F. Keefe, M. Jensen, J. Vlaeyan, and K. Vowles (Eds.), IASP Press, Washington, DC, 415--427.

[15]

10.1016/j.pain.2006.06.019

[16]

10.1145/2663204.2663261

[17]

10.1109/acii.2015.7344578

[18]

10.5555/3021319.3021331

[19]

10.1145/3025453.3025947

[20]

10.1016/j.ejpain.2005.06.009

[21]

The Prevalence of Chronic Pain in United States Adults: Results of an Internet-Based Survey

Catherine B. Johannes, T. Kim Le, Xiaolei Zhou et al.

The Journal of Pain 10.1016/j.jpain.2010.07.002

[22]

10.1016/j.jpain.2009.09.001

[23]

The Pain Consortium. 2016. UK Pain Messages. Pain News. The Pain Consortium. 2016. UK Pain Messages. Pain News.

[24]

10.1016/j.pain.2004.07.001

[25]

Fear-avoidance and its consequences in chronic musculoskeletal pain: a state of the art

Johan W.S. Vlaeyen, Steven J. Linton

Pain 10.1016/s0304-3959(99)00242-0

[26]

10.1037/0033-2909.119.1.95

[27]

10.1016/j.pain.2012.05.034

[28]

Using thematic analysis in psychology

Virginia Braun, Victoria Clarke

Qualitative Research in Psychology 10.1191/1478088706qp063oa

[29]

10.1016/s0031-9406(05)61298-9

[30]

10.1093/bja/87.1.144

[31]

10.1016/j.pain.2011.10.023

[32]

10.1097/ajp.0b013e3181f15d45

[33]

10.1016/j.apmr.2010.06.004

[34]

10.1109/t-affc.2012.16

[35]

Hatice Gunes , Caifeng Shan , Shizhi Chen , and YingLi Tian . 2015. Bodily expression for automatic affect recognition . In Emotion Recognition: A Pattern Analysis Approach ( 1 st ed.). Amit Konar and Aruna Chakraborty (Eds.), Wiley and Sons , 343--377. Hatice Gunes, Caifeng Shan, Shizhi Chen, and YingLi Tian. 2015. Bodily expression for automatic affect recognition. In Emotion Recognition: A Pattern Analysis Approach (1st ed.). Amit Konar and Aruna Chakraborty (Eds.), Wiley and Sons, 343--377.

[36]

10.1109/taffc.2015.2462830

[37]

Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications

Rafael A Calvo, Sidney D'Mello

IEEE Transactions on Affective Computing 10.1109/t-affc.2010.1

[38]

10.1300/j094v05n04_05

[39]

10.1016/s0268-0033(97)00065-x

[40]

Automatic pain quantification using autonomic parameters.

Steffen Walter, Sascha Gruss, Kerstin Limbrecht-Ecklundt et al.

Psychology & Neuroscience 10.3922/j.psns.2014.041

[41]

10.1007/s12530-016-9158-4

[42]

10.1016/j.pain.2009.03.020

[43]

10.1016/0304-3959(90)91072-q

[44]

10.1016/0304-3959(88)90160-1

[45]

10.1109/titb.2003.821322

[46]

10.1109/titb.2009.2022927

[47]

10.1016/s0268-0033(02)00032-3

[48]

10.1109/acii.2009.5349358

[49]

10.1109/acii.2013.53

[50]

10.21437/interspeech.2016-1339

Showing 50 of 97 references

Metrics

40

Citations

97

References

Details

Published: Jan 30, 2019
Vol/Issue: 26(1)
Pages: 1-29
License: View

Authors

T

Temitayo A. Olugbade