Optimality principles in sensorimotor control

Emanuel Todorov

doi:10.1038/nn1309

journal article Aug 26, 2004

Optimality principles in sensorimotor control

Emanuel Todorov

Nature Neuroscience Vol. 7 No. 9 pp. 907-915 · Springer Science and Business Media LLC

View at Publisher Save 10.1038/nn1309

Topics

No keywords indexed for this article. Browse by subject →

References

119

[1]

Chow, C.K. & Jacobson, D.H. Studies of human locomotion via optimal programming. Math. Biosci. 10, 239–306 (1971). 10.1016/0025-5564(71)90062-9

[2]

Hatze, H. & Buys, J.D. Energy-optimal controls in the mammalian neuromuscular system. Biol. Cybern. 27, 9–20 (1977). 10.1007/bf00357705

[3]

Davy, D.T. & Audu, M.L. A dynamic optimization technique for predicting muscle forces in the swing phase of gait. J. Biomech. 20, 187–201 (1987). 10.1016/0021-9290(87)90310-1

[4]

Collins, J.J. The redundant nature of locomotor optimization laws. J. Biomech. 28, 251–267 (1995). 10.1016/0021-9290(94)00072-c

[5]

Popovic, D., Stein, R.B., Oguztoreli, N., Lebiedowska, M. & Jonic, S. Optimal control of walking with functional electrical stimulation: a computer simulation study. IEEE Trans. Rehabil. Eng. 7, 69–79 (1999). 10.1109/86.750554

[6]

Anderson, F.C. & Pandy, M.G. Dynamic optimization of human walking. J. Biomech. Eng. 123, 381–390 (2001). 10.1115/1.1392310

[7]

Rasmussen, J., Damsgaard, M. & Voigt, M. Muscle recruitment by the min/max criterion—a comparative numerical study. J. Biomech. 34, 409–415 (2001). 10.1016/s0021-9290(00)00191-3

[8]

Nelson, W.L. Physical principles for economies of skilled movements. Biol. Cybern. 46, 135–147 (1983). 10.1007/bf00339982

[9]

Hogan, N. An organizing principle for a class of voluntary movements. J. Neurosci. 4, 2745–2754 (1984). 10.1523/jneurosci.04-11-02745.1984

[10]

Flash, T. & Hogan, N. The coordination of arm movements: an experimentally confirmed mathematical model. J. Neurosci. 5, 1688–1703 (1985). 10.1523/jneurosci.05-07-01688.1985

[11]

Pandy, M.G., Garner, B.A. & Anderson, F.C. Optimal control of non-ballistic muscular movements: a constraint-based performance criterion for rising from a chair. J. Biomech. Eng. 117, 15–26 (1995). 10.1115/1.2792265

[12]

Todorov, E. & Jordan, M.I. Smoothness maximization along a predefined path accurately predicts the speed profiles of complex arm movements. J. Neurophysiol. 80, 696–714 (1998). 10.1152/jn.1998.80.2.696

[13]

Smeets, J.B. & Brenner, E. A new view on grasping. Motor Control 3, 237–271 (1999). 10.1123/mcj.3.3.237

[14]

Uno, Y., Kawato, M. & Suzuki, R. Formation and control of optimal trajectory in human multijoint arm movement: Minimum torque-change model. Biol. Cybern. 61, 89–101 (1989). 10.1007/bf00204593

[15]

Nakano, E. et al. Quantitative examinations of internal representations for arm trajectory planning: minimum commanded torque change model. J. Neurophysiol. 81, 2140–2155 (1999). 10.1152/jn.1999.81.5.2140

[16]

Harris, C.M. & Wolpert, D.M. Signal-dependent noise determines motor planning. Nature 394, 780–784 (1998). 10.1038/29528

[17]

Harwood, M.R., Mezey, L.E. & Harris, C.M. The spectral main sequence of human saccades. J. Neurosci. 19, 9098–9106 (1999). 10.1523/jneurosci.19-20-09098.1999

[18]

Hamilton, A.F. & Wolpert, D.M. Controlling the statistics of action: obstacle avoidance. J. Neurophysiol. 87, 2434–2440 (2002). 10.1152/jn.2002.87.5.2434

[19]

Pandy, M.G., Zajac, F.E., Sim, E. & Levine, W.S. An optimal control model for maximum-height human jumping. J. Biomech. 23, 1185–1198 (1990). 10.1016/0021-9290(90)90376-e

[20]

Valero-Cuevas, F.J., Zajac, F.E. & Burgar, C.G. Large index-fingertip forces are produced by subject-independent patterns of muscle excitation. J. Biomech. 31, 693–703 (1998). 10.1016/s0021-9290(98)00082-7

[21]

Todorov, E. Cosine tuning minimizes motor errors. Neural Comput. 14, 1233–1260 (2002). 10.1162/089976602753712918

[22]

Fagg, A.H., Shah, A. & Barto, A.G. A computational model of muscle recruitment for wrist movements. J. Neurophysiol. 88, 3348–3358 (2002). 10.1152/jn.00621.2002

[23]

Ivanchenko, V. & Jacobs, R.A. A developmental approach aids motor learning. Neural Comput. 15, 2051–2065 (2003). 10.1162/089976603322297287

[24]

Loeb, G.E., Levine, W.S. & He, J. Understanding sensorimotor feedback through optimal control. Cold Spring Harb. Symp. Quant. Biol. 55, 791–803 (1990). 10.1101/sqb.1990.055.01.074

[25]

Hoff, B. A Computational Description of the Organization of Human Reaching and Prehension. Ph.D. Thesis, Univ. Southern California (1992).

[26]

Hoff, B. & Arbib, M.A. Models of trajectory formation and temporal interaction of reach and grasp. J. Mot. Behav. 25, 175–192 (1993). 10.1080/00222895.1993.9942048

[27]

Kuo, A.D. An optimal control model for analyzing human postural balance. IEEE Trans. Biomed. Eng. 42, 87–101 (1995). 10.1109/10.362914

[28]

Shimansky, Y.P. Spinal motor control system incorporates an internal model of limb dynamics. Biol. Cybern. 83, 379–389 (2000). 10.1007/s004220000159

[29]

Ijspeert, A.J. A connectionist central pattern generator for the aquatic and terrestrial gaits of a simulated salamander. Biol. Cybern. 84, 331–348 (2001). 10.1007/s004220000211

[30]

Todorov, E. & Jordan, M. Optimal feedback control as a theory of motor coordination. Nat. Neurosci. 5, 1226–1235 (2002). 10.1038/nn963

[31]

Shimansky, Y.P., Kang, T. & He, J.P. A novel model of motor learning capable of developing an optimal movement control law online from scratch. Biol. Cybern. 90, 133–145 (2004). 10.1007/s00422-003-0452-4

[32]

Li, W., Todorov, E. & Pan, X. Hierarchical optimal control of redundant biomechanical systems. in Proceedings of the 26th Annual International Conferences of the IEEE Engineering in Medicine and Biology Society (IEEE Press, ISSN 1094-687X, in the press).

[33]

Marr, D. Vision (Freeman, San Francisco, 1982).

[34]

Feldman, A.G. & Levin, M.F. The origin and use of positional frames of reference in motor control. Behav. Brain Sci. 18, 723–744 (1995). 10.1017/s0140525x0004070x

[35]

Bizzi, E., Hogan, N., Mussa-Ivaldi, F.A. & Giszter, S. Does the nervous system use equilibrium-point control to guide single and multiple joint movements? Behav. Brain Sci. 15, 603–613 (1992). 10.1017/s0140525x00072538

[36]

Kelso, J.A.S. Dynamic Patterns: The Self-Organization of Brain and Behavior (MIT Press, Cambridge, Massachusetts, 1995).

[37]

Sporns, O. & Edelman, G.M. Solving Bernstein's problem: a proposal for the development of coordinated movement by selection. Child Dev. 64, 960–981 (1993). 10.2307/1131321

[38]

Kalaska, J., Sergio, L.E. & Cisek, P. in Sensory Guidance of Movement: Novartis Foundation Symposium (ed. Glickstein, M.) 176–201 (Wiley, Chichester, UK, 1998).

[39]

Bernstein, N.I. The Coordination and Regulation of Movements (Pergamon, Oxford, 1967).

[40]

Loeb, G.E., Brown, I.E. & Cheng, E.J. A hierarchical foundation for models of sensorimotor control. Exp. Brain Res. 126, 1–18 (1999). 10.1007/s002210050712

[41]

Todorov, E. & Ghahramani, Z. Unsupervised learning of sensory-motor primitives. in Proceedings of the 25th Annual International Conference of the IEEE Engineering in Biology and Medicine Society 1750–1753 (IEEE Press, ISSN 1094-687X, 2003).

[42]

Kalman, R. When is a linear control system optimal? Trans. AMSE J. Basic Eng. Ser. D 86, 51–60 (1964). 10.1115/1.3653115

[43]

Moylan, P. & Anderson, B. Nonlinear regulator theory and an inverse optimal control problem. IEEE Trans. Automatic Control AC-18, 460–465 (1973). 10.1109/tac.1973.1100365

[44]

Ng, A. & Russell, S. Algorithms for inverse reinforcement learning. in Proceedings of the 17th International Conference on Machine Learning (Morgan Kaufmann, San Francisco, 2000).

[45]

Scott, S. Optimal feedback control and the neural basis of volitional motor control. Nat. Neurosci. Rev. 5, 534–546 (2004). 10.1038/nrn1427

[46]

Kording, K. & Wolpert, D. The loss function of sensorimotor learning. Proc. Natl. Acad. Sci. USA 101, 9839–9842 (2004). 10.1073/pnas.0308394101

[47]

Lacquaniti, F., Terzuolo, C. & Viviani, P. The law relating the kinematic and figural aspects of drawing movements. Acta Psychol. 54, 115–130 (1983). 10.1016/0001-6918(83)90027-6

[48]

Sutton, G.G. & Sykes, K. The variation of hand tremor with force in healthy subjects. J. Physiol. (Lond.) 191, 699–711 (1967). 10.1113/jphysiol.1967.sp008276

[49]

Schmidt, R.A., Zelaznik, H., Hawkins, B., Frank, J.S. & Quinn, J.T. Jr. Motor-output variability: a theory for the accuracy of rapid notor acts. Psychol. Rev. 86, 415–451 (1979). 10.1037/0033-295x.86.5.415

[50]

Sabes, P.N., Jordan, M.I. & Wolpert, D.M. The role of inertial sensitivity in motor planning. J. Neurosci. 18, 5948–5957 (1998). 10.1523/jneurosci.18-15-05948.1998

Showing 50 of 119 references

Cited By

1,428

A control policy can be adapted to task demands during both motor execution and motor planning

Jean-Jacques Orban de Xivry, Robert M. Hardwick · 2025

Journal of Neurophysiology

Robustness and adaptability of sensorimotor skills in expert piano performance

Masaki Yasuhara, Kazumasa Uehara · 2024

iScience

Acquiring musculoskeletal skills with curriculum-based reinforcement learning

Alberto Silvio Chiappa, Pablo Tano · 2024

Neuron