Publications

Please note, the below pre-prints are provided for personal use only.

2016

Wearable embroidered muscle activity sensing device for the human upper leg. R. B. R. Manero, B. Michael, A. Shafti, K. Althoefer, J. L. R. Fernandez, and M. Howard. IEEE International Conference Engineering in Medicine and Biology Society, 2016. In Press. [ bib | http ]
Learning unfair trading: a market manipulation analysis from the reinforcement learning perspective. E. Martinez-Miranda, P. McBurney, and M. Howard. IEEE International Conference on Evolving and Adaptive Intelligent Systems, 2016. [ bib ]
Learning predictive movement models from fabric-mounted wearable sensors. B. Michael and M. Howard. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2016. In Press. [ bib ]
Textile-integrated embroidered electrodes for wearable surface electromyography. A. Shafti, R. B. R. Manero, A. M. Borg, K. Althoefer, and M. Howard. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2016. In Press. [ bib ]
Designing embroidered electrodes for wearable surface electromyography. A. Shafti, R. B. R. Manero, A. M. Borg, K. Althoefer, and M. Howard. IEEE International Conference Robotics and Automation, 2016. [ bib ]

2015

Learning null space projections. H.-C. Lin, M. Howard, and S. Vijayakumar. IEEE International Conference Robotics and Automation, 2015. [ pdf | bib ]

2014

A novel approach for representing and generalising periodic gaits. H.-C. Lin, M. Howard, and S. Vijayakumar. Robotica, 32:1225--1244, 12 2014. [ bib | DOI | http ]
Generalising walking gaits across subjects and walking speeds. H.-C. Lin, M. Howard, and S. Vijayakumar. IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics, 2014. [ bib ]
Eliminating motion artifacts from fabric-mounted wearable sensors. B. Michael and M. Howard. IEEE International Conference Humanoid Robots, 2014. [ pdf | bib ]
Internal impedance control helps information gain in embodied perception. N. Sornkarn, M. Howard, and T. Nanayakkara. IEEE International Conference Robotics and Automation, 2014. [ pdf | bib ]

2013

Transferring human impedance behavior to heterogeneous variable impedance actuators. M. Howard, D. Braun, and S. Vijayakumar. IEEE Transactions on Robotics, 29(4):847--862, 2013. [ pdf | bib | DOI | http ]
Locally weighted least squares policy iteration for model-free learning in uncertain environments. M. Howard and Y. Nakamura. IEEE International Conference Intelligent Robots and Systems, 2013. [ pdf | bib ]
Locally weighted least squares temporal difference learning. M. Howard and Y. Nakamura. European Symposium Artificial Neural Networks, 2013. [ pdf | bib ]

2012

Optimal variable stiffness control: Formulation and application to explosive movement tasks. D. Braun, M. Howard, and S. Vijayakumar. Autonomous Robots, 33:237--253, 2012. [ bib | DOI | http ]
Exploiting variable physical damping in rapid movement tasks. A. Radulescu, M. Howard, D. Braun, and S. Vijayakumar. IEEE/ASME International Conference Advanced Intelligent Mechatronics, 2012. [ pdf | bib ]

2011

Exploiting variable stiffness in explosive movement tasks. D. Braun, M. Howard, and S. Vijayakumar. Robotics: Science and Systems, Los Angeles, CA, USA, June 2011. [ pdf | bib ]
Constraint-based equilibrium and stiffness control of variable stiffness actuators. M. Howard, D. Braun, and S. Vijayakumar. IEEE International Conference Robotics and Automation, 2011. [ pdf | bib ]
Model-free apprenticeship learning for transfer of human impedance behaviour. T. Mori, M. Howard, and S. Vijayakumar. IEEE International Conference Humanoid Robots, 2011. [ pdf | bib ]

2010

Using dimensionality reduction to exploit constraints in reinforcement learning. S. Bitzer, M. Howard, and S. Vijayakumar. IEEE International Conference Intelligent Robots and Systems, 2010. [ video | pdf | bib ]
Transferring impedance control strategies between heterogeneous systems via apprenticeship learning. M. Howard, D. Mitrovic, and S. Vijayakumar. IEEE International Conference Humanoid Robots, 2010. [ video | pdf | bib ]
Exploiting sensorimotor stochasticity for learning control of variable impedance actuators. D. Mitrovic, S. Klanke, M. Howard, and S. Vijayakumar. IEEE International Conference Humanoid Robots, 2010. [ pdf | bib ]
Learning null space policies. C. Towell, M. Howard, and S. Vijayakumar. IEEE International Conference Intelligent Robots and Systems, 2010. [ video | pdf | bib ]

2009

Methods for learning control policies from variable-constraint demonstrations. M. Howard, S. Klanke, M. Gienger, C. Goerick, and S. Vijayakumar. From Motor to Interaction Learning in Robots. Springer, 2009. [ pdf | bib ]
A novel method for learning policies from variable constraint data. M. Howard, S. Klanke, M. Gienger, C. Goerick, and S. Vijayakumar. Autonomous Robots, 27:105--121, 2009. [ video | pdf | bib | DOI | http ]
Robust constraint-consistent learning. M. Howard, S. Klanke, M. Gienger, C. Goerick, and S. Vijayakumar. IEEE International Conference Intelligent Robots and Systems, 2009. [ pdf | bib | DOI ]
Learning control policies from constrained motion. M. Howard. University of Edinburgh, 2009. [ pdf | bib ]
A novel method for learning policies from constrained motion. M. Howard, S. Klanke, M. Gienger, C. Goerick, and S. Vijayakumar. IEEE International Conference Robotics and Automation, 2009. [ pdf | bib ]
Planning and moving in dynamic environments: A statistical machine learning approach. S. Vijayakumar, M. Toussaint, G. Petkos, and M. Howard. Sendhoff, Koerner, Sporns, Ritter, and Doya, eds., Creating Brain Like Intelligence: From Principles to Complex Intelligent Systems, vol. 5436 of Lecture Notes in Artificial Intelligence. Springer-Verlag, 2009. [ pdf | bib ]

2008

Behaviour generation in humanoids by learning potential-based policies from constrained motion. M. Howard, S. Klanke, M. Gienger, C. Goerick, and S. Vijayakumar. Applied Bionics and Biomechanics, 5(4):195--211, Dec. 2008. [ video | pdf | bib | DOI | http ]
Learning potential-based policies from constrained motion. M. Howard, S. Klanke, M. Gienger, C. Goerick, and S. Vijayakumar. IEEE International Conference Humanoid Robots, 2008. [ pdf | bib ]

2007

Reconstructing null-space policies subject to dynamic task constraints in redundant manipulators. M. Howard and S. Vijayakumar. Workshop on Robotics and Mathematics, September 2007. [ pdf | bib ]

2006

Learning utility surfaces for movement selection. M. Howard, M. Gienger, C. Goerick, and S. Vijayakumar. IEEE International Conference on Robotics and Biomimetics, 2006. [ pdf | bib ]