Research Handbook on Meaningful Human Control of Artificial Intelligence Systems

Edited by Giulio Mecacci, Assistant Professor of Ethics and Philosophy of AI, Donders Institute for Brain, Cognition and Behaviour, Radboud University, the Netherlands, Daniele Amoroso, Professor of International Law, University of Cagliari, Italy, Luciano Cavalcante Siebert, Assistant Professor of Responsible AI, Faculty of Electrical Engineering, Mathematics and Computer Science, Delft University of Technology, David Abbink, Professor of Human-Robot Interaction, the Faculty of Mechanical Engineering and the Faculty of Industrial Design Engineering, Delft University of Technology, Jeroen van den Hoven, Professor of Ethics of Technology, Delft University of Technology and Filippo Santoni de Sio, Associate Professor of Ethics of Technology, Delft University of Technology, the Netherlands

Contents
List of contributors vii
Acknowledgements x
1 Introduction to meaningful human control of artificially intelligent systems 1
Authors (listed in alphabetical order): David Abbink, Daniele Amoroso,
Luciano Cavalcante Siebert, Jeroen van den Hoven, Giulio Mecacci and
Filippo Santoni de Sio
PART I PHILOSOPHY AND ETHICS
2 Automated mobility and meaningful human control: when and why is
control important and what are its different dimensions? 13
Sven Nyholm
3 Reflection machines and the proximity scale of reasons: addressing
accountability asymmetry 28
Pim Haselager and Giulio Mecacci
4 Out of control: flourishing with carebots through embodied design 38
Anco Peeters
5 Meaningful human command: advance control directives as a method to
enable moral and legal responsibility for autonomous weapons systems 53
S. Kate Devitt
PART II LAW AND GOVERNANCE
6 Legal and governance perspectives on meaningful human control: the
case of automated mobility 82
Giuseppe Contissa
7 From “human control” in international law to “human oversight” in the
new EU act on artificial intelligence 105
Juliane Beck and Thomas Burri
8 Meaningful human control in shared medical decision making 133
Susanne Beck, Simon Gerndt, David Samhammer and Peter Dabrock
9 Meaningful human control: an international criminal law account 150
Marta Bo
PART III DESIGN AND ENGINEERING
10 Designing automated vehicle and traffic systems towards meaningful
human control 165
Simeon Calvert, Stig Johnsen and Ashwin George
11 Reflective hybrid intelligence for meaningful human control in
decision-support systems 191
Catholijn M. Jonker, Luciano Cavalcante Siebert and Pradeep K.
Murukannaiah
12 Meaningful human control of increasingly autonomous robots for surgery 208
Fanny Ficuciello, Mohammad Hossein Hamedani and Guglielmo Tamburrini
13 Designing for meaningful human control in military human-machine teams 235
Jurriaan van Diggelen, Karel van den Bosch, Mark Neerincx and Marc Steen
PART IV INTERDISCIPLINARY AND SYSTEMIC PERSPECTIVES
14 Too much control? Health, sex and war 257
Ezio Di Nucci
15 Worldbuilding a planet-positive future enabled by human + AI coevolution 267
Ann Pendleton-Jullian
16 Holistic bow-tie model of meaningful human control over effective
systems: towards a dynamic balance of humans and AI-based systems
within our global society and environment 313
Frank Flemisch, Marcel Baltzer, David Abbink, Luciano Cavalcante Siebert,
Jurriaan van Diggelen, Nicolas Daniel Herzberger, Mark Draper, Michael
Boardman, Marie-Pierre Pacaux-Lemoine, Joscha Wasser