Sensor-Actuator Supported Implicit Interaction in Driver Assistance Systems (eBook)

Dr. Andreas Riener is a research and teaching assistant at the Institute for Pervasive Computing, Johannes Kepler University Linz, Austria, and is employed as a researcher at the Research Institute for Pervasive Computing (RIPE) in Hagenberg, Austria.

Foreword 6
Foreword 8
Preface 10
Contents 13
List of Figures 16
List of Tables 21
List of Acronyms 22
Part I Research Hypotheses 26
1 Introduction 27
1.1 User Interfaces 27
1.1.1 Interaction in Vehicles 27
1.1.2 Driver-Vehicle Interaction 28
1.1.3 Single Driver, Single Vehicle 29
1.2 Interface Paradigms 30
1.2.1 Surrounding Traffic 32
1.2.2 Vehicle Operation 33
1.2.3 Conversation and Telecommunications 33
1.3 Distraction Forecast 36
2 Perception 38
2.1 Vision 39
2.2 Hearing 39
2.3 Touch 40
3 Driver Expression 42
3.1 Modes of Interaction: Explicit versus Implicit Feedback 43
3.1.1 Explicit Interaction 43
3.1.2 Implicit Interaction 44
3.2 Modes of Interaction: Cardinality of Sensory Channels 45
3.2.1 Unimodal 45
3.2.2 Multimodal 45
3.2.3 Amodal 48
4 Perception and Articulation 51
4.1 Application Domains 51
4.2 Participation Demand 52
4.3 Interaction Modalities versus Application Domains 53
5 Hypotheses and Research Questions 54
5.1 Interaction Modalities 54
5.1.1 Articulation 54
5.1.2 Perception 55
5.2 Research Questions 55
5.2.1 Objective 55
5.3 Experiments 56
5.4 Hypothesis I 58
5.5 Hypothesis II 59
Part II Driver-Vehicle Interaction 63
6 Vibro-Tactile Articulation and Presentation 64
6.1 Excursus: Sensory Modalities 64
6.1.1 State of the Art in In-Car Interaction 64
6.1.2 Potential of Smell and Taste 66
6.1.3 Summary 68
6.2 Motivation for Tactile Displays 69
6.2.1 Complex Vehicle Handling 69
6.2.2 Haptics as Support for Visual/Auditory Interaction 69
6.3 Definition of Terms 71
6.3.1 Force Displays 72
6.3.2 Summary 73
6.4 The Skin as a Sensory Organ 73
6.4.1 Stimulation Technologies 74
6.5 Research on Vibro-Tactile Stimulation 74
6.5.1 Waistbelt (Torso) 75
6.5.2 Bottom and Back 76
6.5.3 Head 78
6.5.4 Feet 78
6.5.5 Hands 80
6.5.6 Buttocks 80
6.5.7 Arms 81
6.6 Touch-Based Driver-Vehicle Input 81
6.7 Haptic Interaction in Vehicles 81
6.7.1 Driving Dynamics 82
6.7.2 Vibro-Tactile Stimulation: State of the Art in the Automotive Domain? 83
6.7.3 The Driver Seat: Suitable for Haptic Noti.cations? 84
Part III Information Needs of Drivers 87
7 The Driver as the Weak Point in Interaction 88
7.1 Cognitive Load: A Big Challenge 88
7.2 Empirical Evidence for Cognitive Load 89
7.3 Managing Workload 90
7.3.1 Examples 91
8 Driver Activity and Notification Demands 92
8.1 Notification-Induced Driver Distraction 93
8.1.1 Causes of Distraction 94
8.2 What Information? 95
8.2.1 Classes of Information 96
8.3 When and How? 97
8.3.1 Information Capacity Limits 98
8.3.2 Selection of Sensory Modalities 98
8.3.3 Airplanes – The Better Cars? 100
8.4 Where? 101
8.5 Visual and Auditory Perception 101
8.5.1 Summary 103
8.5.2 Research Potential 103
9 Advanced Driver Assistance Systems (ADAS) 104
9.1 Alternatives Supporting the Driver 105
10 Vibro-Tactile Interfaces 106
10.1 Motivation 107
10.2 Types of Stimuli 108
10.2.1 Electro-Tactile 108
10.2.2 Heat (Thermal) 109
10.2.3 Mechanical Pneumatic 109
10.3 Stimulation via the Skin 110
10.3.1 Cutaneous Mechanoreceptors 110
10.4 Alphabets and Vibro-Tactile Patterns 114
10.4.1 Tactograms – Related Application 115
10.4.2 Parameters of Vibro-tactile Stimulation 116
10.4.3 General Remarks 119
10.5 Tactograms 119
10.5.1 Related Work 120
10.5.2 Multi-Tactor Systems 120
10.5.3 Level of Attention (LOA) 122
Part IV Methodology 125
11 Analytical Methods 126
11.1 Requirements and Technological Conditions 126
11.1.1 Force-Sensitive Input 127
11.1.2 Vibro-Tactile Output 127
11.1.3 Other Sensors 128
11.2 System Design 128
11.2.1 Posture Pattern Analysis 128
11.2.2 Vibro-Tactile Notifications 129
11.3 Eligible Methods for Pressure Sensing 129
11.3.1 Multivariate Data Analysis (MDA) 129
11.3.2 Linear Discriminant Analysis (LDA) 130
11.3.3 Hidden Markov Models (HMM) 130
11.3.4 Other Methods 131
11.3.5 Summary and Impact 131
11.4 Techniques for Vibro-Tactile Stimulation 132
11.4.1 Stimulus Detection 132
11.4.2 Discriminating Stimuli 133
11.4.3 Stimulus Threshold 135
11.4.4 Age and Gender Sensitivity 136
11.4.5 Summary and Impact 137
12 Experiments 138
12.1 Identification and Authorization 140
12.1.1 Experimental Design 140
12.1.2 Feature Evaluation 142
12.1.3 Biometric Identi.cation 144
12.1.4 Results 148
12.1.5 Improvement Potential 150
12.1.6 General Findings 150
12.2 Activity Recognition 151
12.2.1 Problem Statement 152
12.2.2 Activity Recognition 152
12.2.3 General Findings 157
12.2.4 Experimental Design 159
12.2.5 Evaluation 161
12.2.6 Discussion 162
12.2.7 General Findings 164
12.3 Dynamic Adaptation of Vibro-Tactile Feedback 167
12.3.1 Requirements for a Vibration-Based Seat System 168
12.3.2 Touch Sensation 169
12.3.3 Requirements Analysis 170
12.3.4 Experimental Results 173
12.3.5 General Findings 178
12.4 Simulating Real-Driving Performance 180
12.4.1 Distraction Classes 181
12.4.2 Experimental Design 183
12.4.3 Evaluation and Results 188
12.4.4 Conclusions 198
12.4.5 General Findings 200
12.5 Further Experiments 201
Part V Discussion and Conclusion 202
13 Predeterminations for Investigation 203
13.1 Domain 203
13.2 Prototype 203
14 Refiecting on the Hypotheses 204
14.1 On Implicit Driver Articulation 204
14.2 On Vibro-Tactile Driver Notification 207
15 Experiments: Lessons Learned 210
15.1 Novelty of Haptics 210
15.2 Run-in Experiments 210
15.3 Annoyances 210
15.3.1 Surreal Simulation 210
15.3.2 Vibration Noise 210
15.4 Varying Stimulation Parameters 211
15.5 Parameter Mapping 211
16 Conclusion 212
16.1 Applicability 212
16.2 Additional Workload for Touch Sensations? 212
16.3 Limitations 212
17 Future Prospects 213
17.1 Reconfiguration of Vibro-Tactile Feedback Based on the Driver’s Sitting Posture 213
17.2 Reaction Times in Multimodal Interfaces 213
17.3 Integration of Biochemical Features 213
17.4 Additional Sensory Modalities 214
17.5 Theoretical Studies on Haptics and Tactograms 214
Appendices 215
Bibliography 250
Index 300