Distributed Video Sensor Networks (eBook)

Preface 5
Contents 7
Introduction 11
Distributed Video Sensor Networks and Research Challenges 18
Report on NSF/ARO/ONR Workshop on Distributed Camera Networks: Research Challenges and Future Directions 19
1 Introduction 20
2 Workshop Recommendations 20
3 Suggested Major Research Topics 28
Appendix 1: List of Attendees in Alphabetical Order 29
Appendix 2: Groups and Group Leaders 34
Appendix 3: Talks with Titles and Presenters 37
Video Processing and Understanding 40
Motion Analysis: Past, Present and Future 41
1 Introduction to Motion: An Early History 42
2 Motion: Highlights from Philosophy, Psychology and Neurobiology 43
3 Motion in Computer Vision: The Beginnings 44
4 Optical Flow-Based Motion Detection 46
5 Human Actions and Activities 48
6 Motion: Future 49
References 51
Projective Joint Invariants for Matching Curves in Camera Networks 54
1 Introduction 54
2 Problem Formulation and Preliminaries 57
3 Joint-Invariant Signatures 60
4 Toward Local Signatures 61
5 Matching Performance 65
6 Discussion 66
References 66
Multiple-View Object Recognition in Smart Camera Networks 68
1 Introduction 69
2 Encoding Multiple-View Features via Sparse Representation 70
3 System Implementation 76
4 Experiment 78
5 Conclusion and Discussion 80
References 80
A Comparison of Techniques for Camera Selection and Hand- Off in a Video Network 82
1 Introduction 82
2 RelatedWork and Contributions 83
3 Theoretical Comparison 86
4 Experimental Results 90
5 Conclusions and Future Work 94
References 95
Distributed Sensing and Processing for Multi- Camera Networks 97
1 Introduction 97
2 Statistical Inference for Tracking 99
3 Efficient Particle Filtering 102
4 Compressive Sensing 107
5 Conclusions and Future Directions 111
References 112
Tracking of Multiple Objects over Camera Networks with Overlapping and Non- overlapping Views 114
1 Introduction 114
2 RelatedWork 116
3 Tracking within a Single Camera 117
4 Tracking Across Multiple Cameras 121
5 Experimental Results 124
6 Conclusion 127
References 127
Toward Robust Online Visual Tracking 129
1 Introduction 129
2 Appearance Modeling for Visual Tracking 130
3 Learning Detectors Online for Visual Tracking 135
4 Conclusions 143
References 143
Modeling Patterns of Activity and Detecting Abnormal Events with Low- Level Co- occurrences 147
1 Introduction 148
2 Context, Overview and Notations 148
3 OurMethod 151
4 Experimental Results 154
5 Conclusion 156
References 158
Use of Context in Video Processing 159
1 Introduction 159
2 Case Study: Environment Discovery 161
3 Conclusion 169
References 170
Simulation, Graphics, Cognition and Video Networks 171
Virtual Vision 172
1 Introduction 173
2 The Case for Virtual Vision 174
3 RelatedWork 177
4 Smart Camera Nodes 178
5 Surveillance Systems 183
6 Conclusions 184
References 186
Virtualization and Programming Support for Video Sensor Networks with Application toWireless and Physical Security 187
1 Motivation 188
2 RelatedWork 189
3 SNBench Overview 191
4 EnablingWireless Monitoring 192
5 Deployment Environment 194
6 Service Programming Primer 195
7 Wireless Security Services 196
8 Future Work and Conclusions 198
References 199
Simulating Human Activities for Synthetic Inputs to Sensor Systems 201
1 Overview 201
2 The CAROSA System 202
3 RelatedWork 203
4 Parameterized Representations 204
5 Resource Management 206
6 Roles and Groups 206
7 Scenario Authoring 208
8 Example Simulation 209
9 CAROSA Summary 210
10 Input to Distributed Sensor Networks 211
11 Summary 211
References 212
Cognitive Sensor Networks 214
1 Introduction 214
2 Cognition 215
3 Symmetry Theory in Signal Processing 218
4 Conclusion 219
References 219
Ubiquitous Displays: A Distributed Network of Active Displays 221
1 Introduction 221
2 Initial Progress 226
3 Conclusion 235
References 235
Wireless Video Sensor Networks, Communications and Control 237
Research Challenges forWireless Multimedia Sensor Networks 238
1 Introduction 238
2 Applications of Wireless Multimedia Sensor Networks 239
3 Network Architecture 240
4 Factors Influencing the Design of Multimedia Sensor Networks 241
5 Application Layer 243
6 Transport Layer Protocols 246
7 Network Layer 248
8 MAC Layer 248
9 Physical Layer 249
10 Conclusions 250
References 250
Camera Control and Geo-Registration for Video Sensor Networks 252
1 Introduction 252
2 RelatedWork 253
3 PTZ Camera Viewspace Control Model 254
4 Scene-Based Camera Geo-Registration and Mapping 257
5 Operational Interface 260
6 Summary 260
References 261
Persistent Observation of Dynamic Scenes in an Active Camera Network 263
1 Introduction 264
2 Technical Rationale 264
3 Cooperative Target Acquisition Using Game Theory 266
4 Experimental Results 271
5 Conclusion 274
References 274
Proactive PTZ Camera Control 276
1 Introduction 276
2 Proactive Camera Control 279
3 Results 285
4 Conclusions and Future Work 288
References 289
Distributed Consensus Algorithms for Image- Based Localization in Camera Sensor Networks 291
1 Introduction 291
2 Review of Average-Consensus Algorithms 293
3 Distributed Object Localization 294
4 Distributed CSN Localization 297
5 Conclusion 302
References 303
Conditional Posterior Cramér–Rao Lower Bound and its Applications in Adaptive Sensor Management 305
1 Introduction 306
2 Conditional PCRLB for Recursive Nonlinear Filtering 309
3 C-PCRLB-Based Sensor Management 312
4 Applications in Camera Network Management 315
References 317
Distributed Embedded Cameras and Real- Time Video Analysis 320
VideoWeb: Optimizing aWireless Camera Network for Real- time Surveillance 321
1 Introduction 321
2 RelatedWork and Contributions 322
3 Building the Camera Network 322
4 The VideoWebWireless Camera Network 326
5 Experiments for Performance Characterization and Optimization of the Video Network 328
6 Conclusions 333
References 333
VideoWeb Dataset for Multi-camera Activities and Non- verbal Communication 335
1 Introduction 336
2 Data Collection 336
3 Conclusions 347
References 347
Wide-Area Persistent Airborne Video: Architecture and Challenges 348
1 Introduction 349
2 Spatio-temporal Reflectance Variations 353
3 Wide Aperture Imaging Model of Camera Arrays 358
4 Accommodating Dynamic Variations in Operational Camera Arrays Using Pose Information 364
5 Summary and Conclusions 366
References 368
Collaborative Face Recognition Using a Network of Embedded Cameras 371
1 Introduction 371
2 RelatedWork 373
3 Experimental Setup 374
4 System Performance 379
5 Conclusions and Future Work 382
References 384
SATware: A Semantic Approach for Building Sentient Spaces 386
1 Introduction 386
2 SATware: An Middleware Framework for Sentient Spaces 389
3 A Programming Model for Pervasive Applications 389
4 Supporting Scalability through Semantic Scheduling 394
5 Supporting Robustness through Sensor Recalibration 396
6 Conclusions 397
References 398
Applications of Distributed Video Networks 400
Video Analytics for Force Protection 401
1 Aerial Video Analysis 403
2 Tracking from Fixed Ground Based Cameras 406
3 Person Detection from Moving Platforms 410
4 Biometrics at a Distance 412
5 Facial Analysis 416
6 Summary 418
References 419
Recognizing Activity Structures in Massive Numbers of Simple Events Over Large Areas 422
1 Introduction 422
2 Spatial Structure 424
3 Temporal Structure 426
4 Event-Linkage Structure 427
5 Short Event-Sequence Structure 427
6 Network Structure 430
7 Summary 432
References 432
Distributed Sensor Networks for Visual Surveillance 433
1 Introduction 434
2 Technical Challenges in Large Sensor Networks 434
3 System Design and Components 435
4 Results 440
References 443
Ascertaining Human Identity in Night Environments 444
1 Introduction 445
2 Color-NIR Cross-Spectral Iris Matching 446
3 Short Wave Infrared Face Verification 449
4 Gait Curves for Human Recognition in a Night-Time Environment 454
5 Soft Biometrics—Body Measurement 457
6 Summary 459
References 459
Educational Opportunities and Curriculum Development 461
Educational Opportunities in Video Sensor Networks 462
1 Introduction 462
2 Computational Sensor Networks 464
3 Engineering Background for Video Sensor Networks 465
4 Course Organization 465
5 Support Technology for Instruction 466
6 Conclusion 466
Appendix 1: Recommended Courses and Topics 468
References 469
Index 470