Auditory and Visual Sensations (eBook)

Yoichi Ando is an expert in the areas of concert hall acoustics architectural acoustics, brain activities, and environmental design. He has been awarded the AIA Institute Honor, American Institute of Architects in 1995: For 30 years of work developing and applying new theories of concert hall acoustics have helped the way music is heard. A scientist, author, and educator, his achievements are a benefit to both the world of architecture and the world of music. He has also been awarded the "Laurea Honoris Causa" (Dottore ad Honorem) by University of Ferrara, Italy on 12 June 2002, and serves as Editor-In-Chief, of the Journal of Temporal Design in Architecture and the Environment.Peter Cariani works in the fields of auditory neurophysiology; temporal coding of pitch, timbre, and consonance; neural networks for temporal processing; music perception and cognition.

Preface 7
Previous Publications Related to This Topic 11
Guest Editors Preface 13
Acknowledgments 19
Contents 21
Part I Temporal and Spatial Sensations in the Human Auditory System 26
1 Introduction 27
1.1 Auditory Temporal and Spatial Factors 27
1.2 Auditory System Model for Temporal and Spatial Information Processing 11
2 Temporal and Spatial Aspects of Sounds and Sound Fields 33
2.1 Analysis of Source Signals 33
2.1.1 Power Spectrum 33
2.1.2 Autocorrelation Function (ACF) 34
2.1.3 Running Autocorrelation 37
2.2 Physical Factors of Sound Fields 42
2.2.1 Sound Transmission from a Point Source through a Room to the Listener 42
2.2.2 Temporal-Monaural Factors 43
2.2.3 Spatial-Binaural Factors 44
2.3 Simulation of a Sound Field in an Anechoic Enclosure 47
3 Subjective Preferences for Sound Fields 49
3.1 Preferred Properties for Sound Fields with Multiple Reflections 50
3.1.1 Preferred Delay Time of a Single Reflection 50
3.1.2 Preferred Horizontal Direction of a Single Reflection 53
3.2 Preferred Conditions for Sound Fields with Multiple Reflections 54
3.2.1 Optimal Listening Level (LL) 54
3.2.2 Optimal First Reflection Time ( t1) 55
3.2.3 Optimal Subsequent Reverberation Times (T sub) 55
3.2.4 Optimal Magnitude of Interaural Crosscorrelation (IACC) 57
3.3 Theory of Subjective Preferences for Sound Fields 58
3.4 Evaluation of Boston Symphony Hall Based on Temporal and Spatial Factors 61
4 Electrical and Magnetic Responses in the Central AuditorySystem 63
4.1 Auditory Brainstem Responses (ABRs) 63
4.1.1 Brainstem Response Correlates of Sound Direction in the Horizontal Plane 64
4.1.2 Brainstem Response Correlates of Listening Level (LL) and Interaural Crosscorrelation Magnitude (IACC) 68
4.1.3 Remarks 70
4.2 Slow Vertex Responses (SVRs) 72
4.2.1 SVR Correlates of First Reflection Time t1 Contrast 72
4.2.2 Hemispheric Lateralization Related to Spatial Aspects of Sound 74
4.2.3 Response Latency Correlates of Subjective Preference 77
4.3 Electroencephalographic (EEG) Correlates of Subjective Preference 79
4.3.1 EEG Correlates of First Reflection Time t1 Changes 79
4.3.2 EEG Correlates of Reverberation Time T sub Changes 82
4.3.3 EEG Correlates of Interaural Correlation Magnitude (IACC) Changes 84
4.4 Magnetoencephalographic (MEG) Correlates of Preference and Annoyance 86
4.4.1 Preferences and the Persistence of Alpha Rhythms 87
4.4.2 Preferences and the Spatial Extent of Alpha Rhythms 92
4.4.3 Alpha Rhythm Correlates of Annoyance 92
5 Model of Temporal and Spatial Factors in the Central Auditory System 97
5.1 Signal Processing Model of the Human Auditory System 97
5.1.1 Summary of Neural Evidence 97
5.1.1.1 Physical Characteristics of the Ear 97
5.1.1.2 Left and Right Auditory Brainstem Responses (ABRs) 98
5.1.1.3 Left and Right Hemisphere Slow Vertex Responses (SVRs) 98
5.1.1.4 Left and Right Hemisphere EEG Responses 98
5.1.1.5 Left and Right Hemisphere MEG Responses 99
5.1.2 Auditory Signal Processing Model 99
5.2 Temporal Factors Extracted from Autocorrelations of Sound Signals 107
5.3 Auditory Temporal Window for Autocorrelation Processing 108
5.4 Spatial Factors and Interaural Crosscorrelation 110
5.5 Auditory Temporal Window for Binaural Processing 111
5.6 Hemispheric Specialization for Spatial Attributes of Sound Fields 111
6 Temporal Sensations of the Sound Signal 114
6.1 Combinations of Temporal and Spatial Sensations 114
6.2 Pitch of Complex Tones and Multiband Noise 116
6.2.1 Perception of the Low Pitch of Complex Tones 116
6.2.2 Pitch of Multiband ''Complex Noise'' 123
6.2.3 Frequency Limits of Missing Fundamentals 124
6.3 Beats Induced by Dual Missing Fundamentals 128
6.4 Loudness 131
6.4.1 Loudness of Sharply Filtered Noise 131
6.4.2 Loudness of Complex Noise 137
6.5 Duration Sensation 142
6.6 Timbre of an Electric Guitar Sound with Distortion 143
6.6.1 Experiment 1 -- Peak Clipping 145
6.6.2 Experiment 2 -- Commercial Effects Box 147
6.6.3 Concluding Remarks 147
7 Spatial Sensations of Binaural Signals 148
7.1 Sound Localization 148
7.1.1 Cues of Localization in the Horizontal Plane 148
7.1.2 Cues of Localization in the Median Plane 149
7.2 Apparent Source Width (ASW) 150
7.2.1 Apparent Width of Bandpass Noise 153
7.2.2 Apparent Width of Multiband Noise 154
7.3 Subjective Diffuseness 159
8 Applications (I) Music and Concert Hall Acoustics 165
8.1 Pitches of Piano Notes 165
8.2 Design Studies of Concert Halls as Public Spaces 170
8.2.1 Genetic Algorithms (GAs) for Shape Optimization 170
8.2.2 Two Actual Designs: Kirishima and Tsuyama 175
8.3 Individualized Seat Selection Systems for Enhancing Aural Experience 180
8.3.1 A Seat Selection System 180
8.3.2 Individual Subjective Preference 180
8.3.3 Distributions of Listener Preferences 183
8.4 Subjective Preferences of Cello Soloists for First Reflection Time, t1 187
8.5 Concert Hall as Musical Instrument 194
8.5.1 Composing with the Hall in Mind: Matching Music and Reverberation 194
8.5.2 Expanding the Musical Image: Spatial Expression and Apparent Source Width 196
8.5.3 Enveloping Music: Spatial Expression and Musical Dynamics 197
8.6 Performing in a Hall: Blending Musical Performances with Sound Fields 197
8.6.1 Choosing a Performing Position on the Stage 197
8.6.2 Performance Adjustments that Optimize Temporal Factors 198
8.6.3 Towards Future Integration of Composition, Performance and Hall Acoustics 199
9 Applications (II) Speech Reception in Sound Fields 201
9.1 Effects of Temporal Factors on Speech Reception 201
9.2 Effects of Spatial Factors on Speech Reception 207
9.3 Effects of Sound Fields on Perceptual Dissimilarity 211
9.3.1 Perceptual Distance due to Temporal Factors 216
9.3.2 Perceptual Distance due to Spatial Factors 217
10 Applications (III) Noise Measurement 220
10.1 Method of Noise Measurement 220
10.2 Aircraft Noise 221
10.3 Flushing Toilet Noise 228
11 Applications (IV) Noise Annoyance 233
11.1 Noise Annoyance in Relation to Temporal Factors 233
11.1.1 Annoyance of Band-Pass Noise 233
11.1.2 Annoyance of Traffic Noise 238
11.2 Noise Annoyance in Relation to Spatial Factors 243
11.2.1 Experiment 1: Effects of SPL and IACC Fluctuations 243
11.2.2 Experiment 2: Effects of Sound Movement 245
11.3 Effects of Noise and Music on Children 248
Part II Temporal and Spatial Sensations in the Human Visual System 253
12 Introduction to Visual Sensations 254
13 Temporal and Spatial Sensations in Vision 256
13.1 Temporal Sensations of Flickering Light 256
13.1.1 Conclusions 262
13.2 Spatial Sensations 262
14 Subjective Preferences in Vision 271
14.1 Subjective Preferences for Flickering Lights 271
14.2 Subjective Preferences for Oscillatory Movements 277
14.3 Subjective Preferences for Texture 281
14.3.1 Preferred Regularity of Texture 281
14.3.2 Application: Spatial ''Vibrato'' in a Drawing 282
15 EEG and MEG Correlates of Visual Subjective Preferences 284
15.1 EEG Correlates of Preferences for Flickering Lights 284
15.1.1 Persistence of Alpha Rhythms 284
15.1.2 Spatial Extent of Alpha Rhythms 292
15.2 MEG Correlates of Preferences for Flickering Lights 299
15.2.1 MEG Correlates of Sinusoidal Flicker 299
15.2.2 MEG Correlates of Fluctuating Flicker Rates 305
15.3 EEG Correlates of Preferences for Oscillatory Movements 306
15.4 Hemispheric Specializations in Vision 312
16 Summary of Auditory and Visual Sensations 314
16.1 Auditory Sensations 315
16.1.1 Auditory Temporal Sensations 315
16.1.2 Auditory Spatial Sensations 316
16.1.3 Auditory Subjective Preferences 317
16.1.4 Effects of Noise on Tasks and Annoyance 318
16.2 Visual Sensations 320
16.2.1 Temporal and Spatial Sensations in Vision 321
16.2.2 Visual Subjective Preferences 322
References 324
Glossary of Symbols 339
Abbreviations 345
Author Index 348
Subject Index 352