Multimedia Signal Coding and Transmission (eBook)

Preface 6
Table of Contents 7
1 Introduction 12
1.1 Concepts and terminology 12
1.1.1 Signal representation by source coding 14
1.1.2 Optimization of transmission 17
1.2 Signal sources and acquisition 18
1.3 Digital representation of multimedia signals 21
1.3.1 Image and video signals 22
1.3.2 Speech and audio signals 29
1.3.3 Need for compression technology 29
1.4 Problems 30
2 Fundamentals 32
2.1 Signals and systems 32
2.1.1 Elementary signals 32
2.2 Signals and Fourier spectra 38
2.2.1 Spectra over two- and multi-dimensional coordinates 38
2.2.2 Spatio-temporal signals 39
2.3 Sampling of multimedia signals 42
2.3.1 Separable two-dimensional sampling 45
2.3.2 Non-separable two-dimensional sampling 46
2.4 Discrete signal processing 57
2.4.1 LSI systems 57
2.4.2 Discrete Fourier transform 58
2.4.3 z transform 59
2.4.4 Multi-dimensional LSI systems 61
2.5 Statistical analysis 65
2.5.1 Sample statistics 65
2.5.2 Joint statistical properties 69
2.5.3 Spectral properties of random signals 76
2.5.4 Markov chain models 76
2.5.5 Statistical foundation of information theory 79
2.6 Linear prediction 85
2.6.1 Autoregressive models 85
2.7 Linear block transforms 105
2.7.1 Orthogonal basis functions 105
2.7.2 Types of orthogonal transforms 109
2.7.3 Efficiency of transforms 122
2.7.4 Transforms with block overlap 123
2.8 Filterbank transforms 126
2.9 Problems 160
3 Perception and Quality 167
3.1 Properties of vision 167
3.1.1 Physiology of the eye 167
3.1.2 Sensitivity functions 169
3.1.3 Color vision 172
3.1.4 Binocular vision and reproduction 173
3.2 Properties of hearing 175
3.2.1 Physiology of the ear 175
3.2.2 Sensitivity functions 176
3.3 Quality metrics 180
3.3.1 Objective signal quality metrics 181
3.3.2 Subjective assessment 188
3.4 Problems 192
4 Quantization and Coding 194
4.1 Scalar quantization and pulse code modulation 194
4.2 Coding theory 201
4.2.1 Source coding theorem and rate-distortion function 201
4.2.2 Rate-distortion function for correlated signals 202
4.2.3 Rate-distortion function for multi-dimensional signals 206
4.3 Rate-distortion optimization of quantizers 208
4.4 Entropy coding 212
4.4.1 Properties of variable-length codes 212
4.4.2 Huffman code design 216
4.4.3 Systematic variable-length codes 217
4.4.4 Arithmetic coding 222
4.4.5 Adaptive and context-dependent entropy coding 227
4.4.6 Entropy coding and transmission errors 231
4.4.7 Lempel-Ziv coding 233
4.5 Vector quantization 234
4.5.1 Basic principles of VQ 235
4.5.2 VQ with uniform codebooks 239
4.5.3 VQ with non-uniform codebooks 241
4.5.4 Structured codebooks 245
4.5.5 Adaptive VQ 249
4.6 Trellis-coded quantization 254
4.7 Problems 256
5 Methods of Signal Compression 260
5.1 Run-length coding 260
5.2 Predictive coding 263
5.2.1 Open-loop and closed-loop prediction systems 263
5.2.2 Non-linear and shift-variant prediction 266
5.2.3 Effects of transmission losses 267
5.2.4 Vector prediction 268
5.2.5 Delayed-decision predictive coding 271
5.2.6 Prediction in multi-resolution pyramids 272
5.3 Transform coding 277
5.3.1 Gain in discrete transform coding 278
5.3.2 Quantization of transform coefficients 281
5.3.3 Coding of transform coefficients 285
5.3.4 Transform coding under transmission losses 288
5.4 Bit streams with multiple decoding capability 289
5.4.1 Simulcast and transcoding 289
5.4.2 Scalable coding 289
5.4.3 Multiple-description coding 291
5.5 Distributed source coding 293
5.6 Problems 295
6 Intra-picture Coding 297
6.1 Compression of binary pictures 297
6.1.1 Compression of bi-level images 297
6.1.2 Binary shape coding 302
6.1.3 Contour coding 304
6.2 Vector quantization of pictures 306
6.3 Predictive coding of pictures 308
6.3.1 2D prediction 308
6.3.2 2D block prediction 310
6.3.3 Quantization and encoding of prediction errors 312
6.3.4 Error propagation in 2D DPCM 315
6.3.5 Coding of side information in 2D predictive coding 315
6.4 Transform coding of pictures 318
6.4.1 Block transform coding 318
6.4.2 Quantization and coding of transform coefficients 320
6.4.3 Overlapping-block transform coding 332
6.4.4 Subband and wavelet transform coding 332
6.4.5 Local adaptation of transform bases by signal properties 339
6.5 Lossless and near-lossless picture coding 342
6.6 Synthesis based picture coding 344
6.6.1 Region-based coding 346
6.6.2 Color and texture synthesis 348
6.6.3 Synthesis of illumination effects 351
6.7 Fractal image coding 352
6.8 3D picture coding 355
6.9 Reconstruction filtering 356
6.10 Still picture coding standards 360
6.11 Problems 364
7 Inter-picture Coding 369
7.1 Intra-picture and replenishment coding 369
7.2 Hybrid video coding 372
7.2.1 Motion-compensated hybrid coders 372
7.2.2 Characteristics of inter-picture prediction error signals 374
7.2.3 Quantization error feedback and error propagation 377
7.2.4 Reference pictures in motion-compensated prediction 381
7.2.5 Accuracy of motion compensation 395
7.2.6 Hybrid coding of interlaced video signals 402
7.2.7 Optimization of hybrid encoders 405
7.2.8 Hybrid coding using subband/wavelet transforms 407
7.3 Spatio-temporal transform coding 409
7.3.1 Inter-picture transform and subband coding 409
7.3.2 Motion-compensated temporal filtering 413
7.3.3 Quantization and encoding of MCTF-based representations 418
7.4 Coding of side information (motion, modes, partitioning) 421
7.5 Scalable video coding 430
7.5.1 Scalability in hybrid video coding 431
7.5.2 Standardization in scalable video coding 438
7.6 Multi-view video coding 443
7.7 Synthesis based video coding 451
7.7.1 Region-based video coding 452
7.7.2 Super-resolution synthesis 455
7.7.3 Moving texture synthesis 455
7.8 Video coding standards 458
7.9 Problems 467
8 Speech and Audio Coding 470
8.1 Coding of speech signals 471
8.1.1 Linear predictive coding 471
8.1.2 Parametric (synthesis) coding 475
8.1.3 Speech coding standards 475
8.2 Generic audio, music and sound coding 477
8.2.1 Transform coding of audio signals 477
8.2.2 Synthesis based coding of audio and sound signals 482
8.2.3 Coding of stereo and multi-channel audio signals 485
8.2.4 Music and sound coding standards 493
9 Transmission and Storage of Multimedia Data 498
9.1 Digital multimedia services 498
9.2 Network interfaces 500
9.3 Adaptation for channel characteristics 504
9.3.1 Rate and transmission control 505
9.3.2 Error control 509
9.4 Media transport, storage and reproduction 515
9.4.1 Broadcast applications 516
9.4.2 Communication services 520
9.4.3 File storage 521
9.4.4 Internet and mobile media streaming 523
A Vector and Matrix Algebra 528
B Symbols and Variables 535
C Glossary and Acronyms 539
D References 543
E Index 558