Multimedia Communication Systems

K. R. RAO is Professor of Electrical Engineering at the University of Texas at Arlington. He has authored or co-authored several additional leading texts in the field, including Techniques and Standards for Image/Video/Audio Coding, and Packet Video Communications over ATM Networks (Prentice Hall PTR). In 1975, with two other researchers, he introduced the Discrete Cosine Transform, one of today's most powerful digital signal processing techniques. He is a Fellow of the IEEE. ZORAN S. BOJKOVIC and DRAGORAD A. MILOVANOVIC are members of the Traffic & Transport and Electrical Engineering faculty at the University of Belgrade, Yugoslavia.

Preface.


Acknowledgments.


List of Acronyms.


1. Multimedia Communications.


Introduction. Multimedia Communication Model. Elements of Multimedia Systems. User Requirements. Network Requirements. Packet Transfer Concept. Multimedia Requirements and ATM Networks. Multimedia Terminals. Concluding Remarks.



2. Audio-Visual Integration.


Introduction. Media Interaction. Bimodality of Human Speech. Lip Reading. Speech-Driven Talking Heads. Lip Synchronization. Lip Tracking. Audio-to-Visual Mapping. Bimodal Person Verification. Joint Audio-Video Coding. Concluding Remarks.



3. Multimedia Processing in Communications.


Introduction. Digital Media. Signal-Processing Elements. Challenges of Multimedia Information Processing. Texture-Based Methods. Shape-Based Methods. Color-Based Methods. Perceptual Coding of Digital Audio Signals. Absolute Threshold of Hearing. Critical Band Frequency Analysis. Simultaneous Masking and the Spread of Masking. Temporal Masking. PE. Transform Audio Coders. Audio Subband Coders. Speech Coder Attributes. CD Audio Coding for Multimedia Applications. Image Coding. Video Coding. Watermarking. Organization, Storage and Retrieval Issues. Signal Processing for Networked Multimedia. NNs for Multimedia Processing. Multimedia Processors. Concluding Remarks.



4. Distributed Multimedia Systems.


Introduction. Main Features of a DMS. Resource Management of DMS. Networking. IP Networking. IP Multicast. Resource Reservation Protocol (RSVP). RTP. Performance Management. Fault Management. Configuration Management. Security Management. Accounting and Billing Management. Multimedia Operating Systems. CPU Management. Memory Management. I/O Management. File System Management. Distributed Multimedia Servers. Distributed Multimedia Applications. VoD. Telecooperation Infrastructure. Telecooperative Applications. Telemedicine. Basic Features of a Hypermedia System. The Web. Concluding Remarks.



5. Multimedia Communication Standards.


Introduction. MPEG Approach to Multimedia Standardization. MPEG-1 (Coding of Moving Pictures and Associated Audio). MPEG-2 (Generic Coding of Moving Pictures and Associated Audio). MPEG-2 Video-The Basics. MPEG-2 Video Syntax. MPEG-2 Video Scalability. MPEG-2 Video: Profiles and Levels. MPEG-4-Coding of Audiovisual Objects. Media_Objects. MPEG-4 Version 1. MPEG-4 Version_2. Extensions to MPEG-4 Beyond Version 2. Profiles in MPEG-4. Verification Testing: Checking MPEG's Performance. MPEG-4 Standardization Process. Requirements for MPEG-4. MPEG-4 Systems Architecture. Elementary Stream Management (ESM). Auxiliary Descriptors and Streams. Structuring Content by Grouping of Streams. Managing Content Complexity. Distributed Content-Handling Considerations. System Decoder Model (SDM) for ES Synchronization. MPEG-4 Systems BIFS. DMIF Computational Model. Shape-Coding Tools for MPEG-4 Natural Video. Motion Estimation and Compensation. Texture-Coding Tools. Multifunctional Coding. Sprite Coding. Scalability. Error Resilience. Relationship Between Natural and Synthetic Video Coding. Synthetic Images. Integration of Face Animation with Natural Video. FAPs. Face Model. Coding of FAPs. FIT. Integration of Face Animation and Text-to-Speech (TTS) Synthesis. BIFS for Facial Animation. 2D Mesh Coding. VO Tracking. 2D-Mesh Object Encoder/Decoder. MPEG-4 Natural Audio Coding. General Audio Coding (Advanced Audio Coding Based). Twin VQ. Speech Coding in MPEG-4 Audio. Scalability in MPEG-4 Natural Audio. Synthetic Audio in MPEG-4. Audio BIFS. Visual Object Types. Visual Profiles. Audio Object Types. Audio Profiles. Graphics. Systems Profiles. MPEG-4 Visual Texture Coding (VTC) and JPEG 2000 Image Compression Standards. MPEG-4 VTC. JPEG. PNG. Region of Interest (ROI) Coding. Scalability. Error Resilience. IPRs. Error Resilience. MPEG-7 Standardization Process of Multimedia Content Description. MPEG-7 Systems. MPEG-7 DDL. MPEG-7 Audio. MPEG-7 Visual. MPEG-7 MMDSs. MPEG-7 Reference Software (XM). MPEG-7 Conformance. MPEG-21 Multimedia Framework. MPEG-21 Digital Item Declaration. Content Representation. Digital Item Identification and Description. Content Management and Usage. Intellectual Property Management and Protection. Terminals and Networks. Event Reporting. ITU-T Standardization of Audiovisual Communication Systems (H.310, H.320, H.321, H.322, H.323, and H.324). H.320 Standard. Standards for Audiovisual Services Across ATM H.310 and H.321. Standard H.322-Guaranteed QoS LAN Systems. ITU-T H.323 Standard. H.324 Standard. H.261 Standard. H.263 Standard. H.263+ (H.263 Version 2) Standard. H.263++ Standard Development. H.26L Standard. Bit Rate_. Delay. Complexity. Quality. ITU-T Recommendation H.221. ITU-T Recommendation H.223. ITU-T Recommendation H.225. Common Control Protocol H.245_. IETF and Internet Standards. Classical IP Stack. IP Version 6_. Priority Field. Flow Label. IPv6 Addresses. Hop-by-Hop Options Header. Fragment Header_. Routing Header. IPv6 Security. Signaling. Session Control. Transport_. Network Infrastructure_. Multimedia Data for Network Use. Use of RTP_. System Architecture. MPEG-4 Server. MPEG-4 Client. Concluding Remarks.



6. Multimedia Communications Across Networks.


Packet Audio/Video in the Network Environment. Video Transport Across Generic Networks. Layered Compression. Layered Transmission. Error-Resilient Encoding. Decoder Error Concealment. Error-Resilient Entropy Code. Rate Control Techniques. Theoretical Foundation of the SRC. Video Compression. Requirements Imposed by Streaming Applications. Application Layer QoS Control. Continuous Media Distribution Services. Streaming Servers. Media Synchronization. Protocols for Streaming Video. Multimedia Transport Across ATM Networks. Multimedia Across IP Networks. MPEG Video Transmission on the Internet. Video Coding for Multimedia Across IP. Multimedia Across DSLs. Serial Transmission: TDM. Parallel Transmission Frequency Division Multiplexing. Internet Access Networks. Multimedia Across Wireless. Communication System (WBCS) for Multimedia. Speech Transmission in GSM. Video Across GSM. Mobile ATM. Mobile IP. Wireless Multimedia Delivery. SIP in Mobile Environment. Multicast Routing in Cellular Networks. Broadband Wireless Mobile. Digital Video Broadcasting (DVB). Data Transmission Using MPEG-2 and DVB. MPEG Program Stream. MPEG Transport Stream. Broadband Multimedia Satellite Systems. Multimedia Home Platform. Multimedia Car Platform. Digital Television Infrastructure for Interactive Multimedia Services. Interactive Broadcast Data (IDB) Services. Data Carousel Concept. Concluding Remarks.



References.


Index.


About the Authors.