Semantic Multimedia and Ontologies (eBook)

Acknowledgments 5
Contents 7
Contributors 9
List of Abbreviations 13
Part I Introduction 18
Introduction to Semantic Multimedia 19
1.1 Introduction 19
1.2 Multimedia Ontologies 23
1.3 Multimedia Ontologies, Analysis and Reasoning – Theory 24
1.4 Applications of Semantic Multimedia 27
1.5 Alternative Approaches to Multimedia Ontologies 27
1.6 Conclusions 28
References 28
Part II Multimedia Ontologies, Analysis and Reasoning – Theory 31
Multimedia Content Description Using Semantic Web Languages 33
2.1 Introduction 33
2.2 Multimedia Content Description Using MPEG-7 35
2.3 Web Ontology Languages 43
2.4 MPEG-7 Ontologies 50
2.5 Mapping Approach 52
2.6 Use Cases 55
2.7 An Integrated Ontological Infrastructure for the Semantic Description of Multimedia Content 60
2.8 Conclusions 68
References 68
Ontology-Based Reasoning Techniques for Multimedia Interpretation and Retrieval 71
3.1 Introduction 71
3.2 Ontology-Based Information Retrieval 74
3.3 Automatic Construction of Metadata for Media Objects 87
3.4 Uncertain and Ambiguous Interpretations 102
3.5 Conclusions 110
References 110
Introducing Context and Reasoning in Visual Content Analysis: An Ontology- Based Framework 115
4.1 Introduction 115
4.2 RelevantWork 117
4.3 Ontology Infrastructure 120
4.4 Context Analysis 123
4.5 Constraint Reasoning to Eliminate Ambiguities in Labelled Images 128
4.6 Experimental Results and Evaluation 132
4.7 Conclusions and Further Discussions 135
References 136
Audio Content Analysis 139
5.1 Introduction 139
5.2 Overview of Audio Content Analysis 141
5.3 General Audio Classification and Segmentation 145
5.4 Speaker Segmentation 148
5.5 Spoken Content Indexing and Spoken Document Retrieval 158
5.6 Music Content Analysis 164
5.7 Summary and Concluding Remarks 172
References 173
Part III Applications Using Semantic Web Technologies 179
Personalised Multimedia Summaries 181
6.1 Introduction 181
6.2 Personalised Multimedia Summaries 183
6.3 Use Case – Personalised Soccer Summaries 184
6.4 Contextual Coherence of Personalised Summaries 192
6.5 Conclusions 197
References 198
The Role of Ontologies for 3D Media Applications 201
7.1 Introduction 201
7.2 3D Media Representation: From Geometry to Semantics 203
7.3 Knowledge and Ontologies for 3D Media Applications 208
7.4 3D Application Ontologies: The Experience of AIM@SHAPE 213
7.5 Conclusions 219
References 220
The Application of Semantic Web Technologies to Multimedia Data Fusion within eScience 223
8.1 Introduction 223
8.2 The Relevance of Semantic Web Technologies to eScience 224
8.3 Data-Driven Discovery of Novel Fuel Cell Materials 226
8.4 Semantic WildNet 232
8.5 Ethnographic Media Analysis 236
8.6 Conclusions 240
References 241
Part IV Applications Using Alternative Approaches to Multimedia Ontologies 243
Mind the Gaps – Finding the Appropriate Dimensional Representation for Semantic Retrieval of Multimedia Assets 245
9.1 Introduction: Multimedia Retrieval 245
9.2 Dimensionality Reduction Techniques 253
9.3 The Journey of Latent Semantic Analysis from the Textual Domain to the Multimedia Landscape 257
9.4 Conclusion 265
References 265
Filling the Semantic Gap in Video Retrieval: An Exploration 269
10.1 Introduction: Bridging the Semantic Gap 269
10.2 Are Semantic Concepts Useful to Video Retrieval? 270
10.3 What Kinds of Concepts Should be Chosen? 279
10.4 How can we Use the Concepts to Help Video Search? 285
10.5 Conclusions and Future Work 290
References 291
Part V Conclusion 295
Conclusions Relating to Semantic Multimedia and Ontologies 297
11.1 Reflections on Semantic Multimedia and Ontologies 297
11.2 Harmonisation of Multimedia Ontologies 298
11.3 For Further Reading and Research 299
Further Reading 299
Web Resources 301
Index 303