Testing Commercial-off-the-Shelf Components and Systems (eBook)

  Sami Beydeda is a research associate at the computer science department of the University of Leipzig, Germany. His research interests include quality assurance of software components and component-based systems. Sami Beydeda has written his PhD on "The Self-Testing COTS Components (STECC) Method" and has published several articles on testing in component-based development. He was responsible for several software development project in industry, in the financial sector in particular, and for research projects at the Universities of Dortmund and Leipzig. Sami Beydeda is a program committee member of COMPSAC 2004, Workshop on Quality Assurance and Testing of Web-Based Applications 2004, AICCSA 2005. Volker Gruhn is a full professor at the computer science department of the University of Leipzig, Germany. His research interests are component-based development, software processes for distributed systems, architecture of electronic commerce applications and workflow management. He has been chief technical officer of a German software house called LION from 1992 to 1996. In this position he was responsible for a software development department of 150 people. Volker Gruhn was a PC member of major software engineering conferences (ESEC95, ESEC97, ICSE2004) and several software process workshops and conferences. He was program chair of the 6th European Workshop on Software Process Technology and the 8th European Software Engineering Conference. Volker Gruhn has already organized a workshop at ICSE, the Engineering Distributed Objects Workshop during ICSE 99. In 1997 Volker Gruhn co-founded adesso AG, a German software house specialized in component-based software development. adesso AG currently has 170 employees.

Preface 5
Acknowledgments 8
Contents 11
Basic Concepts and Terms 13
1 Software Development in the Large 13
2 Components as Building Blocks 16
3 Component Models and Frameworks 20
4 Commercial-off-the-Shelf (COTS) Components 26
Context of the Book 27
1 Lack of information in development of and with components 27
2 Issues in Testing Components and Component-based Systems 35
Testing Components Context-Independently 43
Testing Polymorphic Behavior of Framework Components 44
1 Introduction 44
2 A Diagram Editor Framework Component 47
3 Interaction Specification 50
4 Testing the Interaction Specifications 57
5 Prototype Implementation 62
6 Related Work 63
7 Conclusions and Future Work 64
COTS Component Testing through Built-In Test 66
1 Introduction 66
2 Components and COTS-based Products 67
3 Component Testability, BIT 70
4 COTS Components and BIT-Based Application Evolution Scenarios 75
5 Conclusion 80
Acknowledgments 81
COTS Component Testing through Aspect- Based Metadata 82
1 Introduction 82
2 Aspects and Metadata for Testing 85
3 An Aspect-Based Environment for Component Testing 93
4 Conclusion and Future Work 99
5 Acknowledgments 99
Automatic Testing of Exception Handling Code 100
1 Introduction 100
2 Related Work 102
3 Problem Description and Motivation 103
4 Detecting Failure Non-Atomic Methods 104
5 Implementations 109
6 Experimental Results 111
7 Conclusion 115
Testing Components in the Context of a System 117
A Process and Role-Based Taxonomy of Techniques to Make Testable COTS Components 118
1 Introduction 118
2 State Machine Models 122
3 Built-In Tests 125
4 Built-In Contract Testing 127
5 Interface Probing 130
6 Traceable Components 133
7 Metacontent 137
8 Binary Reverse Engineering 140
9 Fault Injection Support 141
10 Testable Beans 143
11 Retro Components 144
12 Component Test Bench 145
13 Self-Testing Components 146
14 Conclusions 149
Evaluating the Integrability of COTS Components – Software Product Family Viewpoint 150
1 Introduction 150
2 The Impact of Architectural Properties on Integrability 152
3 Evaluation Methods of COTS Components for Integrability 166
4 Conclusions 176
A User-Oriented Framework for Component Deployment Testing 177
1 Introduction 177
2 CB Development Process and Testing Phase 181
3 Related Work 184
4 Overview of the CDT Framework 187
5 A Case Study 189
6 Using CDT 191
7 Framework Architecture 198
8 Conclusions and Future Work 201
Acknowledgments 202
Modeling and Implementation of Built- In Contract Tests 203
1 Introduction 203
2 Built-In Contract Testing 205
3 Generation of Built-In Contract Tests from UML 208
4 Implementation and Execution of Built-in Tests 211
5 A Working Example 212
6 Summary and Conclusion 217
Acknowledgment 219
Using a Specification Approach to Facilitate Component Testing 220
1 Context and Orientation 220
2 Specification Approach 221
3 Application to COTS Component Testing 233
A Methodology of Component Integration Testing 245
1 Introduction 245
2 Overview of the Observation Theory 247
3 Behavioral Observation in Component Integration Testing 261
4 Conclusion 273
5 Acknowledgments 275
Testing Component-Based Systems 276
Modeling and Validation of Publish/ Subscribe Architectures 277
1 Introduction 277
2 Our Approach 279
3 Modeling 280
4 Validation 285
5 Tool Support 291
6 Related Work 292
7 Conclusions and Future Work 294
Performance Testing of Distributed Component Architectures 296
1 Introduction 296
2 Related Work 299
3 Approach 300
4 Preliminary Assessment 309
5 Scope and Extensions 313
6 Conclusions and Future Work 316
Acknowledgments 317
A Generic Environment for COTS Testing and Quality Prediction 318
1 Introduction 318
2 A Development Framework for Component-Based Software Systems 321
3 Quality Assurance for Component-Based Software Systems 323
4 A Quality Assurance Model for Component-Based Software Systems 324
5 A Generic Quality Assessment Environment for Component- Based Systems: ComPARE 331
6 Experiment and Discussion 339
7 Conclusion 349
Acknowledgment 350
Automatic Testing for Robustness Violations 351
1 Introduction 351
2 Goals and Objectives 353
3 Methodology 356
4 Example: Fault-containment Wrapper 362
5 Related Work 363
6 Conclusion 364
Testing Component-Based Systems Using FSMs 365
1 Introduction 365
2 Demonstrative Example 368
3 Description of the Testing Technique 373
4 Conclusions 381
References 382
Index 407