SAP NetWeaver Business Warehouse: Administration and Monitoring

Milco OEsterholm is an SAP BI solution architect and cofuonder of the Swedish consulting company E1NS (www.eins.se). As a project leader, he has managed large SAP implementation projects for many years. Currently, alongside his work in BI architecture teams, he manages the operation of SAP NetWeaver BW for various clients. Milco OEsterholm has been active in technical consulting and project management in the BI area of SAP for several years, He also has many years of experience of FI-CO and SD development. Olaf Klostermann is an SAP BI solution architect at K-42 eG (www.k-42.com), where he is a cofounder and board member. His consulting specializations are technical issues in SAP NetWeaver BW, particularly architecture and performance. He has many years of international project experience in the design and implementation of SAP NetWeaver BW, including several years at SAP in Germany. Previously, he worked for a long period as a developer and technical consultant for database systems and BI solutions.

... Preface ... 19 PART I ... Basic Principles ... 23 1 ... SAP Implementation Concept ... 25 1.1 ... IT Practices and Scenarios ... 25 1.1.1 ... Enterprise Data Warehousing ... 27 1.1.2 ... Enterprise Reporting, Query, and Analysis ... 28 1.1.3 ... Business Planning and Analytical Services ... 28 1.2 ... Usage Types ... 30 2 ... Overview of AS ABAP and AS Java ... 31 2.1 ... SAP NetWeaver Application Server ABAP ... 31 2.2 ... SAP NetWeaver Application Server Java ... 33 2.3 ... Cooperation of Both Platforms ... 34 2.4 ... SAP NetWeaver Portal ... 37 2.4.1 ... Portal Platform ... 37 2.4.2 ... SAP NetWeaver BW Software Components ... 39 2.5 ... Basis Parameters ... 41 2.5.1 ... Determining Parameters ... 42 2.5.2 ... Recommendations ... 44 2.5.3 ... Recommendations for BI Java ... 47 2.5.4 ... Recommendations for Parameters in the Source System ... 48 2.6 ... RSADMIN Parameters ... 50 2.6.1 ... Parameters ... 51 2.6.2 ... Obsolete Parameters ... 65 2.7 ... Lock Management ... 67 2.8 ... Number Range Buffer ... 70 2.8.1 ... Number Ranges in an SAP NetWeaver BW System ... 71 2.8.2 ... Analysis and Repair ... 73 3 ... Database Management ... 75 3.1 ... Indexes ... 75 3.1.1 ... Primary Index and Secondary Index ... 76 3.1.2 ... Clustered Index ... 76 3.1.3 ... Main Index Types ... 77 3.1.4 ... Indexes for InfoCubes ... 80 3.1.5 ... Indexes for Master Data ... 83 3.1.6 ... Indexes for DataStore Objects ... 84 3.1.7 ... Index Management in an SAP NetWeaver BW System ... 85 3.1.8 ... Temporarily Deleting Indexes ... 88 3.1.9 ... DB Statistics ... 89 3.2 ... Database Memory Parameters for BW Objects ... 90 3.3 ... Buffering InfoObject Tables ... 92 3.4 ... DBA Cockpit ... 93 3.4.1 ... Database Monitoring and Administration ... 94 3.4.2 ... New Functions ... 94 3.4.3 ... Restrictions ... 95 3.4.4 ... Postprocessing ... 95 3.5 ... Provider-Specific Information ... 96 3.5.1 ... Database Management Systems DB2, DB4, and DB6 ... 96 3.5.2 ... IBM DB2 RUNSTATS ... 96 3.5.3 ... RSADMIN Parameter for IBM DB2 ... 97 3.5.4 ... Statistics in Microsoft SQL Server ... 99 3.6 ... Backup and Recovery Strategies ... 100 4 ... System Connections and Access ... 103 4.1 ... SAP NetWeaver BW Source Systems ... 103 4.1.1 ... Creating Source Systems ... 104 4.1.2 ... Logical System Name ... 106 4.1.3 ... Maintaining Source System IDs ... 107 4.2 ... IDoc, ALE, RFC, and Similar Technology ... 107 4.2.1 ... RFC and tRFC ... 107 4.2.2 ... IDoc Interface ... 108 4.2.3 ... Application Link Enabling ... 111 4.2.4 ... IDoc Communication During Data Extraction ... 112 4.3 ... Web Services, SOAP, and Similar Technology ... 116 4.3.1 ... SOA Manager ... 116 4.3.2 ... Data Transfer Using Web Services ... 117 4.4 ... BAPI, MDX, and Similar Technology ... 118 4.4.1 ... MDX ... 119 4.4.2 ... OLE DB for OLAP ... 120 4.4.3 ... OLAP BAPI ... 120 4.4.4 ... XML for Analysis ... 121 5 ... Monitoring and Analysis Tools ... 123 5.1 ... General Tools (SAP Basis) ... 125 5.1.1 ... SAP Central Process Scheduling ... 125 5.1.2 ... Runtime Analysis (Transaction SE30) ... 125 5.1.3 ... Application Log (Transaction SLG1) ... 128 5.1.4 ... System Log (Transaction SM21) ... 132 5.1.5 ... Job Overview (Transaction SM37) ... 135 5.1.6 ... Process Overview (Transaction SM50) ... 137 5.1.7 ... System Trace (Transaction ST01) ... 139 5.1.8 ... Tune Summary (Transaction ST02) ... 142 5.1.9 ... Workload Monitor (Transaction ST03N) ... 146 5.1.10 ... Database Performance Analysis (Transaction ST04) ... 147 5.1.11 ... Performance Analysis (Transaction ST05) ... 149 5.1.12 ... OS Monitor (Transaction ST06N) ... 150 5.1.13 ... Application Monitor (Transaction ST07) ... 150 5.1.14 ... ABAP Runtime Error (Transaction ST22) ... 151 5.2 ... Special SAP NetWeaver BW System Tools ... 154 5.2.1 ... BI Monitor (Transaction BWCCMS) ... 154 5.2.2 ... BI Background Management (Transaction RSBATCH) ... 155 5.2.3 ... Displaying SAP NetWeaver BW Jobs (Transaction RSM37) ... 159 5.2.4 ... Monitoring Process Chains (Transaction RSPCM) ... 160 5.2.5 ... Extraction Monitor (Transaction RSMO) ... 161 5.2.6 ... Query Monitor (Transaction RSRT) ... 163 5.2.7 ... Trace Tool (Transaction RSRTRACE) ... 165 5.2.8 ... Analyzing BW Objects (Transaction RSRV) ... 166 5.2.9 ... RS Trace Tool (Transaction RSTT) ... 183 5.2.10 ... Reporting Function Modules (Transaction RSZT) ... 184 6 ... Basic Principles of Processes and Objects ... 185 6.1 ... DataStore Object ... 185 6.2 ... InfoCubes ... 188 6.2.1 ... Real-Time InfoCubes ... 188 6.2.2 ... Further Processing of InfoCube Data ... 188 6.3 ... Aggregates ... 189 6.4 ... SAP NetWeaver BW Accelerator ... 190 6.4.1 ... How to Achieve High Performance ... 191 6.4.2 ... SAP NetWeaver BW Accelerator Architecture ... 192 6.5 ... Open Hub Destinations and InfoSpokes ... 194 6.5.1 ... Extraction Mode and Delta Administration ... 194 6.5.2 ... Open Hub Monitor ... 196 6.6 ... Reporting ... 196 6.6.1 ... OLAP Server ... 196 6.6.2 ... Internet Communication Framework ... 199 6.6.3 ... Documents ... 202 6.6.4 ... Internet Graphics Service ... 203 PART II ... SAP NetWeaver BW Administration ... 205 7 ... User Administration and Authorization Management ... 207 7.1 ... Basic Principles ... 207 7.1.1 ... AS ABAP Authorization Concept ... 207 7.1.2 ... User Administration ... 208 7.1.3 ... Central User Administration ... 209 7.1.4 ... User Information System ... 210 7.1.5 ... Identity Management ... 214 7.1.6 ... SAP GRC ... 215 7.1.7 ... AS Java Authorization Concept ... 216 7.2 ... Basic Principles of Authorizations in the SAP NetWeaver BW System ... 219 7.3 ... Role Maintenance in Transaction PFCG ... 220 7.4 ... Analysis Authorizations ... 226 7.4.1 ... New Concept with SAP NetWeaver 7.0 ... 227 7.4.2 ... Authorization Dimensions ... 228 7.4.3 ... Management of Analysis Authorizations ... 230 7.4.4 ... Example of Creating Analysis Authorizations ... 232 7.4.5 ... Defining Authorizations ... 234 7.4.6 ... Troubleshooting ... 243 7.4.7 ... Migration ... 247 8 ... Archiving and Data Maintenance ... 249 8.1 ... Archiving Concepts ... 249 8.2 ... Data Archiving Process ... 252 8.3 ... Archive Development Kit ... 255 8.3.1 ... Tasks ... 256 8.3.2 ... Archiving Data and Monitoring Activities ... 259 8.3.3 ... Accessing Archived Data ... 262 8.3.4 ... Other Archiving Functions ... 264 8.3.5 ... Special Characteristics of Write-Optimized DataStore Object ... 265 8.4 ... Nearline Storage ... 266 8.4.1 ... Basic Principles ... 266 8.4.2 ... Creating a Nearline Storage Connection ... 268 8.4.3 ... Changes to Archived InfoProviders ... 269 8.5 ... Archiving Request Management Data ... 270 8.6 ... Archiving PSA Data ... 272 8.7 ... Scheduling Archiving Using Process Chains ... 273 8.8 ... Decision-Making Support for Archiving Concept ... 275 8.9 ... Partitioning and Clustering ... 276 8.9.1 ... Partitioning ... 277 8.9.2 ... Repartitioning ... 281 8.9.3 ... Clustering ... 285 8.9.4 ... Reclustering ... 287 8.10 ... Master Data Cleansing ... 288 8.10.1 ... Deleting Individual Master Data Records ... 289 8.10.2 ... Deleting All Master Data and Texts ... 289 9 ... Maintenance ... 291 9.1 ... Support Package Stacks, Support Packages, and Patches ... 292 9.2 ... ABAP Support Packages ... 294 9.2.1 ... Functions ... 294 9.2.2 ... Adjusting Modifications ... 296 9.3 ... Java Support Packages ... 300 9.4 ... Transport System ... 303 9.4.1 ... Transport Landscape ... 304 9.4.2 ... Change and Transport System ... 306 9.4.3 ... Transporting Roles ... 308 9.4.4 ... Special Feature When Transporting BW Objects ... 309 9.4.5 ... SAP Solution Manager ... 320 9.4.6 ... Organization ... 324 9.5 ... Maintenance Optimizer ... 326 9.6 ... SAP NetWeaver BW Accelerator Revisions ... 329 9.7 ... System Copies ... 329 9.7.1 ... Deleting Source System Assignments in the Target SAP NetWeaver BW System after Copying ... 330 9.7.2 ... Renaming the Target SAP NetWeaver BW System and Conversion of Logical System Names ... 331 9.7.3 ... Executing SAP NetWeaver BW Specific Adjustments ... 332 10 ... Technical Content and BI Administration Cockpit ... 333 10.1 ... Updating Statistics Data ... 334 10.2 ... Installing the Technical Content ... 335 10.2.1 ... Scheduling Process Chains ... 336 10.2.2 ... Activating the Direct Access for Virtual Providers ... 337 10.2.3 ... BI Administration Business Package ... 338 10.2.4 ... Optional Definition of Importance ... 338 10.3 ... Runtimes of Queries ... 340 10.3.1 ... Technical Content for Query Runtime Statistics ... 340 10.3.2 ... Query Execution ... 341 10.3.3 ... Details of Statistics Information ... 343 10.4 ... Data Load Status ... 345 10.5 ... Data Load Statistics ... 348 10.6 ... Evaluation of CPH Data ... 354 10.7 ... Workload Monitor (Transaction ST03) ... 356 10.8 ... Loading and Deleting Statistics Data ... 357 10.9 ... Enhancements ... 358 10.9.1 ... Example: BI Administration Cockpit with SAP NetWeaver BW 7.0 Objects ... 358 10.9.2 ... Example: Proactive Alerts ... 359 11 ... Process Chains ... 361 11.1 ... Processes Relevant for the Operation ... 362 11.1.1 ... Interrupt Process ... 363 11.1.2 ... Start Process ... 363 11.1.3 ... AND (Last), OR (Every), and EXOR (First) ... 364 11.1.4 ... ABAP Program ... 365 11.1.5 ... Operating System Command ... 366 11.1.6 ... Local Process Chain and Remote Process Chain ... 366 11.1.7 ... Deciding Between Multiple Alternatives ... 367 11.2 ... Administration of Process Chains ... 368 11.2.1 ... User for Execution ... 368 11.2.2 ... Starting Terminated Processes ... 368 11.2.3 ... Process Status Valuation ... 369 11.2.4 ... Executing Process Chains Synchronously ... 370 11.2.5 ... Alerting ... 370 11.2.6 ... Batch Process Requirements ... 371 11.2.7 ... Monitoring Process Chains ... 372 11.3 ... Jobs in Process Chains ... 375 12 ... Administration of SAP NetWeaver BW Processes in Detail ... 377 12.1 ... Extraction and Load Processes ... 377 12.1.1 ... Delta Queue ... 378 12.1.2 ... Number of Packages and Request Size ... 382 12.1.3 ... Common Loading Processes ... 383 12.1.4 ... InfoPackage in Process Chains ... 385 12.1.5 ... Number of Dialog Processes ... 385 12.1.6 ... Defining the Server or Host and User ... 388 12.1.7 ... Direct Loading of Master Data ... 391 12.1.8 ... Extractor Checker ... 392 12.1.9 ... IDoc Errors ... 395 12.1.10 ... Real-Time Data Acquisition ... 396 12.1.11 ... Replication of DataSources ... 399 12.2 ... Change Run ... 404 12.2.1 ... Detailed Flow ... 405 12.2.2 ... Important Notes ... 409 12.3 ... Administration of InfoCubes ... 412 12.3.1 ... InfoCube Content ... 412 12.3.2 ... Selective Deletion ... 415 12.3.3 ... Requests in InfoCubes ... 415 12.3.4 ... Automatic Further Processing ... 418 12.3.5 ... Rebuilding InfoCubes ... 419 12.4 ... Performance Settings for InfoCubes ... 420 12.4.1 ... Indexes ... 421 12.4.2 ... Database Statistics ... 421 12.5 ... Compressing InfoCubes ... 422 12.5.1 ... Compression After a Change Run ... 424 12.5.2 ... Compressing All Aggregates ... 425 12.5.3 ... Noncumulative InfoCubes ... 425 12.6 ... Further Processing of Data in a DSO ... 426 12.6.1 ... Activating Data ... 426 12.6.2 ... Analysis of Unexpected Data ... 427 12.6.3 ... Troubleshooting ... 430 12.6.4 ... Simulating and Debugging a DTP Request ... 432 12.7 ... Deleting Data from a DSO ... 433 12.7.1 ... Delete by Request ... 434 12.7.2 ... Selective Deletion ... 435 12.7.3 ... Deleting from the Change Log ... 437 12.7.4 ... Deleting Already Updated Data ... 437 12.8 ... Monitoring Analysis Processes ... 438 12.8.1 ... Exceeding the Maximum Allowed Runtime ... 438 12.8.2 ... Memory Overflow During Executions and Simulations ... 439 12.8.3 ... Using Queries ... 441 13 ... Reporting Monitoring and Administration ... 443 13.1 ... Administration of the BEx Analyzer ... 443 13.1.1 ... SAP NetWeaver Check Workstation Wizard ... 443 13.1.2 ... SAP BEx Installation Check ... 444 13.1.3 ... Statistics Workbook ... 445 13.1.4 ... BEx Analyzer Trace ... 447 13.2 ... Query Administration ... 448 13.2.1 ... Processing Queries ... 448 13.2.2 ... Query Read Mode ... 449 13.2.3 ... Cache Mode ... 450 13.2.4 ... Delta Caching ... 453 13.2.5 ... Caching for Virtual Characteristics and Key Figures ... 454 13.2.6 ... Backup Versions ... 455 13.3 ... Internet Communication Frameworks Administration ... 455 13.3.1 ... ICF Services ... 456 13.3.2 ... Internet Communication Manager ... 457 13.4 ... OLAP Caching ... 460 13.5 ... Aggregates ... 465 13.5.1 ... Displaying Aggregates and Their Components ... 468 13.5.2 ... Further Processing Functions for Aggregates ... 471 13.5.3 ... Activating Aggregates and Providing Them with Data ... 472 13.5.4 ... Checking Aggregates ... 476 13.6 ... SAP NetWeaver BW Accelerator ... 482 13.6.1 ... Connection to SAP NetWeaver BW Accelerator ... 483 13.6.2 ... Which InfoCubes Should Be Indexed ... 485 13.6.3 ... SAP NetWeaver BW Accelerator Index Maintenance Wizard ... 487 13.6.4 ... Effects of Data Changes ... 490 13.6.5 ... SAP NetWeaver BW Accelerator Delta Indexes ... 492 13.6.6 ... Information about Existing Indexes ... 493 13.6.7 ... Analysis and Repair of Indexes ... 495 13.6.8 ... Analysis of SAP NetWeaver BW Accelerator Data ... 502 13.6.9 ... Tracing of SAP NetWeaver BW Accelerator ... 504 13.7 ... Information Broadcasting ... 506 13.7.1 ... Sending Email ... 507 13.7.2 ... Reorganization ... 508 13.8 ... Results in Reporting ... 509 13.8.1 ... Size Restrictions for Result Sets ... 510 13.8.2 ... Analysis of Report Results ... 511 13.8.3 ... Query Execution in Safe Mode ... 512 13.8.4 ... Different Data in ABAP and Java ... 513 13.8.5 ... Incorrect Data When Using Aggregates ... 514 13.9 ... Integrating SAP NetWeaver BW Contents into SAP NetWeaver Portal ... 515 13.10 ... Analysis and Monitoring in the Portal ... 517 13.10.1 ... Availability Checks ... 517 13.10.2 ... Monitoring of Log Files ... 518 13.10.3 ... Usage of the Portal Cache (BW iViews) ... 519 13.11 ... Communication Problems with BEx Web Java ... 520 13.11.1 ... Usage of RFC ... 521 13.11.2 ... Usage of HTTP(S) ... 524 13.12 ... Performance of Web Applications ... 525 13.12.1 ... Runtime Measurements in BI Java ... 525 13.12.2 ... Guidelines for Performance Improvements ... 525 PART III ... Management and Support ... 529 14 ... SAP Support ... 531 14.1 ... Tools for the Support ... 531 14.2 ... SAP Solution Manager ... 533 14.3 ... SAP Active Global Support ... 534 14.3.1 ... SAP Enterprise Support ... 535 14.3.2 ... Run SAP ... 536 14.3.3 ... SAP MaxAttention ... 537 14.4 ... SAP Service Marketplace ... 538 14.5 ... Service Connections ... 541 14.5.1 ... Basic Setup ... 541 14.5.2 ... BW RFC and BW GUI Service Types ... 545 14.5.3 ... HTTPconnect Service Type ... 545 14.5.4 ... Connection to SAP NetWeaver BW Accelerator ... 546 14.6 ... Customer Messages ... 547 14.6.1 ... Procedure for SAP NetWeaver BW-Specific Messages ... 548 14.6.2 ... Priority ... 551 14.6.3 ... Secure Area for Access Data ... 551 14.6.4 ... Faster Processing ... 553 14.6.5 ... Message Escalation ... 554 14.7 ... Additional Functions in the SAP Service Marketplace ... 555 14.7.1 ... SAP Notes Search ... 555 14.7.2 ... SAP Software Change Registration ... 557 14.7.3 ... Namespaces ... 557 14.7.4 ... Product Availability Matrix ... 559 14.8 ... BI Diagnostics & Support Desktop Tool ... 559 14.9 ... SAP EarlyWatch Alert and other Solutions ... 561 14.9.1 ... SAP EarlyWatch Alert in SAP Solution Manager ... 563 14.9.2 ... SAP EarlyWatch Alert Processed at SAP ... 563 14.9.3 ... Additional Services ... 564 15 ... Organizing SAP NetWeaver BW Administration Teams ... 565 15.1 ... Teams and Responsibilities ... 565 15.2 ... Best Practices (ITIL) ... 566 15.2.1 ... Service Desk ... 567 15.2.2 ... Technical Management ... 568 15.2.3 ... Application Management ... 568 15.2.4 ... Operations Management ... 569 15.3 ... Operating Documentation ... 569 15.4 ... Regular Tasks ... 571 ... Appendices ... 575 A ... Transactions, Reports, and Function Modules ... 575 B ... Glossary ... 581 C ... Bibliography ... 589 D ... The Authors ... 591 ... Index ... 593