Hands-On Data Warehousing with Azure Data Factory (eBook)

Leverage the power of Microsoft Azure Data Factory v2 to build hybrid data solutions

Key Features

• Combine the power of Azure Data Factory v2 and SQL Server Integration Services
• Design and enhance performance and scalability of a modern ETL hybrid solution
• Interact with the loaded data in data warehouse and data lake using Power BI

Book Description

ETL is one of the essential techniques in data processing. Given data is everywhere, ETL will always be the vital process to handle data from different sources.

Hands-On Data Warehousing with Azure Data Factory starts with the basic concepts of data warehousing and ETL process. You will learn how Azure Data Factory and SSIS can be used to understand the key components of an ETL solution. You will go through different services offered by Azure that can be used by ADF and SSIS, such as Azure Data Lake Analytics, Machine Learning and Databrick's Spark with the help of practical examples. You will explore how to design and implement ETL hybrid solutions using different integration services with a step-by-step approach. Once you get to grips with all this, you will use Power BI to interact with data coming from different sources in order to reveal valuable insights.

By the end of this book, you will not only learn how to build your own ETL solutions but also address the key challenges that are faced while building them.

What you will learn

• Understand the key components of an ETL solution using Azure Data Factory and Integration Services
• Design the architecture of a modern ETL hybrid solution
• Implement ETL solutions for both on-premises and Azure data
• Improve the performance and scalability of your ETL solution
• Gain thorough knowledge of new capabilities and features added to Azure Data Factory and Integration Services

Who this book is for

This book is for you if you are a software professional who develops and implements ETL solutions using Microsoft SQL Server or Azure cloud. It will be an added advantage if you are a software engineer, DW/ETL architect, or ETL developer, and know how to create a new ETL implementation or enhance an existing one with ADF or SSIS.

Christian Coté has been in IT for more than 12 years. He is an MS-certified technical specialist in business intelligence (MCTS-BI). For about 10 years, he has been a consultant in ETL/BI projects. His ETL projects have used various ETL tools and plain code with various RDBMSes (such as Oracle and SQL Server). He is currently working on his sixth SSIS implementation in 4 years. Michelle Gutzait has been in IT for 30 years as a developer, business analyst, and database consultant. She has worked with MS SQL Server for 20 years. Her skills include infrastructure and database design, performance tuning, security, HADR solutions, consolidation, very large databases, replication, T-SQL coding and optimization, SSIS, SSRS, SSAS, admin and infrastructure tools development, cloud services, training developers, DBAs, and more. She has been an Oracle developer, business analyst, and development team lead. Giuseppe Ciaburro holds a PhD in environmental technical physics and two master's degrees. His research is on machine learning applications in the study of urban sound environments. He works at Built Environment Control Laboratory, Università degli Studi della Campania Luigi Vanvitelli (Italy). He has over 15 years' experience in programming Python, R, and MATLAB, first in the field of combustion, and then in acoustics and noise control. He has several publications to his credit.

---

Leverage the power of Microsoft Azure Data Factory v2 to build hybrid data solutionsAbout This BookCombine the power of Azure Data Factory v2 and SQL Server Integration ServicesDesign and enhance performance and scalability of a modern ETL hybrid solutionInteract with the loaded data in data warehouse and data lake using Power BIWho This Book Is ForThis book is for you if you are a software professional who develops and implements ETL solutions using Microsoft SQL Server or Azure cloud. It will be an added advantage if you are a software engineer, DW/ETL architect, or ETL developer, and know how to create a new ETL implementation or enhance an existing one with ADF or SSIS.What You Will LearnUnderstand the key components of an ETL solution using Azure Data Factory and Integration ServicesDesign the architecture of a modern ETL hybrid solutionImplement ETL solutions for both on-premises and Azure dataImprove the performance and scalability of your ETL solutionGain thorough knowledge of new capabilities and features added to Azure Data Factory and Integration ServicesIn DetailETL is one of the essential techniques in data processing. Given data is everywhere, ETL will always be the vital process to handle data from different sources.Hands-On Data Warehousing with Azure Data Factory starts with the basic concepts of data warehousing and ETL process. You will learn how Azure Data Factory and SSIS can be used to understand the key components of an ETL solution. You will go through different services offered by Azure that can be used by ADF and SSIS, such as Azure Data Lake Analytics, Machine Learning and Databrick's Spark with the help of practical examples. You will explore how to design and implement ETL hybrid solutions using different integration services with a step-by-step approach. Once you get to grips with all this, you will use Power BI to interact with data coming from different sources in order to reveal valuable insights.By the end of this book, you will not only learn how to build your own ETL solutions but also address the key challenges that are faced while building them.Style and approachA step-by-step guide to develop data movement code using SSIS, Azure Data Factory, and database stored procedures for implementing intelligent BI solutions.