Hands-On-Lab: Transform Data in Azure Data Factory using Visual Studio – Hive Activity

Azure Data Factory is a cloud-based data integration service that automates the movement and transformation of data. We can create data integration solutions using the Data Factory service that can read data from various data stores, transform/process the data, and publish result data to the data stores. Data Factory service allows us to create data pipelines that move and transform data, and then run the pipelines on a specified schedule (hourly, daily, weekly, etc.). We will be creating the Azure Data Factory using Visual Studio. In the first exercise, we will learn to configure Visual Studio and will also learn to create linked services using Visual Studio. In the second exercise, we will learn to create datasets. In the third exercise, we will learn to create pipeline, publish the Azure Data Factory using Visual Studio and see the result.

Exercise 1: Configure Visual Studio and Create Linked Services using Visual Studio
Exercise 2: Create datasets
Exercise 3: Create pipeline, Publish the Azure Data Factory using Visual Studio and see the result.

SQLMaestros Hands-On-Labs enables the practical way of learning. Each lab document consists of multiple exercises and each exercise consists of multiple tasks. Apart from step-by-step instructions, the HOL document contains images, explanations, observations, notes, tips & tricks to ensure a great learning experience. With each lab, you can practice a specific concept step-by-step. With our HOL documents, you will get hands-on with hundreds of topics in SQL Server & Microsoft Data Platform. Learn More.

Get weekly learning resources from SQLMaestros, right in your inbox. Subscribe to our Bulletins.