Recent Posts - page 2
-
Azure Data Factory – Data Flow – Pivot Transformation
The Azure Data Factory Data Flow Pivot transformation can be used to reshape the data from the previous post at https://blog.westmorr.com/2024/01/09/azure-data-factory-data-flow-aggregate-and-sort/. In that post, the following data slice was generated to visualize the total number of maintenance tickets by type… Read More ›
-
Azure Data Factory – Data Flow – Aggregate and Sort
Azure Data Factory Data Flow Aggregate and Sort transformations can be used similarly to SQL Groups and aggregates such as COUNT, SUM, MIN, etc. The Aggregate and Sort transformations are used against our existing Maintenance Tickets table to count the… Read More ›
-
Azure Data Factory – Exists Transformation
The Azure Data Factory Exists Transformation, is demonstrated in a reusable automation pattern. The business requirement is to create a ticket for every maintenance log if that hasn’t been done yet. Configure the Exists Transformation Maintenance_Logs and Maintenance_Tickets are both… Read More ›
-
Azure Data Factory – Data Flow – Select and Filter
The Azure Data Factory Select schema and Filter row modifiers can be used together to transform the source schema and exclude unwanted rows during data loading. In this example, Maintenance Tickets will be created from Maintenance Logs. The Select modifier… Read More ›
-
Azure Data Factory – Lookup and ForEach Activity
A Lookup Activity provides an easy way to obtain an iterator over dataset records. When this activity is used to read a configuration dataset, for example, then it is easy to pass this configuration into our pipelines, linked services, data… Read More ›
-
Azure Data Factory – Copy Data – SQL to Azure Data Lake
Learn how to use the Azure Data Factory, Copy Data activity, for copying SQL into an Azure Data Lake CSV.. Setup SQL Data I’ve created a table with the following schema in Azure SQL: CREATE TABLE Building ( Building_Id VARCHAR(5)… Read More ›
-
Azure Data Factory – Copy Data – Multiple Files
This post provides an example of how to work with the Azure Data Factory Copy Data activity to copy multiple files from an Azure Blob to Azure Data Lake storage. Uploading Multiple Files Continue with the “Buildings” example by uploading… Read More ›
-
Azure Data Factory – Copy Data – Logging
This post demonstrates the configuration and runtime results for Azure Data Factory Copy Data logging. Locating the Copy Data Logging Configuration The logging configuration for the “Copy data” activity is found in the “Settings” tab. Continuing with the Pipeline from… Read More ›
-
Azure Data Factory – Copy Data – Azure Blob to Azure Data Lake
This post demonstrates how to use Azure Data Factory Copy Data activity to copy an Azure Blob file to Data Lake. The steps followed are to: Create Azure Blob Content To start, upload a CSV file to an Azure Blob… Read More ›
-
R Programming with qplot in ggplot2
The qplot function produces insightful visualizations even with limited data and arguments. I’ll demonstrate some basic graphs in this introduction post to R programming with qplot in ggplot2. The ggplot2 library is required to use the qplot() function, t. Use… Read More ›
Featured Categories
SharePoint ›
-
Microsoft PowerApps – Tickets in SharePoint and SQL – Append Text Fields
September 29, 2019
-
Microsoft Power Apps – E-Mail App for SharePoint Contacts
September 10, 2019
Office 365 and O365 ›
-
Microsoft PowerApps – Filter Collection using List Box Control and Distinct
September 10, 2019
-
Microsoft PowerApps – Customer Data Table with Collections
September 9, 2019
Business ›
-
Excel Stock Trading Spreadsheet using NETWORKDAYS
April 8, 2019
-
Excel Profit and Loss – INDIRECT and VLOOKUP
April 6, 2019