Azure Data Factory and Synapse Analytics

Azure Data Factory and Synapse Analytics

Create External Data Sources in Synapse Serverless SQL

Step by step using Synapse Studio UI or Script to create External Data Source more …

ADF or ASA lookup filter Modified date query for SharePoint Online List

This article is focused on ADF or ASA lookup activity filter modified date, type, is Current version or not etc. query for SharePoint Online List. more …

Metadata driven full solution for Azure Data Factory or Synapse incrementally copy data from SharePoint Online sink to ADSL Gen2

Provide a fully Metadata driven solution about using Azure Data Factory (ADF) or Synapse Analytics (ASA) incrementally copy multiple data sets one time from SharePoint Online (SPO) then sink them to ADSL Gen2. more …

ADF activities failure vs pipeline failure and pipeline error handling logical mechanism

This article talks when activities failed on a pipeline, the pipeline status will be, failure or success, and error handing logical mechanism. more ...

Comparing the use of wildcards in the Copy Activity of Azure Data Factory with the Get Metadata activity for managing multiple file copies

Both the Copy Activity with wildcards (*.*) and the Get Metadata activity for retrieving a file list serve to work with multiple files copy or move. more …

ADF or ASA lookup Delta Table in Databricks Unity Catalog

Using ADF to look up data from a Delta table in Databricks’ Unity Catalog involves several steps more …

Comparison:  “Linked Services to databricks” and “Linked Services to databricks delta lake”

In ADF or ASA, when you create Linked Services, both “Databricks” and “Databricks Delta Lake” are available as options, more …

Azure Data Factory or Synapse Copy Activity with File System

In Azure Data Factory (ADF) or Synapse, using Copy Activity with a File System as a source or sink is common when dealing with on-premises more …