Lakehouse

Lakehouse

Create External Data Sources in Synapse Serverless SQL

Step by step using Synapse Studio UI or Script to create External Data Source more …

Data Lake implementation – Data Lake Zones and Containers Planning

It’s important to plan your data structure before you land it into a data lake.  more …

Unity Catalog

Unity Catalog brings a new layer of data management and security to your Databricks environment more …

Comparison: Unity Catalog, Metastore, Mount data, External Data Source, External Table

Comparison including the Databricks Catalog (Unity Catalog) alongside Mounting Data, External Data Source, External Table and Metastore. more …

Unity Catalog: create metastore and Enabling Unity Catalog in Azure

Manual create metastore and enabling unity catalog if they are not automatically created while we created Azure Databricks service more …

ADF or ASA lookup Delta Table in Databricks Unity Catalog

Using ADF to look up data from a Delta table in Databricks’ Unity Catalog involves several steps more …

delta: Delta Table, Delta Lake

Delta table is a type of table that builds on the Delta Lake storage layer and brings ACID (Atomicity, Consistency, Isolation, Durability) transactions, schema enforcement, and scalable metadata management to traditional data lakes. more …

delta: Time Travel of Delta Table

Time Travel in Delta Lake allows you to query, restore, vacuum or audit the historical versions of a Delta table. more …

Implementing Slowly Changing Dimension (SCD) Type 2 Using Delta Lake on Databricks

Step by step performing type 2 upserts for slowly changing dimension tables with Delta Lake.
more …

Building Slowly Changing Dimensions Type 2 in Azure Data Factory and Synapse

Within the context of enterprise data warehousing, the effective management of historical data is essential for supporting informed business decision-making. Slowly Changing Dimension (SCD) Type 2 is a widely adopted technique for addressing changes in data over time.
more …

Comprehensive migration engineering strategy

Data migration, the process of transferring digital information, is a complex undertaking crucial to organizational operations. It necessitates thorough risk assessment and careful planning to address the numerous challenges that can arise during implementation. This discussion details key strategies and processes.

more …