Lakehouse

Create External Data Sources in Synapse Serverless SQL
Step by step using Synapse Studio UI or Script to create External Data Source more …
Data Lake implementation – Data Lake Zones and Containers Planning
It’s important to plan your data structure before you land it into a data lake. more …
Unity Catalog
Unity Catalog brings a new layer of data management and security to your Databricks environment more …
Comparison: Unity Catalog, Metastore, Mount data, External Data Source, External Table
Comparison including the Databricks Catalog (Unity Catalog) alongside Mounting Data, External Data Source, External Table and Metastore. more …
Unity Catalog: create metastore and Enabling Unity Catalog in Azure
Manual create metastore and enabling unity catalog if they are not automatically created while we created Azure Databricks service more …
ADF or ASA lookup Delta Table in Databricks Unity Catalog
Using ADF to look up data from a Delta table in Databricks’ Unity Catalog involves several steps more …
delta: Delta Table, Delta Lake
Delta table is a type of table that builds on the Delta Lake storage layer and brings ACID (Atomicity, Consistency, Isolation, Durability) transactions, schema enforcement, and scalable metadata management to traditional data lakes. more …
delta: Time Travel of Delta Table
Time Travel in Delta Lake allows you to query, restore, vacuum or audit the historical versions of a Delta table. more …
Implementing Slowly Changing Dimension (SCD) Type 2 Using Delta Lake on Databricks
Step by step performing type 2 upserts for slowly changing dimension tables with Delta Lake.
more …
Building Slowly Changing Dimensions Type 2 in Azure Data Factory and Synapse
Within the context of enterprise data warehousing, the effective management of historical data is essential for supporting informed business decision-making. Slowly Changing Dimension (SCD) Type 2 is a widely adopted technique for addressing changes in data over time.
more …
Comprehensive migration engineering strategy
Data migration, the process of transferring digital information, is a complex undertaking crucial to organizational operations. It necessitates thorough risk assessment and careful planning to address the numerous challenges that can arise during implementation. This discussion details key strategies and processes.