Best practice and metadata driven ingestion framework
Snowflake, Azure Data Factory and dbt
By Ejvind Hald
Snowflake Copenhagen User Group
On the 19th December 2024 a Snowflake Copenhagen User Group event took place in Copenhagen. As a co-organizer of this event Ejvind Hald & Tamas Paulik held a presentation regarding data platform including live demo. The presentation was also streamed live on YouTube via infrastructure facilities provided by Lund & Bendsen, and it can be view on the link below.
Typical setup and need in Danish companies
In the presentation we are showing an example of how we handle typical challenges for Danish companies regarding data platforms. They often use SQL Server and many companies have a preference for Microsoft tools like Azure Data Factory. We show how this can be configured so data ingestion works simply with Snowflake and dbt. There is a live demo of best practices for dbt and a well-structured Terraform setup with execution on Terraform Cloud.