Cart
SuperUsers image
courseSU-252

Databricks Data Engineer

Databricks Data Engineer

15.600 DKK

(excl. VAT)

The course covers the core elements of Databricks, giving you a solid grasp of Unity Catalog, notebooks, clusters, Spark, Delta Lake, medallion architecture, workflows and Delta Live Tables.

Course calendar

 
Hillerød
October
Week
November
Week
December
15/12
Week 51
15 - 17 Dec 2026
January
Week
February
3/2
Week 5
3 - 5 Feb 2027
March
Week
April
20/4
Week 16
20 - 22 Apr 2027
May
19/5
Week 20
19 - 21 May 2027
Aarhus
Week
2/11
Week 45
2 - 4 Nov 2026
17/11
Week 47
17 - 19 Nov 2026
Week
13/1
Week 2
13 - 15 Jan 2027
Week
15/3
Week 11
15 - 17 Mar 2027
20/4
Week 16
20 - 22 Apr 2027
Week
Virtual
Week
2/11
Week 45
2 - 4 Nov 2026
17/11
Week 47
17 - 19 Nov 2026
15/12
Week 51
15 - 17 Dec 2026
13/1
Week 2
13 - 15 Jan 2027
3/2
Week 5
3 - 5 Feb 2027
15/3
Week 11
15 - 17 Mar 2027
20/4
Week 16
20 - 22 Apr 2027
19/5
Week 20
19 - 21 May 2027
Dates are start dates
Virtual classroom available
Guaranteed to run

Description

The course starts with creating a Databricks workspace in Azure and configuring Unity Catalog. We then dive into the essentials you need to know as a Data Engineer working with Databricks. For example, the option to run serverless has made Databricks even more attractive, because there is less waiting for a cluster to start up and be ready.

Today, data is no longer just neatly structured information in databases that we can access with SQL. We need other ways to store and analyze data, because data can be audio, video, images or, for example, JSON with hierarchical data.

Databricks invented the modern Lakehouse, which gives us the best of both worlds: it is simply a mix of a data lake and a data warehouse. We can store data as files, and with notebooks containing Python/Scala code, we can transform and prepare the data so it becomes more structured and suitable for a data warehouse and data analysis.

Tables in a Lakehouse are stored via Delta Lake in Parquet files, and each table has an associated transaction log. This means we get the ACID properties we know from the database world.

The course gives a thorough introduction to Databricks and to what a modern Lakehouse is. You gain a deeper understanding of Delta Lake and perform transformations with a Spark DataFrame. We set up batch loading of data and configure it as a workflow with a schedule. Next, we look at the options for real-time data in Databricks. Structured Streaming combined with Delta Live Tables is a powerful tool for handling data that, for example, arrives continuously as events/files in Blob Storage.

Finally, we look at what Databricks offers in terms of a data warehouse, SQL queries and dashboards with visualizations.

Related exam

Prerequisites

To get the most out of the course, we recommend experience or knowledge equivalent to:

Video teaser

Certification bundles

Module overview

  • Introduction   
  • Data lake vs Lakehouse
  • What is Databricks?
  • What is Spark?
  • Cloud Provider (Microsoft Azure, AWS, Google Cloud)

  • Deployment of Azure Databricks workspace
  • Creating a Databricks cluster
  • Serverless clusters

  • Creating and using notebooks
  • Mix SQL, Scala and Python in your code cells
  • Load and explore data

  • Understanding Data Governance
  • Unity catalog
  • Securable objects and privileges
  • Lakehouse Federation
  • Catalog Explorer/browsing Unity Catalog
  • Data lineage
  • Entity relationships

  • ACID, Databases, table level transactions and data in files
  • What is Delta lake?
  • Data versioning and time travel in Delta Lake
  • VACUUM
  • OPTIMIZE
  • Liquid Clustering
  • Predictive Optimization

  • Spark
  • Data transformation with a Spark dataframe

  • CTAS, COPY INTO
  • Schemas, Schema Enforcement
  • Schema Evolution
  • Fetching data from various sources (e.g. Azure Data lake, AWS etc)
  • Connecting to a database (Azure SQL or other)

  • Get started with SQL warehouses in Databricks
  • Create a SQL warehouse/cluster
  • Serverless SQL warehouses
  • Create schemas and tables
  • Visualize data   
  • Create queries and dashboards

  • Orchestrate and schedule workflows in Databricks
  • Tasks
  • Job clusters/serverless compute
  • Schedule
  • Notifications
  • Monitor in the job UI

  • Structured streaming in Databricks
  • Ingest data with structured streaming
  • Autoloader
  • What is DLT?
  • Streaming tables, materialized views, views
  • Medaillon architecture
  • Check constraints, Quality constraints, warn, drop, fail
  • Pipeline SQL syntax
  • Pipeline Python syntax
  • Monitor DLT, Eventlog

  • DevOps
  • CI/CD
  • DAB (Databricks Asset bundles – now renamed to Databricks Automation Bundles)
  • Databricks CLI
  • VS Code
  • Databricks REST API
  • Databricks SDK

  • Power BI storage mode: import mode/direct query/direct lake
  • Publish to Power BI from Databricks
  • Refresh Power BI semantic model from Databricks

Free course advice

We care a lot about helping you find the course path that creates the most value for you and your workplace. Get in touch with our course advisors — they're ready to help you, free of charge and with no obligation.

Contact image

I can't give anything less than 5 stars across the board. Either you're truly in a class of your own, or I've just been to the wrong course venues before. Fantastic place and atmosphere.... once you've learned to find your way around :-)

— Mikael Ejberg Pedersen
Cobham SATCOM

Your instructors are exceptional; skilled, competent and good at teaching - so you have everything you need to get off to a good start.

You have fantastic facilities, good food and lovely people throughout the building.

— Camilla Esper
Leita Aps

A really good, in-depth course. Your course facilities at Karlebogaard are nothing short of fantastic. A beautiful historic house with lots of fun stories and great course rooms. The course itself was very useful. I learned everything I had hoped to and then some. My instructor was damn good and really funny. He made it a pleasure, and the hours flew by.

— Henrik Thuelund
Magasin du Nord

Probably the best course I've ever taken and the best instructor I've ever had!! Really good depth and thorough explanations, and on top of that, fantastic food!!!

— Michael Hasløv
Lån & Spar Bank

Delicious food, cozy facilities, good structure and atmosphere. I'll be back when I can.

— Ea Stenberg
Oticon A/S

Absolutely the best course I've ever taken!

— Esben Salling
JN Data A/S

The course venue is so inviting and welcoming that it has been a pleasure to be here. Clean, tidy and full of charm. I attended a course where all the individual parts came together into a greater whole that can hardly be described.

— Bo Peter Jensen
Kyndryl Danmark ApS

I got a lot out of the course. It opened my eyes to possibilities I didn't know existed. I'm sure this won't be the last time we're in touch with SuperUsers.

— Christian Larsen
Siemens Gamesa Renewable Energy A/S

I never in my wildest dreams imagined that a course venue could be so beautiful. I don't know if it's true, but I have a feeling that the surroundings rub off on the people who work here, so everyone seems incredibly happy.

There's a really great atmosphere. All the way from the woman at the reception desk to the people who work in the kitchen.

— Jannik Berg Møller
Metro Service

The instructor tailored the course to my level to a very large extent and was flexible. I had very high expectations, and they were exceeded.

Great precision, good exercises, good pace, a great atmosphere and maximum learning.

— Luka Dalum
Semler

The instructor was very pleasant and the exercises were extremely good. I really learned a lot about the topics the course covered.

On top of that, really nice, calm and green surroundings with good catering - especially good food. I would like to take my courses here again next time.

— Arif Mikkelsen Yüce
Københavns Kommune

It was a real pleasure to take a course at SuperUsers. The week we spent on the course was worth the money and means that we can now save many consultant hours. It's always nice to have the knowledge in-house.

There is a relaxed atmosphere in the classroom, lovely surroundings in the building itself, and skilled instructors who do a really good job.

I started using all the knowledge I soaked up on the course almost right away, and now we are well underway with developing our future cloud solution.

There is no doubt about who we will turn to if we need other courses.

— Maksym Bilyk
KVM A/S

This is my first time at SuperUsers. It has been a really good experience. The instructor seems very experienced and competent.

The instructor's strong technical background made the course and the in-depth answers to questions a good experience.

— Thomas Gram
Nic. Christiansen Gruppen A/S

A really nice course venue in pleasant surroundings that make for a good setting for focused learning. The instructor came across as well prepared, with extensive knowledge of the relevant topics.

The instructor also showed a strong ability to answer any questions that came up during the course.

— Simon Schmidt Eriksen
Norlys

I'll be back the next time I need to take a course. It's a lovely place, the food is fantastic, and the instructor is very knowledgeable and happy to share that knowledge!

— Jan Christiansen
TV2 Danmark A/S

The technical depth of the course was really good. The instructor's knowledge went much deeper than the curriculum necessarily requires.

You could throw all kinds of curveballs at the instructor, and he had it all under control - he also made the content exciting.

— Nicolai Bæklund
Danish Crown

We have now completed Microsoft 365 courses for a total of 5 people here in our department. Everyone agrees that it was an excellent course with a skilled instructor and communicator who could discuss and explain things at the right level, while also being efficient and bringing humor.

It has been a really good experience.

— Henrik Dyrhøj
Nyborg Kommune

It's calm and quiet at SuperUsers' country venue. Good atmosphere and catering. Some thought has gone into healthy eating when it comes to food and cake, so it doesn't get completely out of hand.

The instructor is knowledgeable about the topics and readily puts them in a broader perspective by relating them to other relevant areas. It's rewarding that this is possible too, and it gives you ideas for further study.

In addition, the instructor was engaged and entertaining to have presenting the content.

— Kenneth Middelboe Carlson
Svend Hoyer A/S

As always, it was a great experience, and you learn a lot in a short time from some very skilled instructors.

I work in Azure almost every day, and both courses have been really good at helping me understand Azure better.

— Marthin Lundquist
DEAS A/S

The instructor is very presentation-oriented and gets you involved in the teaching and the material. He is good at varying the teaching so it never gets monotonous.

It is clear that the instructor has hands-on experience and not just the theory, with many good examples that related to real-world challenges we might encounter.

Good facilities and good food, without drowning in unhealthy habits.

— Kenneth Middelboe Carlson
Svend Hoyer A/S

Very good course, the instructor was the best. I've been here at SuperUsers before, now I'm here again, and hopefully coming back another time.

— Mads From
Sampension Administrationsselskab A/S

The instructor seemed very competent and has extensive knowledge of his field. He was good at explaining things in a clear and humorous way. There were also simple exercises that gave a good understanding. 

— Jeppe Hvelplund
Vattenfall Vindkraft A/S

The instructor was really good at going in depth while still making sure everyone was keeping up. A really nice venue and room, and great food.

There was no doubt that the instructor knew exactly what he was talking about, and even the simplest questions were answered gladly, without anyone being made to feel stupid.

— Jesper Nederby
Rudersdal Kommune

A lovely, cozy place where the receptionist, the kitchen and the instructors make you feel at home. A good setting makes for good learning. Really good food that helps round out the whole experience of taking a course at SuperUsers.

— Henrik Valentin Eltang
Privatperson

Really happy with the venue and the stay over in the horse stable. I'll see if I can come back here for the next course I take. A really beautiful building, and great to experience a place like this. A fantastic place to hold a course.

— Mads-Ejnar Kehlet
Herningsholm IT-center