
Databricks Data Engineer
SU-252(3 days)
Databricks Data Engineer
15.600 DKK
(excl. VAT)
- Home
- Databases, BI & SQL
- Databricks
- Databricks Data Engineer
Course calendar
Description
The course starts with creating a Databricks workspace in Azure and configuring Unity Catalog. We then dive into the essentials you need to know as a Data Engineer working with Databricks. For example, the option to run serverless has made Databricks even more attractive, because there is less waiting for a cluster to start up and be ready.
Today, data is no longer just neatly structured information in databases that we can access with SQL. We need other ways to store and analyze data, because data can be audio, video, images or, for example, JSON with hierarchical data.
Databricks invented the modern Lakehouse, which gives us the best of both worlds: it is simply a mix of a data lake and a data warehouse. We can store data as files, and with notebooks containing Python/Scala code, we can transform and prepare the data so it becomes more structured and suitable for a data warehouse and data analysis.
Tables in a Lakehouse are stored via Delta Lake in Parquet files, and each table has an associated transaction log. This means we get the ACID properties we know from the database world.
The course gives a thorough introduction to Databricks and to what a modern Lakehouse is. You gain a deeper understanding of Delta Lake and perform transformations with a Spark DataFrame. We set up batch loading of data and configure it as a workflow with a schedule. Next, we look at the options for real-time data in Databricks. Structured Streaming combined with Delta Live Tables is a powerful tool for handling data that, for example, arrives continuously as events/files in Blob Storage.
Finally, we look at what Databricks offers in terms of a data warehouse, SQL queries and dashboards with visualizations.
Related exam
Prerequisites
To get the most out of the course, we recommend experience or knowledge equivalent to:
Certification bundles
Module overview
- Introduction
- Data lake vs Lakehouse
- What is Databricks?
- What is Spark?
- Cloud Provider (Microsoft Azure, AWS, Google Cloud)
- Deployment of Azure Databricks workspace
- Creating a Databricks cluster
- Serverless clusters
- Creating and using notebooks
- Mix SQL, Scala and Python in your code cells
- Load and explore data
- Understanding Data Governance
- Unity catalog
- Securable objects and privileges
- Lakehouse Federation
- Catalog Explorer/browsing Unity Catalog
- Data lineage
- Entity relationships
- ACID, Databases, table level transactions and data in files
- What is Delta lake?
- Data versioning and time travel in Delta Lake
- VACUUM
- OPTIMIZE
- Liquid Clustering
- Predictive Optimization
- Spark
- Data transformation with a Spark dataframe
- CTAS, COPY INTO
- Schemas, Schema Enforcement
- Schema Evolution
- Fetching data from various sources (e.g. Azure Data lake, AWS etc)
- Connecting to a database (Azure SQL or other)
- Get started with SQL warehouses in Databricks
- Create a SQL warehouse/cluster
- Serverless SQL warehouses
- Create schemas and tables
- Visualize data
- Create queries and dashboards
- Orchestrate and schedule workflows in Databricks
- Tasks
- Job clusters/serverless compute
- Schedule
- Notifications
- Monitor in the job UI
- Structured streaming in Databricks
- Ingest data with structured streaming
- Autoloader
- What is DLT?
- Streaming tables, materialized views, views
- Medaillon architecture
- Check constraints, Quality constraints, warn, drop, fail
- Pipeline SQL syntax
- Pipeline Python syntax
- Monitor DLT, Eventlog
- DevOps
- CI/CD
- DAB (Databricks Asset bundles – now renamed to Databricks Automation Bundles)
- Databricks CLI
- VS Code
- Databricks REST API
- Databricks SDK
- Power BI storage mode: import mode/direct query/direct lake
- Publish to Power BI from Databricks
- Refresh Power BI semantic model from Databricks
Free course advice
We care a lot about helping you find the course path that creates the most value for you and your workplace. Get in touch with our course advisors — they're ready to help you, free of charge and with no obligation.

I can't give anything less than 5 stars across the board. Either you're truly in a class of your own, or I've just been to the wrong course venues before. Fantastic place and atmosphere.... once you've learned to find your way around :-)
Your instructors are exceptional; skilled, competent and good at teaching - so you have everything you need to get off to a good start.
You have fantastic facilities, good food and lovely people throughout the building.
A really good, in-depth course. Your course facilities at Karlebogaard are nothing short of fantastic. A beautiful historic house with lots of fun stories and great course rooms. The course itself was very useful. I learned everything I had hoped to and then some. My instructor was damn good and really funny. He made it a pleasure, and the hours flew by.
Probably the best course I've ever taken and the best instructor I've ever had!! Really good depth and thorough explanations, and on top of that, fantastic food!!!
Delicious food, cozy facilities, good structure and atmosphere. I'll be back when I can.
Absolutely the best course I've ever taken!
The course venue is so inviting and welcoming that it has been a pleasure to be here. Clean, tidy and full of charm. I attended a course where all the individual parts came together into a greater whole that can hardly be described.
I got a lot out of the course. It opened my eyes to possibilities I didn't know existed. I'm sure this won't be the last time we're in touch with SuperUsers.
I never in my wildest dreams imagined that a course venue could be so beautiful. I don't know if it's true, but I have a feeling that the surroundings rub off on the people who work here, so everyone seems incredibly happy.
There's a really great atmosphere. All the way from the woman at the reception desk to the people who work in the kitchen.
The instructor tailored the course to my level to a very large extent and was flexible. I had very high expectations, and they were exceeded.
Great precision, good exercises, good pace, a great atmosphere and maximum learning.
The instructor was very pleasant and the exercises were extremely good. I really learned a lot about the topics the course covered.
On top of that, really nice, calm and green surroundings with good catering - especially good food. I would like to take my courses here again next time.
It was a real pleasure to take a course at SuperUsers. The week we spent on the course was worth the money and means that we can now save many consultant hours. It's always nice to have the knowledge in-house.
There is a relaxed atmosphere in the classroom, lovely surroundings in the building itself, and skilled instructors who do a really good job.
I started using all the knowledge I soaked up on the course almost right away, and now we are well underway with developing our future cloud solution.
There is no doubt about who we will turn to if we need other courses.
This is my first time at SuperUsers. It has been a really good experience. The instructor seems very experienced and competent.
The instructor's strong technical background made the course and the in-depth answers to questions a good experience.
A really nice course venue in pleasant surroundings that make for a good setting for focused learning. The instructor came across as well prepared, with extensive knowledge of the relevant topics.
The instructor also showed a strong ability to answer any questions that came up during the course.
I'll be back the next time I need to take a course. It's a lovely place, the food is fantastic, and the instructor is very knowledgeable and happy to share that knowledge!
The technical depth of the course was really good. The instructor's knowledge went much deeper than the curriculum necessarily requires.
You could throw all kinds of curveballs at the instructor, and he had it all under control - he also made the content exciting.
We have now completed Microsoft 365 courses for a total of 5 people here in our department. Everyone agrees that it was an excellent course with a skilled instructor and communicator who could discuss and explain things at the right level, while also being efficient and bringing humor.
It has been a really good experience.
It's calm and quiet at SuperUsers' country venue. Good atmosphere and catering. Some thought has gone into healthy eating when it comes to food and cake, so it doesn't get completely out of hand.
The instructor is knowledgeable about the topics and readily puts them in a broader perspective by relating them to other relevant areas. It's rewarding that this is possible too, and it gives you ideas for further study.
In addition, the instructor was engaged and entertaining to have presenting the content.
As always, it was a great experience, and you learn a lot in a short time from some very skilled instructors.
I work in Azure almost every day, and both courses have been really good at helping me understand Azure better.
The instructor is very presentation-oriented and gets you involved in the teaching and the material. He is good at varying the teaching so it never gets monotonous.
It is clear that the instructor has hands-on experience and not just the theory, with many good examples that related to real-world challenges we might encounter.
Good facilities and good food, without drowning in unhealthy habits.
Very good course, the instructor was the best. I've been here at SuperUsers before, now I'm here again, and hopefully coming back another time.
The instructor seemed very competent and has extensive knowledge of his field. He was good at explaining things in a clear and humorous way. There were also simple exercises that gave a good understanding.
The instructor was really good at going in depth while still making sure everyone was keeping up. A really nice venue and room, and great food.
There was no doubt that the instructor knew exactly what he was talking about, and even the simplest questions were answered gladly, without anyone being made to feel stupid.
A lovely, cozy place where the receptionist, the kitchen and the instructors make you feel at home. A good setting makes for good learning. Really good food that helps round out the whole experience of taking a course at SuperUsers.
Really happy with the venue and the stay over in the horse stable. I'll see if I can come back here for the next course I take. A really beautiful building, and great to experience a place like this. A fantastic place to hold a course.