Microsoft Fabric Data Engineer

During this course, students will learn how to:

• Describe Dataflow capabilities in Microsoft Fabric
• Create Dataflow solutions to ingest and transform data
• Include a Dataflow in a pipeline
• Configure Spark in a Microsoft Fabric workspace
• Identify suitable scenarios for Spark notebooks and Spark jobs
• Use Spark dataframes to analyze and transform data
• Use Spark SQL to query data in tables and views
• Visualize data in a Spark notebook
• Create an eventhouse in Microsoft Fabric
• Query real-time data by using Kusto Query Language (KQL).
• Create materialized views and stored functions in a KQL database.
• Describe core features and capabilities of lakehouses in Microsoft Fabric.
• Create a lakehouse.
• Ingest data into files and tables in a lakehouse.
• Query lakehouse tables with SQL.
• Configure Spark in a Microsoft Fabric workspace
• Identify suitable scenarios for Spark notebooks and Spark jobs
• Use Spark dataframes to analyze and transform data
• Describe Dataflow capabilities in Microsoft Fabric
• Create Dataflow solutions to ingest and transform data
• Include a Dataflow in a pipeline
• Describe pipeline capabilities in Microsoft Fabric.
• Use the Copy Data activity in a pipeline.
• Create pipelines based on predefined templates.
• Run and monitor pipelines.
• Describe the principles of using the medallion architecture in data management.
• Apply the medallion architecture framework within the Microsoft Fabric environment.
• Analyze data stored in the lakehouse using DirectLake in Power BI.
• Describe best practices for ensuring the security and governance of data stored in the medallion architecture.
• Create a real-time dashboard in Microsoft Fabric.
• Use advanced feature of real-time dashboards.
• Apply best practices for real-time dashboards.
• Describe the permissions model in Microsoft Fabric.
• Configure workspace and item permissions.
• Apply granular permissions.
• Describe Fabric admin tasks
• Navigate the admin center
• Manage user access
• Govern data in Fabric

This audience for this course is data professionals with experience in data extraction, transformation, and loading. DP-700 is designed for professionals who need to create and deploy data engineering solutions using Microsoft Fabric for enterprise-scale data analytics. Learners should also have experience at manipulating and transforming data with one of the following programming languages: Structured Query Language (SQL), PySpark, or Kusto Query Language (KQL).
 

Familiarity with Microsoft Fabric and core data preparation concepts.
 

Ingest data with Microsoft Fabric

• Ingest Data with Dataflows Gen2 in Microsoft Fabric
  • Introduction
  • Understand Dataflows Gen2 in Microsoft Fabric
  • Explore Dataflows Gen2 in Microsoft Fabric
  • Integrate Dataflows Gen2 and Pipelines in Microsoft Fabric
  • Exercise - Create and use a Dataflow Gen2 in Microsoft Fabric
  • Knowledge check
• Orchestrate processes and data movement with Microsoft Fabric
  • Introduction
  • Understand pipelines
  • Use the Copy Data activity
  • Use pipeline templates
  • Run and monitor pipelines
  • Exercise - Ingest data with a pipeline
  • Knowledge check
• Use Apache Spark in Microsoft Fabric
  • Introduction
  • Prepare to use Apache Spark
  • Run Spark code
  • Work with data in a Spark dataframe
  • Work with data using Spark SQL
  • Visualize data in a Spark notebook
  • Exercise - Analyze data with Apache Spark
  • Knowledge check
• Get started with Real-Time Intelligence in Microsoft Fabric
  • Introduction
  • What is real-time data analytics?
  • Real-Time Intelligence in Microsoft Fabric
  • Ingest and transform real-time data
  • Store and query real-time data
  • Visualize real-time data
  • Automate actions
  • Exercise - Explore Real-Time Intelligence in Fabric
  • Knowledge check
• Use real-time eventstreams in Microsoft Fabric
  • Introduction
  • Components of eventstreams
  • Eventstream sources and destinations
  • Eventstream transformations
  • Exercise - Ingest real-time data with Eventstream in Microsoft Fabric
  • Knowledge check
• Work with real-time data in a Microsoft Fabric eventhouse
  • Introduction
  • Get started with an eventhouse
  • Use KQL effectively
  • Materialized views and stored functions
  • Exercise - Work with data in a Microsoft Fabric eventhouse
  • Knowledge check

Implement a Lakehouse with Microsoft Fabric

• Introduction to end-to-end analytics using Microsoft Fabric
  • Introduction
  • Explore end-to-end analytics with Microsoft Fabric
  • Data teams and Microsoft Fabric
  • Enable and use Microsoft Fabric
  • Knowledge Check
• Get started with lakehouses in Microsoft Fabric
  • Introduction
  • Explore the Microsoft Fabric lakehouse
  • Work with Microsoft Fabric lakehouses
  • Explore and transform data in a lakehouse
  • Exercise - Create a Microsoft Fabric lakehouse
  • Knowledge check
• Use Apache Spark in Microsoft Fabric
  • Introduction
  • Prepare to use Apache Spark
  • Run Spark code
  • Work with data in a Spark dataframe
  • Work with data using Spark SQL
  • Visualize data in a Spark notebook
  • Exercise - Analyze data with Apache Spark
  • Knowledge check
• Work with Delta Lake tables in Microsoft Fabric
  • Introduction
  • Understand Delta Lake
  • Create delta tables
  • Optimize delta tables
  • Work with delta tables in Spark
  • Use delta tables with streaming data
  • Exercise - Use delta tables in Apache Spark
  • Knowledge check
• Ingest Data with Dataflows Gen2 in Microsoft Fabric
  • Introduction
  • Understand Dataflows Gen2 in Microsoft Fabric
  • Explore Dataflows Gen2 in Microsoft Fabric
  • Integrate Dataflows Gen2 and Pipelines in Microsoft Fabric
  • Exercise - Create and use a Dataflow Gen2 in Microsoft Fabric
  • Knowledge check
• Orchestrate processes and data movement with Microsoft Fabric
  • Introduction
  • Understand pipelines
  • Use the Copy Data activity
  • Use pipeline templates
  • Run and monitor pipelines
  • Exercise - Ingest data with a pipeline
  • Knowledge check
• Organize a Fabric lakehouse using medallion architecture design
  • Introduction
  • Describe medallion architecture
  • Implement a medallion architecture in Fabric
  • Query and report on data in your Fabric lakehouse
  • Considerations for managing your lakehouse
  • Exercise - Organize your Fabric lakehouse using a medallion architecture
  • Knowledge check

Implement Real-Time Intelligence with Microsoft Fabric

• Get started with Real-Time Intelligence in Microsoft Fabric
  • Introduction
  • What is real-time data analytics?
  • Real-Time Intelligence in Microsoft Fabric
  • Ingest and transform real-time data
  • Store and query real-time data
  • Visualize real-time data
  • Automate actions
  • Exercise - Explore Real-Time Intelligence in Fabric
  • Knowledge check
• Use real-time eventstreams in Microsoft Fabric
  • Introduction
  • Components of eventstreams
  • Eventstream sources and destinations
  • Eventstream transformations
  • Exercise - Ingest real-time data with Eventstream in Microsoft Fabric
  • Knowledge check
• Work with real-time data in a Microsoft Fabric eventhouse
  • Introduction
  • Get started with an eventhouse
  • Use KQL effectively
  • Materialized views and stored functions
  • Exercise - Work with data in a Microsoft Fabric eventhouse
  • Knowledge check
• Create Real-Time Dashboards with Microsoft Fabric
  • Introduction
  • Get started with real-time dashboards
  • Advanced features
  • Real-Time Dashboard best practices
  • Exercise - Get started with real-time dashboards
  • Knowledge check

Implement a data warehouse with Microsoft Fabric

• Introduction to end-to-end analytics using Microsoft Fabric
  • Introduction
  • Explore end-to-end analytics with Microsoft Fabric
  • Data teams and Microsoft Fabric
  • Enable and use Microsoft Fabric
  • Knowledge Check
• Get started with data warehouses in Microsoft Fabric
  • Introduction
  • Understand data warehouse fundamentals
  • Understand data warehouses in Fabric
  • Query and transform data
  • Prepare data for analysis and reporting
  • Secure and monitor your data warehouse
  • Exercise - Analyze data in a data warehouse
  • Knowledge check
• Load data into a Microsoft Fabric data warehouse
  • Introduction
  • Explore data load strategies
  • Use data pipelines to load a warehouse
  • Load data using T-SQL
  • Load and transform data with Dataflow Gen2
  • Exercise: Load data into a warehouse in Microsoft Fabric
  • Knowledge check
• Query a data warehouse in Microsoft Fabric
  • Introduction
  • Query data
  • Use the SQL query editor
  • Explore the visual query editor
  • Use client tools to query a warehouse
  • Exercise: Query a data warehouse in Microsoft Fabric
  • Knowledge check
• Monitor a Microsoft Fabric data warehouse
  • Introduction
  • Monitor capacity metrics
  • Monitor current activity
  • Monitor queries
  • Exercise - Monitor a data warehouse in Microsoft Fabric
  • Knowledge check
• Secure a Microsoft Fabric data warehouse
  • Introduction
  • Explore dynamic data masking
  • Implement row-level security
  • Implement column-level security
  • Configure SQL granular permissions using T-SQL
  • Exercise: Secure a warehouse in Microsoft Fabric
  • Knowledge check

Manage a Microsoft Fabric environment

• Implement continuous integration and continuous delivery (CI/CD) in Microsoft Fabric
  • Introduction
  • Understand Continuous Integration and Continuous Delivery (CI/CD)
  • Implement version control and Git integration
  • Implement deployment pipelines
  • Automate CI/CD using Fabric APIs
  • Exercise: Implement deployment pipelines in Microsoft Fabric
  • Knowledge check
• Monitor activities in Microsoft Fabric
  • Introduction
  • Understand monitoring
  • Use Microsoft Fabric Monitor Hub
  • Take action with Microsoft Fabric Activator
  • Exercise - Monitor Fabric activity in the Monitor hub
  • Knowledge check
• Secure data access in Microsoft Fabric
  • Introduction
  • Understand the Fabric security model
  • Configure workspace and item permissions
  • Apply granular permissions
  • Exercise: Secure data access in Microsoft Fabric
  • Knowledge check
• Administer a Microsoft Fabric environment
  • Introduction
  • Understand the Fabric Architecture
  • Understand the Fabric administrator role
  • Manage Fabric security
  • Govern data in Fabric
  • Knowledge check