Learning Objectives: Become a proficient Azure user and Data Engineer by mastering Azure Subscription creation, resource management, and budgeting; exploring Data Engineer's role and technologies; and developing skills in ML modeling and deployment with FastAPI and MLOps.

Topics

• How to Create Azure Subscription
• Azure Portal Overview
• How to Delete Resources and Set Budget
• How Did Data Engineer Profile Evolve
• Understand Data Engineer's Role and Responsibility
• Explore Data Engineer Technologies

Learning Objectives: Master Azure Storage Services, provisioning, redundancy, access tiers, File Share and Disk Storage. Explore Cosmos DB, Data Lake evolution. Compare Blob Storage and Data Lake, examine security. Differentiate HA and DR concepts, explore HA/DR options for Azure Storage and Cosmos DB.

Topics

• Overview of Azure Storage Services
• Demo Provision Azure Storage Account
• Explore Data Redundancy Options
• Overview Azure Blob Storage
• Learn about Azure Storage Access Tiers
• Overview Azure Table Storage
• Overview of Azure Queue Storage
• Understand Azure File Share Storage
• Demo Azure File Share Storage
• Azure Disk Storage and Demo
• Explore Cosmos DB and its Various Features
• What is Data Lake?
• How Data Lake Gen 2 Evolved
• Azure Blob Storage vs Azure Data Lake
• Explore Azure Blob and Data Lake Security Options
• High Availability vs Disaster Recovery
• Azure Storage - HA and DR Options
• Cosmos DB - HA and DR Options

Learning Objectives: Acquire comprehensive expertise in Azure SQL and Synapse Analytics, including their features, architecture comparison, pool creation, data analysis, and security measures such as data masking and encryption.

Topics

• Module Introduction
• Features of Azure SQL
• Explore Azure SQL and its Various Features
• Learn the Difference between Traditional vs Modern Warehouse Architecture
• What is Synapse Analytics Service
• Demo: Create Dedicated SQL Pool
• Demo: Connect Dedicated SQL Pool with SSMS
• Demo: Create Azure Synapse Analytics Studio Workspace
• Demo: Explore Synapse Studio
• Demo: Create Dedicated SQL Pool and Spark Pool
• Demo: Analyse Data using Dedicated SQL Pool
• Demo: Analyse Data using Apache Spark Notebook
• Demo: Analyse Data using Serverless SQL Pool
• Demo: Data Factory from Synapse Analytics Studio
• Demo: Monitor Synapse Studio
• Explore Azure Synapse and its Various Features
• Understand the Scaling Azure Datawarehouse
• Azure SQL Datawarehouse Backup and Restore
• Azure Database vs Azure Datawarehouse (Synapse Data Pool)
• How to Implement Data Masking
• Learn to Encrypt Data at Rest and in Motion

Learning Objectives: Master the fundamentals of Azure Data Factory and Azure Databricks, including their features, provisioning, data access, data processing, Spark Basics, cluster exploration, and other essential components.

Topics

• Introduction
• Explore Azure Data Factory and its Features
• What is Azure Databricks
• Demo Overview
• Demo: Provision Databricks, Clusters and Workbook
• Demo: Mount Data Lake to Databricks DBFS
• Demo: Explore, Analyze, Clean, Transform and Load Data in Databricks
• Learn About Spark Basics
• Explore Azure Databricks Clusters
• Azure Databricks Other Important Components

Learning Objectives: Master Azure Stream Analytics and Windowing Functions for real-time data processing. Learn to configure input and output, use different window types (Tumbling, Hopping, Sliding, and Session), and process Blob Storage and IOT Hub Input.

Topics

• Module Introduction
• What is Live Event Processing
• Introducing Azure Stream Analytics (Configure Input and Output)
• Introduction to Windowing Functions
• What is Tumbling Window
• What is Hopping Window
• What is Sliding Window
• What is Session Window
• Demo: Processing Blob Storage Input
• Demo: Processing IOT Hub Input

Learning Objectives: Master the implementation of Azure Monitor service to efficiently monitor and optimize various Azure resources, including Blob and Data Lake Storage, Azure Synapse Analytics, and Cosmos DB.

Topics

• Module Introduction
• Intro to Azure Monitor Service
• Demo: Azure Monitor Service
• Implementing Blob and Data Lake Storage Monitoring
• Implement Azure Synapse Analytics Monitoring
• Implement Cosmos DB Monitoring

Learning Objectives: Learn to effectively monitor and optimize Data Factory pipelines, Azure Databricks for big data analytics, and Stream Analytics for real-time data processing using various monitoring tools like metrics, alerts, and diagnostic settings.

Topics

• Module Introduction
• Monitor Data Factory Pipelines
• Monitor Data Factory - Metrics, Alerts, Diagnostic Settings
• Monitor Azure Databricks
• Monitor Stream Analytics

Learning Objectives: Learn to troubleshoot and optimize data processing in various Azure services, including Data Lake Storage, Stream Analytics, and Azure Synapse Analytics. Also, gain proficiency in managing the Data Lifecycle to ensure data quality and compliance.

Topics

• Module Introduction
• Troubleshoot Data Partitioning Bottlenecks
• Optimize Data Lake Storage
• Optimize Stream Analytics
• Optimize Azure Synapse Analytics
• Manage the Data Lifecycle

Learning Objectives: Master data solutions in Azure: data types, storage options, Azure store selection, recovery planning, CosmosDB vs. Data Lake vs. Blob Storage design, SQL Database vs. Data warehouse, Batch Processing with Data Factory and DataBricks, Data Ingestion Methods, Real-Time Processing, Compute Resources, Lambda Architecture, and secure endpoint planning.

Topics

• Different Types of Data Types
• Data Storage Types
• Select Azure Store for Application
• Azure Data Platform Architecture
• Understand RTO and RPO
• Scenarios - Designing a Solution for CosmosDB vs Data Lake vs Blob Storage
• Scenarios - Designing for SQL Database vs Data warehouse
• Design Batch Processing Solutions Using Data Factory and DataBricks
• Learn Data Ingestion Methods
• Explore Real Time Processing
• Design and Provision Compute Resources
• Explore Lambda Architecture
• Plan for Secure Endpoints (Public/Private)

In this final module, we will provide a comprehensive recap of the Microsoft Azure Data Engineer (DP-203) Course, highlighting how it equips you with practical skills for the real world.