# Azure Data Integration Pipeline Training
## Zero to Level 401
### 3 Day

![Slide Header](./05.%20Agenda%20Header.png)

___

## Overview


___

## Agenda

The following offers an insight into the complete agenda and module breakdown for this course.

* __Module 1:__ [Pipeline Fundamentals]()
  * The History of Azure Orchestration
  * Synapse Analytics vs Data Factory
  * Integration Components
  * Common Activities
  * Execution Dependencies

___

* __Module 2:__ [Integration Runtime Design Patterns]()
  * Compute Types
    * Azure
    * Hosted
    * SSIS
  * Patterns & Configuration

___

* __Module 3:__ [Data Transformation]()
  * Data Flows
  * Power Query Injection
  * Spark Configuration
  * Use Cases

___

* __Module 4:__ [Dynamic Pipelines]()
  * Expressions & Interpolation
  * Simple Metadata Driven Execution
  * Dynamic Content Chains
  * Reference Names

___

* __Module 5:__ [Pipeline Extensibility]()
  * Azure Batch Service
    * Tasks
    * Compute Pools
    * Scaling
  * Pipeline Custom Activities
  * Azure Management API
  * Azure Functions 

___

* __Module 6:__ [Execution Parallelism]()
  * Control Flow Scale Out
  * Concurrency Limitations
  * Internal vs External Activities
  * Orchestration Framework - [procfwk.com](http://procfwk.com/)

___

* __Module 7:__ [VNet Integration]()
  * Private Endpoints
  * Managed VNet's
  * Firewall Bypass

___

* __Module 8:__ [Security]()
  * Service Principals
  * Managed Identities
  * Azure Key Vault Integration
  * Customer Managed Keys
  * Pipeline Access & Permissions

___

* __Module 9:__ [Monitoring & Alerting]()
    * Studio Monitoring
    * Log Analytics & Kusto Queries
    * Operational Dashboards
    * Advanced Alerting

___

* __Module 10:__ [Solution Testing]()
    * Development Time Validation
    * Test Coverage
    * NUnit Tests

___

* __Module 11:__ [CI/CD]()
    * Source Control vs Developer UI
    * Basic ARM Template Deployments
    * Advanced Deployment Patterns

___

* __Module 12:__ [Final Thoughts]()
  * Running Costs
  * Conclusions
  * Best Practices

___

[<< Back to root](https://github.com/mrpaulandrewltd/Azure-Data-Integration-Pipeline-Training)