116 lines
2.1 KiB
Markdown
116 lines
2.1 KiB
Markdown
# Azure Data Integration Pipeline Training
|
|
## Zero to Level 401
|
|
### 3 Day
|
|
|
|
|
|
|
|
___
|
|
|
|
## Overview
|
|
|
|
|
|
___
|
|
|
|
## Agenda
|
|
|
|
The following offers an insight into the complete agenda and module breakdown for this course.
|
|
|
|
* __Module 1:__ [Pipeline Fundamentals]()
|
|
* The History of Azure Orchestration
|
|
* Synapse Analytics vs Data Factory
|
|
* Integration Components
|
|
* Common Activities
|
|
* Execution Dependencies
|
|
|
|
___
|
|
|
|
* __Module 2:__ [Integration Runtime Design Patterns]()
|
|
* Compute Types
|
|
* Azure
|
|
* Hosted
|
|
* SSIS
|
|
* Patterns & Configuration
|
|
|
|
___
|
|
|
|
* __Module 3:__ [Data Transformation]()
|
|
* Data Flows
|
|
* Power Query Injection
|
|
* Spark Configuration
|
|
* Use Cases
|
|
|
|
___
|
|
|
|
* __Module 4:__ [Dynamic Pipelines]()
|
|
* Expressions & Interpolation
|
|
* Simple Metadata Driven Execution
|
|
* Dynamic Content Chains
|
|
* Reference Names
|
|
|
|
___
|
|
|
|
* __Module 5:__ [Pipeline Extensibility]()
|
|
* Azure Batch Service
|
|
* Tasks
|
|
* Compute Pools
|
|
* Scaling
|
|
* Pipeline Custom Activities
|
|
* Azure Management API
|
|
* Azure Functions
|
|
|
|
___
|
|
|
|
* __Module 6:__ [Execution Parallelism]()
|
|
* Control Flow Scale Out
|
|
* Concurrency Limitations
|
|
* Internal vs External Activities
|
|
* Orchestration Framework - [procfwk.com](http://procfwk.com/)
|
|
|
|
___
|
|
|
|
* __Module 7:__ [VNet Integration]()
|
|
* Private Endpoints
|
|
* Managed VNet's
|
|
* Firewall Bypass
|
|
|
|
___
|
|
|
|
* __Module 8:__ [Security]()
|
|
* Service Principals
|
|
* Managed Identities
|
|
* Azure Key Vault Integration
|
|
* Customer Managed Keys
|
|
* Pipeline Access & Permissions
|
|
|
|
___
|
|
|
|
* __Module 9:__ [Monitoring & Alerting]()
|
|
* Studio Monitoring
|
|
* Log Analytics & Kusto Queries
|
|
* Operational Dashboards
|
|
* Advanced Alerting
|
|
|
|
___
|
|
|
|
* __Module 10:__ [Solution Testing]()
|
|
* Development Time Validation
|
|
* Test Coverage
|
|
* NUnit Tests
|
|
|
|
___
|
|
|
|
* __Module 11:__ [CI/CD]()
|
|
* Source Control vs Developer UI
|
|
* Basic ARM Template Deployments
|
|
* Advanced Deployment Patterns
|
|
|
|
___
|
|
|
|
* __Module 12:__ [Final Thoughts]()
|
|
* Running Costs
|
|
* Conclusions
|
|
* Best Practices
|
|
|
|
___
|
|
|
|
[<< Back to root](https://github.com/mrpaulandrewltd/Azure-Data-Integration-Pipeline-Training) |