2.1 KiB
2.1 KiB
Azure Data Integration Pipeline Training
Zero to Level 401
3 Day
Overview
Agenda
The following offers an insight into the complete agenda and module breakdown for this course.
- Module 1: Pipeline Fundamentals
- The History of Azure Orchestration
- Synapse Analytics vs Data Factory
- Integration Components
- Common Activities
- Execution Dependencies
- Module 2: Integration Runtime Design Patterns
- Compute Types
- Azure
- Hosted
- SSIS
- Patterns & Configuration
- Compute Types
- Module 3: Data Transformation
- Data Flows
- Power Query Injection
- Spark Configuration
- Use Cases
- Module 4: Dynamic Pipelines
- Expressions & Interpolation
- Simple Metadata Driven Execution
- Dynamic Content Chains
- Reference Names
- Module 5: Pipeline Extensibility
- Azure Batch Service
- Tasks
- Compute Pools
- Scaling
- Pipeline Custom Activities
- Azure Management API
- Azure Functions
- Azure Batch Service
- Module 6: Execution Parallelism
- Control Flow Scale Out
- Concurrency Limitations
- Internal vs External Activities
- Orchestration Framework - procfwk.com
- Module 7: VNet Integration
- Private Endpoints
- Managed VNet's
- Firewall Bypass
- Module 8: Security
- Service Principals
- Managed Identities
- Azure Key Vault Integration
- Customer Managed Keys
- Pipeline Access & Permissions
- Module 9: Monitoring & Alerting
- Studio Monitoring
- Log Analytics & Kusto Queries
- Operational Dashboards
- Advanced Alerting
- Module 10: Solution Testing
- Development Time Validation
- Test Coverage
- NUnit Tests
- Module 11: CI/CD
- Source Control vs Developer UI
- Basic ARM Template Deployments
- Advanced Deployment Patterns
- Module 12: Final Thoughts
- Running Costs
- Conclusions
- Best Practices