5.1.3. Data Processing with Azure Synapse Analytics

💡 First Principle: Azure Synapse is a unified analytics platform that combines data warehousing, big data processing, and data integration into a single service. Instead of managing separate clusters for SQL and Spark, Synapse provides both under one roof with shared governance and security.

Key Components

• Synapse SQL:
  • Dedicated SQL Pool: Provisioned data warehouse (MPP). Pay per DWU.
  • Serverless SQL Pool: Query data in Data Lake using T-SQL without loading it. Pay per TB scanned.
• Apache Spark Pool: Managed Spark clusters for big data processing (Python, Scala, R).
• Synapse Pipelines: Data Factory integrated within Synapse.

Visual: Azure Synapse Components