stablegrid.io

PySpark

What Spark actually does when your job runs. By the end you read plans, diagnose skew, and tune memory before it costs you.

JUNIOR — CORE FOUNDATION

(0 of 110 lessons)

MID — ADVANCED TRANSFORMATIONS

  • 01
    Module 1Execution Plans and the Catalyst Optimizer11 lessons·325m
  • 02
    Module 2Partitioning Strategy11 lessons·335m
  • 03
    Module 3Join Performance and Shuffle Optimization11 lessons·355m
  • 04
    Module 4Schema Evolution and Delta Lake11 lessons·345m
  • 05
    Module 5Pipeline Design Patterns11 lessons·335m
  • 06
    Module 6Testing PySpark Pipelines11 lessons·315m
  • 07
    Module 7Deployment and CI/CD11 lessons·315m
  • 08
    Module 8Memory Management and Caching11 lessons·325m
  • 09
    Module 9Performance Monitoring and Tuning11 lessons·335m
  • 10
    Module 10Structured Streaming Foundations11 lessons·345m
REQUIRES MID TIER

500 kWh away. Reach 500 kWh total processing power in Practice to unlock.

SENIOR — CLUSTER TUNING

  • 01
    Module 1Platform Architecture at Scale11 lessons·425m
  • 02
    Module 2Advanced Catalyst and AQE Internals11 lessons·445m
  • 03
    Module 3Partition Strategy at Scale11 lessons·455m
  • 04
    Module 4Advanced Join Architecture11 lessons·435m
  • 05
    Module 5Schema Registries and Data Contracts11 lessons·425m
  • 06
    Module 6Spark Internals — The Execution Engine11 lessons·465m
  • 07
    Module 7Spark Internals — Storage and I/O11 lessons·445m
  • 08
    Module 8Multi-Tenant Operations and Security11 lessons·425m
  • 09
    Module 9Advanced Streaming Architecture11 lessons·455m
  • 10
    Module 10Enterprise Governance and Capacity Planning11 lessons·475m
REQUIRES SENIOR TIER

Requires Mid completion and 1,200 kWh.