Job Description
Job Title: Sr Data Engineer
Job ID: 87104
Location: Calgary, Alberta
What you will be doing:
- Cloud Ecosystem: Primary AWS environment.
- Architecture: Medallion Architecture (Bronze / Silver / Gold layers) using Apache Iceberg and Hive table formats.
- Orchestration & Transformation: Implementation via MWAA (Airflow), containerized workloads, and dbt.
- Query & Performance: Design/optimization of Athena-based query patterns; must understand partitioning strategies and table maintenance (compaction/expiry).
- Infrastructure: Infrastructure-as-Code (IaC) is critical. Must be proficient in Terraform (and ideally Terragrunt).
- The “Tenant” Challenge: Troubleshooting and monitoring pipelines across 200+ tenant environments (sports teams/leagues), ensuring strict SLA adherence.
- Innovation: Strong comfort with AI-assisted development (Claude Code) for pipeline generation an...