Data Engineer Pyspark and Azure

Compunnel, Inc.

alton, on, Canada
Full-time
Posted May 31, 2026

Job Description

We are seeking a highly skilled Data Engineer with expertise in PySpark and Azure to lead the improvement of our Investment Reporting System.

This role involves guiding the engineering team, implementing cloud-native solutions, and ensuring adherence to best practices.

Key Responsibilities

  • Lead the development of ETL pipelines and cloud-native architectures using Azure services.
  • Work hands-on with Azure Data Factory, Databricks, Functions, Event Grid, and Service Bus.
  • Collaborate with Solution Architects to translate designs into actionable tasks.
  • Implement DevOps practices, CI/CD pipelines, and infrastructure automation.
  • Provide technical mentorship and problem-solving support to the team.

Required Qualifications

  • Proven experience as a Lead Engineer or similar role.
  • Hands‑on expertise in Azure services and PySpark.
  • Strong experience in ETL development and database migrat...