Job Description
Elevate data engineering capabilities as a Data Engineering Manager spearheading a robust data platform tailored for retail operations. Ensure architecture and data quality while driving multi-tenant solutions in a collaborative setting.
In this pivotal role, you will focus on the comprehensive design and optimization of the Databricks Lakehouse, ensuring its alignment with business objectives. Mentor your engineering team while implementing high standards for data observability and operational excellence. Foster partnerships with BI, Data Science, and Product teams for scalable data solutions.
Key Responsibilities:
• Lead the design and optimization of Databricks Lakehouse
• Drive ingestion strategies from Azure Table Storage and APIs
• Enhance PySpark-based ETL frameworks
• Implement end-to-end data validation systems
• Oversee CI/CD processes and governance standards
Requirements:
• 8+ years in Data Engineeri...
In this pivotal role, you will focus on the comprehensive design and optimization of the Databricks Lakehouse, ensuring its alignment with business objectives. Mentor your engineering team while implementing high standards for data observability and operational excellence. Foster partnerships with BI, Data Science, and Product teams for scalable data solutions.
Key Responsibilities:
• Lead the design and optimization of Databricks Lakehouse
• Drive ingestion strategies from Azure Table Storage and APIs
• Enhance PySpark-based ETL frameworks
• Implement end-to-end data validation systems
• Oversee CI/CD processes and governance standards
Requirements:
• 8+ years in Data Engineeri...