Databricks Engineer – Azure Data Platform (Contract)

About the role

We are looking for an experienced Databricks Engineer to join our delivery team on a contract basis. The role focuses on designing, building and optimizing modern data platforms on Azure Databricks for our clients in Calgary, working closely with both Data Elephant and client analytics teams.

Key responsibilities

• Implement modern data platforms on Databricks, including ETL pipelines, workload migrations and Unity Catalog.
• Design and develop data pipelines using PySpark and SQL on Azure Databricks.
• Build and optimise batch and streaming workloads, applying Delta Lake patterns such as medallion architecture and CDC.
• Migrate legacy data workloads to Azure and integrate Databricks with ADLS, ADF, Azure Key Vault and Azure DevOps.
• Optimize performance and cost through cluster sizing, job orchestration and query tuning.
• Collaborate with solution architects, analytics engineers and client stakeholders, and provide knowledge transfer and documentation.

Required profile

• 7+ years of data engineering experience, with at least 4 years building production solutions on Databricks.
• Proven experience leading large‑scale data migrations and working with Azure data services.
• Strong communication skills and prior consulting or professional services experience.

Required skills

• Azure Databricks
• PySpark
• SQL
• Delta Lake (medallion architecture, CDC)
• Unity Catalog
• MLflow
• Azure Data Lake Storage (ADLS)
• Azure Data Factory (ADF)
• Azure Synapse Analytics
• Azure Key Vault
• Azure DevOps / CI‑CD
• Data governance and security frameworks