Senior Data Engineer (Azure & Databricks)

We're hiring a Senior Data Engineer to lead the design and optimisation of data pipelines on a modern Azure and Databricks lakehouse platform. You'll own how data is ingested, modelled and delivered across the business — working shoulder to shoulder with data scientists, BI developers and business stakeholders.

What you'll do

• Design and build scalable ETL/ELT data pipelines with Azure Data Factory, Databricks and Apache Spark

• Build and manage data lakes and Delta tables on Azure Data Lake Storage Gen2 and Delta Lake

• Optimise Spark workloads for performance, scalability and cost efficiency

• Embed data quality, data governance and security practices across every pipeline;

• Partner with analytics teams to enable self-service reporting in Power BI and Power Apps

• Monitor and troubleshoot production jobs using Azure Monitor and Databricks job runs

• Mentor junior data engineers and set standards for coding, architecture and DevOps

What you'll bring

• 5+ years in data engineering or a closely related field

• Strong hands-on expertise across Azure cloud services

• Proven experience with Databricks, Spark (PySpark or Scala) and Delta Lake

• Advanced SQL and Python, plus distributed data processing

• CI/CD and Infrastructure as Code — Terraform, GitHub Actions or Azure DevOps

• Solid data modelling fundamentals

• Excellent communication in English, with technical and non-technical audiences alike

• Ownership, autonomy and comfort working in a distributed, global team

• Nice to have: Experience with Kafka or Azure Event Hubs, Azure certifications, MLOps, data governance tools (Purview, Unity Catalog), and knowledge of GDPR or data security practices.