Contract Role – Senior Azure Data Engineer (Databricks) – Dublin – 12 months
Hands-on Senior Azure Data Engineer (Databricks) with 6–9 years’ experience building scalable data pipelines and streaming solutions using Databricks, PySpark and Azure Data Lake. Strong in SQL, Python and ETL/ELT, with a focus on simplicity, quality and delivery.
Role Overview:
- Job Title: Senior Azure Data Engineer (Databricks)
- Location: Dublin
- Contract Type: 12 months
- Sector: Healthcare.
JOB SUMMARY:
- We are seeking a Senior Data Engineer to join our data engineering team. This is a hands-on delivery role focused on building, optimizing, and maintaining scalable data pipelines using the Azure data platform.
- The ideal candidate is pragmatic, delivery-oriented, and collaborative, someone who can design fit-for-purpose solutions, work closely with leads and peers, and contribute positively to team culture.
Required Experience & Skills
- 6–9 years of experience in data engineering roles.
Strong hands-on experience with:
- Azure Databricks
- PySpark
- Azure Data Lake
- ADF / orchestration tools
- Solid programming experience in SQL and python.
- Good understanding of ETL/ELT best practices, data modeling, and distributed data processing.
- Experience working in production-grade data platforms.
- Strong communication skills and a collaborative, professional working style.
- Ability to take feedback positively and adapt solutions to team standards.
KEY RESPONSIBILITIES:
- Design, build, and maintain scalable data pipelines using Azure Databricks (PySpark) and Azure Data Lake.
- Hands on implementation experience in event-based or streaming ingestion pipelines (Event Hub, Kafka, etc.).
- Develop reliable ETL/ELT workflows, ensuring data quality, performance, and operational stability.
- Optimize Spark workloads with a focus on simplicity, efficiency, and maintainability.
- Work closely with the Data Engineering Lead to implement agreed designs, review solutions, and continuously improve engineering practices.
- Participate in peer code reviews, applying best practices and constructive feedback.
- Troubleshoot production issues proactively and support operational excellence.
- Collaborate effectively with cross-functional teams across Ireland and the US, communicating clearly and professionally.
Please feel free to contact myself – Daisy Nguyen ([email protected])
at Gibbs Consulting/Atrium UK for a confidential chat to know more details about the role.
Please also note: Due to the volume of applications received for positions, it will not be possible to respond to all applications and only applicants who are considered suitable for interview will be contacted.