Senior Data Engineer

Blackbook.ai is one of Australia's most successful and progressive automation companies. Our use of Data and AI to deliver on our client's pursuit of bottom-line benefits has resulted in a company that can claim a 100% success rate in solution delivery. We have an agile approach to tackling problems. We understand that there isn't just one solution to every problem! Our unique approach to problem-solving will see you working directly with our customers, capturing additional requirements and developing intuitive solutions while drawing on the vast knowledge of existing team members. 

The Senior Data Engineer role will see you working with multiple clients, projects and stakeholders. You will find yourself working with fellow experts in the DataOps, Digital, and AI teams. You will have skills and working experience in either Databricks or MS Fabric, in building data pipelines.

Your responsibilities as a Data Engineer are as follows: 

• Work directly with clients as a Blackbook.ai consultant 

• Gather requirements, design, build and test analytics solutions 

• Design and build cloud platform architectures to support scalable analytics on Azure and Databricks

• Design and build metadata-driven data ingestion into data lakes and databases 

• Design and build data models to support highly scalable and cost-efficient data analysis 

• Work with traditional BI and Modern Data Warehouse architectures 

• Take ownership of the end-to-end process from requirements gathering to implementation 

• Leverage the skill and knowledge of your peers, technical leads and management 

• Apply best practices and be self-motivating to keep up with emerging technologies 

To be considered for the position you must have a bachelor's degree or higher, and be comfortable demonstrating your skills in the following areas: 

• Professional presentation and communication skills: written and verbal, formal documentation, diagramming and modelling 

• Critical thinking and problem solving skills 

• Azure or Databricks certification in Data Engineering or Architecture 

• Designing and building relational, star and snowflake models and schemas 

• Designing and building Modern Data Warehouse architectures 

• Fast, high-quality development in SQL Server or a similar relational database engine such as Oracle or PostgreSQL 

• Visualising data effectively using Power BI, Tableau or QlikSense 

Highly regarded although not mandatory experience includes: 

• MS Fabric or Databricks

• Snowflake, Synapse or Databricks 

• PowerShell, Azure/AWS CLI, or TerraForm for managing cloud infrastructure 

In return, we can offer you: 

• Competitive Remuneration 

• Flexible Working Conditions 

• Gym and PT 

• Free Spotify Account 

• Extra leave 

Blackbook.ai can offer a fast-paced and collaborative delivery environment with an emphasis on culture and teamwork, ensuring all projects are delivered with our high standards. We have a large team of dedicated consultants able to work alongside and guide you through your journey, and offer on-the-job training and development with access to multiple certifications.