Tasks:
- * Design lakehouse solutions using Medallion Architecture and Delta Lake
- * Develop complex data models for analytics
- * Guide ML model integration and deployment
- * Implement Unity Catalog governance and access controls
- * Integrate Databricks workflows with CI/CD pipelines
- * Lead and mentor data engineering teams
- * Lead end-to-end data modernization projects
- * Migrate legacy data warehouse models to Databricks
- * Optimize Spark jobs and cluster costs
- * Review code and define engineering best practices
Perks/Benefits:
Skills/Tech stack required:
[Apache Spark] [Artificial Intelligence] [Asset bundles] [Azure DevOps] [CI/CD] [Databricks] [Databricks (asset)] [Databricks Asset Bundles] [Data Governance] [Data Modeling] [Data modernization] [Data Structures] [Data Structures and Algorithms] [Data Warehouse] [Data Warehouse Migration] [Delta Lake] [Feature Engineering] [GitHub] [Java] [Machine Learning] [Medallion Architecture] [MLflow] [NoSQL Databases] [Predictive Analytics] [PySpark] [Python] [SQL] [SQL Databases] [Terraform] [Unity Catalog]
Educational requirements:
[Bachelor's Degree] [Master's Degree]
Role(s):
[Architect] [Data Architect] [Databricks Architect] [Data Engineering] [Data Engineering Lead] [Engineering Lead] [Lead]