Data Engineer/Data Testing

Data Engineering

Design, build, and maintain scalable ETL/ELT pipelines to ingest, transform, and load data from multiple sources

Develop and optimize data models, warehouses, and data lakes

Collaborate with data analysts, scientists, and business stakeholders to understand data requirements

Ensure efficient data storage, retrieval, and processing performance

Monitor pipeline performance and troubleshoot production issues

Implement data governance, security, and compliance best practices

Data Testing & QA

Design and execute test plans and test cases for data pipelines, transformations, and reports

Perform data validation, reconciliation, and integrity checks across source and target systems

Develop automated data quality checks and testing frameworks

Identify, document, and track data defects, working with engineering teams on resolution

Conduct regression testing for data pipeline changes and migrations

Validate business logic and transformation rules against requirements

Create and maintain test documentation, including test strategies and QA sign-off criteria

Required Skills & Qualifications

Bachelor's degree in Computer Science, Information Technology, or related field

3+ years of experience in data engineering, data testing, or QA (adjust based on seniority)

Strong proficiency in SQL and at least one programming language (Python preferred)

Experience with ETL/ELT tools (e.g., Informatica, Talend, dbt, Apache Airflow)

Hands-on experience with cloud data platforms (AWS, Azure, or GCP)

Familiarity with data warehousing concepts (Snowflake, Redshift, BigQuery, etc.)

Experience with data testing/automation frameworks (e.g., Great Expectations, PyTest, DBT tests)

Understanding of data modeling, data governance, and data quality principles

Strong analytical and problem-solving skills with attention to detail

Preferred Qualifications

Experience with CI/CD pipelines for data workflows

Knowledge of version control tools (Git)

Exposure to Agile/Scrum methodologies

Experience with BI tools (Power BI, Tableau) for data validation purposes

Soft Skills

Strong communication skills to liaise between technical and business teams

Ability to work independently and manage multiple priorities

Detail-oriented mindset with a quality-first approach