Data Engineer

About the Role As a Data Engineer on the Data Services & Operations team, you will be the primary point of contact for data requests — connecting business users with the right data assets while upholding governance, security, and service standards. The role is equal parts engineering, stakeholder partnership, and operational excellence. Key Responsibilities Data Pipeline & Architecture Design • Design and implement scalable ETL/ELT pipelines using AWS services including Glue, Step Functions, Lambda and S3. • Architect and build data lakehouse solutions leveraging Apache Iceberg or S3 tables — incorporating schema evolution, partition evolution and ACID transactions. • Optimise pipelines for performance, cost and reliability at scale. Data Quality & Governance • Define, implement and maintain automated data quality validation frameworks, with metrics and monitoring to ensure data accuracy, completeness and consistency. • Enforce data governance standards and ensure compliance across the data platform. Application Development & Deployment • Write production-quality code and deploy solutions on AWS cloud infrastructure. • Apply DevOps practices — CI/CD pipelines and infrastructure-as-code tools such as Terraform or CloudFormation — for repeatable, auditable deployments. Collaboration & Handover Work closely with cross-functional teams and communicate technical designs clearly to non-technical stakeholders. Produce thorough technical documentation to support the handover of solutions to the Day 2 operations team. Qualifications Degree in Computer Science, Data Engineering, Information Systems or a related field. 3–5 years of experience in data engineering, ETL/ELT development or data platform roles. Strong hands-on experience with AWS services, and proficiency in Apache Iceberg or similar open table formats. Experience in a Government Commercial Cloud (GCC) environment is strongly preferred. AWS certifications such as AWS Certified Data Analytics or AWS Certified Solutions Architect are an advantage. Nice to Have: Hands-on experience with Microsoft Purview and Unity Catalog. Professional certifications in cloud, data engineering, data governance, or analytics.