Data Engineer

£450 to £465 per day | Contract | Inside IR35

We are looking for an experienced Azure Data Engineer to join a major data transformation programme, delivering modern cloud-based data solutions using the Microsoft Azure platform.

You'll play a key role in designing and building scalable data pipelines, supporting enterprise reporting and analytics, and migrating legacy data into a modern Azure Lakehouse environment.

• Develop and maintain data pipelines using Azure Data Factory, Databricks and Azure Lakehouse.
• Design ETL/ELT solutions supporting Bronze, Silver and Gold layers using Medallion Architecture.
• Build and optimise data models for Power BI and enterprise reporting.
• Support migration of legacy data into Azure cloud services.
• Ensure data quality, integrity and governance through automated validation and monitoring.
• Optimise data processing performance and troubleshoot production data pipelines.
• Collaborate with architecture and governance teams to implement security, metadata and data lineage.
• Contribute to CI/CD, Infrastructure as Code, automated testing and DevOps best practices.

• Proven experience as an Azure Data Engineer.
• Strong Azure Data Factory (ADF) and Azure Databricks experience.
• Experience building ETL/ELT pipelines within Azure Lakehouse environments.
• Knowledge of Medallion Architecture and Delta Lake.
• Strong SQL and Python skills.
• Experience with Power BI datasets and data modelling.
• Familiarity with Azure DevOps, Git, CI/CD and Infrastructure as Code.
• Understanding of data governance, security and cloud best practices.

Skills:

• Azure
• Data Engineering
• Data Engineering
• Databricks
• Data Analysis

This is an excellent opportunity to join a large-scale cloud transformation programme working with modern Azure technologies in a collaborative, agile environment.