Azure Data Engineer

Azure Data Engineer

Location: Coventry - Hybrid - 3 days per week onsite

Start Date: ASAP

Contract Rate: £420 per day inside IR35

Duration: 6 to 12 months initially

Role Overview

Our client is seeking a highly skilled Azure Data Engineer to design, develop, and execute enterprise-scale data migration and transformation solutions within the Microsoft Azure ecosystem. The successful candidate will play a key role in building high-performance data pipelines, enabling scalable data processing, and supporting critical business data initiatives.

Key Responsibilities

• Design and build scalable ETL/ELT pipelines using Azure Data Factory and Synapse Pipelines
• Develop structured data migration payloads, including schema mapping and transformation logic
• Implement Change Data Capture (CDC) for efficient incremental data loads
• Develop and maintain PySpark notebooks for data transformation, cleansing, and partitioning
• Build reusable Python utilities for data validation and API integrations
• Create and optimise SQL queries, stored procedures, and analytical data models
• Manage and integrate data across Azure Data Lake (ADLS Gen2), Synapse Analytics, and Azure SQL
• Design solutions for handling structured and semi-structured data formats such as JSON and Delta Lake
• Ensure performance optimisation, scalability, and reliability of data pipelines
• Support data quality, governance, and security best practices

Skills & Experience

Essential

• 5+ years’ experience in cloud data engineering, ideally within Azure
• Strong hands-on expertise with Azure Data Factory and Azure Synapse Analytics
• Advanced programming skills in Python, PySpark, and SQL (T-SQL / Spark SQL)
• Experience designing and implementing data pipelines and migration solutions
• Strong understanding of data modelling, transformations, and optimisation techniques
• Experience working with Azure Data Lake Storage (ADLS Gen2)

Desirable

• Experience with Azure Databricks
• Familiarity with Cosmos DB, Oracle DB, and Delta Lake
• Knowledge of event-driven architectures (Event Hub, Kafka, IoT Hub)
• Exposure to Microsoft Fabric / OneLake
• CI/CD experience with Azure DevOps or GitHub
• Understanding of data governance, data quality, and security frameworks
• Experience working with unstructured data and large-scale datasets

If you have the relevant skills and experience, please do apply promptly to be considered