Azure Data Engineer

• Azure Data Engineer (Government Digital Services)
• 6-month contract
• Remote working (UK)
• Outside IR35
• £475 per day

The Opportunity:

We are supporting a major public sector organisation on the appointment of an experienced Azure Data Engineer to join a high-profile data and analytics programme on an initial 6-month contract basis.

This is a backend-focused Data Engineering role centred on building and maintaining scalable data services, pipelines and platform capabilities using Azure Databricks within a containerised Docker environment.

Working within a multidisciplinary data team across Agile delivery environments, you will play a key role in designing, developing and optimising modern cloud-based data solutions that support critical environmental, scientific and operational decision-making across the organisation.

This role offers the opportunity to work with large-scale data platforms, geospatial datasets and advanced analytics capabilities, helping to drive innovation and improve access to trusted, high-quality data, consulting on modern engineering practices to deliver robust, secure and high-performing data solutions.

Skills and Experience:

• Proven commercial experience working as a Data Engineer within complex data environments
• Strong experience designing and developing Azure-based data solutions
• Hands-on experience with: Azure Databricks / Azure Data Lake / Azure Data Platform technologies
• Experience developing solutions within containerised environments using Docker.
• Strong SQL and data transformation skills
• Experience building scalable ETL/ELT pipelines
• Experience working with large and complex datasets
• Understanding of data governance, data quality and metadata management principles

Experience working with the following is highly-desirable:

• Power BI / ArcGIS /QGIS / Geospatial or spatial data platforms
• Experience contributing to enterprise data architecture initiatives
• Familiarity with Sparx Enterprise Architect (EA Sparx)
• Experience supporting cloud-based analytics and reporting platforms
• Public sector, environmental, scientific or regulatory sector experience

Role and Responsibilities:

• Design, build and maintain scalable data pipelines and data engineering solutions.
• Develop and optimise Azure-based data platforms and services.
• Develop and deploy data engineering solutions within a containerised Docker environment.
• Support the ingestion, transformation and management of structured and unstructured datasets.
• Build robust ETL and ELT processes to support analytics and reporting requirements.
• Work closely with data scientists, analysts, architects and business stakeholders to understand and deliver data requirements.
• Support the development and enhancement of enterprise data models and data architecture artefacts.
• Manage and optimise data storage solutions including cloud-based data lakes.
• Ensure data quality, integrity, governance and security standards are maintained.
• Support the delivery of geospatial and location-based data solutions.
• Develop technical documentation and contribute to best practices across the data engineering function.
• Assist with platform modernisation, automation and continuous improvement initiatives.

NB: The successful candidate will be required to undergo a basic level of security clearance before undertaking the assignment (around two weeks’ lead-time).

Applications:

To learn more about this newly created opportunity consulting as an Azure-focused Data Engineer for an initial 6 month engagement, operating on a remote-working basis; please call and speak with Edward Laing here at ISR Recruitment or please send through a copy of your latest online profile and/or CV for an immediate call back in the strictest confidence.