Data Engineer
Omni RMS
Data Engineer
Contract: IT
Location: London, E14 9SH – hybrid/remote
Hours of work: 40
Contract Type: Permanent
Our client, a leading provider of facilities services in the UK, is seeking an experienced Data Engineer to support the mobilisation of new contracts by integrating data and processes into a central data ecosystem.
Job Overview
This role operates within a central data team and is responsible for moving contract data into core systems to ensure it is available, reliable and ready for reporting and insight. The position plays a key part in enabling effective contract performance reporting and service delivery through high‑quality, well‑governed data.
As a new data strategy is delivered, the focus is shifting away from traditional data warehouse approaches towards modern, cloud‑based technologies, including Databricks and Microsoft Fabric. The role combines support for an existing UK data warehouse with the development of new ingestion pipelines and data transformations that underpin analytics and operational insight.
Key Responsibilities
- Develop and maintain data ingestion pipelines using Databricks and Microsoft Fabric
- Build and manage data flows across Bronze, Silver and Gold layers in line with Medallion Architecture principles
- Support and maintain the existing UK Data Warehouse, including SQL Server and SSIS components
- Design and develop SQL Server database objects, including views, stored procedures and scripts
- Integrate data from multiple UK and global systems, including data transfers via SFTP
- Support new contract mobilisation through data analysis, preparation and integration
- Collaborate with business and technical stakeholders to translate requirements into technical solutions
- Ensure the accuracy, quality and reliability of datasets used for reporting and analytics
Person Specification
- Experience of ETL / ELT processes and working with a variety of data sources
- Hands‑on experience with Databricks and Microsoft Fabric
- Strong SQL Server and T‑SQL skills, including stored procedures and database views
- Experience developing and supporting SSIS packages
- Python scripting experience, particularly within Databricks
- Strong understanding of complex datasets and relational data models
- Experience working within an Agile framework
- Ability to explain complex data concepts clearly to non‑technical stakeholders
Application opens at the source listing. Free for jobseekers.