Data Engineer

Job Description:-
The Senior Data Engineer is responsible for designing and delivering high‑quality data engineering solutions across tactical and strategic initiatives. The role spans building reliable data pipelines, centralising transformation logic, and supporting enterprise analytics platforms, including Palantir, while operating within governed and regulated environments.

Key Responsibilities

• Design and implement scalable data transformation and integration solutions using SQL‑based and programmatic patterns.
• Build and maintain batch data pipelines using Python and cloud‑native execution models.
• Implement incremental data loading, idempotent processing, and recovery patterns to support reliable data refreshes.
• Establish and manage control structures such as watermarks, run metadata, and monitoring.
• Work across cloud environments (AWS and/or Azure) to enable secure and efficient data movement.
• Contribute to the design and implementation of strategic data platform solutions, including Palantir Foundry, following delivery of tactical solutions.
• Collaborate with data architects to ensure alignment between near‑term delivery and long‑term platform direction.
• Support data quality validation, reconciliation, operational readiness, and production support.
• Produce clear technical documentation and contribute to standards, best practices, and knowledge sharing.

Skills & Experience

• Strong experience with SQL and relational databases (e.g. PostgreSQL).
• Hands‑on experience with Python for data processing and orchestration.
• Experience working with cloud platforms (AWS and/or Azure).
• Practical understanding of incremental loading, data quality, and operational resilience patterns.
• Experience with, or strong exposure to, Palantir Foundry (pipelines, data integration, transformations, or ontology concepts).
• Comfortable working in regulated or public‑sector environments.
• Proven ability to deliver under time‑bound and evolving requirements.