Data Engineer in London, Greater London

Data Engineer – Spark / PySpark

Technify Talent is recruiting an experienced Data Engineer to build data platforms that support research engineers and other technical specialists within a fast-paced startup.

We’re looking for someone fluent in Spark and PySpark who understands how to build reliable, usable data platforms for people tackling complex research and analytical problems. You’ll bring strong engineering foundations alongside regular use of AI coding agents.

What you’ll be doing

• Building and developing data platforms and pipelines using Spark and PySpark.
• Working closely with research engineers and specialist users to understand their data needs.
• Making data accessible and dependable for research and analytical work.
• Using AI coding agents to support development, while taking ownership of code quality and technical decisions.
• Adapting the platform as requirements and priorities evolve.

What we’re looking for

• Strong commercial data engineering experience and fluency in Spark/PySpark.
• Experience building data platforms for research engineers, quants or similarly specialist users.
• Solid engineering foundations developed before AI coding tools became commonplace.
• Frequent, practical use of coding agents, with no preference for a particular tool or provider.
• The ability to work independently and translate complex requirements into practical solutions.

Useful extras

• Familiarity with the AWS data stack.
• Experience working in a fast-moving startup with changing priorities.

For further details please contact Katie Collins