URGENT | AWS Data Engineer (migration) in Remote work
Posted by Opus Recruitment Solutions
Rate: Up to £500-525 per day, Outside IR35
Working Patterns: Remote-first, London (up to 1 day p/w on-site).
Contract: 3-6 months (likley extension)
Sector: Financial Services
About:
We're supporting a major cloud transformation programme focused on migrating a large-scale legacy ETL estate consiting of several thousand batch jobs from Ab Initio to a modern, serverless AWS data platform. This is a hands-on Senior Data Engineer role where you'll play a key part in defining migration patterns and delivering production-ready AWS Glue solutions.
Person Requirments:
- Strong AWS Data Engineer - ideally AWS Certified.
- Idelaly, you'll bring proven experience delivering Ab Initio → AWS Glue (PySpark) migration programmes
- Strong hands-on AWS Data Engineering expertise, particularly AWS Glue, S3, Athena and serverless data platforms.
- Advanced Python, PySpark and SQL skills.
- Strong understanding of converting Ab Initio transformations/reformat logic into scalable PySpark solutions.
- Experience building and optimising large-scale ETL/data pipeline solutions in AWS.
- Excellent Spark performance tuning capabilities, including troubleshooting data skew, partitioning, memory and load-related issues.
- Strong data warehousing and data modelling knowledge
- Strong comminication skills.
Nice to Have- Experience with Claude Code or AI-assisted code conversion tools.
- Amazon MWAA (Airflow) experience.
- AWS Certifications.
- Experience working on large-scale legacy modernisation programmes.
Application opens at the source listing. Free for jobseekers.