Live Roles
Role Details
AWS Data Engineer
£500 - £600 per day
Buy Side
Role Type:
Contract Duration:
6 months
Phone Number:
0207 280 9906
Job Reference:
Date Posted:
Data Engineer – Hadoop, HDFS, Hive, Spark, AWS, Amazon Web Services, Python, Big Data, Investment Manager, Asset Manager, Finance

A world-leading investment manager based in the City/London are looking to hire a hands-on AWS Data Engineer who will play a key role in the development of a new cloud native big data platform.

You will be working as an “AWS Data Engineer” in the newly created UK Data Analytics team to contribute to the build out of a new greenfield data lake. You will be coding in Python and working with Hadoop in an AWS environment therefore you must have good knowledge of Hadoop and AWS components.

Key Requirements:
  • Strong commerial experience across the Hadoop ecosystem: Spark, HDFS, YARN, Hive, Presto, etc. Strong Spark experience is a significant advantage.
  • Exposure to the AWS platform using services such as EMR, S3, IAM, Glue and CloudFormation.
  • Strong programming background (3+ years) in Python. Basic understanding of Java is a plus.
  • Data Warehousing design and data modelling, ETL development and testing experience in Big Data technologies. Database knowledge should extend to SQL.
  • Experience of handling data in various file types; JSON, XML, Parquet, data frames, etc
  • Experience with Jira, Confluence and Bamboo alongside GIT
  • Have experience working with Agile/Lean delivery methods
  • Good communication skills

Nice to have:

  • AWS experience extending to the wider ecosystem: Lambda, Kinesis, Step Functions, Athena , IAM policies, CloudWatch, CloudTrail, KMS, SNS, Service Catalog
  • An understanding of continuous integration and deployment (CI/CD). Experience with Bamboo is a plus
  • Experience in Business Intelligence tools such as Tableau
  • Exposure to data science practices using tools such as Zeppelin or Jupyter

Key Responsibilities: 

  • Develop, document and maintain data pipelines that transform and clean data so it’s ready for consumption by a variety of end services
  • Collaboration with global technology teams to build out data lake components
  • Administration and configuration of lower environments whilst supporting operations with the production environment.
  • Play a central role in all stages of an ETL life cycle, including:
    • Partnering with business leaders, domain experts, and end-users to gain business understanding, data understanding, and collect requirements
    • Data preparation, analysis and modeling
    • Evaluation/interpretation of results and presentation to business leaders
  • Proactively communicate the vision and status of the project, ensuring that accurate expectations are set and met across all levels of stakeholders
  • You will help define requirements, technical architecture and technical solutions.

The team is small but elite so you will need to thrive on freedom, trust and responsibility while being highly accountable. You should be a highly skilled technical developer who has strong organizational and people skills; someone who is passionate about the data business and have commerial experiences in big data projects.

This is an exciting opportunity for a skilled Data Engineer, particularly those who are looking to move into the financial markets industry, to join a fast-growing Investment Management institution.

Cornwallis Elt is an Employment Agency and has been listed 3 times in The Sunday Times Virgin Fast Track 100 of the UK`s fastest growing private companies, as well as in the Recruitment International Top 250, Top 50 in IT and the Recruiter Fast 50. You can also follow our live roles on the website at and on Twitter:
Application Form
I have read and accept the terms of the privacy policy *
* indicates mandatory fields