A fast-growing global Insurance broker situated in the City of London is searching for a Lead Data Engineer to join their newly formed Data & Analytics team and play a pivotal role in their data transformation. At present, they’re looking to transition from a program-based structure into a balanced operation through embracing agile methodologies to augment efficiency.
The Lead Data Engineer will be tasked with creating a Lakehouse platform in Azure by owning, managing, and implementing data engineering pipelines within Azure Databricks to ingest both structured and unstructured data from the global business. Furthermore, you will be responsible for managing a small team of engineers to help grow their careers and enable them to succeed.
Skills Required
- It is imperative to have worked as a Principal or Lead Data Engineer in a previous business and can manage your own deliverables.
- Prior experience working with large datasets and a proficiency in SQL, Python and PySpark is required.
- Experience of managing a team of Engineers with varying degrees of experience.
- Experience of pipeline deployment within Azure Databricks in line with the medallion architecture framework.
- It would be highly beneficial to understand the London Insurance Market, with a particular preference given to Lloyds.
Cornwallis Elt is an Employment Agency & Employment Business and has been listed 3 times in The Sunday Times Virgin Fast Track 100 of the UK`s fastest growing private companies, as well as in the Recruitment International Top 250, Top 50 in IT and the Recruiter Fast 50 & Hot 100 reports.
