LONDON
7 days ago
Data Engineer with Python, ETL, SQL (Lead II - Software Engineering)

UST is recruiting for a Data Engineer to join our team in London, who will work with the client’s team to help deliver data sources and data capabilities (that is: tools, data sources and data products that enable business teams to find and get the best from our data) across a wide range of technologies and stakeholders

 

Location:                             London

Type:                                   Fixed Term/ Full time employment/ Contract inside IR35

Duration                              6 months with possible extensions

Join:                                     ASAP- 30 days’ notice period

 Hybrid Working model:   3 days’ work from client office

Who we’re looking for

 An experienced data engineer with strong SQL & python skills.

We’re in the process of transferring many of our data sources and pipelines to Snowflake cloud Databases, so experience with Snowflake Data Engineering or Cloud databases in general will really help you to hit the ground running.

We also use Airflow and DBT heavily, so real world experience of these or adjacent technologies, would be advantageous.

You must have hands on ETL / ELT coding experience and be able to quickly pick up and run with new technologies to meet the varying needs of the team while maintaining high quality, well documented code.

Experience of constructing tests and deploying via automated release pipelines is required.

You will have a solid understanding of how to apply data modelling theory and ideally be from a computer science or applied science/engineering background, although relevant industry experience is equally valuable and will be taken into consideration.

 

The knowledge, experience and qualifications you need

• Experience in python, specifically within Data Engineering, in a commercial setting

• Excellent understanding of ETL/ELT patterns, idempotency and other data engineering best practices.

• Experience with data modelling (3rd normal form, star schemas, wide/tall projections)

• Excellent SQL knowledge, including an understanding of how to write optimised SQL code, good general knowledge of different SQL engines, and what considerations they bring when optimising.

 • Practical understanding of how to profile SQL and manage performance trade-offs.

 • Working knowledge of agile methodology, and capable of following the framework, contributing to team success through participation in ceremonies and occasionally assisting with scrum-master duties, owning of retro actions and maintaining scrum artefacts.

• Knowledgeable in how to build data pipelines that robustly handle different possible modes of failure and maintain Metadata.

 • Good knowledge of source control (GitHub especially) and working on a shared codebase.

 • Experience working with business stakeholders in understanding requirements and translating these to technical requirements, implementing them, and then closing the loop with the stakeholders.

• Working knowledge of enterprise access control RBAC style security as applied to data sets.

If interested, please apply with your updated CV for an immediate discussion with hiring team

#UST

Confirm your E-mail: Send Email