Pyspark / Big Data Engineer  - VP (Hybrid)

Job Description

We are looking to hire experienced Data Engineer to join our team responsible for building technology solutions for the Markets Business Controls Technology and for various business risk and controls functions. You will work with the Architects, Business stakeholders and Data Scientists to ensure we are meeting their requirements to develop and drive automation. This is an exciting opportunity to work on an important project for the group, which will have huge impact on the business and future design in this area.

Key Responsibilities:

Develop and automate large scale, high performance data processing systems(batch and real time) to drive growth and improve product experienceDevelop and maintain infrastructure tooling for our data systemsCollaborate with software teams and business analysts to understand their data requirements and deliver quality fit for purpose data solutionsEnsure data quality and accuracy by implementing data quality checks, data contracts and data governance processesContribute to the ongoing development of our data architecture and data governance capabilitiesDevelop and maintain data models and data dictionariesServe as advisor and coach to junior members of the teamIdentify problems, analyse information, and make evaluative judgements to recommend and implement solutionsWork collaboratively in teams and develop meaningful relationships to achieve common goals

Essential Skills & Experience :

Extensive experience as a Lead Engineer including evaluating and providing technical solutions to solve a variety of complex and interdependent processes.Significant professional experience in Data engineering, ETL processing and Data WarehousingCommercial exposure on development using PySpark/Spark, particularly on data processing and the associated modulesCloud - Exposure to Kubernetes/Red Hat OpenShiftExperience working with Open table/storage formats like delta lake, Apache Iceberg or Apache HudiHave worked on Delta Lake and exposure on consuming real time messages via KafkaExperience on Unix, HDFS and supported libraries such as PyArrow. PySpark experience is preferred as the environment uses Hadoop and SparkProfessional working knowledge of Databases (SQL/NoSQL)Working knowledge of BitBucket or equivalent SCM toolKnowledge of Apache Airflow is desirableAbility to multi-task and deliver to a tight deadlineExperience as an SME to senior stakeholders and/or other team membersSkilled in evaluating and performing POC’s on new strategic technical products and applications and it’s applicability to the strategic platform

This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.

What we’ll provide you

By joining Citi London, you will not only be part of a business casual workplace with a hybrid working model (up to 2 days working at home per week), but also receive a competitive base salary (which is annually reviewed), and enjoy a whole host of additional benefits such as:

27 days annual leave (plus bank holidays)A discretional annual performance related bonusPrivate Medical Care & Life InsuranceEmployee Assistance ProgramPension PlanPaid Parental LeaveSpecial discounts for employees, family, and friendsAccess to an array of learning and development resources

Visit our Global Benefits page to learn more.

Alongside these benefits Citi is committed to ensuring our workplace is where everyone feels comfortable coming to work as their whole self, every day. We want the best talent around the world to be energized to join us, motivated to stay and empowered to thrive.

#LI-AP2

------------------------------------------------------

Job Family Group:

Technology

------------------------------------------------------

Job Family:

Applications Development

------------------------------------------------------

Time Type:

Full time

------------------------------------------------------

Citi is an equal opportunity and affirmative action employer.

Qualified applicants will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Citigroup Inc. and its subsidiaries ("Citi”) invite all qualified interested applicants to apply for career opportunities. If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View the "EEO is the Law" poster. View the EEO is the Law Supplement.

View the EEO Policy Statement.

View the Pay Transparency Posting