Pune, India
16 days ago
Staff data engineer

Job Family Group:

IT&S Group


Job Description:

ResponsibilitiesLeads, grows and develops a team of data engineers that writes, deploys and maintains software to build, integrate, manage, maintain, and quality-assure data at bp.Creates positive engagement and drives an inclusive work environment with team and stakeholders through the quality of interactions and collaboration across multiple business entities.Set and communicate team priorities that align and support the broader organization’s goalsEffectively works with cross-disciplinary collaborators and stakeholders across multiple business entities.Set clear expectations with individuals based on their level and role and aligned to the broader organization’s goals. Meet regularly with individuals to discuss performance and development and provide feedback and coachingDevelop the mid-term technical vision and roadmap within the scope of your (often multiple) team(s) Evolve the roadmap to meet anticipated future requirements and infrastructure needsArchitects and designs reliable and scalable data infrastructure.Advocates for and ensures their team adheres to software engineering best practices (e.g. technical design, technical design review, unit testing, monitoring & alerting, checking in code, code review, documentation),Responsible for service reliability and following site-reliability engineering best practices: on-call rotations for services they oversee, responsible for defining and maintaining SLAs.Qualifications

Essential

BS degree in computer science or related field   Experience (typically 2+ years) leading, growing and developing a data engineering team of around 7-30 peopleDeep and hands-on experience (typically 5+ years) designing, planning, productionizing, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments3+ years of experience in a technical leadership role, overseeing projectsDevelopment experience in one or more object-oriented programming languages (e.g. Python, Scala, Java, C#) Solid database and SQL knowledgeExperience designing and implementing large-scale distributed systems             Deep knowledge and hands-on experience in technologies across all data lifecycle stagesStrong stakeholder management and ability to lead teams through managerial and technical influenceContinuous learning and improvement mindset

Desired

No prior experience in the energy industry requiredSenior Platform Engineer - (Individual Contributor, Grade H)

Responsibilities

As a Senior Platform Engineer, you will be responsible for designing, building, and maintaining the software infrastructure and services that powers our technology platforms. In this role, you will provide technical leadership of junior engineers to ensure that the platform is highly available, scalable, and secure. You will also be responsible for developing features, improving the platform's performance, and providing technical support to other teams.

Design and document sophisticated software components, services, and platformsImplement robust and maintainable code with clear and maintained documentationDeliver customer value in iterative fashion while working towards longer term systems to solve roadmap goals with increasing efficiencyServe as a technical lead and own projects end-to-endCommunicate status and changes to the work they are responsible and accountable for, keep all stakeholders informed of changes and updates to original planDesign test automation on all code implemented through unit testing and integration testingWork with internal and external teams to bring new platforms to marketMaintain and enhance software frameworks for developmentServe as a technical mentor for other engineers on the teamParticipate in code reviews and contribute to the development of best practicesCollaborate with cross-functional teams to identify and resolve platform-related issuesSupport internal and external audit teams to prepare for and participate in security, software licensing, and regulatory audits, ensuring that all necessary documentation and evidence is available and accurateCollaborate with cross-functional teams to implement new controls and procedures to ddress identified compliance gaps or risksDefine behaviour driven development cycle for Glue PySpark SDLF data pipelinescreate training material and run sessions to support data engineers to adopt of new tooling and ways of workingdefine target Python package to consolidate existing Glue PySpark SDLF data pipeline helper functionsSupport Bazel adoption for Data / Software Engineers across C&PImprove development velocity, pull request merge rate, and product quality through introduction of continuous integration pipelines for Glue PySpark jobs:design continuous integration solution for PySpark data pipelinesimplement continuous integration pipelines within subtenant repositoriesImprove development velocity though introduction of continuous deployment pipelines:collaborate with AWS Data Hub platform team to define Glue PySpark SDLF data pipeline deployment APIscollaborate with bp DevInfra and AWS Data Hub platform team to develop continuous deployment solutionsupport subtenant adoption of continuous deployment pipelines

Technical Skills we need from you

Bachelor’s degree in Computer Science, Engineering, Computer Information Systems or equivalent work experienceCompetent in the ability to adapt to new technologies and processes, and be able to work independently and as part of a teamCompetent in problem-solving, with the ability to analyze complex problems, identify root causes and develop creative and effective solutionsExcellent communication skills and ability to communicate with your peers through to senior leaders. You should be able to engage and influence others to collect requirements, describe what you’re doing, work through problems, and find productive solutionsSelf-starter, able to handle ambiguity, navigate uncertainty, identify risks, and find the right people and tools to get the job done

Software Skills

Competent in at least one programming language (C#, Python, or TypeScript) including object-oriented design. You should be competent in the use of data structures, algorithms, runtime complexity, API and database design, as well as unit and functional test methodologiesCompetent in writing secure, stable, testable, and maintainable code with minimal defectsCompetent in systems design4+ years of experience in software development, with a focus on platform or service engineeringCompetent in software engineering practices & best practices for full software development life cycle, including coding standards, code reviews, source control management, continuous deployments, testing, and operationsCompetent in designing and building complex software systems end-to-end which have been optimally delivered and operated in production. You should understand security and privacy best practices as well as how to properly monitor, log, and alarm production systems

Infrastructure Skills

Competent in building and scaling infrastructure services using Amazon Web Services or Microsoft AzureCompetent in the understanding of using core cloud application infrastructure services including identity platforms, networking, storage, databases, containers, and serverlessCompetent in troubleshooting large-scale distributed production systems4+ years of experience working on production systems. You’ll have supported these production systems through on-call rotations

Database Skills

Competent knowledge of databases, such as relational, graph, document, and key-valueCompetent ability in data modeling


Travel Requirement:

Up to 10% travel should be expected with this role


Relocation Assistance:

This role is eligible for relocation within country


Remote Type:

This position is a hybrid of office/remote working


Skills:

Commercial Acumen, Communication, Data Analysis, Data cleansing and transformation, Data domain knowledge, Data Integration, Data Management, Data Manipulation, Data Sourcing, Data strategy and governance, Data Structures and Algorithms (Inactive), Data visualization and interpretation, Digital Security, Extract, transform and load, Group Problem Solving


Legal Disclaimer:

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, socioeconomic status, neurodiversity/neurocognitive functioning, veteran status or disability status. Individuals with an accessibility need may request an adjustment/accommodation related to bp’s recruiting process (e.g., accessing the job application, completing required assessments, participating in telephone screenings or interviews, etc.). If you would like to request an adjustment/accommodation related to the recruitment process, please contact us.

If you are selected for a position and depending upon your role, your employment may be contingent upon adherence to local policy. This may include pre-placement drug screening, medical review of physical fitness for the role, and background checks.

Confirm your E-mail: Send Email