Pune, India
18 hours ago
Data engineer

Entity:

Technology


Job Family Group:

IT&S Group


Job Description:

Data Engineer -- (Individual Contributor, Grade I)

We’re looking for curious minds who are excited by the opportunity to create and deliver an exciting suite of digital products and services to advance the global energy transition. You will need to solve complex business challenges whilst collaborating and co-innovating globally, backed by a culture that encourages creativity and curiosity, and a team that cares brings out the best in each other.

Role Synopsis:

As part of the bp “Innovation & Engineering” team, you will help to drive the digital transformation of bp through its use of data and analytics. A major digital sub-team within I&E is Asset Management, responsible for all digital and data initiatives and operations across the following areas of the bp business:

Production & ProjectsHealth, Safety, Environment & CarbonRefining & OperationsWells & SubsurfaceStrategy & Sustainability

“DataWorx” is the name of the data team that is responsible for all data within these areas and we are developing deep data capabilities to transform the access, supply, control and quality to our vast and ever growing data reserves that are measured in Petabytes. The DataWorx team covers many data sub-disciplines, including data science, data analytics, data engineering and data management as well as specialist areas such as geospatial, remote sensing, knowledge management and digital twin. The DataWorx team works with a wide variety of data from structured data to unstructured data & we also work on Real-time streaming data processing along with Batch data processing.

Key Responsibilities

Assist in the design, implementation and maintenance of reliable and scalable data infrastructure and products on Microsoft Azure cloud environmentsAssist in design, development, and delivery of large-scale data ingestion, data processing, and data transformation projects on the Azure cloudShares knowledge with the team to provide design reviews, discussions and prototypesWorks with Digital Technology teams and customers to deploy, manage, and audit best practices for cloud productsAdheres to and advocates for software & data engineering best practices (e.g. technical design and review, unit testing, monitoring, alerting, source control, code review & documentation)Adheres to privacy and compliance requirements; develops, maintains and improves CI / CD pipelinePart of a cross-disciplinary team working closely with other data engineers, software engineers, data scientists, data managers and business partners in a Scrum/Agile setup

Job Requirements:

Education:

Bachelor or higher degree in computer science, Engineering, Information Systems or other quantitative fields

Experience:

Years of experience: 2 to 4 years with minimum of 1 to 3 years relevant experience Experience designing, planning, productionizing, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments Hands on experience with:

Databricks and using Spark for data processing (batch and/or real-time)

Languages: Python, Scala, SQL

Cloud platforms: Azure (ideally) or AWS

Azure Data Factory

Azure Data Lake, Azure SQL DB, Synapse, and Cosmos DB

Data Management Gateway, Azure Storage Options, Stream Analytics and Event Hubs

Delivering agreed scope to stakeholders

Data modeling with relational or data-warehouse systems

Azure Devops (or similar tools) for source control & building CI/CD pipelines

Understanding Data Structures & Algorithms & their performance Experience designing and implementing large-scale distributed systems Experience with big data technologies and graph modelling (e.g. neo4j, Azure Digital Twin and other Azure data technologies, Hadoop, Hive, and Spark etc) a plus

Desirable Criteria:

Stakeholder managementContinuous learning and improvement mindsetBoy Scout mindset to leave the system better than you found it

Key Behaviors:

Empathetic: Cares about our people, our community, and our planetCurious: Seeks to explore and excelCreative: Imagines the extraordinaryInclusive: Brings out the best in each other


 


Travel Requirement

Up to 10% travel should be expected with this role


Relocation Assistance:

This role is eligible for relocation within country


Remote Type:

This position is a hybrid of office/remote working


Skills:

Commercial Acumen, Communication, Data Analysis, Data cleansing and transformation, Data domain knowledge, Data Integration, Data Management, Data Manipulation, Data Sourcing, Data strategy and governance, Data Structures and Algorithms (Inactive), Data visualization and interpretation, Digital Security, Extract, transform and load, Group Problem Solving


Legal Disclaimer:

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, socioeconomic status, neurodiversity/neurocognitive functioning, veteran status or disability status. Individuals with an accessibility need may request an adjustment/accommodation related to bp’s recruiting process (e.g., accessing the job application, completing required assessments, participating in telephone screenings or interviews, etc.). If you would like to request an adjustment/accommodation related to the recruitment process, please contact us.

If you are selected for a position and depending upon your role, your employment may be contingent upon adherence to local policy. This may include pre-placement drug screening, medical review of physical fitness for the role, and background checks.

Confirm your E-mail: Send Email