Role Overview

The OCI Data Engineer will be responsible for building, managing, and optimizing data pipelines, data lakes, and data warehouses using Oracle Cloud Infrastructure (OCI) and other associated tools and technologies. The ideal candidate will have strong experience with cloud-based data engineering solutions, focusing on the integration, storage, and processing of large datasets in a scalable and efficient manner.

This role requires close collaboration with data scientists, analysts, and architects to ensure that data infrastructure is designed, implemented, and maintained in accordance with business requirements and best practices.

Key Responsibilities

Data Pipeline Development Design, develop, and maintain data pipelines to move large volumes of data from various sources into OCI environments. Build scalable ETL (Extract, Transform, Load) workflows to handle both batch and real-time data processing. Automate data ingestion and transformation processes using OCI tools such as Oracle Data Integration service (ODI), Oracle Cloud Data Flow, FDI etc. Data Infrastructure Management Experience in  OCI Administration on strong understanding of Tenancy , VCN, Compartments, Network Layers, handling firewalls, subnet, polices, storage options Ensure optimal performance, security, and reliability of the data infrastructure in OCI environments. Develop and manage data lakes, data warehouses, and other data storage solutions. Cloud Integration Integrate OCI services with on-premise systems, third-party applications, and external data sources. Implement secure and high-performance data sharing and integration using Oracle Cloud Integration tools. Data Quality and Governance Implement data quality controls to ensure the integrity and accuracy of the data. Ensure compliance with data governance policies and industry standards. Work with Data Architects to define data standards, schemas, and metadata management. Collaboration and Communication Collaborate with cross-functional teams, including data analysts, data scientists, and business stakeholders, to understand data requirements. Develop and communicate data solutions effectively to both technical and non-technical teams. Assist in data visualization and reporting for business intelligence (BI) solutions. Performance Optimization Optimize data pipelines and queries for better performance and cost management. Troubleshoot issues related to performance, scalability, and reliability of data engineering solutions. Documentation and Reporting Document the architecture, design, and implementation of data solutions for internal stakeholders. Provide regular status updates, metrics, and insights regarding data pipeline health, performance, and issues. Continuous Learning and Improvement Stay up-to-date with the latest developments in Oracle Cloud Infrastructure and data engineering technologies. Continuously improve data engineering processes, ensuring innovation and optimization in data handling.

Required Skills & Qualifications

Experience: 3-5 years of hands-on experience in data engineering, specifically with Oracle Cloud Infrastructure (OCI). Strong experience in designing and managing ETL pipelines using tools such as Oracle Data Integration Service, Oracle Data Flow, or Apache Spark. Experience with Oracle Autonomous Database, FDI, Oracle Exadata, Oracle Object Storage, and related OCI services. Experience with SQL and NoSQL databases, data warehousing, and data lakes. Familiarity with data modeling, data integration, and data governance best practices. Technical Skills: Expertise in Oracle Cloud Infrastructure (OCI) services for data processing and storage. Strong programming skills in languages such as Python, SQL. Familiarity with cloud-native tools and frameworks for data engineering (e.g., Apache Kafka, Apache Airflow). Hands-on experience with monitoring, logging, and optimizing data processes in cloud environments. Soft Skills: Strong problem-solving and analytical skills. Excellent communication skills, with the ability to work with cross-functional teams. Ability to work under pressure and manage multiple projects with tight deadlines. Attention to detail and a commitment to data accuracy and quality.

Preferred Qualifications

Certifications: Oracle Cloud Infrastructure (OCI) Data Engineering or Cloud certifications. Certifications in big data tools (e.g., Apache Spark, Hadoop) 

Career Level - IC3