OCI Data Flow is a fully managed Apache Spark service that performs processing tasks on extremely large datasets, without infrastructure to deploy or manage. Data engineers can use Spark Structured Streaming to process their streaming data in a continuous fashion with minimum data latency. Jupyter Notebook integration enabled data scientists to perform ad-hoc analysis on petabytes of data in Data Lake, backed by OCI Object Storage or other storage platforms.

We are looking for a senior software engineer who are excited to scale large distributed system, build next-generation SQL query engine, optimize performance with data storage system, and develop seamless enterprise grade security.

What we look for:

BS (or higher) in Computer Science or related engineering fields.0-2+ years of career experiences in Java or Scala. Knowledge in Python is a plus.Solid foundation in data structures and algorithms.Experiences with distributed systems, databases, and big data systems (Apache Spark, Delta Lake, Hadoop). Knowledge in SQL is a plus.Proficiency in developing and managing cloud applications using Kubernetes is an advantage.Experiences in developing open-source data framework is a plus.Background in batch and streaming data processing and analytics is a plus.

Career Level - IC2