Collects, reads, and migrates large volumes of raw data from multiple data sources and across disparate platforms, using PL-SQL and NoSQL, and ETL tools. Modernizes core enterprise recordkeeping capabilities using Amazon Web Services (AWS) and Azure. Builds software applications using tools — Python, Java, and Scala. Drives platform evolution and provides technical leadership in data engineering and Test Driven Development (TDD) for software applications. Drafts business value-oriented user stories. Works with large volume data implementations, Data Analysis, and application platform development for a global customer base in an Agile environment.
Primary Responsibilities:
•Analyzes information to determine, recommend, and plan computer software specifications on major projects and proposes modifications and improvements based on user need.
• Develops software system testing and validation procedures, programming, and documentation.
• Develops original and creative technical solutions to support on-going development efforts.
• Designs applications or subsystems on major projects and for/in multiple platforms.
• Develops applications for multiple projects supporting several divisional initiatives.
• Supports and performs all phases of testing leading to implementation.
• Assists in the planning and conducting of user acceptance testing.
• Develops comprehensive documentation for multiple applications supporting several corporate initiatives.
• Performs post-installation testing to identify and resolve technical problems.
• Establishes project plans for projects of moderate scope.
• Develops technical modules in support of complex assignments and multi-phase projects.
• Performs independent and complex technical and functional analysis for multiple simultaneous projects.
Education and Experience:
Bachelor’s degree (or foreign education equivalent) in Computer Science, Engineering, Information Technology, Information Systems, Mathematics, Physics, or a closely related field and five (5) years of experience as a Principal Data Engineer (or closely related occupation) migrating on-premises applications to the Cloud.
Or, alternatively, Master’s degree (or foreign education equivalent) in Computer Science, Engineering, Information Technology, Information Systems, Mathematics, Physics, or a closely related field and three (3) years of experience as a Principal Data Engineer (or closely related occupation) migrating on-premise applications to the Cloud.
Skills and Knowledge:
Candidate must also possess:
• Demonstrated Expertise (“DE”) building resilient and scalable Cloud solutions using Microsoft Azure Services.
• DE building data movement patterns using ETL tools; and migrating data between heterogeneous datastores using Azure Data Factory (ADF), PL/SQL, and Informatica Intelligent Services.
• DE optimizing Oracle database and data transformation capabilities; and performing performance tuning using EXPLAIN PLAN and AWR reports.
• DE in the Software Development Lifecycle (SDLC) — analyzing, designing, implementing, and performing version control (using Git/Bitbucket) and post-installation validation; and building applications in Artifactory using pipeline automation tools (Jenkins Core and Script).