About the RoleAs a Senior Data Engineer, you will work closely with engineering, analytics, data science staff across various Gap Development Center to deliver the goals and objectives of the business.What You'll DoPartner with Product Managers, and Solution Architects to define and analyze customer’s technical requirementsProvides technical input to Statement of Work for External Service ProvidersAbility to break down product management stories into detailed design specifications for medium to complex business problemsExperience with building data pipeline from several business applicationsAbility to collaborate with business stakeholders to identify and meet data requirements.Guides team members on the use of design patterns and adherence to code quality metricsUses software code management tools and processes to ensure code traceability and good governance.Conducts code reviews with other team members (either internal or external service providers)Makes continuous improvement to our coding and test practices across applicationsWorks in DevOps team which uses continuous development, integration and testing with automated releases to lower and higher environments with application monitoring plus supporting the productExperience performing root cause analysis on all data and processes to answer specific questions and identify opportunities for improvement.Participates in recommending emerging technologies and application solutionsWho You AreCandidate with 5+ years of experience in a Data Engineer roleGraduate degree in Computer Science or equivalentHigh Problem-Solving Skills with analytical thinking and logical reasoningHaving experience working on spark platform, spark sql, Python and common python libraries.Working experience on cloud-based environments such as Databricks on Azure. ADF, PySpark etc.Hands on experience writing notebooks using Python/SparkWell versed with relational databases, nonrelational databases, data streams, and file storesExperience with source control systems such as GitHub and Jenkins build and continuous integration tools.Automation using Linux shell & Python scripting.

Development experience with Enterprise integration patterns